Test Report: Docker_Linux_containerd 14420

                    
                      b28e6de4ba37ffec66170588afce60c61d1bcd44:2022-06-30:24687
                    
                

Test fail (16/266)

x
+
TestKubernetesUpgrade (572.65s)

                                                
                                                
=== RUN   TestKubernetesUpgrade
=== PAUSE TestKubernetesUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestKubernetesUpgrade
version_upgrade_test.go:229: (dbg) Run:  out/minikube-linux-amd64 start -p kubernetes-upgrade-20220630205032-9950 --memory=2200 --kubernetes-version=v1.16.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
E0630 20:50:47.269257    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/ingress-addon-legacy-20220630202923-9950/client.crt: no such file or directory
version_upgrade_test.go:229: (dbg) Done: out/minikube-linux-amd64 start -p kubernetes-upgrade-20220630205032-9950 --memory=2200 --kubernetes-version=v1.16.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (52.20861152s)
version_upgrade_test.go:234: (dbg) Run:  out/minikube-linux-amd64 stop -p kubernetes-upgrade-20220630205032-9950
version_upgrade_test.go:234: (dbg) Done: out/minikube-linux-amd64 stop -p kubernetes-upgrade-20220630205032-9950: (1.370478709s)
version_upgrade_test.go:239: (dbg) Run:  out/minikube-linux-amd64 -p kubernetes-upgrade-20220630205032-9950 status --format={{.Host}}
version_upgrade_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 -p kubernetes-upgrade-20220630205032-9950 status --format={{.Host}}: exit status 7 (136.289372ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
version_upgrade_test.go:241: status error: exit status 7 (may be ok)
version_upgrade_test.go:250: (dbg) Run:  out/minikube-linux-amd64 start -p kubernetes-upgrade-20220630205032-9950 --memory=2200 --kubernetes-version=v1.24.2 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd

                                                
                                                
=== CONT  TestKubernetesUpgrade
version_upgrade_test.go:250: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p kubernetes-upgrade-20220630205032-9950 --memory=2200 --kubernetes-version=v1.24.2 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: exit status 109 (8m34.487237284s)

                                                
                                                
-- stdout --
	* [kubernetes-upgrade-20220630205032-9950] minikube v1.26.0 on Ubuntu 20.04 (kvm/amd64)
	  - MINIKUBE_LOCATION=14420
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-amd64
	* Using the docker driver based on existing profile
	* Starting control plane node kubernetes-upgrade-20220630205032-9950 in cluster kubernetes-upgrade-20220630205032-9950
	* Pulling base image ...
	* Restarting existing docker container for "kubernetes-upgrade-20220630205032-9950" ...
	* Preparing Kubernetes v1.24.2 on containerd 1.6.6 ...
	  - kubelet.cni-conf-dir=/etc/cni/net.mk
	  - Generating certificates and keys ...
	  - Booting up control plane ...
	  - Generating certificates and keys ...
	  - Booting up control plane ...
	X Problems detected in kubelet:
	  Jun 30 21:00:00 kubernetes-upgrade-20220630205032-9950 kubelet[11593]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0630 20:51:26.586252  166730 out.go:296] Setting OutFile to fd 1 ...
	I0630 20:51:26.586359  166730 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 20:51:26.586368  166730 out.go:309] Setting ErrFile to fd 2...
	I0630 20:51:26.586373  166730 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 20:51:26.586840  166730 root.go:329] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/bin
	I0630 20:51:26.587077  166730 out.go:303] Setting JSON to false
	I0630 20:51:26.588945  166730 start.go:115] hostinfo: {"hostname":"ubuntu-20-agent-8","uptime":2039,"bootTime":1656620248,"procs":982,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1012-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0630 20:51:26.589009  166730 start.go:125] virtualization: kvm guest
	I0630 20:51:26.591984  166730 out.go:177] * [kubernetes-upgrade-20220630205032-9950] minikube v1.26.0 on Ubuntu 20.04 (kvm/amd64)
	I0630 20:51:26.593600  166730 notify.go:193] Checking for updates...
	I0630 20:51:26.593666  166730 preload.go:306] deleting older generation preload /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v8-v1.20.0-containerd-overlay2-amd64.tar.lz4
	I0630 20:51:26.593628  166730 out.go:177]   - MINIKUBE_LOCATION=14420
	I0630 20:51:26.595320  166730 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0630 20:51:26.597266  166730 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 20:51:26.598973  166730 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube
	I0630 20:51:26.600457  166730 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0630 20:51:26.602410  166730 config.go:178] Loaded profile config "kubernetes-upgrade-20220630205032-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.16.0
	I0630 20:51:26.603015  166730 driver.go:360] Setting default libvirt URI to qemu:///system
	I0630 20:51:26.656019  166730 docker.go:137] docker version: linux-20.10.17
	I0630 20:51:26.656127  166730 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0630 20:51:26.792023  166730 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:8 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:90 OomKillDisable:true NGoroutines:89 SystemTime:2022-06-30 20:51:26.692586748 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1012-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexServ
erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662451712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-8 Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Client
Info:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
	I0630 20:51:26.792170  166730 docker.go:254] overlay module found
	I0630 20:51:26.795114  166730 out.go:177] * Using the docker driver based on existing profile
	I0630 20:51:26.796421  166730 start.go:284] selected driver: docker
	I0630 20:51:26.796446  166730 start.go:808] validating driver "docker" against &{Name:kubernetes-upgrade-20220630205032-9950 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:kubernetes-upgrade-20220630205032-9
950 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.67.2 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:26214
4 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 20:51:26.796575  166730 start.go:819] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0630 20:51:26.797439  166730 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0630 20:51:26.941945  166730 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:8 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:90 OomKillDisable:true NGoroutines:89 SystemTime:2022-06-30 20:51:26.836163709 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1012-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexServ
erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662451712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-8 Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Client
Info:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
	I0630 20:51:26.942276  166730 cni.go:95] Creating CNI manager for ""
	I0630 20:51:26.942296  166730 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 20:51:26.942310  166730 start_flags.go:310] config:
	{Name:kubernetes-upgrade-20220630205032-9950 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:kubernetes-upgrade-20220630205032-9950 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[]
DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.67.2 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Disable
Optimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 20:51:26.945459  166730 out.go:177] * Starting control plane node kubernetes-upgrade-20220630205032-9950 in cluster kubernetes-upgrade-20220630205032-9950
	I0630 20:51:26.947103  166730 cache.go:120] Beginning downloading kic base image for docker with containerd
	I0630 20:51:26.948526  166730 out.go:177] * Pulling base image ...
	I0630 20:51:26.949998  166730 preload.go:132] Checking if preload exists for k8s version v1.24.2 and runtime containerd
	I0630 20:51:26.950056  166730 preload.go:148] Found local preload: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-containerd-overlay2-amd64.tar.lz4
	I0630 20:51:26.950083  166730 cache.go:57] Caching tarball of preloaded images
	I0630 20:51:26.950092  166730 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e in local docker daemon
	I0630 20:51:26.950355  166730 preload.go:174] Found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-containerd-overlay2-amd64.tar.lz4 in cache, skipping download
	I0630 20:51:26.950374  166730 cache.go:60] Finished verifying existence of preloaded tar for  v1.24.2 on containerd
	I0630 20:51:26.950521  166730 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/kubernetes-upgrade-20220630205032-9950/config.json ...
	I0630 20:51:26.987537  166730 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e in local docker daemon, skipping pull
	I0630 20:51:26.987580  166730 cache.go:142] gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e exists in daemon, skipping load
	I0630 20:51:26.987594  166730 cache.go:208] Successfully downloaded all kic artifacts
	I0630 20:51:26.987685  166730 start.go:352] acquiring machines lock for kubernetes-upgrade-20220630205032-9950: {Name:mk3ce5577a5981c634683234969065cedd5d124e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0630 20:51:26.987805  166730 start.go:356] acquired machines lock for "kubernetes-upgrade-20220630205032-9950" in 93.45µs
	I0630 20:51:26.987834  166730 start.go:94] Skipping create...Using existing machine configuration
	I0630 20:51:26.987845  166730 fix.go:55] fixHost starting: 
	I0630 20:51:26.988107  166730 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220630205032-9950 --format={{.State.Status}}
	I0630 20:51:27.021932  166730 fix.go:103] recreateIfNeeded on kubernetes-upgrade-20220630205032-9950: state=Stopped err=<nil>
	W0630 20:51:27.021973  166730 fix.go:129] unexpected machine state, will restart: <nil>
	I0630 20:51:27.024690  166730 out.go:177] * Restarting existing docker container for "kubernetes-upgrade-20220630205032-9950" ...
	I0630 20:51:27.026337  166730 cli_runner.go:164] Run: docker start kubernetes-upgrade-20220630205032-9950
	I0630 20:51:27.580949  166730 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220630205032-9950 --format={{.State.Status}}
	I0630 20:51:27.622320  166730 kic.go:416] container "kubernetes-upgrade-20220630205032-9950" state is running.
	I0630 20:51:27.622828  166730 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" kubernetes-upgrade-20220630205032-9950
	I0630 20:51:27.667608  166730 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/kubernetes-upgrade-20220630205032-9950/config.json ...
	I0630 20:51:27.667858  166730 machine.go:88] provisioning docker machine ...
	I0630 20:51:27.667881  166730 ubuntu.go:169] provisioning hostname "kubernetes-upgrade-20220630205032-9950"
	I0630 20:51:27.667929  166730 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220630205032-9950
	I0630 20:51:27.706610  166730 main.go:134] libmachine: Using SSH client type: native
	I0630 20:51:27.706822  166730 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil>  [] 0s} 127.0.0.1 49344 <nil> <nil>}
	I0630 20:51:27.706848  166730 main.go:134] libmachine: About to run SSH command:
	sudo hostname kubernetes-upgrade-20220630205032-9950 && echo "kubernetes-upgrade-20220630205032-9950" | sudo tee /etc/hostname
	I0630 20:51:27.707572  166730 main.go:134] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:55004->127.0.0.1:49344: read: connection reset by peer
	I0630 20:51:30.852653  166730 main.go:134] libmachine: SSH cmd err, output: <nil>: kubernetes-upgrade-20220630205032-9950
	
	I0630 20:51:30.852738  166730 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220630205032-9950
	I0630 20:51:30.894688  166730 main.go:134] libmachine: Using SSH client type: native
	I0630 20:51:30.894880  166730 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil>  [] 0s} 127.0.0.1 49344 <nil> <nil>}
	I0630 20:51:30.894912  166730 main.go:134] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\skubernetes-upgrade-20220630205032-9950' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 kubernetes-upgrade-20220630205032-9950/g' /etc/hosts;
				else 
					echo '127.0.1.1 kubernetes-upgrade-20220630205032-9950' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0630 20:51:31.026245  166730 main.go:134] libmachine: SSH cmd err, output: <nil>: 
	I0630 20:51:31.026281  166730 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube CaCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/c
erts/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube}
	I0630 20:51:31.026321  166730 ubuntu.go:177] setting up certificates
	I0630 20:51:31.026334  166730 provision.go:83] configureAuth start
	I0630 20:51:31.026401  166730 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" kubernetes-upgrade-20220630205032-9950
	I0630 20:51:31.068746  166730 provision.go:138] copyHostCerts
	I0630 20:51:31.068804  166730 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem, removing ...
	I0630 20:51:31.068819  166730 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem
	I0630 20:51:31.068873  166730 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem (1082 bytes)
	I0630 20:51:31.068967  166730 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem, removing ...
	I0630 20:51:31.068984  166730 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem
	I0630 20:51:31.069024  166730 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem (1123 bytes)
	I0630 20:51:31.069154  166730 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem, removing ...
	I0630 20:51:31.069170  166730 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem
	I0630 20:51:31.069207  166730 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem (1679 bytes)
	I0630 20:51:31.069255  166730 provision.go:112] generating server cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem org=jenkins.kubernetes-upgrade-20220630205032-9950 san=[192.168.67.2 127.0.0.1 localhost 127.0.0.1 minikube kubernetes-upgrade-20220630205032-9950]
	I0630 20:51:31.128341  166730 provision.go:172] copyRemoteCerts
	I0630 20:51:31.128404  166730 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0630 20:51:31.128457  166730 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220630205032-9950
	I0630 20:51:31.162442  166730 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49344 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/kubernetes-upgrade-20220630205032-9950/id_rsa Username:docker}
	I0630 20:51:31.254557  166730 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
	I0630 20:51:31.272454  166730 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem --> /etc/docker/server.pem (1285 bytes)
	I0630 20:51:31.288797  166730 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0630 20:51:31.305252  166730 provision.go:86] duration metric: configureAuth took 278.89858ms
	I0630 20:51:31.305278  166730 ubuntu.go:193] setting minikube options for container-runtime
	I0630 20:51:31.305428  166730 config.go:178] Loaded profile config "kubernetes-upgrade-20220630205032-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 20:51:31.305449  166730 machine.go:91] provisioned docker machine in 3.63756739s
	I0630 20:51:31.305455  166730 start.go:306] post-start starting for "kubernetes-upgrade-20220630205032-9950" (driver="docker")
	I0630 20:51:31.305461  166730 start.go:316] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0630 20:51:31.305497  166730 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0630 20:51:31.305531  166730 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220630205032-9950
	I0630 20:51:31.340269  166730 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49344 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/kubernetes-upgrade-20220630205032-9950/id_rsa Username:docker}
	I0630 20:51:31.424271  166730 ssh_runner.go:195] Run: cat /etc/os-release
	I0630 20:51:31.426813  166730 main.go:134] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0630 20:51:31.426834  166730 main.go:134] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0630 20:51:31.426846  166730 main.go:134] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0630 20:51:31.426854  166730 info.go:137] Remote host: Ubuntu 20.04.4 LTS
	I0630 20:51:31.426863  166730 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/addons for local assets ...
	I0630 20:51:31.426912  166730 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files for local assets ...
	I0630 20:51:31.426990  166730 filesync.go:149] local asset: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem -> 99502.pem in /etc/ssl/certs
	I0630 20:51:31.427081  166730 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0630 20:51:31.433879  166730 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem --> /etc/ssl/certs/99502.pem (1708 bytes)
	I0630 20:51:31.450663  166730 start.go:309] post-start completed in 145.193312ms
	I0630 20:51:31.450735  166730 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0630 20:51:31.450774  166730 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220630205032-9950
	I0630 20:51:31.484811  166730 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49344 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/kubernetes-upgrade-20220630205032-9950/id_rsa Username:docker}
	I0630 20:51:31.569337  166730 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0630 20:51:31.573174  166730 fix.go:57] fixHost completed within 4.585324282s
	I0630 20:51:31.573203  166730 start.go:81] releasing machines lock for "kubernetes-upgrade-20220630205032-9950", held for 4.585380278s
	I0630 20:51:31.573303  166730 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" kubernetes-upgrade-20220630205032-9950
	I0630 20:51:31.605506  166730 ssh_runner.go:195] Run: systemctl --version
	I0630 20:51:31.605568  166730 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220630205032-9950
	I0630 20:51:31.605572  166730 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/
	I0630 20:51:31.605626  166730 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220630205032-9950
	I0630 20:51:31.641192  166730 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49344 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/kubernetes-upgrade-20220630205032-9950/id_rsa Username:docker}
	I0630 20:51:31.641502  166730 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49344 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/kubernetes-upgrade-20220630205032-9950/id_rsa Username:docker}
	I0630 20:51:31.754899  166730 ssh_runner.go:195] Run: sudo systemctl stop -f crio
	I0630 20:51:31.769747  166730 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0630 20:51:31.781864  166730 docker.go:179] disabling docker service ...
	I0630 20:51:31.781909  166730 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0630 20:51:31.793418  166730 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0630 20:51:31.805271  166730 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0630 20:51:31.894517  166730 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0630 20:51:31.982759  166730 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0630 20:51:31.994518  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
	image-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0630 20:51:32.010132  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*sandbox_image = .*$|sandbox_image = "k8s.gcr.io/pause:3.7"|' -i /etc/containerd/config.toml"
	I0630 20:51:32.017921  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*restrict_oom_score_adj = .*$|restrict_oom_score_adj = false|' -i /etc/containerd/config.toml"
	I0630 20:51:32.025982  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*SystemdCgroup = .*$|SystemdCgroup = false|' -i /etc/containerd/config.toml"
	I0630 20:51:32.036272  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*conf_dir = .*$|conf_dir = "/etc/cni/net.mk"|' -i /etc/containerd/config.toml"
	I0630 20:51:32.045346  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^# imports|imports = ["/etc/containerd/containerd.conf.d/02-containerd.conf"]|' -i /etc/containerd/config.toml"
	I0630 20:51:32.055128  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc/containerd/containerd.conf.d && printf %s "dmVyc2lvbiA9IDIK" | base64 -d | sudo tee /etc/containerd/containerd.conf.d/02-containerd.conf"
	I0630 20:51:32.070535  166730 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0630 20:51:32.078660  166730 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0630 20:51:32.086631  166730 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0630 20:51:32.177917  166730 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0630 20:51:32.251946  166730 start.go:447] Will wait 60s for socket path /run/containerd/containerd.sock
	I0630 20:51:32.252020  166730 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
	I0630 20:51:32.256063  166730 start.go:468] Will wait 60s for crictl version
	I0630 20:51:32.256137  166730 ssh_runner.go:195] Run: sudo crictl version
	I0630 20:51:32.293501  166730 retry.go:31] will retry after 11.04660288s: Temporary Error: sudo crictl version: Process exited with status 1
	stdout:
	
	stderr:
	time="2022-06-30T20:51:32Z" level=fatal msg="getting the runtime version: rpc error: code = Unknown desc = server is not initialized yet"
	I0630 20:51:43.341147  166730 ssh_runner.go:195] Run: sudo crictl version
	I0630 20:51:43.363404  166730 start.go:477] Version:  0.1.0
	RuntimeName:  containerd
	RuntimeVersion:  1.6.6
	RuntimeApiVersion:  v1alpha2
	I0630 20:51:43.363474  166730 ssh_runner.go:195] Run: containerd --version
	I0630 20:51:43.391400  166730 ssh_runner.go:195] Run: containerd --version
	I0630 20:51:43.554073  166730 out.go:177] * Preparing Kubernetes v1.24.2 on containerd 1.6.6 ...
	I0630 20:51:43.602563  166730 cli_runner.go:164] Run: docker network inspect kubernetes-upgrade-20220630205032-9950 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0630 20:51:43.637519  166730 ssh_runner.go:195] Run: grep 192.168.67.1	host.minikube.internal$ /etc/hosts
	I0630 20:51:43.640999  166730 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.67.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0630 20:51:43.653224  166730 out.go:177]   - kubelet.cni-conf-dir=/etc/cni/net.mk
	I0630 20:51:43.654680  166730 preload.go:132] Checking if preload exists for k8s version v1.24.2 and runtime containerd
	I0630 20:51:43.655032  166730 ssh_runner.go:195] Run: sudo crictl images --output json
	I0630 20:51:43.681485  166730 containerd.go:543] couldn't find preloaded image for "k8s.gcr.io/kube-apiserver:v1.24.2". assuming images are not preloaded.
	I0630 20:51:43.681542  166730 ssh_runner.go:195] Run: which lz4
	I0630 20:51:43.684514  166730 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
	I0630 20:51:43.687461  166730 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot stat '/preloaded.tar.lz4': No such file or directory
	I0630 20:51:43.687492  166730 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-containerd-overlay2-amd64.tar.lz4 --> /preloaded.tar.lz4 (447741112 bytes)
	I0630 20:51:44.463680  166730 containerd.go:490] Took 0.779203 seconds to copy over tarball
	I0630 20:51:44.463749  166730 ssh_runner.go:195] Run: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4
	I0630 20:51:46.766499  166730 ssh_runner.go:235] Completed: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4: (2.302722694s)
	I0630 20:51:46.861012  166730 containerd.go:497] Took 2.397296 seconds t extract the tarball
	I0630 20:51:46.861028  166730 ssh_runner.go:146] rm: /preloaded.tar.lz4
	I0630 20:51:46.942844  166730 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0630 20:51:47.021797  166730 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0630 20:51:47.105437  166730 ssh_runner.go:195] Run: sudo crictl images --output json
	I0630 20:51:47.132274  166730 cache_images.go:88] LoadImages start: [k8s.gcr.io/kube-apiserver:v1.24.2 k8s.gcr.io/kube-controller-manager:v1.24.2 k8s.gcr.io/kube-scheduler:v1.24.2 k8s.gcr.io/kube-proxy:v1.24.2 k8s.gcr.io/pause:3.7 k8s.gcr.io/etcd:3.5.3-0 k8s.gcr.io/coredns/coredns:v1.8.6 gcr.io/k8s-minikube/storage-provisioner:v5]
	I0630 20:51:47.132363  166730 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
	I0630 20:51:47.132382  166730 image.go:134] retrieving image: k8s.gcr.io/kube-proxy:v1.24.2
	I0630 20:51:47.132403  166730 image.go:134] retrieving image: k8s.gcr.io/kube-controller-manager:v1.24.2
	I0630 20:51:47.132410  166730 image.go:134] retrieving image: k8s.gcr.io/kube-scheduler:v1.24.2
	I0630 20:51:47.132456  166730 image.go:134] retrieving image: k8s.gcr.io/kube-apiserver:v1.24.2
	I0630 20:51:47.132466  166730 image.go:134] retrieving image: k8s.gcr.io/etcd:3.5.3-0
	I0630 20:51:47.132471  166730 image.go:134] retrieving image: k8s.gcr.io/pause:3.7
	I0630 20:51:47.132527  166730 image.go:134] retrieving image: k8s.gcr.io/coredns/coredns:v1.8.6
	I0630 20:51:47.133673  166730 image.go:177] daemon lookup for k8s.gcr.io/etcd:3.5.3-0: Error: No such image: k8s.gcr.io/etcd:3.5.3-0
	I0630 20:51:47.133701  166730 image.go:177] daemon lookup for k8s.gcr.io/kube-controller-manager:v1.24.2: Error: No such image: k8s.gcr.io/kube-controller-manager:v1.24.2
	I0630 20:51:47.133732  166730 image.go:177] daemon lookup for k8s.gcr.io/kube-apiserver:v1.24.2: Error: No such image: k8s.gcr.io/kube-apiserver:v1.24.2
	I0630 20:51:47.133678  166730 image.go:177] daemon lookup for k8s.gcr.io/kube-scheduler:v1.24.2: Error: No such image: k8s.gcr.io/kube-scheduler:v1.24.2
	I0630 20:51:47.133784  166730 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
	I0630 20:51:47.133675  166730 image.go:177] daemon lookup for k8s.gcr.io/coredns/coredns:v1.8.6: Error: No such image: k8s.gcr.io/coredns/coredns:v1.8.6
	I0630 20:51:47.133680  166730 image.go:177] daemon lookup for k8s.gcr.io/pause:3.7: Error: No such image: k8s.gcr.io/pause:3.7
	I0630 20:51:47.133843  166730 image.go:177] daemon lookup for k8s.gcr.io/kube-proxy:v1.24.2: Error: No such image: k8s.gcr.io/kube-proxy:v1.24.2
	I0630 20:51:47.587260  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/coredns/coredns:v1.8.6"
	I0630 20:51:47.593540  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/kube-proxy:v1.24.2"
	I0630 20:51:47.593544  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/pause:3.7"
	I0630 20:51:47.600688  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/kube-controller-manager:v1.24.2"
	I0630 20:51:47.604698  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/etcd:3.5.3-0"
	I0630 20:51:47.610061  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/kube-scheduler:v1.24.2"
	I0630 20:51:47.669038  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/kube-apiserver:v1.24.2"
	I0630 20:51:47.952030  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep gcr.io/k8s-minikube/storage-provisioner:v5"
	I0630 20:51:48.342274  166730 cache_images.go:116] "k8s.gcr.io/coredns/coredns:v1.8.6" needs transfer: "k8s.gcr.io/coredns/coredns:v1.8.6" does not exist at hash "a4ca41631cc7ac19ce1be3ebf0314ac5f47af7c711f17066006db82ee3b75b03" in container runtime
	I0630 20:51:48.342327  166730 cri.go:216] Removing image: k8s.gcr.io/coredns/coredns:v1.8.6
	I0630 20:51:48.342367  166730 ssh_runner.go:195] Run: which crictl
	I0630 20:51:48.357096  166730 cache_images.go:116] "k8s.gcr.io/kube-proxy:v1.24.2" needs transfer: "k8s.gcr.io/kube-proxy:v1.24.2" does not exist at hash "a634548d10b032c2a1d704ef9a2ab04c12b0574afe67ee192b196a7f12da9536" in container runtime
	I0630 20:51:48.357140  166730 cri.go:216] Removing image: k8s.gcr.io/kube-proxy:v1.24.2
	I0630 20:51:48.357176  166730 ssh_runner.go:195] Run: which crictl
	I0630 20:51:48.439467  166730 cache_images.go:116] "k8s.gcr.io/pause:3.7" needs transfer: "k8s.gcr.io/pause:3.7" does not exist at hash "221177c6082a88ea4f6240ab2450d540955ac6f4d5454f0e15751b653ebda165" in container runtime
	I0630 20:51:48.439514  166730 cri.go:216] Removing image: k8s.gcr.io/pause:3.7
	I0630 20:51:48.439557  166730 ssh_runner.go:195] Run: which crictl
	I0630 20:51:48.448014  166730 cache_images.go:116] "k8s.gcr.io/kube-controller-manager:v1.24.2" needs transfer: "k8s.gcr.io/kube-controller-manager:v1.24.2" does not exist at hash "34cdf99b1bb3b3a62c5b4226c3bc0983ab1f13e776269d1872092091b07203df" in container runtime
	I0630 20:51:48.448062  166730 cri.go:216] Removing image: k8s.gcr.io/kube-controller-manager:v1.24.2
	I0630 20:51:48.448103  166730 ssh_runner.go:195] Run: which crictl
	I0630 20:51:48.448119  166730 cache_images.go:116] "k8s.gcr.io/etcd:3.5.3-0" needs transfer: "k8s.gcr.io/etcd:3.5.3-0" does not exist at hash "aebe758cef4cd05b9f8cee39758227714d02f42ef3088023c1e3cd454f927a2b" in container runtime
	I0630 20:51:48.448158  166730 cri.go:216] Removing image: k8s.gcr.io/etcd:3.5.3-0
	I0630 20:51:48.448197  166730 ssh_runner.go:195] Run: which crictl
	I0630 20:51:48.450162  166730 cache_images.go:116] "k8s.gcr.io/kube-scheduler:v1.24.2" needs transfer: "k8s.gcr.io/kube-scheduler:v1.24.2" does not exist at hash "5d725196c1f47e72d2bc7069776d5928b1fb1e4adf09c18997733099aa3663ac" in container runtime
	I0630 20:51:48.450226  166730 cri.go:216] Removing image: k8s.gcr.io/kube-scheduler:v1.24.2
	I0630 20:51:48.450263  166730 ssh_runner.go:195] Run: which crictl
	I0630 20:51:48.541939  166730 cache_images.go:116] "k8s.gcr.io/kube-apiserver:v1.24.2" needs transfer: "k8s.gcr.io/kube-apiserver:v1.24.2" does not exist at hash "d3377ffb7177cc4becce8a534d8547aca9530cb30fac9ebe479b31102f1ba503" in container runtime
	I0630 20:51:48.541989  166730 cri.go:216] Removing image: k8s.gcr.io/kube-apiserver:v1.24.2
	I0630 20:51:48.542042  166730 ssh_runner.go:195] Run: which crictl
	I0630 20:51:48.630143  166730 cache_images.go:116] "gcr.io/k8s-minikube/storage-provisioner:v5" needs transfer: "gcr.io/k8s-minikube/storage-provisioner:v5" does not exist at hash "6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562" in container runtime
	I0630 20:51:48.630182  166730 cri.go:216] Removing image: gcr.io/k8s-minikube/storage-provisioner:v5
	I0630 20:51:48.630228  166730 ssh_runner.go:195] Run: which crictl
	I0630 20:51:48.630245  166730 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi k8s.gcr.io/coredns/coredns:v1.8.6
	I0630 20:51:48.630304  166730 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi k8s.gcr.io/kube-proxy:v1.24.2
	I0630 20:51:48.630341  166730 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi k8s.gcr.io/pause:3.7
	I0630 20:51:48.630427  166730 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi k8s.gcr.io/kube-controller-manager:v1.24.2
	I0630 20:51:48.630438  166730 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi k8s.gcr.io/etcd:3.5.3-0
	I0630 20:51:48.630500  166730 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi k8s.gcr.io/kube-scheduler:v1.24.2
	I0630 20:51:48.630518  166730 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi k8s.gcr.io/kube-apiserver:v1.24.2
	I0630 20:51:51.462351  166730 ssh_runner.go:235] Completed: which crictl: (2.832098591s)
	I0630 20:51:51.462395  166730 ssh_runner.go:235] Completed: sudo /usr/bin/crictl rmi k8s.gcr.io/coredns/coredns:v1.8.6: (2.83212097s)
	I0630 20:51:51.462407  166730 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi gcr.io/k8s-minikube/storage-provisioner:v5
	I0630 20:51:51.462415  166730 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/images/amd64/k8s.gcr.io/coredns/coredns_v1.8.6
	I0630 20:51:51.462463  166730 ssh_runner.go:235] Completed: sudo /usr/bin/crictl rmi k8s.gcr.io/kube-proxy:v1.24.2: (2.832131931s)
	I0630 20:51:51.462485  166730 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/images/amd64/k8s.gcr.io/kube-proxy_v1.24.2
	I0630 20:51:51.462488  166730 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/images/coredns_v1.8.6
	I0630 20:51:51.462500  166730 ssh_runner.go:235] Completed: sudo /usr/bin/crictl rmi k8s.gcr.io/pause:3.7: (2.832140439s)
	I0630 20:51:51.462516  166730 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/images/amd64/k8s.gcr.io/pause_3.7
	I0630 20:51:51.462556  166730 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/images/kube-proxy_v1.24.2
	I0630 20:51:51.462569  166730 ssh_runner.go:235] Completed: sudo /usr/bin/crictl rmi k8s.gcr.io/etcd:3.5.3-0: (2.832115956s)
	I0630 20:51:51.462572  166730 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/images/pause_3.7
	I0630 20:51:51.462578  166730 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/images/amd64/k8s.gcr.io/etcd_3.5.3-0
	I0630 20:51:51.462619  166730 ssh_runner.go:235] Completed: sudo /usr/bin/crictl rmi k8s.gcr.io/kube-controller-manager:v1.24.2: (2.832172571s)
	I0630 20:51:51.462626  166730 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/images/amd64/k8s.gcr.io/kube-controller-manager_v1.24.2
	I0630 20:51:51.462632  166730 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/images/etcd_3.5.3-0
	I0630 20:51:51.462662  166730 ssh_runner.go:235] Completed: sudo /usr/bin/crictl rmi k8s.gcr.io/kube-scheduler:v1.24.2: (2.832143134s)
	I0630 20:51:51.462667  166730 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/images/kube-controller-manager_v1.24.2
	I0630 20:51:51.462672  166730 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/images/amd64/k8s.gcr.io/kube-scheduler_v1.24.2
	I0630 20:51:51.462731  166730 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/images/kube-scheduler_v1.24.2
	I0630 20:51:51.498315  166730 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5
	I0630 20:51:51.498409  166730 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/images/storage-provisioner_v5
	I0630 20:51:51.498429  166730 ssh_runner.go:352] existence check for /var/lib/minikube/images/kube-proxy_v1.24.2: stat -c "%s %y" /var/lib/minikube/images/kube-proxy_v1.24.2: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot stat '/var/lib/minikube/images/kube-proxy_v1.24.2': No such file or directory
	I0630 20:51:51.498332  166730 ssh_runner.go:235] Completed: sudo /usr/bin/crictl rmi k8s.gcr.io/kube-apiserver:v1.24.2: (2.867794285s)
	I0630 20:51:51.498461  166730 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/images/amd64/k8s.gcr.io/kube-proxy_v1.24.2 --> /var/lib/minikube/images/kube-proxy_v1.24.2 (39518208 bytes)
	I0630 20:51:51.498466  166730 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/images/amd64/k8s.gcr.io/kube-apiserver_v1.24.2
	I0630 20:51:51.498504  166730 ssh_runner.go:352] existence check for /var/lib/minikube/images/coredns_v1.8.6: stat -c "%s %y" /var/lib/minikube/images/coredns_v1.8.6: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot stat '/var/lib/minikube/images/coredns_v1.8.6': No such file or directory
	I0630 20:51:51.498526  166730 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/images/amd64/k8s.gcr.io/coredns/coredns_v1.8.6 --> /var/lib/minikube/images/coredns_v1.8.6 (13586432 bytes)
	I0630 20:51:51.498536  166730 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/images/kube-apiserver_v1.24.2
	I0630 20:51:51.498618  166730 ssh_runner.go:352] existence check for /var/lib/minikube/images/pause_3.7: stat -c "%s %y" /var/lib/minikube/images/pause_3.7: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot stat '/var/lib/minikube/images/pause_3.7': No such file or directory
	I0630 20:51:51.498640  166730 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/images/amd64/k8s.gcr.io/pause_3.7 --> /var/lib/minikube/images/pause_3.7 (311296 bytes)
	I0630 20:51:51.498686  166730 ssh_runner.go:352] existence check for /var/lib/minikube/images/kube-controller-manager_v1.24.2: stat -c "%s %y" /var/lib/minikube/images/kube-controller-manager_v1.24.2: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot stat '/var/lib/minikube/images/kube-controller-manager_v1.24.2': No such file or directory
	I0630 20:51:51.498710  166730 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/images/amd64/k8s.gcr.io/kube-controller-manager_v1.24.2 --> /var/lib/minikube/images/kube-controller-manager_v1.24.2 (31037952 bytes)
	I0630 20:51:51.498755  166730 ssh_runner.go:352] existence check for /var/lib/minikube/images/kube-scheduler_v1.24.2: stat -c "%s %y" /var/lib/minikube/images/kube-scheduler_v1.24.2: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot stat '/var/lib/minikube/images/kube-scheduler_v1.24.2': No such file or directory
	I0630 20:51:51.498777  166730 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/images/amd64/k8s.gcr.io/kube-scheduler_v1.24.2 --> /var/lib/minikube/images/kube-scheduler_v1.24.2 (15491584 bytes)
	I0630 20:51:51.498758  166730 ssh_runner.go:352] existence check for /var/lib/minikube/images/etcd_3.5.3-0: stat -c "%s %y" /var/lib/minikube/images/etcd_3.5.3-0: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot stat '/var/lib/minikube/images/etcd_3.5.3-0': No such file or directory
	I0630 20:51:51.498804  166730 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/images/amd64/k8s.gcr.io/etcd_3.5.3-0 --> /var/lib/minikube/images/etcd_3.5.3-0 (102146048 bytes)
	I0630 20:51:51.509709  166730 ssh_runner.go:352] existence check for /var/lib/minikube/images/storage-provisioner_v5: stat -c "%s %y" /var/lib/minikube/images/storage-provisioner_v5: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot stat '/var/lib/minikube/images/storage-provisioner_v5': No such file or directory
	I0630 20:51:51.509749  166730 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5 --> /var/lib/minikube/images/storage-provisioner_v5 (9060352 bytes)
	I0630 20:51:51.509808  166730 ssh_runner.go:352] existence check for /var/lib/minikube/images/kube-apiserver_v1.24.2: stat -c "%s %y" /var/lib/minikube/images/kube-apiserver_v1.24.2: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot stat '/var/lib/minikube/images/kube-apiserver_v1.24.2': No such file or directory
	I0630 20:51:51.509833  166730 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/images/amd64/k8s.gcr.io/kube-apiserver_v1.24.2 --> /var/lib/minikube/images/kube-apiserver_v1.24.2 (33798144 bytes)
	I0630 20:51:51.542946  166730 containerd.go:227] Loading image: /var/lib/minikube/images/pause_3.7
	I0630 20:51:51.543017  166730 ssh_runner.go:195] Run: sudo ctr -n=k8s.io images import /var/lib/minikube/images/pause_3.7
	I0630 20:51:51.829369  166730 cache_images.go:315] Transferred and loaded /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/images/amd64/k8s.gcr.io/pause_3.7 from cache
	I0630 20:51:51.829437  166730 containerd.go:227] Loading image: /var/lib/minikube/images/storage-provisioner_v5
	I0630 20:51:51.829511  166730 ssh_runner.go:195] Run: sudo ctr -n=k8s.io images import /var/lib/minikube/images/storage-provisioner_v5
	I0630 20:51:52.555734  166730 cache_images.go:315] Transferred and loaded /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5 from cache
	I0630 20:51:52.555787  166730 containerd.go:227] Loading image: /var/lib/minikube/images/coredns_v1.8.6
	I0630 20:51:52.555854  166730 ssh_runner.go:195] Run: sudo ctr -n=k8s.io images import /var/lib/minikube/images/coredns_v1.8.6
	I0630 20:51:53.203567  166730 cache_images.go:315] Transferred and loaded /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/images/amd64/k8s.gcr.io/coredns/coredns_v1.8.6 from cache
	I0630 20:51:53.203601  166730 containerd.go:227] Loading image: /var/lib/minikube/images/kube-scheduler_v1.24.2
	I0630 20:51:53.203636  166730 ssh_runner.go:195] Run: sudo ctr -n=k8s.io images import /var/lib/minikube/images/kube-scheduler_v1.24.2
	I0630 20:51:54.025760  166730 cache_images.go:315] Transferred and loaded /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/images/amd64/k8s.gcr.io/kube-scheduler_v1.24.2 from cache
	I0630 20:51:54.025801  166730 containerd.go:227] Loading image: /var/lib/minikube/images/kube-controller-manager_v1.24.2
	I0630 20:51:54.025839  166730 ssh_runner.go:195] Run: sudo ctr -n=k8s.io images import /var/lib/minikube/images/kube-controller-manager_v1.24.2
	I0630 20:51:55.298907  166730 ssh_runner.go:235] Completed: sudo ctr -n=k8s.io images import /var/lib/minikube/images/kube-controller-manager_v1.24.2: (1.273037745s)
	I0630 20:51:55.298940  166730 cache_images.go:315] Transferred and loaded /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/images/amd64/k8s.gcr.io/kube-controller-manager_v1.24.2 from cache
	I0630 20:51:55.298970  166730 containerd.go:227] Loading image: /var/lib/minikube/images/kube-apiserver_v1.24.2
	I0630 20:51:55.299016  166730 ssh_runner.go:195] Run: sudo ctr -n=k8s.io images import /var/lib/minikube/images/kube-apiserver_v1.24.2
	I0630 20:51:56.693542  166730 ssh_runner.go:235] Completed: sudo ctr -n=k8s.io images import /var/lib/minikube/images/kube-apiserver_v1.24.2: (1.394496936s)
	I0630 20:51:56.693574  166730 cache_images.go:315] Transferred and loaded /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/images/amd64/k8s.gcr.io/kube-apiserver_v1.24.2 from cache
	I0630 20:51:56.693601  166730 containerd.go:227] Loading image: /var/lib/minikube/images/kube-proxy_v1.24.2
	I0630 20:51:56.693659  166730 ssh_runner.go:195] Run: sudo ctr -n=k8s.io images import /var/lib/minikube/images/kube-proxy_v1.24.2
	I0630 20:51:57.496211  166730 cache_images.go:315] Transferred and loaded /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/images/amd64/k8s.gcr.io/kube-proxy_v1.24.2 from cache
	I0630 20:51:57.496260  166730 containerd.go:227] Loading image: /var/lib/minikube/images/etcd_3.5.3-0
	I0630 20:51:57.496303  166730 ssh_runner.go:195] Run: sudo ctr -n=k8s.io images import /var/lib/minikube/images/etcd_3.5.3-0
	I0630 20:52:01.352409  166730 ssh_runner.go:235] Completed: sudo ctr -n=k8s.io images import /var/lib/minikube/images/etcd_3.5.3-0: (3.856075384s)
	I0630 20:52:01.352443  166730 cache_images.go:315] Transferred and loaded /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/images/amd64/k8s.gcr.io/etcd_3.5.3-0 from cache
	I0630 20:52:01.352477  166730 cache_images.go:123] Successfully loaded all cached images
	I0630 20:52:01.352483  166730 cache_images.go:92] LoadImages completed in 14.220178423s
	I0630 20:52:01.352541  166730 ssh_runner.go:195] Run: sudo crictl info
	I0630 20:52:01.380791  166730 cni.go:95] Creating CNI manager for ""
	I0630 20:52:01.380813  166730 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 20:52:01.380824  166730 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
	I0630 20:52:01.380836  166730 kubeadm.go:158] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.67.2 APIServerPort:8443 KubernetesVersion:v1.24.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:kubernetes-upgrade-20220630205032-9950 NodeName:kubernetes-upgrade-20220630205032-9950 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.67.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.67.2 CgroupDriver:cg
roupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}
	I0630 20:52:01.380989  166730 kubeadm.go:162] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.67.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: /run/containerd/containerd.sock
	  name: "kubernetes-upgrade-20220630205032-9950"
	  kubeletExtraArgs:
	    node-ip: 192.168.67.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.67.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.24.2
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%"
	  nodefs.inodesFree: "0%"
	  imagefs.available: "0%"
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0630 20:52:01.381121  166730 kubeadm.go:961] kubelet [Unit]
	Wants=containerd.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.24.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cni-conf-dir=/etc/cni/net.mk --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=kubernetes-upgrade-20220630205032-9950 --image-service-endpoint=unix:///run/containerd/containerd.sock --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.67.2 --runtime-request-timeout=15m
	
	[Install]
	 config:
	{KubernetesVersion:v1.24.2 ClusterName:kubernetes-upgrade-20220630205032-9950 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
	I0630 20:52:01.381186  166730 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.24.2
	I0630 20:52:01.388900  166730 binaries.go:44] Found k8s binaries, skipping transfer
	I0630 20:52:01.388975  166730 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0630 20:52:01.396955  166730 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (562 bytes)
	I0630 20:52:01.410556  166730 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0630 20:52:01.424249  166730 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2067 bytes)
	I0630 20:52:01.437849  166730 ssh_runner.go:195] Run: grep 192.168.67.2	control-plane.minikube.internal$ /etc/hosts
	I0630 20:52:01.441016  166730 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.67.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0630 20:52:01.451256  166730 certs.go:54] Setting up /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/kubernetes-upgrade-20220630205032-9950 for IP: 192.168.67.2
	I0630 20:52:01.451384  166730 certs.go:182] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.key
	I0630 20:52:01.451427  166730 certs.go:182] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.key
	I0630 20:52:01.451516  166730 certs.go:298] skipping minikube-user signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/kubernetes-upgrade-20220630205032-9950/client.key
	I0630 20:52:01.451589  166730 certs.go:298] skipping minikube signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/kubernetes-upgrade-20220630205032-9950/apiserver.key.c7fa3a9e
	I0630 20:52:01.451641  166730 certs.go:298] skipping aggregator signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/kubernetes-upgrade-20220630205032-9950/proxy-client.key
	I0630 20:52:01.451785  166730 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950.pem (1338 bytes)
	W0630 20:52:01.451824  166730 certs.go:384] ignoring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950_empty.pem, impossibly tiny 0 bytes
	I0630 20:52:01.451853  166730 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem (1679 bytes)
	I0630 20:52:01.451900  166730 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem (1082 bytes)
	I0630 20:52:01.451948  166730 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem (1123 bytes)
	I0630 20:52:01.451981  166730 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/key.pem (1679 bytes)
	I0630 20:52:01.452033  166730 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem (1708 bytes)
	I0630 20:52:01.452704  166730 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/kubernetes-upgrade-20220630205032-9950/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
	I0630 20:52:01.471509  166730 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/kubernetes-upgrade-20220630205032-9950/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
	I0630 20:52:01.489340  166730 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/kubernetes-upgrade-20220630205032-9950/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0630 20:52:01.507508  166730 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/kubernetes-upgrade-20220630205032-9950/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
	I0630 20:52:01.525863  166730 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0630 20:52:01.544238  166730 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
	I0630 20:52:01.563954  166730 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0630 20:52:01.583225  166730 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
	I0630 20:52:01.604725  166730 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem --> /usr/share/ca-certificates/99502.pem (1708 bytes)
	I0630 20:52:01.625613  166730 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0630 20:52:01.644354  166730 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950.pem --> /usr/share/ca-certificates/9950.pem (1338 bytes)
	I0630 20:52:01.662674  166730 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0630 20:52:01.676058  166730 ssh_runner.go:195] Run: openssl version
	I0630 20:52:01.682146  166730 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/99502.pem && ln -fs /usr/share/ca-certificates/99502.pem /etc/ssl/certs/99502.pem"
	I0630 20:52:01.690320  166730 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/99502.pem
	I0630 20:52:01.693950  166730 certs.go:431] hashing: -rw-r--r-- 1 root root 1708 Jun 30 20:26 /usr/share/ca-certificates/99502.pem
	I0630 20:52:01.694042  166730 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/99502.pem
	I0630 20:52:01.699253  166730 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/99502.pem /etc/ssl/certs/3ec20f2e.0"
	I0630 20:52:01.707280  166730 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0630 20:52:01.716191  166730 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0630 20:52:01.719579  166730 certs.go:431] hashing: -rw-r--r-- 1 root root 1111 Jun 30 20:22 /usr/share/ca-certificates/minikubeCA.pem
	I0630 20:52:01.719639  166730 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0630 20:52:01.724961  166730 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0630 20:52:01.733025  166730 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/9950.pem && ln -fs /usr/share/ca-certificates/9950.pem /etc/ssl/certs/9950.pem"
	I0630 20:52:01.741314  166730 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/9950.pem
	I0630 20:52:01.744800  166730 certs.go:431] hashing: -rw-r--r-- 1 root root 1338 Jun 30 20:26 /usr/share/ca-certificates/9950.pem
	I0630 20:52:01.744867  166730 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/9950.pem
	I0630 20:52:01.749927  166730 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/9950.pem /etc/ssl/certs/51391683.0"
	I0630 20:52:01.757508  166730 kubeadm.go:395] StartCluster: {Name:kubernetes-upgrade-20220630205032-9950 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:kubernetes-upgrade-20220630205032-9950 Namespace:defaul
t APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.67.2 Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mo
untPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 20:52:01.757641  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
	I0630 20:52:01.757695  166730 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0630 20:52:01.786766  166730 cri.go:87] found id: ""
	I0630 20:52:01.786847  166730 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0630 20:52:01.794672  166730 kubeadm.go:410] found existing configuration files, will attempt cluster restart
	I0630 20:52:01.794697  166730 kubeadm.go:626] restartCluster start
	I0630 20:52:01.794749  166730 ssh_runner.go:195] Run: sudo test -d /data/minikube
	I0630 20:52:01.802317  166730 kubeadm.go:127] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
	stdout:
	
	stderr:
	I0630 20:52:01.802881  166730 kubeconfig.go:116] verify returned: extract IP: "kubernetes-upgrade-20220630205032-9950" does not appear in /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 20:52:01.803156  166730 kubeconfig.go:127] "kubernetes-upgrade-20220630205032-9950" context is missing from /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig - will repair!
	I0630 20:52:01.803774  166730 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig: {Name:mk34e4a4e7b04f624b9adbda4f77ee20b38308ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 20:52:01.805311  166730 kapi.go:59] client config for kubernetes-upgrade-20220630205032-9950: &rest.Config{Host:"https://192.168.67.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/kubernetes-upgrade-20220630205032-9950/client.crt", KeyFile:"/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/
profiles/kubernetes-upgrade-20220630205032-9950/client.key", CAFile:"/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x173d420), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I0630 20:52:01.806033  166730 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
	I0630 20:52:01.813898  166730 kubeadm.go:593] needs reconfigure: configs differ:
	-- stdout --
	--- /var/tmp/minikube/kubeadm.yaml	2022-06-30 20:50:52.985425599 +0000
	+++ /var/tmp/minikube/kubeadm.yaml.new	2022-06-30 20:52:01.431872633 +0000
	@@ -1,4 +1,4 @@
	-apiVersion: kubeadm.k8s.io/v1beta1
	+apiVersion: kubeadm.k8s.io/v1beta3
	 kind: InitConfiguration
	 localAPIEndpoint:
	   advertiseAddress: 192.168.67.2
	@@ -17,7 +17,7 @@
	     node-ip: 192.168.67.2
	   taints: []
	 ---
	-apiVersion: kubeadm.k8s.io/v1beta1
	+apiVersion: kubeadm.k8s.io/v1beta3
	 kind: ClusterConfiguration
	 apiServer:
	   certSANs: ["127.0.0.1", "localhost", "192.168.67.2"]
	@@ -31,16 +31,14 @@
	   extraArgs:
	     leader-elect: "false"
	 certificatesDir: /var/lib/minikube/certs
	-clusterName: kubernetes-upgrade-20220630205032-9950
	+clusterName: mk
	 controlPlaneEndpoint: control-plane.minikube.internal:8443
	-dns:
	-  type: CoreDNS
	 etcd:
	   local:
	     dataDir: /var/lib/minikube/etcd
	     extraArgs:
	-      listen-metrics-urls: http://127.0.0.1:2381,http://192.168.67.2:2381
	-kubernetesVersion: v1.16.0
	+      proxy-refresh-interval: "70000"
	+kubernetesVersion: v1.24.2
	 networking:
	   dnsDomain: cluster.local
	   podSubnet: "10.244.0.0/16"
	
	-- /stdout --
	I0630 20:52:01.813927  166730 kubeadm.go:1092] stopping kube-system containers ...
	I0630 20:52:01.813943  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name: Namespaces:[kube-system]}
	I0630 20:52:01.813998  166730 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0630 20:52:01.840698  166730 cri.go:87] found id: ""
	I0630 20:52:01.840770  166730 ssh_runner.go:195] Run: sudo systemctl stop kubelet
	I0630 20:52:01.851159  166730 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0630 20:52:01.859638  166730 kubeadm.go:155] found existing configuration files:
	-rw------- 1 root root 5755 Jun 30 20:50 /etc/kubernetes/admin.conf
	-rw------- 1 root root 5795 Jun 30 20:50 /etc/kubernetes/controller-manager.conf
	-rw------- 1 root root 5955 Jun 30 20:50 /etc/kubernetes/kubelet.conf
	-rw------- 1 root root 5739 Jun 30 20:50 /etc/kubernetes/scheduler.conf
	
	I0630 20:52:01.859713  166730 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
	I0630 20:52:01.867622  166730 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
	I0630 20:52:01.875482  166730 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
	I0630 20:52:01.883550  166730 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
	I0630 20:52:01.891479  166730 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0630 20:52:01.899553  166730 kubeadm.go:703] reconfiguring cluster from /var/tmp/minikube/kubeadm.yaml
	I0630 20:52:01.899583  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"
	I0630 20:52:01.945951  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"
	I0630 20:52:02.438142  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"
	I0630 20:52:02.642118  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"
	I0630 20:52:02.697519  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"
	I0630 20:52:02.772854  166730 api_server.go:51] waiting for apiserver process to appear ...
	I0630 20:52:02.772934  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:03.282155  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:03.782123  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:04.282248  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:04.782262  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:05.282402  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:05.782265  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:06.281862  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:06.782165  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:07.282074  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:07.782263  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:08.282314  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:08.782266  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:09.281607  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:09.782157  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:10.281762  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:10.782503  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:11.281768  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:11.781936  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:12.281667  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:12.782289  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:13.281813  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:13.782293  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:14.281683  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:14.782273  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:15.282263  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:15.781955  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:16.282016  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:16.781836  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:17.282239  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:17.782241  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:18.281825  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:18.781760  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:19.281711  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:19.782305  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:20.282076  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:20.781956  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:21.282322  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:21.782517  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:22.281725  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:22.782567  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:23.281648  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:23.782283  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:24.281749  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:24.781688  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:25.282286  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:25.782284  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:26.281770  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:26.781637  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:27.282264  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:27.781697  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:28.282261  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:28.782254  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:29.282275  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:29.781883  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:30.282267  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:30.782344  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:31.282256  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:31.782495  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:32.282260  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:32.782178  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:33.281639  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:33.782271  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:34.282242  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:34.782250  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:35.281624  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:35.782258  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:36.281917  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:36.781626  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:37.282264  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:37.781620  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:38.282219  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:38.781620  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:39.282263  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:39.782271  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:40.282226  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:40.781977  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:41.282255  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:41.781704  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:42.281765  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:42.782253  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:43.282553  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:43.782308  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:44.281968  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:44.781622  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:45.282257  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:45.781599  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:46.281948  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:46.782135  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:47.282277  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:47.782047  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:48.282249  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:48.782251  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:49.282256  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:49.781780  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:50.281875  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:50.782101  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:51.282294  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:51.782354  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:52.282249  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:52.782172  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:53.282495  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:53.782263  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:54.282292  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:54.782252  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:55.281769  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:55.782263  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:56.282249  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:56.781747  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:57.281598  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:57.781790  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:58.281825  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:58.781632  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:59.281641  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:52:59.781876  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:53:00.282315  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:53:00.782248  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:53:01.282260  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:53:01.782278  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:53:02.281839  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:53:02.782253  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
	I0630 20:53:02.782329  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I0630 20:53:02.810918  166730 cri.go:87] found id: ""
	I0630 20:53:02.810951  166730 logs.go:274] 0 containers: []
	W0630 20:53:02.810960  166730 logs.go:276] No container was found matching "kube-apiserver"
	I0630 20:53:02.810967  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
	I0630 20:53:02.811021  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I0630 20:53:02.843332  166730 cri.go:87] found id: ""
	I0630 20:53:02.843356  166730 logs.go:274] 0 containers: []
	W0630 20:53:02.843364  166730 logs.go:276] No container was found matching "etcd"
	I0630 20:53:02.843371  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
	I0630 20:53:02.843418  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I0630 20:53:02.875498  166730 cri.go:87] found id: ""
	I0630 20:53:02.875521  166730 logs.go:274] 0 containers: []
	W0630 20:53:02.875528  166730 logs.go:276] No container was found matching "coredns"
	I0630 20:53:02.875533  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
	I0630 20:53:02.875587  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I0630 20:53:02.898982  166730 cri.go:87] found id: ""
	I0630 20:53:02.899016  166730 logs.go:274] 0 containers: []
	W0630 20:53:02.899025  166730 logs.go:276] No container was found matching "kube-scheduler"
	I0630 20:53:02.899032  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
	I0630 20:53:02.899074  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I0630 20:53:02.921725  166730 cri.go:87] found id: ""
	I0630 20:53:02.921752  166730 logs.go:274] 0 containers: []
	W0630 20:53:02.921758  166730 logs.go:276] No container was found matching "kube-proxy"
	I0630 20:53:02.921764  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
	I0630 20:53:02.921803  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
	I0630 20:53:02.948725  166730 cri.go:87] found id: ""
	I0630 20:53:02.948752  166730 logs.go:274] 0 containers: []
	W0630 20:53:02.948760  166730 logs.go:276] No container was found matching "kubernetes-dashboard"
	I0630 20:53:02.948768  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
	I0630 20:53:02.948825  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
	I0630 20:53:02.973923  166730 cri.go:87] found id: ""
	I0630 20:53:02.973950  166730 logs.go:274] 0 containers: []
	W0630 20:53:02.973958  166730 logs.go:276] No container was found matching "storage-provisioner"
	I0630 20:53:02.973966  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
	I0630 20:53:02.974032  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I0630 20:53:02.999773  166730 cri.go:87] found id: ""
	I0630 20:53:02.999796  166730 logs.go:274] 0 containers: []
	W0630 20:53:02.999803  166730 logs.go:276] No container was found matching "kube-controller-manager"
	I0630 20:53:02.999811  166730 logs.go:123] Gathering logs for kubelet ...
	I0630 20:53:02.999824  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	W0630 20:53:03.052560  166730 logs.go:138] Found kubelet problem: Jun 30 20:53:02 kubernetes-upgrade-20220630205032-9950 kubelet[2339]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	I0630 20:53:03.107990  166730 logs.go:123] Gathering logs for dmesg ...
	I0630 20:53:03.108021  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0630 20:53:03.123360  166730 logs.go:123] Gathering logs for describe nodes ...
	I0630 20:53:03.123400  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	W0630 20:53:03.188388  166730 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	 output: 
	** stderr ** 
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	
	** /stderr **
	I0630 20:53:03.188416  166730 logs.go:123] Gathering logs for containerd ...
	I0630 20:53:03.188430  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
	I0630 20:53:03.226926  166730 logs.go:123] Gathering logs for container status ...
	I0630 20:53:03.226966  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0630 20:53:03.266833  166730 out.go:309] Setting ErrFile to fd 2...
	I0630 20:53:03.266857  166730 out.go:343] TERM=,COLORTERM=, which probably does not support color
	W0630 20:53:03.266968  166730 out.go:239] X Problems detected in kubelet:
	X Problems detected in kubelet:
	W0630 20:53:03.266987  166730 out.go:239]   Jun 30 20:53:02 kubernetes-upgrade-20220630205032-9950 kubelet[2339]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	  Jun 30 20:53:02 kubernetes-upgrade-20220630205032-9950 kubelet[2339]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	I0630 20:53:03.267052  166730 out.go:309] Setting ErrFile to fd 2...
	I0630 20:53:03.267064  166730 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 20:53:13.268087  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:53:13.281926  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
	I0630 20:53:13.282001  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I0630 20:53:13.308407  166730 cri.go:87] found id: ""
	I0630 20:53:13.308436  166730 logs.go:274] 0 containers: []
	W0630 20:53:13.308446  166730 logs.go:276] No container was found matching "kube-apiserver"
	I0630 20:53:13.308453  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
	I0630 20:53:13.308503  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I0630 20:53:13.331806  166730 cri.go:87] found id: ""
	I0630 20:53:13.331838  166730 logs.go:274] 0 containers: []
	W0630 20:53:13.331848  166730 logs.go:276] No container was found matching "etcd"
	I0630 20:53:13.331856  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
	I0630 20:53:13.331908  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I0630 20:53:13.359136  166730 cri.go:87] found id: ""
	I0630 20:53:13.359161  166730 logs.go:274] 0 containers: []
	W0630 20:53:13.359168  166730 logs.go:276] No container was found matching "coredns"
	I0630 20:53:13.359173  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
	I0630 20:53:13.359216  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I0630 20:53:13.382834  166730 cri.go:87] found id: ""
	I0630 20:53:13.382864  166730 logs.go:274] 0 containers: []
	W0630 20:53:13.382873  166730 logs.go:276] No container was found matching "kube-scheduler"
	I0630 20:53:13.382881  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
	I0630 20:53:13.382924  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I0630 20:53:13.405788  166730 cri.go:87] found id: ""
	I0630 20:53:13.405816  166730 logs.go:274] 0 containers: []
	W0630 20:53:13.405824  166730 logs.go:276] No container was found matching "kube-proxy"
	I0630 20:53:13.405831  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
	I0630 20:53:13.405887  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
	I0630 20:53:13.428499  166730 cri.go:87] found id: ""
	I0630 20:53:13.428523  166730 logs.go:274] 0 containers: []
	W0630 20:53:13.428532  166730 logs.go:276] No container was found matching "kubernetes-dashboard"
	I0630 20:53:13.428540  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
	I0630 20:53:13.428593  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
	I0630 20:53:13.452095  166730 cri.go:87] found id: ""
	I0630 20:53:13.452126  166730 logs.go:274] 0 containers: []
	W0630 20:53:13.452136  166730 logs.go:276] No container was found matching "storage-provisioner"
	I0630 20:53:13.452144  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
	I0630 20:53:13.452186  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I0630 20:53:13.476167  166730 cri.go:87] found id: ""
	I0630 20:53:13.476191  166730 logs.go:274] 0 containers: []
	W0630 20:53:13.476197  166730 logs.go:276] No container was found matching "kube-controller-manager"
	I0630 20:53:13.476204  166730 logs.go:123] Gathering logs for describe nodes ...
	I0630 20:53:13.476214  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	W0630 20:53:13.525853  166730 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	 output: 
	** stderr ** 
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	
	** /stderr **
	I0630 20:53:13.525875  166730 logs.go:123] Gathering logs for containerd ...
	I0630 20:53:13.525885  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
	I0630 20:53:13.563912  166730 logs.go:123] Gathering logs for container status ...
	I0630 20:53:13.563950  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0630 20:53:13.591009  166730 logs.go:123] Gathering logs for kubelet ...
	I0630 20:53:13.591034  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	W0630 20:53:13.635289  166730 logs.go:138] Found kubelet problem: Jun 30 20:53:13 kubernetes-upgrade-20220630205032-9950 kubelet[2636]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	I0630 20:53:13.680767  166730 logs.go:123] Gathering logs for dmesg ...
	I0630 20:53:13.680803  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0630 20:53:13.695643  166730 out.go:309] Setting ErrFile to fd 2...
	I0630 20:53:13.695670  166730 out.go:343] TERM=,COLORTERM=, which probably does not support color
	W0630 20:53:13.695768  166730 out.go:239] X Problems detected in kubelet:
	X Problems detected in kubelet:
	W0630 20:53:13.695781  166730 out.go:239]   Jun 30 20:53:13 kubernetes-upgrade-20220630205032-9950 kubelet[2636]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	  Jun 30 20:53:13 kubernetes-upgrade-20220630205032-9950 kubelet[2636]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	I0630 20:53:13.695785  166730 out.go:309] Setting ErrFile to fd 2...
	I0630 20:53:13.695790  166730 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 20:53:23.696367  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:53:23.782318  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
	I0630 20:53:23.782418  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I0630 20:53:23.808045  166730 cri.go:87] found id: ""
	I0630 20:53:23.808068  166730 logs.go:274] 0 containers: []
	W0630 20:53:23.808074  166730 logs.go:276] No container was found matching "kube-apiserver"
	I0630 20:53:23.808080  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
	I0630 20:53:23.808121  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I0630 20:53:23.831977  166730 cri.go:87] found id: ""
	I0630 20:53:23.832003  166730 logs.go:274] 0 containers: []
	W0630 20:53:23.832009  166730 logs.go:276] No container was found matching "etcd"
	I0630 20:53:23.832014  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
	I0630 20:53:23.832065  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I0630 20:53:23.856621  166730 cri.go:87] found id: ""
	I0630 20:53:23.856647  166730 logs.go:274] 0 containers: []
	W0630 20:53:23.856656  166730 logs.go:276] No container was found matching "coredns"
	I0630 20:53:23.856664  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
	I0630 20:53:23.856722  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I0630 20:53:23.881889  166730 cri.go:87] found id: ""
	I0630 20:53:23.881924  166730 logs.go:274] 0 containers: []
	W0630 20:53:23.881934  166730 logs.go:276] No container was found matching "kube-scheduler"
	I0630 20:53:23.881942  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
	I0630 20:53:23.882013  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I0630 20:53:23.904979  166730 cri.go:87] found id: ""
	I0630 20:53:23.905018  166730 logs.go:274] 0 containers: []
	W0630 20:53:23.905027  166730 logs.go:276] No container was found matching "kube-proxy"
	I0630 20:53:23.905034  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
	I0630 20:53:23.905189  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
	I0630 20:53:23.929127  166730 cri.go:87] found id: ""
	I0630 20:53:23.929153  166730 logs.go:274] 0 containers: []
	W0630 20:53:23.929172  166730 logs.go:276] No container was found matching "kubernetes-dashboard"
	I0630 20:53:23.929182  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
	I0630 20:53:23.929243  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
	I0630 20:53:23.953309  166730 cri.go:87] found id: ""
	I0630 20:53:23.953332  166730 logs.go:274] 0 containers: []
	W0630 20:53:23.953339  166730 logs.go:276] No container was found matching "storage-provisioner"
	I0630 20:53:23.953345  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
	I0630 20:53:23.953386  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I0630 20:53:23.976665  166730 cri.go:87] found id: ""
	I0630 20:53:23.976691  166730 logs.go:274] 0 containers: []
	W0630 20:53:23.976697  166730 logs.go:276] No container was found matching "kube-controller-manager"
	I0630 20:53:23.976706  166730 logs.go:123] Gathering logs for containerd ...
	I0630 20:53:23.976720  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
	I0630 20:53:24.016339  166730 logs.go:123] Gathering logs for container status ...
	I0630 20:53:24.016374  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0630 20:53:24.044069  166730 logs.go:123] Gathering logs for kubelet ...
	I0630 20:53:24.044095  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	W0630 20:53:24.091787  166730 logs.go:138] Found kubelet problem: Jun 30 20:53:23 kubernetes-upgrade-20220630205032-9950 kubelet[2933]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	I0630 20:53:24.142983  166730 logs.go:123] Gathering logs for dmesg ...
	I0630 20:53:24.143019  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0630 20:53:24.158258  166730 logs.go:123] Gathering logs for describe nodes ...
	I0630 20:53:24.158292  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	W0630 20:53:24.206195  166730 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	 output: 
	** stderr ** 
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	
	** /stderr **
	I0630 20:53:24.206222  166730 out.go:309] Setting ErrFile to fd 2...
	I0630 20:53:24.206234  166730 out.go:343] TERM=,COLORTERM=, which probably does not support color
	W0630 20:53:24.206342  166730 out.go:239] X Problems detected in kubelet:
	X Problems detected in kubelet:
	W0630 20:53:24.206359  166730 out.go:239]   Jun 30 20:53:23 kubernetes-upgrade-20220630205032-9950 kubelet[2933]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	  Jun 30 20:53:23 kubernetes-upgrade-20220630205032-9950 kubelet[2933]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	I0630 20:53:24.206365  166730 out.go:309] Setting ErrFile to fd 2...
	I0630 20:53:24.206373  166730 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 20:53:34.207830  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:53:34.282109  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
	I0630 20:53:34.282186  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I0630 20:53:34.316905  166730 cri.go:87] found id: ""
	I0630 20:53:34.316933  166730 logs.go:274] 0 containers: []
	W0630 20:53:34.316945  166730 logs.go:276] No container was found matching "kube-apiserver"
	I0630 20:53:34.316953  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
	I0630 20:53:34.317011  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I0630 20:53:34.348275  166730 cri.go:87] found id: ""
	I0630 20:53:34.348315  166730 logs.go:274] 0 containers: []
	W0630 20:53:34.348328  166730 logs.go:276] No container was found matching "etcd"
	I0630 20:53:34.348337  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
	I0630 20:53:34.348383  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I0630 20:53:34.380346  166730 cri.go:87] found id: ""
	I0630 20:53:34.380375  166730 logs.go:274] 0 containers: []
	W0630 20:53:34.380385  166730 logs.go:276] No container was found matching "coredns"
	I0630 20:53:34.380392  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
	I0630 20:53:34.380447  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I0630 20:53:34.406348  166730 cri.go:87] found id: ""
	I0630 20:53:34.406370  166730 logs.go:274] 0 containers: []
	W0630 20:53:34.406378  166730 logs.go:276] No container was found matching "kube-scheduler"
	I0630 20:53:34.406384  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
	I0630 20:53:34.406450  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I0630 20:53:34.436137  166730 cri.go:87] found id: ""
	I0630 20:53:34.436163  166730 logs.go:274] 0 containers: []
	W0630 20:53:34.436196  166730 logs.go:276] No container was found matching "kube-proxy"
	I0630 20:53:34.436208  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
	I0630 20:53:34.436277  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
	I0630 20:53:34.519770  166730 cri.go:87] found id: ""
	I0630 20:53:34.519799  166730 logs.go:274] 0 containers: []
	W0630 20:53:34.519809  166730 logs.go:276] No container was found matching "kubernetes-dashboard"
	I0630 20:53:34.519816  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
	I0630 20:53:34.519870  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
	I0630 20:53:34.578241  166730 cri.go:87] found id: ""
	I0630 20:53:34.578270  166730 logs.go:274] 0 containers: []
	W0630 20:53:34.578281  166730 logs.go:276] No container was found matching "storage-provisioner"
	I0630 20:53:34.578289  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
	I0630 20:53:34.578339  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I0630 20:53:34.605842  166730 cri.go:87] found id: ""
	I0630 20:53:34.605865  166730 logs.go:274] 0 containers: []
	W0630 20:53:34.605870  166730 logs.go:276] No container was found matching "kube-controller-manager"
	I0630 20:53:34.605879  166730 logs.go:123] Gathering logs for describe nodes ...
	I0630 20:53:34.605891  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	W0630 20:53:34.680022  166730 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	 output: 
	** stderr ** 
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	
	** /stderr **
	I0630 20:53:34.680066  166730 logs.go:123] Gathering logs for containerd ...
	I0630 20:53:34.680083  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
	I0630 20:53:34.721435  166730 logs.go:123] Gathering logs for container status ...
	I0630 20:53:34.721471  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0630 20:53:34.763829  166730 logs.go:123] Gathering logs for kubelet ...
	I0630 20:53:34.763862  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	W0630 20:53:34.816984  166730 logs.go:138] Found kubelet problem: Jun 30 20:53:34 kubernetes-upgrade-20220630205032-9950 kubelet[3229]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	I0630 20:53:34.887762  166730 logs.go:123] Gathering logs for dmesg ...
	I0630 20:53:34.887803  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0630 20:53:34.903901  166730 out.go:309] Setting ErrFile to fd 2...
	I0630 20:53:34.903928  166730 out.go:343] TERM=,COLORTERM=, which probably does not support color
	W0630 20:53:34.904028  166730 out.go:239] X Problems detected in kubelet:
	X Problems detected in kubelet:
	W0630 20:53:34.904043  166730 out.go:239]   Jun 30 20:53:34 kubernetes-upgrade-20220630205032-9950 kubelet[3229]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	  Jun 30 20:53:34 kubernetes-upgrade-20220630205032-9950 kubelet[3229]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	I0630 20:53:34.904047  166730 out.go:309] Setting ErrFile to fd 2...
	I0630 20:53:34.904052  166730 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 20:53:44.905002  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:53:45.281704  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
	I0630 20:53:45.281784  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I0630 20:53:45.309453  166730 cri.go:87] found id: ""
	I0630 20:53:45.309478  166730 logs.go:274] 0 containers: []
	W0630 20:53:45.309486  166730 logs.go:276] No container was found matching "kube-apiserver"
	I0630 20:53:45.309494  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
	I0630 20:53:45.309558  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I0630 20:53:45.334824  166730 cri.go:87] found id: ""
	I0630 20:53:45.334851  166730 logs.go:274] 0 containers: []
	W0630 20:53:45.334859  166730 logs.go:276] No container was found matching "etcd"
	I0630 20:53:45.334866  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
	I0630 20:53:45.334921  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I0630 20:53:45.362287  166730 cri.go:87] found id: ""
	I0630 20:53:45.362316  166730 logs.go:274] 0 containers: []
	W0630 20:53:45.362325  166730 logs.go:276] No container was found matching "coredns"
	I0630 20:53:45.362333  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
	I0630 20:53:45.362384  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I0630 20:53:45.390494  166730 cri.go:87] found id: ""
	I0630 20:53:45.390526  166730 logs.go:274] 0 containers: []
	W0630 20:53:45.390535  166730 logs.go:276] No container was found matching "kube-scheduler"
	I0630 20:53:45.390543  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
	I0630 20:53:45.390597  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I0630 20:53:45.417289  166730 cri.go:87] found id: ""
	I0630 20:53:45.417314  166730 logs.go:274] 0 containers: []
	W0630 20:53:45.417321  166730 logs.go:276] No container was found matching "kube-proxy"
	I0630 20:53:45.417326  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
	I0630 20:53:45.417371  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
	I0630 20:53:45.442817  166730 cri.go:87] found id: ""
	I0630 20:53:45.442843  166730 logs.go:274] 0 containers: []
	W0630 20:53:45.442852  166730 logs.go:276] No container was found matching "kubernetes-dashboard"
	I0630 20:53:45.442860  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
	I0630 20:53:45.442920  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
	I0630 20:53:45.468875  166730 cri.go:87] found id: ""
	I0630 20:53:45.468906  166730 logs.go:274] 0 containers: []
	W0630 20:53:45.468915  166730 logs.go:276] No container was found matching "storage-provisioner"
	I0630 20:53:45.468923  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
	I0630 20:53:45.468980  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I0630 20:53:45.498382  166730 cri.go:87] found id: ""
	I0630 20:53:45.498411  166730 logs.go:274] 0 containers: []
	W0630 20:53:45.498420  166730 logs.go:276] No container was found matching "kube-controller-manager"
	I0630 20:53:45.498432  166730 logs.go:123] Gathering logs for kubelet ...
	I0630 20:53:45.498446  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	W0630 20:53:45.557423  166730 logs.go:138] Found kubelet problem: Jun 30 20:53:44 kubernetes-upgrade-20220630205032-9950 kubelet[3513]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	I0630 20:53:45.630364  166730 logs.go:123] Gathering logs for dmesg ...
	I0630 20:53:45.630410  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0630 20:53:45.649242  166730 logs.go:123] Gathering logs for describe nodes ...
	I0630 20:53:45.649277  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	W0630 20:53:45.710775  166730 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	 output: 
	** stderr ** 
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	
	** /stderr **
	I0630 20:53:45.710804  166730 logs.go:123] Gathering logs for containerd ...
	I0630 20:53:45.710819  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
	I0630 20:53:45.764987  166730 logs.go:123] Gathering logs for container status ...
	I0630 20:53:45.765029  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0630 20:53:45.802778  166730 out.go:309] Setting ErrFile to fd 2...
	I0630 20:53:45.802814  166730 out.go:343] TERM=,COLORTERM=, which probably does not support color
	W0630 20:53:45.802952  166730 out.go:239] X Problems detected in kubelet:
	X Problems detected in kubelet:
	W0630 20:53:45.802973  166730 out.go:239]   Jun 30 20:53:44 kubernetes-upgrade-20220630205032-9950 kubelet[3513]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	  Jun 30 20:53:44 kubernetes-upgrade-20220630205032-9950 kubelet[3513]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	I0630 20:53:45.802981  166730 out.go:309] Setting ErrFile to fd 2...
	I0630 20:53:45.802989  166730 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 20:53:55.804125  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:53:56.281673  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
	I0630 20:53:56.281763  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I0630 20:53:56.306847  166730 cri.go:87] found id: ""
	I0630 20:53:56.306876  166730 logs.go:274] 0 containers: []
	W0630 20:53:56.306885  166730 logs.go:276] No container was found matching "kube-apiserver"
	I0630 20:53:56.306899  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
	I0630 20:53:56.306957  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I0630 20:53:56.331358  166730 cri.go:87] found id: ""
	I0630 20:53:56.331381  166730 logs.go:274] 0 containers: []
	W0630 20:53:56.331388  166730 logs.go:276] No container was found matching "etcd"
	I0630 20:53:56.331393  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
	I0630 20:53:56.331436  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I0630 20:53:56.355333  166730 cri.go:87] found id: ""
	I0630 20:53:56.355355  166730 logs.go:274] 0 containers: []
	W0630 20:53:56.355361  166730 logs.go:276] No container was found matching "coredns"
	I0630 20:53:56.355367  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
	I0630 20:53:56.355419  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I0630 20:53:56.379449  166730 cri.go:87] found id: ""
	I0630 20:53:56.379481  166730 logs.go:274] 0 containers: []
	W0630 20:53:56.379492  166730 logs.go:276] No container was found matching "kube-scheduler"
	I0630 20:53:56.379501  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
	I0630 20:53:56.379558  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I0630 20:53:56.402948  166730 cri.go:87] found id: ""
	I0630 20:53:56.402972  166730 logs.go:274] 0 containers: []
	W0630 20:53:56.402978  166730 logs.go:276] No container was found matching "kube-proxy"
	I0630 20:53:56.402983  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
	I0630 20:53:56.403028  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
	I0630 20:53:56.431564  166730 cri.go:87] found id: ""
	I0630 20:53:56.431586  166730 logs.go:274] 0 containers: []
	W0630 20:53:56.431594  166730 logs.go:276] No container was found matching "kubernetes-dashboard"
	I0630 20:53:56.431601  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
	I0630 20:53:56.431663  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
	I0630 20:53:56.461809  166730 cri.go:87] found id: ""
	I0630 20:53:56.461837  166730 logs.go:274] 0 containers: []
	W0630 20:53:56.461847  166730 logs.go:276] No container was found matching "storage-provisioner"
	I0630 20:53:56.461854  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
	I0630 20:53:56.461904  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I0630 20:53:56.484441  166730 cri.go:87] found id: ""
	I0630 20:53:56.484472  166730 logs.go:274] 0 containers: []
	W0630 20:53:56.484481  166730 logs.go:276] No container was found matching "kube-controller-manager"
	I0630 20:53:56.484492  166730 logs.go:123] Gathering logs for container status ...
	I0630 20:53:56.484513  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0630 20:53:56.510538  166730 logs.go:123] Gathering logs for kubelet ...
	I0630 20:53:56.510566  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	W0630 20:53:56.559943  166730 logs.go:138] Found kubelet problem: Jun 30 20:53:56 kubernetes-upgrade-20220630205032-9950 kubelet[3808]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	I0630 20:53:56.605021  166730 logs.go:123] Gathering logs for dmesg ...
	I0630 20:53:56.605070  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0630 20:53:56.620652  166730 logs.go:123] Gathering logs for describe nodes ...
	I0630 20:53:56.620680  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	W0630 20:53:56.679129  166730 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	 output: 
	** stderr ** 
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	
	** /stderr **
	I0630 20:53:56.679153  166730 logs.go:123] Gathering logs for containerd ...
	I0630 20:53:56.679163  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
	I0630 20:53:56.714310  166730 out.go:309] Setting ErrFile to fd 2...
	I0630 20:53:56.714342  166730 out.go:343] TERM=,COLORTERM=, which probably does not support color
	W0630 20:53:56.714464  166730 out.go:239] X Problems detected in kubelet:
	X Problems detected in kubelet:
	W0630 20:53:56.714481  166730 out.go:239]   Jun 30 20:53:56 kubernetes-upgrade-20220630205032-9950 kubelet[3808]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	  Jun 30 20:53:56 kubernetes-upgrade-20220630205032-9950 kubelet[3808]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	I0630 20:53:56.714490  166730 out.go:309] Setting ErrFile to fd 2...
	I0630 20:53:56.714499  166730 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 20:54:06.715516  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:54:06.782139  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
	I0630 20:54:06.782231  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I0630 20:54:06.812026  166730 cri.go:87] found id: ""
	I0630 20:54:06.812054  166730 logs.go:274] 0 containers: []
	W0630 20:54:06.812062  166730 logs.go:276] No container was found matching "kube-apiserver"
	I0630 20:54:06.812069  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
	I0630 20:54:06.812121  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I0630 20:54:06.843344  166730 cri.go:87] found id: ""
	I0630 20:54:06.843368  166730 logs.go:274] 0 containers: []
	W0630 20:54:06.843376  166730 logs.go:276] No container was found matching "etcd"
	I0630 20:54:06.843383  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
	I0630 20:54:06.843432  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I0630 20:54:06.880385  166730 cri.go:87] found id: ""
	I0630 20:54:06.880412  166730 logs.go:274] 0 containers: []
	W0630 20:54:06.880420  166730 logs.go:276] No container was found matching "coredns"
	I0630 20:54:06.880427  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
	I0630 20:54:06.880477  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I0630 20:54:06.911728  166730 cri.go:87] found id: ""
	I0630 20:54:06.911753  166730 logs.go:274] 0 containers: []
	W0630 20:54:06.911762  166730 logs.go:276] No container was found matching "kube-scheduler"
	I0630 20:54:06.911769  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
	I0630 20:54:06.911826  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I0630 20:54:06.942194  166730 cri.go:87] found id: ""
	I0630 20:54:06.942222  166730 logs.go:274] 0 containers: []
	W0630 20:54:06.942231  166730 logs.go:276] No container was found matching "kube-proxy"
	I0630 20:54:06.942238  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
	I0630 20:54:06.942287  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
	I0630 20:54:06.983763  166730 cri.go:87] found id: ""
	I0630 20:54:06.983786  166730 logs.go:274] 0 containers: []
	W0630 20:54:06.983794  166730 logs.go:276] No container was found matching "kubernetes-dashboard"
	I0630 20:54:06.983801  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
	I0630 20:54:06.983854  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
	I0630 20:54:07.010756  166730 cri.go:87] found id: ""
	I0630 20:54:07.010781  166730 logs.go:274] 0 containers: []
	W0630 20:54:07.010788  166730 logs.go:276] No container was found matching "storage-provisioner"
	I0630 20:54:07.010794  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
	I0630 20:54:07.010855  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I0630 20:54:07.040477  166730 cri.go:87] found id: ""
	I0630 20:54:07.040507  166730 logs.go:274] 0 containers: []
	W0630 20:54:07.040515  166730 logs.go:276] No container was found matching "kube-controller-manager"
	I0630 20:54:07.040527  166730 logs.go:123] Gathering logs for describe nodes ...
	I0630 20:54:07.040543  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	W0630 20:54:07.098608  166730 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	 output: 
	** stderr ** 
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	
	** /stderr **
	I0630 20:54:07.098631  166730 logs.go:123] Gathering logs for containerd ...
	I0630 20:54:07.098642  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
	I0630 20:54:07.135890  166730 logs.go:123] Gathering logs for container status ...
	I0630 20:54:07.135926  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0630 20:54:07.167691  166730 logs.go:123] Gathering logs for kubelet ...
	I0630 20:54:07.167718  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	W0630 20:54:07.226083  166730 logs.go:138] Found kubelet problem: Jun 30 20:54:06 kubernetes-upgrade-20220630205032-9950 kubelet[4101]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	I0630 20:54:07.309453  166730 logs.go:123] Gathering logs for dmesg ...
	I0630 20:54:07.309500  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0630 20:54:07.339545  166730 out.go:309] Setting ErrFile to fd 2...
	I0630 20:54:07.339642  166730 out.go:343] TERM=,COLORTERM=, which probably does not support color
	W0630 20:54:07.339849  166730 out.go:239] X Problems detected in kubelet:
	X Problems detected in kubelet:
	W0630 20:54:07.339906  166730 out.go:239]   Jun 30 20:54:06 kubernetes-upgrade-20220630205032-9950 kubelet[4101]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	  Jun 30 20:54:06 kubernetes-upgrade-20220630205032-9950 kubelet[4101]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	I0630 20:54:07.339915  166730 out.go:309] Setting ErrFile to fd 2...
	I0630 20:54:07.339927  166730 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 20:54:17.341440  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:54:17.781864  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
	I0630 20:54:17.781991  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I0630 20:54:17.814133  166730 cri.go:87] found id: ""
	I0630 20:54:17.814163  166730 logs.go:274] 0 containers: []
	W0630 20:54:17.814174  166730 logs.go:276] No container was found matching "kube-apiserver"
	I0630 20:54:17.814183  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
	I0630 20:54:17.814252  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I0630 20:54:17.839529  166730 cri.go:87] found id: ""
	I0630 20:54:17.839563  166730 logs.go:274] 0 containers: []
	W0630 20:54:17.839576  166730 logs.go:276] No container was found matching "etcd"
	I0630 20:54:17.839584  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
	I0630 20:54:17.839636  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I0630 20:54:17.864351  166730 cri.go:87] found id: ""
	I0630 20:54:17.864376  166730 logs.go:274] 0 containers: []
	W0630 20:54:17.864383  166730 logs.go:276] No container was found matching "coredns"
	I0630 20:54:17.864388  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
	I0630 20:54:17.864427  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I0630 20:54:17.889669  166730 cri.go:87] found id: ""
	I0630 20:54:17.889696  166730 logs.go:274] 0 containers: []
	W0630 20:54:17.889702  166730 logs.go:276] No container was found matching "kube-scheduler"
	I0630 20:54:17.889713  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
	I0630 20:54:17.889760  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I0630 20:54:17.915289  166730 cri.go:87] found id: ""
	I0630 20:54:17.915319  166730 logs.go:274] 0 containers: []
	W0630 20:54:17.915331  166730 logs.go:276] No container was found matching "kube-proxy"
	I0630 20:54:17.915339  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
	I0630 20:54:17.915397  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
	I0630 20:54:17.946132  166730 cri.go:87] found id: ""
	I0630 20:54:17.946156  166730 logs.go:274] 0 containers: []
	W0630 20:54:17.946163  166730 logs.go:276] No container was found matching "kubernetes-dashboard"
	I0630 20:54:17.946169  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
	I0630 20:54:17.946216  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
	I0630 20:54:17.975572  166730 cri.go:87] found id: ""
	I0630 20:54:17.975594  166730 logs.go:274] 0 containers: []
	W0630 20:54:17.975606  166730 logs.go:276] No container was found matching "storage-provisioner"
	I0630 20:54:17.975614  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
	I0630 20:54:17.975667  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I0630 20:54:18.003487  166730 cri.go:87] found id: ""
	I0630 20:54:18.003518  166730 logs.go:274] 0 containers: []
	W0630 20:54:18.003527  166730 logs.go:276] No container was found matching "kube-controller-manager"
	I0630 20:54:18.003539  166730 logs.go:123] Gathering logs for kubelet ...
	I0630 20:54:18.003554  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	W0630 20:54:18.063488  166730 logs.go:138] Found kubelet problem: Jun 30 20:54:17 kubernetes-upgrade-20220630205032-9950 kubelet[4406]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	I0630 20:54:18.115402  166730 logs.go:123] Gathering logs for dmesg ...
	I0630 20:54:18.115442  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0630 20:54:18.135700  166730 logs.go:123] Gathering logs for describe nodes ...
	I0630 20:54:18.135773  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	W0630 20:54:18.200170  166730 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	 output: 
	** stderr ** 
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	
	** /stderr **
	I0630 20:54:18.200202  166730 logs.go:123] Gathering logs for containerd ...
	I0630 20:54:18.200216  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
	I0630 20:54:18.242490  166730 logs.go:123] Gathering logs for container status ...
	I0630 20:54:18.242534  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0630 20:54:18.288564  166730 out.go:309] Setting ErrFile to fd 2...
	I0630 20:54:18.288601  166730 out.go:343] TERM=,COLORTERM=, which probably does not support color
	W0630 20:54:18.288755  166730 out.go:239] X Problems detected in kubelet:
	X Problems detected in kubelet:
	W0630 20:54:18.288777  166730 out.go:239]   Jun 30 20:54:17 kubernetes-upgrade-20220630205032-9950 kubelet[4406]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	  Jun 30 20:54:17 kubernetes-upgrade-20220630205032-9950 kubelet[4406]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	I0630 20:54:18.288786  166730 out.go:309] Setting ErrFile to fd 2...
	I0630 20:54:18.288795  166730 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 20:54:28.290269  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:54:28.781730  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
	I0630 20:54:28.781809  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I0630 20:54:28.809443  166730 cri.go:87] found id: ""
	I0630 20:54:28.809473  166730 logs.go:274] 0 containers: []
	W0630 20:54:28.809483  166730 logs.go:276] No container was found matching "kube-apiserver"
	I0630 20:54:28.809493  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
	I0630 20:54:28.809550  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I0630 20:54:28.837363  166730 cri.go:87] found id: ""
	I0630 20:54:28.837391  166730 logs.go:274] 0 containers: []
	W0630 20:54:28.837398  166730 logs.go:276] No container was found matching "etcd"
	I0630 20:54:28.837403  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
	I0630 20:54:28.837444  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I0630 20:54:28.864155  166730 cri.go:87] found id: ""
	I0630 20:54:28.864181  166730 logs.go:274] 0 containers: []
	W0630 20:54:28.864188  166730 logs.go:276] No container was found matching "coredns"
	I0630 20:54:28.864198  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
	I0630 20:54:28.864247  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I0630 20:54:28.890863  166730 cri.go:87] found id: ""
	I0630 20:54:28.890887  166730 logs.go:274] 0 containers: []
	W0630 20:54:28.890894  166730 logs.go:276] No container was found matching "kube-scheduler"
	I0630 20:54:28.890900  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
	I0630 20:54:28.890952  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I0630 20:54:28.916072  166730 cri.go:87] found id: ""
	I0630 20:54:28.916103  166730 logs.go:274] 0 containers: []
	W0630 20:54:28.916112  166730 logs.go:276] No container was found matching "kube-proxy"
	I0630 20:54:28.916120  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
	I0630 20:54:28.916172  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
	I0630 20:54:28.940077  166730 cri.go:87] found id: ""
	I0630 20:54:28.940106  166730 logs.go:274] 0 containers: []
	W0630 20:54:28.940117  166730 logs.go:276] No container was found matching "kubernetes-dashboard"
	I0630 20:54:28.940125  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
	I0630 20:54:28.940176  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
	I0630 20:54:28.964182  166730 cri.go:87] found id: ""
	I0630 20:54:28.964218  166730 logs.go:274] 0 containers: []
	W0630 20:54:28.964224  166730 logs.go:276] No container was found matching "storage-provisioner"
	I0630 20:54:28.964230  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
	I0630 20:54:28.964280  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I0630 20:54:28.988555  166730 cri.go:87] found id: ""
	I0630 20:54:28.988583  166730 logs.go:274] 0 containers: []
	W0630 20:54:28.988592  166730 logs.go:276] No container was found matching "kube-controller-manager"
	I0630 20:54:28.988603  166730 logs.go:123] Gathering logs for kubelet ...
	I0630 20:54:28.988618  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	W0630 20:54:29.037202  166730 logs.go:138] Found kubelet problem: Jun 30 20:54:28 kubernetes-upgrade-20220630205032-9950 kubelet[4692]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	I0630 20:54:29.085796  166730 logs.go:123] Gathering logs for dmesg ...
	I0630 20:54:29.085829  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0630 20:54:29.102294  166730 logs.go:123] Gathering logs for describe nodes ...
	I0630 20:54:29.102325  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	W0630 20:54:29.153169  166730 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	 output: 
	** stderr ** 
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	
	** /stderr **
	I0630 20:54:29.153197  166730 logs.go:123] Gathering logs for containerd ...
	I0630 20:54:29.153211  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
	I0630 20:54:29.205711  166730 logs.go:123] Gathering logs for container status ...
	I0630 20:54:29.205757  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0630 20:54:29.233456  166730 out.go:309] Setting ErrFile to fd 2...
	I0630 20:54:29.233486  166730 out.go:343] TERM=,COLORTERM=, which probably does not support color
	W0630 20:54:29.233607  166730 out.go:239] X Problems detected in kubelet:
	X Problems detected in kubelet:
	W0630 20:54:29.233624  166730 out.go:239]   Jun 30 20:54:28 kubernetes-upgrade-20220630205032-9950 kubelet[4692]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	  Jun 30 20:54:28 kubernetes-upgrade-20220630205032-9950 kubelet[4692]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	I0630 20:54:29.233630  166730 out.go:309] Setting ErrFile to fd 2...
	I0630 20:54:29.233637  166730 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 20:54:39.234859  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:54:39.282124  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
	I0630 20:54:39.282226  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I0630 20:54:39.311602  166730 cri.go:87] found id: ""
	I0630 20:54:39.311627  166730 logs.go:274] 0 containers: []
	W0630 20:54:39.311636  166730 logs.go:276] No container was found matching "kube-apiserver"
	I0630 20:54:39.311645  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
	I0630 20:54:39.311691  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I0630 20:54:39.340505  166730 cri.go:87] found id: ""
	I0630 20:54:39.340536  166730 logs.go:274] 0 containers: []
	W0630 20:54:39.340548  166730 logs.go:276] No container was found matching "etcd"
	I0630 20:54:39.340556  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
	I0630 20:54:39.340613  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I0630 20:54:39.369361  166730 cri.go:87] found id: ""
	I0630 20:54:39.369391  166730 logs.go:274] 0 containers: []
	W0630 20:54:39.369400  166730 logs.go:276] No container was found matching "coredns"
	I0630 20:54:39.369408  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
	I0630 20:54:39.369468  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I0630 20:54:39.401447  166730 cri.go:87] found id: ""
	I0630 20:54:39.401480  166730 logs.go:274] 0 containers: []
	W0630 20:54:39.401490  166730 logs.go:276] No container was found matching "kube-scheduler"
	I0630 20:54:39.401499  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
	I0630 20:54:39.401558  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I0630 20:54:39.431105  166730 cri.go:87] found id: ""
	I0630 20:54:39.431134  166730 logs.go:274] 0 containers: []
	W0630 20:54:39.431142  166730 logs.go:276] No container was found matching "kube-proxy"
	I0630 20:54:39.431150  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
	I0630 20:54:39.431205  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
	I0630 20:54:39.460705  166730 cri.go:87] found id: ""
	I0630 20:54:39.460732  166730 logs.go:274] 0 containers: []
	W0630 20:54:39.460739  166730 logs.go:276] No container was found matching "kubernetes-dashboard"
	I0630 20:54:39.460746  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
	I0630 20:54:39.460794  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
	I0630 20:54:39.486054  166730 cri.go:87] found id: ""
	I0630 20:54:39.486084  166730 logs.go:274] 0 containers: []
	W0630 20:54:39.486093  166730 logs.go:276] No container was found matching "storage-provisioner"
	I0630 20:54:39.486101  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
	I0630 20:54:39.486158  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I0630 20:54:39.510776  166730 cri.go:87] found id: ""
	I0630 20:54:39.510820  166730 logs.go:274] 0 containers: []
	W0630 20:54:39.510829  166730 logs.go:276] No container was found matching "kube-controller-manager"
	I0630 20:54:39.510841  166730 logs.go:123] Gathering logs for container status ...
	I0630 20:54:39.510861  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0630 20:54:39.539623  166730 logs.go:123] Gathering logs for kubelet ...
	I0630 20:54:39.539656  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	W0630 20:54:39.610137  166730 logs.go:138] Found kubelet problem: Jun 30 20:54:38 kubernetes-upgrade-20220630205032-9950 kubelet[4982]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	I0630 20:54:39.659643  166730 logs.go:123] Gathering logs for dmesg ...
	I0630 20:54:39.659698  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0630 20:54:39.676595  166730 logs.go:123] Gathering logs for describe nodes ...
	I0630 20:54:39.676625  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	W0630 20:54:39.729872  166730 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	 output: 
	** stderr ** 
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	
	** /stderr **
	I0630 20:54:39.729894  166730 logs.go:123] Gathering logs for containerd ...
	I0630 20:54:39.729905  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
	I0630 20:54:39.767919  166730 out.go:309] Setting ErrFile to fd 2...
	I0630 20:54:39.767948  166730 out.go:343] TERM=,COLORTERM=, which probably does not support color
	W0630 20:54:39.768071  166730 out.go:239] X Problems detected in kubelet:
	X Problems detected in kubelet:
	W0630 20:54:39.768090  166730 out.go:239]   Jun 30 20:54:38 kubernetes-upgrade-20220630205032-9950 kubelet[4982]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	  Jun 30 20:54:38 kubernetes-upgrade-20220630205032-9950 kubelet[4982]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	I0630 20:54:39.768097  166730 out.go:309] Setting ErrFile to fd 2...
	I0630 20:54:39.768105  166730 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 20:54:49.769191  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:54:50.282553  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
	I0630 20:54:50.282631  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I0630 20:54:50.322527  166730 cri.go:87] found id: ""
	I0630 20:54:50.322552  166730 logs.go:274] 0 containers: []
	W0630 20:54:50.322558  166730 logs.go:276] No container was found matching "kube-apiserver"
	I0630 20:54:50.322564  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
	I0630 20:54:50.322606  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I0630 20:54:50.355188  166730 cri.go:87] found id: ""
	I0630 20:54:50.355220  166730 logs.go:274] 0 containers: []
	W0630 20:54:50.355229  166730 logs.go:276] No container was found matching "etcd"
	I0630 20:54:50.355237  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
	I0630 20:54:50.355295  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I0630 20:54:50.382332  166730 cri.go:87] found id: ""
	I0630 20:54:50.382358  166730 logs.go:274] 0 containers: []
	W0630 20:54:50.382365  166730 logs.go:276] No container was found matching "coredns"
	I0630 20:54:50.382373  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
	I0630 20:54:50.382426  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I0630 20:54:50.407725  166730 cri.go:87] found id: ""
	I0630 20:54:50.407754  166730 logs.go:274] 0 containers: []
	W0630 20:54:50.407762  166730 logs.go:276] No container was found matching "kube-scheduler"
	I0630 20:54:50.407771  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
	I0630 20:54:50.407824  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I0630 20:54:50.436457  166730 cri.go:87] found id: ""
	I0630 20:54:50.436488  166730 logs.go:274] 0 containers: []
	W0630 20:54:50.436514  166730 logs.go:276] No container was found matching "kube-proxy"
	I0630 20:54:50.436523  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
	I0630 20:54:50.436589  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
	I0630 20:54:50.470441  166730 cri.go:87] found id: ""
	I0630 20:54:50.470468  166730 logs.go:274] 0 containers: []
	W0630 20:54:50.470478  166730 logs.go:276] No container was found matching "kubernetes-dashboard"
	I0630 20:54:50.470491  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
	I0630 20:54:50.470549  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
	I0630 20:54:50.502908  166730 cri.go:87] found id: ""
	I0630 20:54:50.502935  166730 logs.go:274] 0 containers: []
	W0630 20:54:50.502943  166730 logs.go:276] No container was found matching "storage-provisioner"
	I0630 20:54:50.502951  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
	I0630 20:54:50.503004  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I0630 20:54:50.533341  166730 cri.go:87] found id: ""
	I0630 20:54:50.533370  166730 logs.go:274] 0 containers: []
	W0630 20:54:50.533378  166730 logs.go:276] No container was found matching "kube-controller-manager"
	I0630 20:54:50.533390  166730 logs.go:123] Gathering logs for kubelet ...
	I0630 20:54:50.533405  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	W0630 20:54:50.588222  166730 logs.go:138] Found kubelet problem: Jun 30 20:54:50 kubernetes-upgrade-20220630205032-9950 kubelet[5288]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	I0630 20:54:50.638567  166730 logs.go:123] Gathering logs for dmesg ...
	I0630 20:54:50.638605  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0630 20:54:50.658087  166730 logs.go:123] Gathering logs for describe nodes ...
	I0630 20:54:50.658120  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	W0630 20:54:50.719357  166730 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	 output: 
	** stderr ** 
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	
	** /stderr **
	I0630 20:54:50.719390  166730 logs.go:123] Gathering logs for containerd ...
	I0630 20:54:50.719404  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
	I0630 20:54:50.768516  166730 logs.go:123] Gathering logs for container status ...
	I0630 20:54:50.768565  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0630 20:54:50.811770  166730 out.go:309] Setting ErrFile to fd 2...
	I0630 20:54:50.811799  166730 out.go:343] TERM=,COLORTERM=, which probably does not support color
	W0630 20:54:50.811942  166730 out.go:239] X Problems detected in kubelet:
	X Problems detected in kubelet:
	W0630 20:54:50.811967  166730 out.go:239]   Jun 30 20:54:50 kubernetes-upgrade-20220630205032-9950 kubelet[5288]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	  Jun 30 20:54:50 kubernetes-upgrade-20220630205032-9950 kubelet[5288]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	I0630 20:54:50.811979  166730 out.go:309] Setting ErrFile to fd 2...
	I0630 20:54:50.811993  166730 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 20:55:00.813470  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:55:01.282167  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
	I0630 20:55:01.282237  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I0630 20:55:01.316418  166730 cri.go:87] found id: ""
	I0630 20:55:01.316451  166730 logs.go:274] 0 containers: []
	W0630 20:55:01.316460  166730 logs.go:276] No container was found matching "kube-apiserver"
	I0630 20:55:01.316468  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
	I0630 20:55:01.316523  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I0630 20:55:01.350741  166730 cri.go:87] found id: ""
	I0630 20:55:01.350771  166730 logs.go:274] 0 containers: []
	W0630 20:55:01.350780  166730 logs.go:276] No container was found matching "etcd"
	I0630 20:55:01.350787  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
	I0630 20:55:01.350838  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I0630 20:55:01.389800  166730 cri.go:87] found id: ""
	I0630 20:55:01.389823  166730 logs.go:274] 0 containers: []
	W0630 20:55:01.389832  166730 logs.go:276] No container was found matching "coredns"
	I0630 20:55:01.389840  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
	I0630 20:55:01.389889  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I0630 20:55:01.418650  166730 cri.go:87] found id: ""
	I0630 20:55:01.418682  166730 logs.go:274] 0 containers: []
	W0630 20:55:01.418691  166730 logs.go:276] No container was found matching "kube-scheduler"
	I0630 20:55:01.418699  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
	I0630 20:55:01.418770  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I0630 20:55:01.449532  166730 cri.go:87] found id: ""
	I0630 20:55:01.449559  166730 logs.go:274] 0 containers: []
	W0630 20:55:01.449567  166730 logs.go:276] No container was found matching "kube-proxy"
	I0630 20:55:01.449575  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
	I0630 20:55:01.449632  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
	I0630 20:55:01.491134  166730 cri.go:87] found id: ""
	I0630 20:55:01.491162  166730 logs.go:274] 0 containers: []
	W0630 20:55:01.491170  166730 logs.go:276] No container was found matching "kubernetes-dashboard"
	I0630 20:55:01.491178  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
	I0630 20:55:01.491226  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
	I0630 20:55:01.522953  166730 cri.go:87] found id: ""
	I0630 20:55:01.522979  166730 logs.go:274] 0 containers: []
	W0630 20:55:01.522987  166730 logs.go:276] No container was found matching "storage-provisioner"
	I0630 20:55:01.522994  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
	I0630 20:55:01.523058  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I0630 20:55:01.557198  166730 cri.go:87] found id: ""
	I0630 20:55:01.557224  166730 logs.go:274] 0 containers: []
	W0630 20:55:01.557237  166730 logs.go:276] No container was found matching "kube-controller-manager"
	I0630 20:55:01.557248  166730 logs.go:123] Gathering logs for kubelet ...
	I0630 20:55:01.557265  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	W0630 20:55:01.614912  166730 logs.go:138] Found kubelet problem: Jun 30 20:55:01 kubernetes-upgrade-20220630205032-9950 kubelet[5588]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	I0630 20:55:01.681604  166730 logs.go:123] Gathering logs for dmesg ...
	I0630 20:55:01.681651  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0630 20:55:01.702883  166730 logs.go:123] Gathering logs for describe nodes ...
	I0630 20:55:01.702918  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	W0630 20:55:01.772344  166730 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	 output: 
	** stderr ** 
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	
	** /stderr **
	I0630 20:55:01.772366  166730 logs.go:123] Gathering logs for containerd ...
	I0630 20:55:01.772377  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
	I0630 20:55:01.816698  166730 logs.go:123] Gathering logs for container status ...
	I0630 20:55:01.816733  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0630 20:55:01.858519  166730 out.go:309] Setting ErrFile to fd 2...
	I0630 20:55:01.858554  166730 out.go:343] TERM=,COLORTERM=, which probably does not support color
	W0630 20:55:01.858674  166730 out.go:239] X Problems detected in kubelet:
	X Problems detected in kubelet:
	W0630 20:55:01.858696  166730 out.go:239]   Jun 30 20:55:01 kubernetes-upgrade-20220630205032-9950 kubelet[5588]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	  Jun 30 20:55:01 kubernetes-upgrade-20220630205032-9950 kubelet[5588]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	I0630 20:55:01.858703  166730 out.go:309] Setting ErrFile to fd 2...
	I0630 20:55:01.858710  166730 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 20:55:11.860054  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:55:12.282142  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
	I0630 20:55:12.282209  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I0630 20:55:12.314170  166730 cri.go:87] found id: ""
	I0630 20:55:12.314201  166730 logs.go:274] 0 containers: []
	W0630 20:55:12.314212  166730 logs.go:276] No container was found matching "kube-apiserver"
	I0630 20:55:12.314220  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
	I0630 20:55:12.314277  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I0630 20:55:12.345301  166730 cri.go:87] found id: ""
	I0630 20:55:12.345330  166730 logs.go:274] 0 containers: []
	W0630 20:55:12.345339  166730 logs.go:276] No container was found matching "etcd"
	I0630 20:55:12.345347  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
	I0630 20:55:12.345404  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I0630 20:55:12.371389  166730 cri.go:87] found id: ""
	I0630 20:55:12.371415  166730 logs.go:274] 0 containers: []
	W0630 20:55:12.371423  166730 logs.go:276] No container was found matching "coredns"
	I0630 20:55:12.371432  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
	I0630 20:55:12.371489  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I0630 20:55:12.402108  166730 cri.go:87] found id: ""
	I0630 20:55:12.402141  166730 logs.go:274] 0 containers: []
	W0630 20:55:12.402149  166730 logs.go:276] No container was found matching "kube-scheduler"
	I0630 20:55:12.402157  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
	I0630 20:55:12.402208  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I0630 20:55:12.443415  166730 cri.go:87] found id: ""
	I0630 20:55:12.443448  166730 logs.go:274] 0 containers: []
	W0630 20:55:12.443458  166730 logs.go:276] No container was found matching "kube-proxy"
	I0630 20:55:12.443467  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
	I0630 20:55:12.443522  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
	I0630 20:55:12.469676  166730 cri.go:87] found id: ""
	I0630 20:55:12.469701  166730 logs.go:274] 0 containers: []
	W0630 20:55:12.469709  166730 logs.go:276] No container was found matching "kubernetes-dashboard"
	I0630 20:55:12.469717  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
	I0630 20:55:12.469773  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
	I0630 20:55:12.506112  166730 cri.go:87] found id: ""
	I0630 20:55:12.506145  166730 logs.go:274] 0 containers: []
	W0630 20:55:12.506155  166730 logs.go:276] No container was found matching "storage-provisioner"
	I0630 20:55:12.506163  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
	I0630 20:55:12.506217  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I0630 20:55:12.539673  166730 cri.go:87] found id: ""
	I0630 20:55:12.539717  166730 logs.go:274] 0 containers: []
	W0630 20:55:12.539726  166730 logs.go:276] No container was found matching "kube-controller-manager"
	I0630 20:55:12.539737  166730 logs.go:123] Gathering logs for kubelet ...
	I0630 20:55:12.539753  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	W0630 20:55:12.605762  166730 logs.go:138] Found kubelet problem: Jun 30 20:55:11 kubernetes-upgrade-20220630205032-9950 kubelet[5866]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	I0630 20:55:12.655001  166730 logs.go:123] Gathering logs for dmesg ...
	I0630 20:55:12.655038  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0630 20:55:12.673642  166730 logs.go:123] Gathering logs for describe nodes ...
	I0630 20:55:12.673683  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	W0630 20:55:12.748987  166730 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	 output: 
	** stderr ** 
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	
	** /stderr **
	I0630 20:55:12.749012  166730 logs.go:123] Gathering logs for containerd ...
	I0630 20:55:12.749025  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
	I0630 20:55:12.808308  166730 logs.go:123] Gathering logs for container status ...
	I0630 20:55:12.808363  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0630 20:55:12.843923  166730 out.go:309] Setting ErrFile to fd 2...
	I0630 20:55:12.843957  166730 out.go:343] TERM=,COLORTERM=, which probably does not support color
	W0630 20:55:12.844090  166730 out.go:239] X Problems detected in kubelet:
	X Problems detected in kubelet:
	W0630 20:55:12.844106  166730 out.go:239]   Jun 30 20:55:11 kubernetes-upgrade-20220630205032-9950 kubelet[5866]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	  Jun 30 20:55:11 kubernetes-upgrade-20220630205032-9950 kubelet[5866]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	I0630 20:55:12.844124  166730 out.go:309] Setting ErrFile to fd 2...
	I0630 20:55:12.844132  166730 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 20:55:22.846057  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:55:23.281665  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
	I0630 20:55:23.281743  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I0630 20:55:23.308304  166730 cri.go:87] found id: ""
	I0630 20:55:23.308331  166730 logs.go:274] 0 containers: []
	W0630 20:55:23.308340  166730 logs.go:276] No container was found matching "kube-apiserver"
	I0630 20:55:23.308348  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
	I0630 20:55:23.308404  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I0630 20:55:23.332259  166730 cri.go:87] found id: ""
	I0630 20:55:23.332290  166730 logs.go:274] 0 containers: []
	W0630 20:55:23.332299  166730 logs.go:276] No container was found matching "etcd"
	I0630 20:55:23.332307  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
	I0630 20:55:23.332368  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I0630 20:55:23.356649  166730 cri.go:87] found id: ""
	I0630 20:55:23.356684  166730 logs.go:274] 0 containers: []
	W0630 20:55:23.356692  166730 logs.go:276] No container was found matching "coredns"
	I0630 20:55:23.356700  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
	I0630 20:55:23.356749  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I0630 20:55:23.382607  166730 cri.go:87] found id: ""
	I0630 20:55:23.382665  166730 logs.go:274] 0 containers: []
	W0630 20:55:23.382674  166730 logs.go:276] No container was found matching "kube-scheduler"
	I0630 20:55:23.382682  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
	I0630 20:55:23.382733  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I0630 20:55:23.407253  166730 cri.go:87] found id: ""
	I0630 20:55:23.407283  166730 logs.go:274] 0 containers: []
	W0630 20:55:23.407292  166730 logs.go:276] No container was found matching "kube-proxy"
	I0630 20:55:23.407300  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
	I0630 20:55:23.407351  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
	I0630 20:55:23.432416  166730 cri.go:87] found id: ""
	I0630 20:55:23.432439  166730 logs.go:274] 0 containers: []
	W0630 20:55:23.432445  166730 logs.go:276] No container was found matching "kubernetes-dashboard"
	I0630 20:55:23.432451  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
	I0630 20:55:23.432493  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
	I0630 20:55:23.456923  166730 cri.go:87] found id: ""
	I0630 20:55:23.456949  166730 logs.go:274] 0 containers: []
	W0630 20:55:23.456957  166730 logs.go:276] No container was found matching "storage-provisioner"
	I0630 20:55:23.456965  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
	I0630 20:55:23.457024  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I0630 20:55:23.481678  166730 cri.go:87] found id: ""
	I0630 20:55:23.481707  166730 logs.go:274] 0 containers: []
	W0630 20:55:23.481714  166730 logs.go:276] No container was found matching "kube-controller-manager"
	I0630 20:55:23.481724  166730 logs.go:123] Gathering logs for kubelet ...
	I0630 20:55:23.481742  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	W0630 20:55:23.530149  166730 logs.go:138] Found kubelet problem: Jun 30 20:55:23 kubernetes-upgrade-20220630205032-9950 kubelet[6164]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	I0630 20:55:23.588501  166730 logs.go:123] Gathering logs for dmesg ...
	I0630 20:55:23.588550  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0630 20:55:23.603780  166730 logs.go:123] Gathering logs for describe nodes ...
	I0630 20:55:23.603817  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	W0630 20:55:23.654235  166730 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	 output: 
	** stderr ** 
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	
	** /stderr **
	I0630 20:55:23.654263  166730 logs.go:123] Gathering logs for containerd ...
	I0630 20:55:23.654276  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
	I0630 20:55:23.690689  166730 logs.go:123] Gathering logs for container status ...
	I0630 20:55:23.690724  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0630 20:55:23.717468  166730 out.go:309] Setting ErrFile to fd 2...
	I0630 20:55:23.717493  166730 out.go:343] TERM=,COLORTERM=, which probably does not support color
	W0630 20:55:23.717596  166730 out.go:239] X Problems detected in kubelet:
	X Problems detected in kubelet:
	W0630 20:55:23.717609  166730 out.go:239]   Jun 30 20:55:23 kubernetes-upgrade-20220630205032-9950 kubelet[6164]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	  Jun 30 20:55:23 kubernetes-upgrade-20220630205032-9950 kubelet[6164]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	I0630 20:55:23.717615  166730 out.go:309] Setting ErrFile to fd 2...
	I0630 20:55:23.717620  166730 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 20:55:33.718491  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:55:33.782515  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
	I0630 20:55:33.782601  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I0630 20:55:33.813757  166730 cri.go:87] found id: ""
	I0630 20:55:33.813783  166730 logs.go:274] 0 containers: []
	W0630 20:55:33.813792  166730 logs.go:276] No container was found matching "kube-apiserver"
	I0630 20:55:33.813801  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
	I0630 20:55:33.813858  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I0630 20:55:33.852916  166730 cri.go:87] found id: ""
	I0630 20:55:33.852946  166730 logs.go:274] 0 containers: []
	W0630 20:55:33.852954  166730 logs.go:276] No container was found matching "etcd"
	I0630 20:55:33.852962  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
	I0630 20:55:33.853024  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I0630 20:55:33.886406  166730 cri.go:87] found id: ""
	I0630 20:55:33.886437  166730 logs.go:274] 0 containers: []
	W0630 20:55:33.886445  166730 logs.go:276] No container was found matching "coredns"
	I0630 20:55:33.886453  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
	I0630 20:55:33.886517  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I0630 20:55:33.919173  166730 cri.go:87] found id: ""
	I0630 20:55:33.919200  166730 logs.go:274] 0 containers: []
	W0630 20:55:33.919209  166730 logs.go:276] No container was found matching "kube-scheduler"
	I0630 20:55:33.919217  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
	I0630 20:55:33.919275  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I0630 20:55:33.952474  166730 cri.go:87] found id: ""
	I0630 20:55:33.952512  166730 logs.go:274] 0 containers: []
	W0630 20:55:33.952521  166730 logs.go:276] No container was found matching "kube-proxy"
	I0630 20:55:33.952529  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
	I0630 20:55:33.952591  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
	I0630 20:55:33.989550  166730 cri.go:87] found id: ""
	I0630 20:55:33.989578  166730 logs.go:274] 0 containers: []
	W0630 20:55:33.989586  166730 logs.go:276] No container was found matching "kubernetes-dashboard"
	I0630 20:55:33.989594  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
	I0630 20:55:33.989653  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
	I0630 20:55:34.026948  166730 cri.go:87] found id: ""
	I0630 20:55:34.026976  166730 logs.go:274] 0 containers: []
	W0630 20:55:34.026985  166730 logs.go:276] No container was found matching "storage-provisioner"
	I0630 20:55:34.026992  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
	I0630 20:55:34.027055  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I0630 20:55:34.074656  166730 cri.go:87] found id: ""
	I0630 20:55:34.074686  166730 logs.go:274] 0 containers: []
	W0630 20:55:34.074696  166730 logs.go:276] No container was found matching "kube-controller-manager"
	I0630 20:55:34.074708  166730 logs.go:123] Gathering logs for kubelet ...
	I0630 20:55:34.074721  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	W0630 20:55:34.143694  166730 logs.go:138] Found kubelet problem: Jun 30 20:55:33 kubernetes-upgrade-20220630205032-9950 kubelet[6451]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	I0630 20:55:34.219939  166730 logs.go:123] Gathering logs for dmesg ...
	I0630 20:55:34.219989  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0630 20:55:34.237752  166730 logs.go:123] Gathering logs for describe nodes ...
	I0630 20:55:34.237791  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	W0630 20:55:34.301853  166730 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	 output: 
	** stderr ** 
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	
	** /stderr **
	I0630 20:55:34.301874  166730 logs.go:123] Gathering logs for containerd ...
	I0630 20:55:34.301885  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
	I0630 20:55:34.356929  166730 logs.go:123] Gathering logs for container status ...
	I0630 20:55:34.356991  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0630 20:55:34.389619  166730 out.go:309] Setting ErrFile to fd 2...
	I0630 20:55:34.389652  166730 out.go:343] TERM=,COLORTERM=, which probably does not support color
	W0630 20:55:34.389799  166730 out.go:239] X Problems detected in kubelet:
	X Problems detected in kubelet:
	W0630 20:55:34.389821  166730 out.go:239]   Jun 30 20:55:33 kubernetes-upgrade-20220630205032-9950 kubelet[6451]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	  Jun 30 20:55:33 kubernetes-upgrade-20220630205032-9950 kubelet[6451]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	I0630 20:55:34.389828  166730 out.go:309] Setting ErrFile to fd 2...
	I0630 20:55:34.389835  166730 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 20:55:44.391595  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:55:44.782426  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
	I0630 20:55:44.782503  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I0630 20:55:44.815920  166730 cri.go:87] found id: ""
	I0630 20:55:44.815947  166730 logs.go:274] 0 containers: []
	W0630 20:55:44.815956  166730 logs.go:276] No container was found matching "kube-apiserver"
	I0630 20:55:44.815966  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
	I0630 20:55:44.816019  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I0630 20:55:44.853352  166730 cri.go:87] found id: ""
	I0630 20:55:44.853381  166730 logs.go:274] 0 containers: []
	W0630 20:55:44.853390  166730 logs.go:276] No container was found matching "etcd"
	I0630 20:55:44.853398  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
	I0630 20:55:44.853451  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I0630 20:55:44.883758  166730 cri.go:87] found id: ""
	I0630 20:55:44.883788  166730 logs.go:274] 0 containers: []
	W0630 20:55:44.883797  166730 logs.go:276] No container was found matching "coredns"
	I0630 20:55:44.883808  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
	I0630 20:55:44.883861  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I0630 20:55:45.010738  166730 cri.go:87] found id: ""
	I0630 20:55:45.010767  166730 logs.go:274] 0 containers: []
	W0630 20:55:45.010774  166730 logs.go:276] No container was found matching "kube-scheduler"
	I0630 20:55:45.010780  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
	I0630 20:55:45.010834  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I0630 20:55:45.046022  166730 cri.go:87] found id: ""
	I0630 20:55:45.046052  166730 logs.go:274] 0 containers: []
	W0630 20:55:45.046061  166730 logs.go:276] No container was found matching "kube-proxy"
	I0630 20:55:45.046069  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
	I0630 20:55:45.046121  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
	I0630 20:55:45.082049  166730 cri.go:87] found id: ""
	I0630 20:55:45.082081  166730 logs.go:274] 0 containers: []
	W0630 20:55:45.082089  166730 logs.go:276] No container was found matching "kubernetes-dashboard"
	I0630 20:55:45.082100  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
	I0630 20:55:45.082155  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
	I0630 20:55:45.111253  166730 cri.go:87] found id: ""
	I0630 20:55:45.111278  166730 logs.go:274] 0 containers: []
	W0630 20:55:45.111285  166730 logs.go:276] No container was found matching "storage-provisioner"
	I0630 20:55:45.111291  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
	I0630 20:55:45.111339  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I0630 20:55:45.141541  166730 cri.go:87] found id: ""
	I0630 20:55:45.141569  166730 logs.go:274] 0 containers: []
	W0630 20:55:45.141579  166730 logs.go:276] No container was found matching "kube-controller-manager"
	I0630 20:55:45.141591  166730 logs.go:123] Gathering logs for dmesg ...
	I0630 20:55:45.141607  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0630 20:55:45.162712  166730 logs.go:123] Gathering logs for describe nodes ...
	I0630 20:55:45.162748  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	W0630 20:55:45.229843  166730 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	 output: 
	** stderr ** 
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	
	** /stderr **
	I0630 20:55:45.229876  166730 logs.go:123] Gathering logs for containerd ...
	I0630 20:55:45.229891  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
	I0630 20:55:45.279559  166730 logs.go:123] Gathering logs for container status ...
	I0630 20:55:45.279595  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0630 20:55:45.310726  166730 logs.go:123] Gathering logs for kubelet ...
	I0630 20:55:45.310766  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	W0630 20:55:45.374121  166730 logs.go:138] Found kubelet problem: Jun 30 20:55:44 kubernetes-upgrade-20220630205032-9950 kubelet[6758]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	I0630 20:55:45.449500  166730 out.go:309] Setting ErrFile to fd 2...
	I0630 20:55:45.449538  166730 out.go:343] TERM=,COLORTERM=, which probably does not support color
	W0630 20:55:45.449706  166730 out.go:239] X Problems detected in kubelet:
	X Problems detected in kubelet:
	W0630 20:55:45.449724  166730 out.go:239]   Jun 30 20:55:44 kubernetes-upgrade-20220630205032-9950 kubelet[6758]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	  Jun 30 20:55:44 kubernetes-upgrade-20220630205032-9950 kubelet[6758]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	I0630 20:55:45.449730  166730 out.go:309] Setting ErrFile to fd 2...
	I0630 20:55:45.449738  166730 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 20:55:55.450574  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:55:55.782242  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
	I0630 20:55:55.782313  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I0630 20:55:55.812323  166730 cri.go:87] found id: ""
	I0630 20:55:55.812354  166730 logs.go:274] 0 containers: []
	W0630 20:55:55.812363  166730 logs.go:276] No container was found matching "kube-apiserver"
	I0630 20:55:55.812371  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
	I0630 20:55:55.812425  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I0630 20:55:55.838877  166730 cri.go:87] found id: ""
	I0630 20:55:55.838905  166730 logs.go:274] 0 containers: []
	W0630 20:55:55.838917  166730 logs.go:276] No container was found matching "etcd"
	I0630 20:55:55.838925  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
	I0630 20:55:55.838985  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I0630 20:55:55.867225  166730 cri.go:87] found id: ""
	I0630 20:55:55.867249  166730 logs.go:274] 0 containers: []
	W0630 20:55:55.867273  166730 logs.go:276] No container was found matching "coredns"
	I0630 20:55:55.867282  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
	I0630 20:55:55.867338  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I0630 20:55:55.893546  166730 cri.go:87] found id: ""
	I0630 20:55:55.893578  166730 logs.go:274] 0 containers: []
	W0630 20:55:55.893585  166730 logs.go:276] No container was found matching "kube-scheduler"
	I0630 20:55:55.893591  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
	I0630 20:55:55.893632  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I0630 20:55:55.917280  166730 cri.go:87] found id: ""
	I0630 20:55:55.917304  166730 logs.go:274] 0 containers: []
	W0630 20:55:55.917313  166730 logs.go:276] No container was found matching "kube-proxy"
	I0630 20:55:55.917320  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
	I0630 20:55:55.917378  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
	I0630 20:55:55.942846  166730 cri.go:87] found id: ""
	I0630 20:55:55.942873  166730 logs.go:274] 0 containers: []
	W0630 20:55:55.942882  166730 logs.go:276] No container was found matching "kubernetes-dashboard"
	I0630 20:55:55.942890  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
	I0630 20:55:55.942944  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
	I0630 20:55:55.970944  166730 cri.go:87] found id: ""
	I0630 20:55:55.970972  166730 logs.go:274] 0 containers: []
	W0630 20:55:55.970981  166730 logs.go:276] No container was found matching "storage-provisioner"
	I0630 20:55:55.970990  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
	I0630 20:55:55.971044  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I0630 20:55:55.995749  166730 cri.go:87] found id: ""
	I0630 20:55:55.995773  166730 logs.go:274] 0 containers: []
	W0630 20:55:55.995779  166730 logs.go:276] No container was found matching "kube-controller-manager"
	I0630 20:55:55.995787  166730 logs.go:123] Gathering logs for kubelet ...
	I0630 20:55:55.995801  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	W0630 20:55:56.047220  166730 logs.go:138] Found kubelet problem: Jun 30 20:55:55 kubernetes-upgrade-20220630205032-9950 kubelet[7036]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	I0630 20:55:56.098827  166730 logs.go:123] Gathering logs for dmesg ...
	I0630 20:55:56.098857  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0630 20:55:56.114004  166730 logs.go:123] Gathering logs for describe nodes ...
	I0630 20:55:56.114038  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	W0630 20:55:56.165221  166730 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	 output: 
	** stderr ** 
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	
	** /stderr **
	I0630 20:55:56.165247  166730 logs.go:123] Gathering logs for containerd ...
	I0630 20:55:56.165257  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
	I0630 20:55:56.202035  166730 logs.go:123] Gathering logs for container status ...
	I0630 20:55:56.202075  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0630 20:55:56.229905  166730 out.go:309] Setting ErrFile to fd 2...
	I0630 20:55:56.229939  166730 out.go:343] TERM=,COLORTERM=, which probably does not support color
	W0630 20:55:56.230076  166730 out.go:239] X Problems detected in kubelet:
	X Problems detected in kubelet:
	W0630 20:55:56.230094  166730 out.go:239]   Jun 30 20:55:55 kubernetes-upgrade-20220630205032-9950 kubelet[7036]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	  Jun 30 20:55:55 kubernetes-upgrade-20220630205032-9950 kubelet[7036]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	I0630 20:55:56.230100  166730 out.go:309] Setting ErrFile to fd 2...
	I0630 20:55:56.230107  166730 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 20:56:06.232825  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:56:06.243827  166730 kubeadm.go:630] restartCluster took 4m4.449118713s
	W0630 20:56:06.243995  166730 out.go:239] ! Unable to restart cluster, will reset it: apiserver healthz: apiserver process never appeared
	! Unable to restart cluster, will reset it: apiserver healthz: apiserver process never appeared
	I0630 20:56:06.244034  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm reset --cri-socket /run/containerd/containerd.sock --force"
	I0630 20:56:06.946910  166730 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 20:56:06.958177  166730 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0630 20:56:06.967186  166730 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver
	I0630 20:56:06.967255  166730 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0630 20:56:06.974506  166730 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0630 20:56:06.974558  166730 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0630 20:56:07.227007  166730 out.go:204]   - Generating certificates and keys ...
	I0630 20:56:08.883897  166730 out.go:204]   - Booting up control plane ...
	W0630 20:58:03.899565  166730 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
	stdout:
	[init] Using Kubernetes version: v1.24.2
	[preflight] Running pre-flight checks
	[preflight] The system verification failed. Printing the output from the verification:
	KERNEL_VERSION: 5.15.0-1012-gcp
	OS: Linux
	CGROUPS_CPU: enabled
	CGROUPS_CPUACCT: enabled
	CGROUPS_CPUSET: enabled
	CGROUPS_DEVICES: enabled
	CGROUPS_FREEZER: enabled
	CGROUPS_MEMORY: enabled
	CGROUPS_PIDS: enabled
	CGROUPS_HUGETLB: enabled
	CGROUPS_BLKIO: enabled
	[preflight] Pulling images required for setting up a Kubernetes cluster
	[preflight] This might take a minute or two, depending on the speed of your internet connection
	[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
	[certs] Using certificateDir folder "/var/lib/minikube/certs"
	[certs] Using existing ca certificate authority
	[certs] Using existing apiserver certificate and key on disk
	[certs] Using existing apiserver-kubelet-client certificate and key on disk
	[certs] Using existing front-proxy-ca certificate authority
	[certs] Using existing front-proxy-client certificate and key on disk
	[certs] Using existing etcd/ca certificate authority
	[certs] Using existing etcd/server certificate and key on disk
	[certs] Using existing etcd/peer certificate and key on disk
	[certs] Using existing etcd/healthcheck-client certificate and key on disk
	[certs] Using existing apiserver-etcd-client certificate and key on disk
	[certs] Using the existing "sa" key
	[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
	[kubeconfig] Writing "admin.conf" kubeconfig file
	[kubeconfig] Writing "kubelet.conf" kubeconfig file
	[kubeconfig] Writing "controller-manager.conf" kubeconfig file
	[kubeconfig] Writing "scheduler.conf" kubeconfig file
	[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
	[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
	[kubelet-start] Starting the kubelet
	[control-plane] Using manifest folder "/etc/kubernetes/manifests"
	[control-plane] Creating static Pod manifest for "kube-apiserver"
	[control-plane] Creating static Pod manifest for "kube-controller-manager"
	[control-plane] Creating static Pod manifest for "kube-scheduler"
	[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
	[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
	[kubelet-check] Initial timeout of 40s passed.
	[kubelet-check] It seems like the kubelet isn't running or healthy.
	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
	[kubelet-check] It seems like the kubelet isn't running or healthy.
	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
	[kubelet-check] It seems like the kubelet isn't running or healthy.
	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
	[kubelet-check] It seems like the kubelet isn't running or healthy.
	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
	[kubelet-check] It seems like the kubelet isn't running or healthy.
	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
	
	Unfortunately, an error has occurred:
		timed out waiting for the condition
	
	This error is likely caused by:
		- The kubelet is not running
		- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
	
	If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
		- 'systemctl status kubelet'
		- 'journalctl -xeu kubelet'
	
	Additionally, a control plane component may have crashed or exited when started by the container runtime.
	To troubleshoot, list all containers using your preferred container runtimes CLI.
	Here is one example how you may list all running Kubernetes containers by using crictl:
		- 'crictl --runtime-endpoint unix:///run/containerd/containerd.sock ps -a | grep kube | grep -v pause'
		Once you have found the failing container, you can inspect its logs with:
		- 'crictl --runtime-endpoint unix:///run/containerd/containerd.sock logs CONTAINERID'
	
	stderr:
	W0630 20:56:07.008038    7586 initconfiguration.go:120] Usage of CRI endpoints without URL scheme is deprecated and can cause kubelet errors in the future. Automatically prepending scheme "unix" to the "criSocket" with value "/run/containerd/containerd.sock". Please update your configuration!
		[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1012-gcp\n", err: exit status 1
		[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
	error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
	To see the stack trace of this error execute with --v=5 or higher
	
	! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
	stdout:
	[init] Using Kubernetes version: v1.24.2
	[preflight] Running pre-flight checks
	[preflight] The system verification failed. Printing the output from the verification:
	KERNEL_VERSION: 5.15.0-1012-gcp
	OS: Linux
	CGROUPS_CPU: enabled
	CGROUPS_CPUACCT: enabled
	CGROUPS_CPUSET: enabled
	CGROUPS_DEVICES: enabled
	CGROUPS_FREEZER: enabled
	CGROUPS_MEMORY: enabled
	CGROUPS_PIDS: enabled
	CGROUPS_HUGETLB: enabled
	CGROUPS_BLKIO: enabled
	[preflight] Pulling images required for setting up a Kubernetes cluster
	[preflight] This might take a minute or two, depending on the speed of your internet connection
	[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
	[certs] Using certificateDir folder "/var/lib/minikube/certs"
	[certs] Using existing ca certificate authority
	[certs] Using existing apiserver certificate and key on disk
	[certs] Using existing apiserver-kubelet-client certificate and key on disk
	[certs] Using existing front-proxy-ca certificate authority
	[certs] Using existing front-proxy-client certificate and key on disk
	[certs] Using existing etcd/ca certificate authority
	[certs] Using existing etcd/server certificate and key on disk
	[certs] Using existing etcd/peer certificate and key on disk
	[certs] Using existing etcd/healthcheck-client certificate and key on disk
	[certs] Using existing apiserver-etcd-client certificate and key on disk
	[certs] Using the existing "sa" key
	[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
	[kubeconfig] Writing "admin.conf" kubeconfig file
	[kubeconfig] Writing "kubelet.conf" kubeconfig file
	[kubeconfig] Writing "controller-manager.conf" kubeconfig file
	[kubeconfig] Writing "scheduler.conf" kubeconfig file
	[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
	[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
	[kubelet-start] Starting the kubelet
	[control-plane] Using manifest folder "/etc/kubernetes/manifests"
	[control-plane] Creating static Pod manifest for "kube-apiserver"
	[control-plane] Creating static Pod manifest for "kube-controller-manager"
	[control-plane] Creating static Pod manifest for "kube-scheduler"
	[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
	[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
	[kubelet-check] Initial timeout of 40s passed.
	[kubelet-check] It seems like the kubelet isn't running or healthy.
	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
	[kubelet-check] It seems like the kubelet isn't running or healthy.
	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
	[kubelet-check] It seems like the kubelet isn't running or healthy.
	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
	[kubelet-check] It seems like the kubelet isn't running or healthy.
	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
	[kubelet-check] It seems like the kubelet isn't running or healthy.
	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
	
	Unfortunately, an error has occurred:
		timed out waiting for the condition
	
	This error is likely caused by:
		- The kubelet is not running
		- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
	
	If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
		- 'systemctl status kubelet'
		- 'journalctl -xeu kubelet'
	
	Additionally, a control plane component may have crashed or exited when started by the container runtime.
	To troubleshoot, list all containers using your preferred container runtimes CLI.
	Here is one example how you may list all running Kubernetes containers by using crictl:
		- 'crictl --runtime-endpoint unix:///run/containerd/containerd.sock ps -a | grep kube | grep -v pause'
		Once you have found the failing container, you can inspect its logs with:
		- 'crictl --runtime-endpoint unix:///run/containerd/containerd.sock logs CONTAINERID'
	
	stderr:
	W0630 20:56:07.008038    7586 initconfiguration.go:120] Usage of CRI endpoints without URL scheme is deprecated and can cause kubelet errors in the future. Automatically prepending scheme "unix" to the "criSocket" with value "/run/containerd/containerd.sock". Please update your configuration!
		[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1012-gcp\n", err: exit status 1
		[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
	error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
	To see the stack trace of this error execute with --v=5 or higher
	
	I0630 20:58:03.899635  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm reset --cri-socket /run/containerd/containerd.sock --force"
	I0630 20:58:04.591252  166730 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 20:58:04.601287  166730 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver
	I0630 20:58:04.601351  166730 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0630 20:58:04.608513  166730 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0630 20:58:04.608564  166730 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0630 21:00:00.464899  166730 out.go:204]   - Generating certificates and keys ...
	I0630 21:00:00.467813  166730 out.go:204]   - Booting up control plane ...
	I0630 21:00:00.470158  166730 kubeadm.go:397] StartCluster complete in 7m58.712661025s
	I0630 21:00:00.470198  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
	I0630 21:00:00.470254  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I0630 21:00:00.494852  166730 cri.go:87] found id: ""
	I0630 21:00:00.494875  166730 logs.go:274] 0 containers: []
	W0630 21:00:00.494882  166730 logs.go:276] No container was found matching "kube-apiserver"
	I0630 21:00:00.494888  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
	I0630 21:00:00.494937  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I0630 21:00:00.518642  166730 cri.go:87] found id: ""
	I0630 21:00:00.518668  166730 logs.go:274] 0 containers: []
	W0630 21:00:00.518674  166730 logs.go:276] No container was found matching "etcd"
	I0630 21:00:00.518680  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
	I0630 21:00:00.518728  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I0630 21:00:00.544697  166730 cri.go:87] found id: ""
	I0630 21:00:00.544733  166730 logs.go:274] 0 containers: []
	W0630 21:00:00.544742  166730 logs.go:276] No container was found matching "coredns"
	I0630 21:00:00.544750  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
	I0630 21:00:00.544808  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I0630 21:00:00.569280  166730 cri.go:87] found id: ""
	I0630 21:00:00.569311  166730 logs.go:274] 0 containers: []
	W0630 21:00:00.569320  166730 logs.go:276] No container was found matching "kube-scheduler"
	I0630 21:00:00.569327  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
	I0630 21:00:00.569383  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I0630 21:00:00.593566  166730 cri.go:87] found id: ""
	I0630 21:00:00.593592  166730 logs.go:274] 0 containers: []
	W0630 21:00:00.593601  166730 logs.go:276] No container was found matching "kube-proxy"
	I0630 21:00:00.593609  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
	I0630 21:00:00.593665  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
	I0630 21:00:00.618029  166730 cri.go:87] found id: ""
	I0630 21:00:00.618053  166730 logs.go:274] 0 containers: []
	W0630 21:00:00.618061  166730 logs.go:276] No container was found matching "kubernetes-dashboard"
	I0630 21:00:00.618067  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
	I0630 21:00:00.618111  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
	I0630 21:00:00.642327  166730 cri.go:87] found id: ""
	I0630 21:00:00.642352  166730 logs.go:274] 0 containers: []
	W0630 21:00:00.642358  166730 logs.go:276] No container was found matching "storage-provisioner"
	I0630 21:00:00.642365  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
	I0630 21:00:00.642412  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I0630 21:00:00.671530  166730 cri.go:87] found id: ""
	I0630 21:00:00.671557  166730 logs.go:274] 0 containers: []
	W0630 21:00:00.671566  166730 logs.go:276] No container was found matching "kube-controller-manager"
	I0630 21:00:00.671576  166730 logs.go:123] Gathering logs for kubelet ...
	I0630 21:00:00.671591  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	W0630 21:00:00.735542  166730 logs.go:138] Found kubelet problem: Jun 30 21:00:00 kubernetes-upgrade-20220630205032-9950 kubelet[11593]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	I0630 21:00:00.809676  166730 logs.go:123] Gathering logs for dmesg ...
	I0630 21:00:00.809714  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0630 21:00:00.837921  166730 logs.go:123] Gathering logs for describe nodes ...
	I0630 21:00:00.837959  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	W0630 21:00:00.891715  166730 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	 output: 
	** stderr ** 
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	
	** /stderr **
	I0630 21:00:00.891742  166730 logs.go:123] Gathering logs for containerd ...
	I0630 21:00:00.891751  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
	I0630 21:00:00.937402  166730 logs.go:123] Gathering logs for container status ...
	I0630 21:00:00.937438  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	W0630 21:00:00.966782  166730 out.go:369] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
	stdout:
	[init] Using Kubernetes version: v1.24.2
	[preflight] Running pre-flight checks
	[preflight] The system verification failed. Printing the output from the verification:
	KERNEL_VERSION: 5.15.0-1012-gcp
	OS: Linux
	CGROUPS_CPU: enabled
	CGROUPS_CPUACCT: enabled
	CGROUPS_CPUSET: enabled
	CGROUPS_DEVICES: enabled
	CGROUPS_FREEZER: enabled
	CGROUPS_MEMORY: enabled
	CGROUPS_PIDS: enabled
	CGROUPS_HUGETLB: enabled
	CGROUPS_BLKIO: enabled
	[preflight] Pulling images required for setting up a Kubernetes cluster
	[preflight] This might take a minute or two, depending on the speed of your internet connection
	[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
	[certs] Using certificateDir folder "/var/lib/minikube/certs"
	[certs] Using existing ca certificate authority
	[certs] Using existing apiserver certificate and key on disk
	[certs] Using existing apiserver-kubelet-client certificate and key on disk
	[certs] Using existing front-proxy-ca certificate authority
	[certs] Using existing front-proxy-client certificate and key on disk
	[certs] Using existing etcd/ca certificate authority
	[certs] Using existing etcd/server certificate and key on disk
	[certs] Using existing etcd/peer certificate and key on disk
	[certs] Using existing etcd/healthcheck-client certificate and key on disk
	[certs] Using existing apiserver-etcd-client certificate and key on disk
	[certs] Using the existing "sa" key
	[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
	[kubeconfig] Writing "admin.conf" kubeconfig file
	[kubeconfig] Writing "kubelet.conf" kubeconfig file
	[kubeconfig] Writing "controller-manager.conf" kubeconfig file
	[kubeconfig] Writing "scheduler.conf" kubeconfig file
	[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
	[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
	[kubelet-start] Starting the kubelet
	[control-plane] Using manifest folder "/etc/kubernetes/manifests"
	[control-plane] Creating static Pod manifest for "kube-apiserver"
	[control-plane] Creating static Pod manifest for "kube-controller-manager"
	[control-plane] Creating static Pod manifest for "kube-scheduler"
	[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
	[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
	[kubelet-check] Initial timeout of 40s passed.
	[kubelet-check] It seems like the kubelet isn't running or healthy.
	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
	[kubelet-check] It seems like the kubelet isn't running or healthy.
	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
	[kubelet-check] It seems like the kubelet isn't running or healthy.
	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
	[kubelet-check] It seems like the kubelet isn't running or healthy.
	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
	[kubelet-check] It seems like the kubelet isn't running or healthy.
	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
	
	Unfortunately, an error has occurred:
		timed out waiting for the condition
	
	This error is likely caused by:
		- The kubelet is not running
		- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
	
	If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
		- 'systemctl status kubelet'
		- 'journalctl -xeu kubelet'
	
	Additionally, a control plane component may have crashed or exited when started by the container runtime.
	To troubleshoot, list all containers using your preferred container runtimes CLI.
	Here is one example how you may list all running Kubernetes containers by using crictl:
		- 'crictl --runtime-endpoint unix:///run/containerd/containerd.sock ps -a | grep kube | grep -v pause'
		Once you have found the failing container, you can inspect its logs with:
		- 'crictl --runtime-endpoint unix:///run/containerd/containerd.sock logs CONTAINERID'
	
	stderr:
	W0630 20:58:04.642467    9717 initconfiguration.go:120] Usage of CRI endpoints without URL scheme is deprecated and can cause kubelet errors in the future. Automatically prepending scheme "unix" to the "criSocket" with value "/run/containerd/containerd.sock". Please update your configuration!
		[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1012-gcp\n", err: exit status 1
		[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
	error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
	To see the stack trace of this error execute with --v=5 or higher
	W0630 21:00:00.966835  166730 out.go:239] * 
	* 
	W0630 21:00:00.967083  166730 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
	stdout:
	[init] Using Kubernetes version: v1.24.2
	[preflight] Running pre-flight checks
	[preflight] The system verification failed. Printing the output from the verification:
	KERNEL_VERSION: 5.15.0-1012-gcp
	OS: Linux
	CGROUPS_CPU: enabled
	CGROUPS_CPUACCT: enabled
	CGROUPS_CPUSET: enabled
	CGROUPS_DEVICES: enabled
	CGROUPS_FREEZER: enabled
	CGROUPS_MEMORY: enabled
	CGROUPS_PIDS: enabled
	CGROUPS_HUGETLB: enabled
	CGROUPS_BLKIO: enabled
	[preflight] Pulling images required for setting up a Kubernetes cluster
	[preflight] This might take a minute or two, depending on the speed of your internet connection
	[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
	[certs] Using certificateDir folder "/var/lib/minikube/certs"
	[certs] Using existing ca certificate authority
	[certs] Using existing apiserver certificate and key on disk
	[certs] Using existing apiserver-kubelet-client certificate and key on disk
	[certs] Using existing front-proxy-ca certificate authority
	[certs] Using existing front-proxy-client certificate and key on disk
	[certs] Using existing etcd/ca certificate authority
	[certs] Using existing etcd/server certificate and key on disk
	[certs] Using existing etcd/peer certificate and key on disk
	[certs] Using existing etcd/healthcheck-client certificate and key on disk
	[certs] Using existing apiserver-etcd-client certificate and key on disk
	[certs] Using the existing "sa" key
	[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
	[kubeconfig] Writing "admin.conf" kubeconfig file
	[kubeconfig] Writing "kubelet.conf" kubeconfig file
	[kubeconfig] Writing "controller-manager.conf" kubeconfig file
	[kubeconfig] Writing "scheduler.conf" kubeconfig file
	[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
	[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
	[kubelet-start] Starting the kubelet
	[control-plane] Using manifest folder "/etc/kubernetes/manifests"
	[control-plane] Creating static Pod manifest for "kube-apiserver"
	[control-plane] Creating static Pod manifest for "kube-controller-manager"
	[control-plane] Creating static Pod manifest for "kube-scheduler"
	[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
	[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
	[kubelet-check] Initial timeout of 40s passed.
	[kubelet-check] It seems like the kubelet isn't running or healthy.
	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
	[kubelet-check] It seems like the kubelet isn't running or healthy.
	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
	[kubelet-check] It seems like the kubelet isn't running or healthy.
	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
	[kubelet-check] It seems like the kubelet isn't running or healthy.
	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
	[kubelet-check] It seems like the kubelet isn't running or healthy.
	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
	
	Unfortunately, an error has occurred:
		timed out waiting for the condition
	
	This error is likely caused by:
		- The kubelet is not running
		- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
	
	If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
		- 'systemctl status kubelet'
		- 'journalctl -xeu kubelet'
	
	Additionally, a control plane component may have crashed or exited when started by the container runtime.
	To troubleshoot, list all containers using your preferred container runtimes CLI.
	Here is one example how you may list all running Kubernetes containers by using crictl:
		- 'crictl --runtime-endpoint unix:///run/containerd/containerd.sock ps -a | grep kube | grep -v pause'
		Once you have found the failing container, you can inspect its logs with:
		- 'crictl --runtime-endpoint unix:///run/containerd/containerd.sock logs CONTAINERID'
	
	stderr:
	W0630 20:58:04.642467    9717 initconfiguration.go:120] Usage of CRI endpoints without URL scheme is deprecated and can cause kubelet errors in the future. Automatically prepending scheme "unix" to the "criSocket" with value "/run/containerd/containerd.sock". Please update your configuration!
		[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1012-gcp\n", err: exit status 1
		[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
	error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
	To see the stack trace of this error execute with --v=5 or higher
	
	X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
	stdout:
	[init] Using Kubernetes version: v1.24.2
	[preflight] Running pre-flight checks
	[preflight] The system verification failed. Printing the output from the verification:
	KERNEL_VERSION: 5.15.0-1012-gcp
	OS: Linux
	CGROUPS_CPU: enabled
	CGROUPS_CPUACCT: enabled
	CGROUPS_CPUSET: enabled
	CGROUPS_DEVICES: enabled
	CGROUPS_FREEZER: enabled
	CGROUPS_MEMORY: enabled
	CGROUPS_PIDS: enabled
	CGROUPS_HUGETLB: enabled
	CGROUPS_BLKIO: enabled
	[preflight] Pulling images required for setting up a Kubernetes cluster
	[preflight] This might take a minute or two, depending on the speed of your internet connection
	[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
	[certs] Using certificateDir folder "/var/lib/minikube/certs"
	[certs] Using existing ca certificate authority
	[certs] Using existing apiserver certificate and key on disk
	[certs] Using existing apiserver-kubelet-client certificate and key on disk
	[certs] Using existing front-proxy-ca certificate authority
	[certs] Using existing front-proxy-client certificate and key on disk
	[certs] Using existing etcd/ca certificate authority
	[certs] Using existing etcd/server certificate and key on disk
	[certs] Using existing etcd/peer certificate and key on disk
	[certs] Using existing etcd/healthcheck-client certificate and key on disk
	[certs] Using existing apiserver-etcd-client certificate and key on disk
	[certs] Using the existing "sa" key
	[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
	[kubeconfig] Writing "admin.conf" kubeconfig file
	[kubeconfig] Writing "kubelet.conf" kubeconfig file
	[kubeconfig] Writing "controller-manager.conf" kubeconfig file
	[kubeconfig] Writing "scheduler.conf" kubeconfig file
	[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
	[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
	[kubelet-start] Starting the kubelet
	[control-plane] Using manifest folder "/etc/kubernetes/manifests"
	[control-plane] Creating static Pod manifest for "kube-apiserver"
	[control-plane] Creating static Pod manifest for "kube-controller-manager"
	[control-plane] Creating static Pod manifest for "kube-scheduler"
	[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
	[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
	[kubelet-check] Initial timeout of 40s passed.
	[kubelet-check] It seems like the kubelet isn't running or healthy.
	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
	[kubelet-check] It seems like the kubelet isn't running or healthy.
	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
	[kubelet-check] It seems like the kubelet isn't running or healthy.
	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
	[kubelet-check] It seems like the kubelet isn't running or healthy.
	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
	[kubelet-check] It seems like the kubelet isn't running or healthy.
	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
	
	Unfortunately, an error has occurred:
		timed out waiting for the condition
	
	This error is likely caused by:
		- The kubelet is not running
		- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
	
	If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
		- 'systemctl status kubelet'
		- 'journalctl -xeu kubelet'
	
	Additionally, a control plane component may have crashed or exited when started by the container runtime.
	To troubleshoot, list all containers using your preferred container runtimes CLI.
	Here is one example how you may list all running Kubernetes containers by using crictl:
		- 'crictl --runtime-endpoint unix:///run/containerd/containerd.sock ps -a | grep kube | grep -v pause'
		Once you have found the failing container, you can inspect its logs with:
		- 'crictl --runtime-endpoint unix:///run/containerd/containerd.sock logs CONTAINERID'
	
	stderr:
	W0630 20:58:04.642467    9717 initconfiguration.go:120] Usage of CRI endpoints without URL scheme is deprecated and can cause kubelet errors in the future. Automatically prepending scheme "unix" to the "criSocket" with value "/run/containerd/containerd.sock". Please update your configuration!
		[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1012-gcp\n", err: exit status 1
		[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
	error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
	To see the stack trace of this error execute with --v=5 or higher
	
	W0630 21:00:00.967126  166730 out.go:239] * 
	* 
	W0630 21:00:00.968129  166730 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0630 21:00:00.970508  166730 out.go:177] X Problems detected in kubelet:
	I0630 21:00:00.972058  166730 out.go:177]   Jun 30 21:00:00 kubernetes-upgrade-20220630205032-9950 kubelet[11593]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	I0630 21:00:00.976653  166730 out.go:177] 
	W0630 21:00:00.978457  166730 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
	stdout:
	[init] Using Kubernetes version: v1.24.2
	[preflight] Running pre-flight checks
	[preflight] The system verification failed. Printing the output from the verification:
	KERNEL_VERSION: 5.15.0-1012-gcp
	OS: Linux
	CGROUPS_CPU: enabled
	CGROUPS_CPUACCT: enabled
	CGROUPS_CPUSET: enabled
	CGROUPS_DEVICES: enabled
	CGROUPS_FREEZER: enabled
	CGROUPS_MEMORY: enabled
	CGROUPS_PIDS: enabled
	CGROUPS_HUGETLB: enabled
	CGROUPS_BLKIO: enabled
	[preflight] Pulling images required for setting up a Kubernetes cluster
	[preflight] This might take a minute or two, depending on the speed of your internet connection
	[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
	[certs] Using certificateDir folder "/var/lib/minikube/certs"
	[certs] Using existing ca certificate authority
	[certs] Using existing apiserver certificate and key on disk
	[certs] Using existing apiserver-kubelet-client certificate and key on disk
	[certs] Using existing front-proxy-ca certificate authority
	[certs] Using existing front-proxy-client certificate and key on disk
	[certs] Using existing etcd/ca certificate authority
	[certs] Using existing etcd/server certificate and key on disk
	[certs] Using existing etcd/peer certificate and key on disk
	[certs] Using existing etcd/healthcheck-client certificate and key on disk
	[certs] Using existing apiserver-etcd-client certificate and key on disk
	[certs] Using the existing "sa" key
	[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
	[kubeconfig] Writing "admin.conf" kubeconfig file
	[kubeconfig] Writing "kubelet.conf" kubeconfig file
	[kubeconfig] Writing "controller-manager.conf" kubeconfig file
	[kubeconfig] Writing "scheduler.conf" kubeconfig file
	[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
	[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
	[kubelet-start] Starting the kubelet
	[control-plane] Using manifest folder "/etc/kubernetes/manifests"
	[control-plane] Creating static Pod manifest for "kube-apiserver"
	[control-plane] Creating static Pod manifest for "kube-controller-manager"
	[control-plane] Creating static Pod manifest for "kube-scheduler"
	[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
	[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
	[kubelet-check] Initial timeout of 40s passed.
	[kubelet-check] It seems like the kubelet isn't running or healthy.
	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
	[kubelet-check] It seems like the kubelet isn't running or healthy.
	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
	[kubelet-check] It seems like the kubelet isn't running or healthy.
	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
	[kubelet-check] It seems like the kubelet isn't running or healthy.
	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
	[kubelet-check] It seems like the kubelet isn't running or healthy.
	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
	
	Unfortunately, an error has occurred:
		timed out waiting for the condition
	
	This error is likely caused by:
		- The kubelet is not running
		- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
	
	If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
		- 'systemctl status kubelet'
		- 'journalctl -xeu kubelet'
	
	Additionally, a control plane component may have crashed or exited when started by the container runtime.
	To troubleshoot, list all containers using your preferred container runtimes CLI.
	Here is one example how you may list all running Kubernetes containers by using crictl:
		- 'crictl --runtime-endpoint unix:///run/containerd/containerd.sock ps -a | grep kube | grep -v pause'
		Once you have found the failing container, you can inspect its logs with:
		- 'crictl --runtime-endpoint unix:///run/containerd/containerd.sock logs CONTAINERID'
	
	stderr:
	W0630 20:58:04.642467    9717 initconfiguration.go:120] Usage of CRI endpoints without URL scheme is deprecated and can cause kubelet errors in the future. Automatically prepending scheme "unix" to the "criSocket" with value "/run/containerd/containerd.sock". Please update your configuration!
		[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1012-gcp\n", err: exit status 1
		[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
	error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
	To see the stack trace of this error execute with --v=5 or higher
	
	X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
	stdout:
	[init] Using Kubernetes version: v1.24.2
	[preflight] Running pre-flight checks
	[preflight] The system verification failed. Printing the output from the verification:
	KERNEL_VERSION: 5.15.0-1012-gcp
	OS: Linux
	CGROUPS_CPU: enabled
	CGROUPS_CPUACCT: enabled
	CGROUPS_CPUSET: enabled
	CGROUPS_DEVICES: enabled
	CGROUPS_FREEZER: enabled
	CGROUPS_MEMORY: enabled
	CGROUPS_PIDS: enabled
	CGROUPS_HUGETLB: enabled
	CGROUPS_BLKIO: enabled
	[preflight] Pulling images required for setting up a Kubernetes cluster
	[preflight] This might take a minute or two, depending on the speed of your internet connection
	[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
	[certs] Using certificateDir folder "/var/lib/minikube/certs"
	[certs] Using existing ca certificate authority
	[certs] Using existing apiserver certificate and key on disk
	[certs] Using existing apiserver-kubelet-client certificate and key on disk
	[certs] Using existing front-proxy-ca certificate authority
	[certs] Using existing front-proxy-client certificate and key on disk
	[certs] Using existing etcd/ca certificate authority
	[certs] Using existing etcd/server certificate and key on disk
	[certs] Using existing etcd/peer certificate and key on disk
	[certs] Using existing etcd/healthcheck-client certificate and key on disk
	[certs] Using existing apiserver-etcd-client certificate and key on disk
	[certs] Using the existing "sa" key
	[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
	[kubeconfig] Writing "admin.conf" kubeconfig file
	[kubeconfig] Writing "kubelet.conf" kubeconfig file
	[kubeconfig] Writing "controller-manager.conf" kubeconfig file
	[kubeconfig] Writing "scheduler.conf" kubeconfig file
	[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
	[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
	[kubelet-start] Starting the kubelet
	[control-plane] Using manifest folder "/etc/kubernetes/manifests"
	[control-plane] Creating static Pod manifest for "kube-apiserver"
	[control-plane] Creating static Pod manifest for "kube-controller-manager"
	[control-plane] Creating static Pod manifest for "kube-scheduler"
	[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
	[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
	[kubelet-check] Initial timeout of 40s passed.
	[kubelet-check] It seems like the kubelet isn't running or healthy.
	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
	[kubelet-check] It seems like the kubelet isn't running or healthy.
	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
	[kubelet-check] It seems like the kubelet isn't running or healthy.
	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
	[kubelet-check] It seems like the kubelet isn't running or healthy.
	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
	[kubelet-check] It seems like the kubelet isn't running or healthy.
	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
	
	Unfortunately, an error has occurred:
		timed out waiting for the condition
	
	This error is likely caused by:
		- The kubelet is not running
		- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
	
	If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
		- 'systemctl status kubelet'
		- 'journalctl -xeu kubelet'
	
	Additionally, a control plane component may have crashed or exited when started by the container runtime.
	To troubleshoot, list all containers using your preferred container runtimes CLI.
	Here is one example how you may list all running Kubernetes containers by using crictl:
		- 'crictl --runtime-endpoint unix:///run/containerd/containerd.sock ps -a | grep kube | grep -v pause'
		Once you have found the failing container, you can inspect its logs with:
		- 'crictl --runtime-endpoint unix:///run/containerd/containerd.sock logs CONTAINERID'
	
	stderr:
	W0630 20:58:04.642467    9717 initconfiguration.go:120] Usage of CRI endpoints without URL scheme is deprecated and can cause kubelet errors in the future. Automatically prepending scheme "unix" to the "criSocket" with value "/run/containerd/containerd.sock". Please update your configuration!
		[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1012-gcp\n", err: exit status 1
		[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
	error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
	To see the stack trace of this error execute with --v=5 or higher
	
	W0630 21:00:00.978591  166730 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
	* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
	W0630 21:00:00.978662  166730 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
	* Related issue: https://github.com/kubernetes/minikube/issues/4172
	I0630 21:00:00.981508  166730 out.go:177] 

                                                
                                                
** /stderr **
version_upgrade_test.go:252: failed to upgrade with newest k8s version. args: out/minikube-linux-amd64 start -p kubernetes-upgrade-20220630205032-9950 --memory=2200 --kubernetes-version=v1.24.2 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd : exit status 109
version_upgrade_test.go:255: (dbg) Run:  kubectl --context kubernetes-upgrade-20220630205032-9950 version --output=json
version_upgrade_test.go:255: (dbg) Non-zero exit: kubectl --context kubernetes-upgrade-20220630205032-9950 version --output=json: exit status 1 (44.228139ms)

                                                
                                                
-- stdout --
	{
	  "clientVersion": {
	    "major": "1",
	    "minor": "24",
	    "gitVersion": "v1.24.2",
	    "gitCommit": "f66044f4361b9f1f96f0053dd46cb7dce5e990a8",
	    "gitTreeState": "clean",
	    "buildDate": "2022-06-15T14:22:29Z",
	    "goVersion": "go1.18.3",
	    "compiler": "gc",
	    "platform": "linux/amd64"
	  },
	  "kustomizeVersion": "v4.5.4"
	}

                                                
                                                
-- /stdout --
** stderr ** 
	The connection to the server 192.168.67.2:8443 was refused - did you specify the right host or port?

                                                
                                                
** /stderr **
version_upgrade_test.go:257: error running kubectl: exit status 1
panic.go:482: *** TestKubernetesUpgrade FAILED at 2022-06-30 21:00:01.17155219 +0000 UTC m=+2349.410690452
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestKubernetesUpgrade]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect kubernetes-upgrade-20220630205032-9950
helpers_test.go:235: (dbg) docker inspect kubernetes-upgrade-20220630205032-9950:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "3933a5e883763c8f5e9da8b4882268e07350288449ee510c219ba0b884c94ad9",
	        "Created": "2022-06-30T20:50:46.703399671Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 167062,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2022-06-30T20:51:27.571953859Z",
	            "FinishedAt": "2022-06-30T20:51:25.512851125Z"
	        },
	        "Image": "sha256:573e7be5768273a7845baee1ae90fa2e33b83b10a7fbb0f0f41efbf29b53d1f1",
	        "ResolvConfPath": "/var/lib/docker/containers/3933a5e883763c8f5e9da8b4882268e07350288449ee510c219ba0b884c94ad9/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/3933a5e883763c8f5e9da8b4882268e07350288449ee510c219ba0b884c94ad9/hostname",
	        "HostsPath": "/var/lib/docker/containers/3933a5e883763c8f5e9da8b4882268e07350288449ee510c219ba0b884c94ad9/hosts",
	        "LogPath": "/var/lib/docker/containers/3933a5e883763c8f5e9da8b4882268e07350288449ee510c219ba0b884c94ad9/3933a5e883763c8f5e9da8b4882268e07350288449ee510c219ba0b884c94ad9-json.log",
	        "Name": "/kubernetes-upgrade-20220630205032-9950",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "kubernetes-upgrade-20220630205032-9950:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "kubernetes-upgrade-20220630205032-9950",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 2306867200,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": null,
	            "BlkioDeviceWriteBps": null,
	            "BlkioDeviceReadIOps": null,
	            "BlkioDeviceWriteIOps": null,
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "KernelMemory": 0,
	            "KernelMemoryTCP": 0,
	            "MemoryReservation": 0,
	            "MemorySwap": 4613734400,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": null,
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/6a1120910baa8020db8ace8ab2c43ee409ff31973d68110156b9688f9732111b-init/diff:/var/lib/docker/overlay2/8b88d9f6f12c48be642a133456203e58549a93f1da67d0349744bd0f78917fba/diff:/var/lib/docker/overlay2/2bcbb3b4718a64188802301a25d7f413bb307cb16d077e7e5af799f9152a2970/diff:/var/lib/docker/overlay2/70b0888bf22fcef1c004704b71288ac581cf26a3b3b19fbca3da296ba10d6978/diff:/var/lib/docker/overlay2/7c5332f38fe652f379ef9b6d23e795158e9994317cfb547b581dd2b1fdf1303b/diff:/var/lib/docker/overlay2/0ddb5a3abf433b644a8bfa124e3c87878eed67878faa35493f2befc2b392e9cb/diff:/var/lib/docker/overlay2/3b7cda5fb0232fdeecbec0531ac704a59eb38fe57664c25777193b07e2df0077/diff:/var/lib/docker/overlay2/a14687ada786c65465b9924ae2d77ba27afc07942851cafaade28e80dfe9da16/diff:/var/lib/docker/overlay2/c49a9b7157aa6e8714e192b2849866d035b59e18de462c0ee9b72f898cc5a485/diff:/var/lib/docker/overlay2/efd71a50e3a1044a6d1c4c1a7d4d91d9f070c066e03e51c6c73a5764b778ad72/diff:/var/lib/docker/overlay2/55476a
1c0a20aa4238a0bb0e43c6402c33dcad312938ad48ee81be0160e12a49/diff:/var/lib/docker/overlay2/c48c4a348a797b9a38f01568a6adbcb4b05b4f56f7b986a4bf1b509d8cb00732/diff:/var/lib/docker/overlay2/568e3f354ab0428de5cf82d1fdfb780c3377f5cc55d9f524731c53e39e0ecae7/diff:/var/lib/docker/overlay2/2857943e320cdcdae9af3d8c2acda1fb61e2f142a88b8b902908071cea67816e/diff:/var/lib/docker/overlay2/bdd9a57f0b65e65c5a16395f239425e794c678b0e8db2f4a368e0a9427fe5116/diff:/var/lib/docker/overlay2/b150183f1b73e8c13c751911bcee09fed8ef973478f4dc3cfdb9e509118bf1ea/diff:/var/lib/docker/overlay2/0a053e7c29417cd6feafb351c7944e81342a52898871bc779f7bf61868c78ec4/diff:/var/lib/docker/overlay2/d3c0de3a44d75d0a05acb7843d53deba5ce0457649d6ed757da9b4c532a81e4f/diff:/var/lib/docker/overlay2/53f6170132880e1697dd802b8577382b31c6f1ba144256f8cc62542998842a6b/diff:/var/lib/docker/overlay2/b5c0be6d8efdb1fcb12e73b8f72853f77baa4bc014ac2c1e28b7b972b07f3325/diff:/var/lib/docker/overlay2/36c908f082a1e5388bb25277f1c957eaecf70fcd958080422fa85a3105724fb2/diff:/var/lib/d
ocker/overlay2/b147fe9dce365cfaf9bfeca2e370829e4d87e2671c133a9836ecb02a85422cc7/diff:/var/lib/docker/overlay2/65f488eb9181a721f01b333f5fa0cb91d216abd7842a9ae193bd95316f378721/diff:/var/lib/docker/overlay2/b04269aa247b68912ddc5b1c98ad55d67af4103f576a900eef4069c196b8a263/diff:/var/lib/docker/overlay2/b714c37e15257ae9d0e15d271dd18a330c38ad765901d9b7e7e3feb73e1b03e4/diff:/var/lib/docker/overlay2/3c253b721193edeaade7bba7ce25ff687c889b8fa86e9489c7ee20d5624e6c5b/diff:/var/lib/docker/overlay2/7f67b74e101fa21dd320393c10576eefa4ce1cec2e210bff405784fa45b360f3/diff:/var/lib/docker/overlay2/c3b2adaa63a06a5e6ed966d7b6f20a757aeadd3f25eb09ef3c7e9a66a8904143/diff:/var/lib/docker/overlay2/ddb5d653d19e8cafc4625a8fe9597667d98b277a7f679e532ad84caa2c6da636/diff:/var/lib/docker/overlay2/03eb172b20323ebeee7cb09025726a6e10de6c3dd8661f4f6bbc5a3a3778bad4/diff:/var/lib/docker/overlay2/80ea9bf34d028e95a8a418b3aeb634be72ab3336448946d7855c51ffdf8258d7/diff:/var/lib/docker/overlay2/e28987ea3fb4d431dee111f38cc76814b85f73e86434be3c463c01fdd59
9ad46/diff:/var/lib/docker/overlay2/6f9a46c7c6cf4fd30ce32a1eb08ed9b1e8dd61cb0e42ce54f0f736f06558c306/diff:/var/lib/docker/overlay2/6fc942eb9ccfc09898edc9a5ef3b3d305a6fcb22e8cefb1a9f9c344d10b59b25/diff:/var/lib/docker/overlay2/f6b8c57540e798dc1dfd51fd29c020193c02a4362f31c6d07aa220327bb07b90/diff:/var/lib/docker/overlay2/85d0aa01a3fab8c77262c59d8a7b0809a72673a3da7d33e4e19c04a66db44a11/diff:/var/lib/docker/overlay2/58dcd81a1605641f785ced5aeb38657eec1f02a31b7adfaf4f6fdd49f4bab1d6/diff:/var/lib/docker/overlay2/9d537e0a65325e4bf85b26da9828002339f5c442ca85f931b340457a80ec8c94/diff:/var/lib/docker/overlay2/a6f73707ee6a74e948a02d03c4a3f12b57c2eb408dc67da3c39961bb3cefcc97/diff:/var/lib/docker/overlay2/922526c310b066dbb73b9a106eef8bf0064ad7907a8d7d7b353f5307a17a4901/diff:/var/lib/docker/overlay2/a4185854870ebf8d34a4c7e1827dbe3bc461559839301ffb23c5efff5e3c9f14/diff:/var/lib/docker/overlay2/8c02b1fcb9d79f5d7b2ee4d44f6625a692c44a0d18df0a5c01cac0cca0fdf3f3/diff",
	                "MergedDir": "/var/lib/docker/overlay2/6a1120910baa8020db8ace8ab2c43ee409ff31973d68110156b9688f9732111b/merged",
	                "UpperDir": "/var/lib/docker/overlay2/6a1120910baa8020db8ace8ab2c43ee409ff31973d68110156b9688f9732111b/diff",
	                "WorkDir": "/var/lib/docker/overlay2/6a1120910baa8020db8ace8ab2c43ee409ff31973d68110156b9688f9732111b/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "kubernetes-upgrade-20220630205032-9950",
	                "Source": "/var/lib/docker/volumes/kubernetes-upgrade-20220630205032-9950/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "kubernetes-upgrade-20220630205032-9950",
	            "Domainname": "",
	            "User": "root",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e",
	            "Volumes": null,
	            "WorkingDir": "",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "kubernetes-upgrade-20220630205032-9950",
	                "name.minikube.sigs.k8s.io": "kubernetes-upgrade-20220630205032-9950",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "a7af35f4f12d65dab8cbf2161ed70a15c30b0116559f0273fb3c50bd980e9897",
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49344"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49343"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49340"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49342"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49341"
	                    }
	                ]
	            },
	            "SandboxKey": "/var/run/docker/netns/a7af35f4f12d",
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "kubernetes-upgrade-20220630205032-9950": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.67.2"
	                    },
	                    "Links": null,
	                    "Aliases": [
	                        "3933a5e88376",
	                        "kubernetes-upgrade-20220630205032-9950"
	                    ],
	                    "NetworkID": "fbd8d6c05e6ba8adf4329c183c9e1d40722efd453e5652cb543464956f975274",
	                    "EndpointID": "11b1db4b4f0318851294fb2aea0254bef09975e72bf05d3ef3237f3dbf979d6b",
	                    "Gateway": "192.168.67.1",
	                    "IPAddress": "192.168.67.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "MacAddress": "02:42:c0:a8:43:02",
	                    "DriverOpts": null
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p kubernetes-upgrade-20220630205032-9950 -n kubernetes-upgrade-20220630205032-9950

                                                
                                                
=== CONT  TestKubernetesUpgrade
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p kubernetes-upgrade-20220630205032-9950 -n kubernetes-upgrade-20220630205032-9950: exit status 2 (446.740367ms)

                                                
                                                
-- stdout --
	Running

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 2 (may be ok)
helpers_test.go:244: <<< TestKubernetesUpgrade FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======>  post-mortem[TestKubernetesUpgrade]: minikube logs <======
helpers_test.go:247: (dbg) Run:  out/minikube-linux-amd64 -p kubernetes-upgrade-20220630205032-9950 logs -n 25
E0630 21:00:01.922787    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/kindnet-20220630204858-9950/client.crt: no such file or directory

                                                
                                                
=== CONT  TestKubernetesUpgrade
helpers_test.go:252: TestKubernetesUpgrade logs: 
-- stdout --
	* 
	* ==> Audit <==
	* |---------|----------------------------------------|----------|---------|---------|---------------------|---------------------|
	| Command |                  Args                  | Profile  |  User   | Version |     Start Time      |      End Time       |
	|---------|----------------------------------------|----------|---------|---------|---------------------|---------------------|
	| start   | -p                                     | minikube | jenkins | v1.26.0 | 30 Jun 22 20:53 UTC | 30 Jun 22 20:53 UTC |
	|         | running-upgrade-20220630205232-9950    |          |         |         |                     |                     |
	|         | --memory=2200 --alsologtostderr        |          |         |         |                     |                     |
	|         | -v=1 --driver=docker                   |          |         |         |                     |                     |
	|         | --container-runtime=containerd         |          |         |         |                     |                     |
	| start   | -p                                     | minikube | jenkins | v1.26.0 | 30 Jun 22 20:53 UTC | 30 Jun 22 20:53 UTC |
	|         | cert-expiration-20220630204940-9950    |          |         |         |                     |                     |
	|         | --memory=2048                          |          |         |         |                     |                     |
	|         | --cert-expiration=8760h                |          |         |         |                     |                     |
	|         | --driver=docker                        |          |         |         |                     |                     |
	|         | --container-runtime=containerd         |          |         |         |                     |                     |
	| delete  | -p                                     | minikube | jenkins | v1.26.0 | 30 Jun 22 20:53 UTC | 30 Jun 22 20:53 UTC |
	|         | cert-expiration-20220630204940-9950    |          |         |         |                     |                     |
	| start   | -p auto-20220630204858-9950            | minikube | jenkins | v1.26.0 | 30 Jun 22 20:53 UTC | 30 Jun 22 20:54 UTC |
	|         | --memory=2048                          |          |         |         |                     |                     |
	|         | --alsologtostderr                      |          |         |         |                     |                     |
	|         | --wait=true --wait-timeout=5m          |          |         |         |                     |                     |
	|         | --driver=docker                        |          |         |         |                     |                     |
	|         | --container-runtime=containerd         |          |         |         |                     |                     |
	| delete  | -p                                     | minikube | jenkins | v1.26.0 | 30 Jun 22 20:53 UTC | 30 Jun 22 20:53 UTC |
	|         | running-upgrade-20220630205232-9950    |          |         |         |                     |                     |
	| start   | -p pause-20220630205252-9950           | minikube | jenkins | v1.26.0 | 30 Jun 22 20:53 UTC | 30 Jun 22 20:54 UTC |
	|         | --alsologtostderr                      |          |         |         |                     |                     |
	|         | -v=1 --driver=docker                   |          |         |         |                     |                     |
	|         | --container-runtime=containerd         |          |         |         |                     |                     |
	| start   | -p kindnet-20220630204858-9950         | minikube | jenkins | v1.26.0 | 30 Jun 22 20:53 UTC | 30 Jun 22 20:54 UTC |
	|         | --memory=2048                          |          |         |         |                     |                     |
	|         | --alsologtostderr                      |          |         |         |                     |                     |
	|         | --wait=true --wait-timeout=5m          |          |         |         |                     |                     |
	|         | --cni=kindnet --driver=docker          |          |         |         |                     |                     |
	|         | --container-runtime=containerd         |          |         |         |                     |                     |
	| pause   | -p pause-20220630205252-9950           | minikube | jenkins | v1.26.0 | 30 Jun 22 20:54 UTC | 30 Jun 22 20:54 UTC |
	|         | --alsologtostderr -v=5                 |          |         |         |                     |                     |
	| unpause | -p pause-20220630205252-9950           | minikube | jenkins | v1.26.0 | 30 Jun 22 20:54 UTC | 30 Jun 22 20:54 UTC |
	|         | --alsologtostderr -v=5                 |          |         |         |                     |                     |
	| pause   | -p pause-20220630205252-9950           | minikube | jenkins | v1.26.0 | 30 Jun 22 20:54 UTC | 30 Jun 22 20:54 UTC |
	|         | --alsologtostderr -v=5                 |          |         |         |                     |                     |
	| delete  | -p pause-20220630205252-9950           | minikube | jenkins | v1.26.0 | 30 Jun 22 20:54 UTC | 30 Jun 22 20:54 UTC |
	|         | --alsologtostderr -v=5                 |          |         |         |                     |                     |
	| profile | list --output json                     | minikube | jenkins | v1.26.0 | 30 Jun 22 20:54 UTC | 30 Jun 22 20:54 UTC |
	| delete  | -p pause-20220630205252-9950           | minikube | jenkins | v1.26.0 | 30 Jun 22 20:54 UTC | 30 Jun 22 20:54 UTC |
	| start   | -p cilium-20220630204859-9950          | minikube | jenkins | v1.26.0 | 30 Jun 22 20:54 UTC | 30 Jun 22 20:55 UTC |
	|         | --memory=2048                          |          |         |         |                     |                     |
	|         | --alsologtostderr                      |          |         |         |                     |                     |
	|         | --wait=true --wait-timeout=5m          |          |         |         |                     |                     |
	|         | --cni=cilium --driver=docker           |          |         |         |                     |                     |
	|         | --container-runtime=containerd         |          |         |         |                     |                     |
	| ssh     | -p auto-20220630204858-9950            | minikube | jenkins | v1.26.0 | 30 Jun 22 20:54 UTC | 30 Jun 22 20:54 UTC |
	|         | pgrep -a kubelet                       |          |         |         |                     |                     |
	| ssh     | -p kindnet-20220630204858-9950         | minikube | jenkins | v1.26.0 | 30 Jun 22 20:54 UTC | 30 Jun 22 20:54 UTC |
	|         | pgrep -a kubelet                       |          |         |         |                     |                     |
	| delete  | -p auto-20220630204858-9950            | minikube | jenkins | v1.26.0 | 30 Jun 22 20:54 UTC | 30 Jun 22 20:54 UTC |
	| start   | -p calico-20220630204859-9950          | minikube | jenkins | v1.26.0 | 30 Jun 22 20:54 UTC |                     |
	|         | --memory=2048                          |          |         |         |                     |                     |
	|         | --alsologtostderr                      |          |         |         |                     |                     |
	|         | --wait=true --wait-timeout=5m          |          |         |         |                     |                     |
	|         | --cni=calico --driver=docker           |          |         |         |                     |                     |
	|         | --container-runtime=containerd         |          |         |         |                     |                     |
	| delete  | -p kindnet-20220630204858-9950         | minikube | jenkins | v1.26.0 | 30 Jun 22 20:54 UTC | 30 Jun 22 20:55 UTC |
	| start   | -p                                     | minikube | jenkins | v1.26.0 | 30 Jun 22 20:55 UTC | 30 Jun 22 21:00 UTC |
	|         | enable-default-cni-20220630204858-9950 |          |         |         |                     |                     |
	|         | --memory=2048 --alsologtostderr        |          |         |         |                     |                     |
	|         | --wait=true --wait-timeout=5m          |          |         |         |                     |                     |
	|         | --enable-default-cni=true              |          |         |         |                     |                     |
	|         | --driver=docker                        |          |         |         |                     |                     |
	|         | --container-runtime=containerd         |          |         |         |                     |                     |
	| ssh     | -p cilium-20220630204859-9950          | minikube | jenkins | v1.26.0 | 30 Jun 22 20:55 UTC | 30 Jun 22 20:55 UTC |
	|         | pgrep -a kubelet                       |          |         |         |                     |                     |
	| delete  | -p cilium-20220630204859-9950          | minikube | jenkins | v1.26.0 | 30 Jun 22 20:55 UTC | 30 Jun 22 20:55 UTC |
	| start   | -p bridge-20220630204858-9950          | minikube | jenkins | v1.26.0 | 30 Jun 22 20:55 UTC | 30 Jun 22 20:56 UTC |
	|         | --memory=2048                          |          |         |         |                     |                     |
	|         | --alsologtostderr                      |          |         |         |                     |                     |
	|         | --wait=true --wait-timeout=5m          |          |         |         |                     |                     |
	|         | --cni=bridge --driver=docker           |          |         |         |                     |                     |
	|         | --container-runtime=containerd         |          |         |         |                     |                     |
	| ssh     | -p bridge-20220630204858-9950          | minikube | jenkins | v1.26.0 | 30 Jun 22 20:56 UTC | 30 Jun 22 20:56 UTC |
	|         | pgrep -a kubelet                       |          |         |         |                     |                     |
	| ssh     | -p                                     | minikube | jenkins | v1.26.0 | 30 Jun 22 21:00 UTC | 30 Jun 22 21:00 UTC |
	|         | enable-default-cni-20220630204858-9950 |          |         |         |                     |                     |
	|         | pgrep -a kubelet                       |          |         |         |                     |                     |
	|---------|----------------------------------------|----------|---------|---------|---------------------|---------------------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2022/06/30 20:55:46
	Running on machine: ubuntu-20-agent-8
	Binary: Built with gc go1.18.3 for linux/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0630 20:55:46.188135  212673 out.go:296] Setting OutFile to fd 1 ...
	I0630 20:55:46.188261  212673 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 20:55:46.188271  212673 out.go:309] Setting ErrFile to fd 2...
	I0630 20:55:46.188278  212673 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 20:55:46.188778  212673 root.go:329] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/bin
	I0630 20:55:46.189121  212673 out.go:303] Setting JSON to false
	I0630 20:55:46.190939  212673 start.go:115] hostinfo: {"hostname":"ubuntu-20-agent-8","uptime":2298,"bootTime":1656620248,"procs":693,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1012-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0630 20:55:46.191018  212673 start.go:125] virtualization: kvm guest
	I0630 20:55:46.193977  212673 out.go:177] * [bridge-20220630204858-9950] minikube v1.26.0 on Ubuntu 20.04 (kvm/amd64)
	I0630 20:55:46.195709  212673 out.go:177]   - MINIKUBE_LOCATION=14420
	I0630 20:55:46.195623  212673 notify.go:193] Checking for updates...
	I0630 20:55:46.198832  212673 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0630 20:55:46.200393  212673 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 20:55:46.201847  212673 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube
	I0630 20:55:46.203668  212673 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0630 20:55:46.205764  212673 config.go:178] Loaded profile config "calico-20220630204859-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 20:55:46.205913  212673 config.go:178] Loaded profile config "enable-default-cni-20220630204858-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 20:55:46.206064  212673 config.go:178] Loaded profile config "kubernetes-upgrade-20220630205032-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 20:55:46.206136  212673 driver.go:360] Setting default libvirt URI to qemu:///system
	I0630 20:55:46.253958  212673 docker.go:137] docker version: linux-20.10.17
	I0630 20:55:46.254102  212673 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0630 20:55:46.369508  212673 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:3 ContainersPaused:0 ContainersStopped:0 Images:8 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:56 OomKillDisable:true NGoroutines:57 SystemTime:2022-06-30 20:55:46.290698743 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1012-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexServ
erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662451712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-8 Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Client
Info:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
	I0630 20:55:46.369632  212673 docker.go:254] overlay module found
	I0630 20:55:46.371835  212673 out.go:177] * Using the docker driver based on user configuration
	I0630 20:55:41.659430  204258 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:55:42.159444  204258 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:55:42.660167  204258 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:55:43.159758  204258 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:55:43.659304  204258 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:55:44.159358  204258 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:55:44.659952  204258 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:55:45.159356  204258 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:55:45.659758  204258 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:55:46.159295  204258 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:55:46.373158  212673 start.go:284] selected driver: docker
	I0630 20:55:46.373183  212673 start.go:808] validating driver "docker" against <nil>
	I0630 20:55:46.373204  212673 start.go:819] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0630 20:55:46.374071  212673 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0630 20:55:46.518248  212673 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:3 ContainersPaused:0 ContainersStopped:0 Images:8 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:56 OomKillDisable:true NGoroutines:57 SystemTime:2022-06-30 20:55:46.405285199 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1012-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexServ
erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662451712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-8 Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Client
Info:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
	I0630 20:55:46.518419  212673 start_flags.go:296] no existing cluster config was found, will generate one from the flags 
	I0630 20:55:46.518656  212673 start_flags.go:853] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0630 20:55:46.520549  212673 out.go:177] * Using Docker driver with root privileges
	I0630 20:55:46.521915  212673 cni.go:95] Creating CNI manager for "bridge"
	I0630 20:55:46.521937  212673 start_flags.go:305] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0630 20:55:46.521958  212673 start_flags.go:310] config:
	{Name:bridge-20220630204858-9950 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:bridge-20220630204858-9950 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:bridge NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:5m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 20:55:46.523711  212673 out.go:177] * Starting control plane node bridge-20220630204858-9950 in cluster bridge-20220630204858-9950
	I0630 20:55:46.525174  212673 cache.go:120] Beginning downloading kic base image for docker with containerd
	I0630 20:55:46.526653  212673 out.go:177] * Pulling base image ...
	I0630 20:55:46.528127  212673 preload.go:132] Checking if preload exists for k8s version v1.24.2 and runtime containerd
	I0630 20:55:46.528154  212673 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e in local docker daemon
	I0630 20:55:46.528184  212673 preload.go:148] Found local preload: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-containerd-overlay2-amd64.tar.lz4
	I0630 20:55:46.528196  212673 cache.go:57] Caching tarball of preloaded images
	I0630 20:55:46.528486  212673 preload.go:174] Found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-containerd-overlay2-amd64.tar.lz4 in cache, skipping download
	I0630 20:55:46.528514  212673 cache.go:60] Finished verifying existence of preloaded tar for  v1.24.2 on containerd
	I0630 20:55:46.528660  212673 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/bridge-20220630204858-9950/config.json ...
	I0630 20:55:46.528690  212673 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/bridge-20220630204858-9950/config.json: {Name:mk69b93e3215d75eba8b8292232181feb9f3fbbf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 20:55:46.567450  212673 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e in local docker daemon, skipping pull
	I0630 20:55:46.567476  212673 cache.go:142] gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e exists in daemon, skipping load
	I0630 20:55:46.567491  212673 cache.go:208] Successfully downloaded all kic artifacts
	I0630 20:55:46.567528  212673 start.go:352] acquiring machines lock for bridge-20220630204858-9950: {Name:mkc17e61ee90ac583c061a9d43e5074539c94220 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0630 20:55:46.567664  212673 start.go:356] acquired machines lock for "bridge-20220630204858-9950" in 112.941µs
	I0630 20:55:46.567688  212673 start.go:91] Provisioning new machine with config: &{Name:bridge-20220630204858-9950 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:bridge-20220630204858-9950 Namespace:default
APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:bridge NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:5m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker Bin
aryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:} &{Name: IP: Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0630 20:55:46.567766  212673 start.go:131] createHost starting for "" (driver="docker")
	I0630 20:55:44.391595  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:55:44.782426  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
	I0630 20:55:44.782503  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I0630 20:55:44.815920  166730 cri.go:87] found id: ""
	I0630 20:55:44.815947  166730 logs.go:274] 0 containers: []
	W0630 20:55:44.815956  166730 logs.go:276] No container was found matching "kube-apiserver"
	I0630 20:55:44.815966  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
	I0630 20:55:44.816019  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I0630 20:55:44.853352  166730 cri.go:87] found id: ""
	I0630 20:55:44.853381  166730 logs.go:274] 0 containers: []
	W0630 20:55:44.853390  166730 logs.go:276] No container was found matching "etcd"
	I0630 20:55:44.853398  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
	I0630 20:55:44.853451  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I0630 20:55:44.883758  166730 cri.go:87] found id: ""
	I0630 20:55:44.883788  166730 logs.go:274] 0 containers: []
	W0630 20:55:44.883797  166730 logs.go:276] No container was found matching "coredns"
	I0630 20:55:44.883808  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
	I0630 20:55:44.883861  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I0630 20:55:45.010738  166730 cri.go:87] found id: ""
	I0630 20:55:45.010767  166730 logs.go:274] 0 containers: []
	W0630 20:55:45.010774  166730 logs.go:276] No container was found matching "kube-scheduler"
	I0630 20:55:45.010780  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
	I0630 20:55:45.010834  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I0630 20:55:45.046022  166730 cri.go:87] found id: ""
	I0630 20:55:45.046052  166730 logs.go:274] 0 containers: []
	W0630 20:55:45.046061  166730 logs.go:276] No container was found matching "kube-proxy"
	I0630 20:55:45.046069  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
	I0630 20:55:45.046121  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
	I0630 20:55:45.082049  166730 cri.go:87] found id: ""
	I0630 20:55:45.082081  166730 logs.go:274] 0 containers: []
	W0630 20:55:45.082089  166730 logs.go:276] No container was found matching "kubernetes-dashboard"
	I0630 20:55:45.082100  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
	I0630 20:55:45.082155  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
	I0630 20:55:45.111253  166730 cri.go:87] found id: ""
	I0630 20:55:45.111278  166730 logs.go:274] 0 containers: []
	W0630 20:55:45.111285  166730 logs.go:276] No container was found matching "storage-provisioner"
	I0630 20:55:45.111291  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
	I0630 20:55:45.111339  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I0630 20:55:45.141541  166730 cri.go:87] found id: ""
	I0630 20:55:45.141569  166730 logs.go:274] 0 containers: []
	W0630 20:55:45.141579  166730 logs.go:276] No container was found matching "kube-controller-manager"
	I0630 20:55:45.141591  166730 logs.go:123] Gathering logs for dmesg ...
	I0630 20:55:45.141607  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0630 20:55:45.162712  166730 logs.go:123] Gathering logs for describe nodes ...
	I0630 20:55:45.162748  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	W0630 20:55:45.229843  166730 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	 output: 
	** stderr ** 
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	
	** /stderr **
	I0630 20:55:45.229876  166730 logs.go:123] Gathering logs for containerd ...
	I0630 20:55:45.229891  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
	I0630 20:55:45.279559  166730 logs.go:123] Gathering logs for container status ...
	I0630 20:55:45.279595  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0630 20:55:45.310726  166730 logs.go:123] Gathering logs for kubelet ...
	I0630 20:55:45.310766  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	W0630 20:55:45.374121  166730 logs.go:138] Found kubelet problem: Jun 30 20:55:44 kubernetes-upgrade-20220630205032-9950 kubelet[6758]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	I0630 20:55:45.449500  166730 out.go:309] Setting ErrFile to fd 2...
	I0630 20:55:45.449538  166730 out.go:343] TERM=,COLORTERM=, which probably does not support color
	W0630 20:55:45.449706  166730 out.go:239] X Problems detected in kubelet:
	W0630 20:55:45.449724  166730 out.go:239]   Jun 30 20:55:44 kubernetes-upgrade-20220630205032-9950 kubelet[6758]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	I0630 20:55:45.449730  166730 out.go:309] Setting ErrFile to fd 2...
	I0630 20:55:45.449738  166730 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 20:55:46.659846  204258 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:55:47.159958  204258 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:55:47.659877  204258 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:55:48.159360  204258 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:55:48.659328  204258 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:55:49.160018  204258 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:55:49.219762  204258 kubeadm.go:1045] duration metric: took 12.158222474s to wait for elevateKubeSystemPrivileges.
	I0630 20:55:49.219805  204258 kubeadm.go:397] StartCluster complete in 24.204884044s
	I0630 20:55:49.219827  204258 settings.go:142] acquiring lock: {Name:mkcbd229caa05b60d3551ef0b47eea08424c9b5d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 20:55:49.219922  204258 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 20:55:49.221667  204258 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig: {Name:mk34e4a4e7b04f624b9adbda4f77ee20b38308ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 20:55:49.738694  204258 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "enable-default-cni-20220630204858-9950" rescaled to 1
	I0630 20:55:49.738753  204258 start.go:208] Will wait 5m0s for node &{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0630 20:55:49.740978  204258 out.go:177] * Verifying Kubernetes components...
	I0630 20:55:49.738826  204258 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0630 20:55:49.738836  204258 addons.go:412] enableAddons start: toEnable=map[], additional=[]
	I0630 20:55:49.739009  204258 config.go:178] Loaded profile config "enable-default-cni-20220630204858-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 20:55:49.742489  204258 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 20:55:49.742536  204258 addons.go:65] Setting default-storageclass=true in profile "enable-default-cni-20220630204858-9950"
	I0630 20:55:49.742552  204258 addons.go:65] Setting storage-provisioner=true in profile "enable-default-cni-20220630204858-9950"
	I0630 20:55:49.742558  204258 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "enable-default-cni-20220630204858-9950"
	I0630 20:55:49.742573  204258 addons.go:153] Setting addon storage-provisioner=true in "enable-default-cni-20220630204858-9950"
	W0630 20:55:49.742586  204258 addons.go:162] addon storage-provisioner should already be in state true
	I0630 20:55:49.742638  204258 host.go:66] Checking if "enable-default-cni-20220630204858-9950" exists ...
	I0630 20:55:49.742945  204258 cli_runner.go:164] Run: docker container inspect enable-default-cni-20220630204858-9950 --format={{.State.Status}}
	I0630 20:55:49.743183  204258 cli_runner.go:164] Run: docker container inspect enable-default-cni-20220630204858-9950 --format={{.State.Status}}
	I0630 20:55:49.803577  204258 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0630 20:55:45.267856  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:55:47.768421  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:55:49.773482  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:55:46.570008  212673 out.go:204] * Creating docker container (CPUs=2, Memory=2048MB) ...
	I0630 20:55:46.570204  212673 start.go:165] libmachine.API.Create for "bridge-20220630204858-9950" (driver="docker")
	I0630 20:55:46.570237  212673 client.go:168] LocalClient.Create starting
	I0630 20:55:46.570306  212673 main.go:134] libmachine: Reading certificate data from /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem
	I0630 20:55:46.570334  212673 main.go:134] libmachine: Decoding PEM data...
	I0630 20:55:46.570351  212673 main.go:134] libmachine: Parsing certificate...
	I0630 20:55:46.570408  212673 main.go:134] libmachine: Reading certificate data from /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem
	I0630 20:55:46.570428  212673 main.go:134] libmachine: Decoding PEM data...
	I0630 20:55:46.570441  212673 main.go:134] libmachine: Parsing certificate...
	I0630 20:55:46.570745  212673 cli_runner.go:164] Run: docker network inspect bridge-20220630204858-9950 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	W0630 20:55:46.605231  212673 cli_runner.go:211] docker network inspect bridge-20220630204858-9950 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
	I0630 20:55:46.605294  212673 network_create.go:272] running [docker network inspect bridge-20220630204858-9950] to gather additional debugging logs...
	I0630 20:55:46.605316  212673 cli_runner.go:164] Run: docker network inspect bridge-20220630204858-9950
	W0630 20:55:46.641026  212673 cli_runner.go:211] docker network inspect bridge-20220630204858-9950 returned with exit code 1
	I0630 20:55:46.641090  212673 network_create.go:275] error running [docker network inspect bridge-20220630204858-9950]: docker network inspect bridge-20220630204858-9950: exit status 1
	stdout:
	[]
	
	stderr:
	Error: No such network: bridge-20220630204858-9950
	I0630 20:55:46.641125  212673 network_create.go:277] output of [docker network inspect bridge-20220630204858-9950]: -- stdout --
	[]
	
	-- /stdout --
	** stderr ** 
	Error: No such network: bridge-20220630204858-9950
	
	** /stderr **
	I0630 20:55:46.641179  212673 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0630 20:55:46.678059  212673 network.go:240] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName:br-c7ee26fec5a3 IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:02:42:cc:d0:4a:9e}}
	I0630 20:55:46.678831  212673 network.go:240] skipping subnet 192.168.58.0/24 that is taken: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 Interface:{IfaceName:br-3e97afadef02 IfaceIPv4:192.168.58.1 IfaceMTU:1500 IfaceMAC:02:42:9e:e7:fd:62}}
	I0630 20:55:46.679666  212673 network.go:240] skipping subnet 192.168.67.0/24 that is taken: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 Interface:{IfaceName:br-fbd8d6c05e6b IfaceIPv4:192.168.67.1 IfaceMTU:1500 IfaceMAC:02:42:6b:9f:58:b3}}
	I0630 20:55:46.680958  212673 network.go:288] reserving subnet 192.168.76.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[] amended:true}} dirty:map[192.168.76.0:0xc00064c288] misses:0}
	I0630 20:55:46.681008  212673 network.go:235] using free private subnet 192.168.76.0/24: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
	I0630 20:55:46.681023  212673 network_create.go:115] attempt to create docker network bridge-20220630204858-9950 192.168.76.0/24 with gateway 192.168.76.1 and MTU of 1500 ...
	I0630 20:55:46.681100  212673 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.76.0/24 --gateway=192.168.76.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=bridge-20220630204858-9950 bridge-20220630204858-9950
	I0630 20:55:46.759260  212673 network_create.go:99] docker network bridge-20220630204858-9950 192.168.76.0/24 created
	I0630 20:55:46.759290  212673 kic.go:106] calculated static IP "192.168.76.2" for the "bridge-20220630204858-9950" container
	I0630 20:55:46.759340  212673 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I0630 20:55:46.797407  212673 cli_runner.go:164] Run: docker volume create bridge-20220630204858-9950 --label name.minikube.sigs.k8s.io=bridge-20220630204858-9950 --label created_by.minikube.sigs.k8s.io=true
	I0630 20:55:46.833736  212673 oci.go:103] Successfully created a docker volume bridge-20220630204858-9950
	I0630 20:55:46.833825  212673 cli_runner.go:164] Run: docker run --rm --name bridge-20220630204858-9950-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=bridge-20220630204858-9950 --entrypoint /usr/bin/test -v bridge-20220630204858-9950:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e -d /var/lib
	I0630 20:55:47.536791  212673 oci.go:107] Successfully prepared a docker volume bridge-20220630204858-9950
	I0630 20:55:47.536859  212673 preload.go:132] Checking if preload exists for k8s version v1.24.2 and runtime containerd
	I0630 20:55:47.536881  212673 kic.go:179] Starting extracting preloaded images to volume ...
	I0630 20:55:47.536958  212673 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-containerd-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v bridge-20220630204858-9950:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e -I lz4 -xf /preloaded.tar -C /extractDir
	I0630 20:55:49.805221  204258 addons.go:345] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 20:55:49.805247  204258 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0630 20:55:49.805301  204258 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" enable-default-cni-20220630204858-9950
	I0630 20:55:49.829524  204258 addons.go:153] Setting addon default-storageclass=true in "enable-default-cni-20220630204858-9950"
	W0630 20:55:49.829557  204258 addons.go:162] addon default-storageclass should already be in state true
	I0630 20:55:49.829595  204258 host.go:66] Checking if "enable-default-cni-20220630204858-9950" exists ...
	I0630 20:55:49.830125  204258 cli_runner.go:164] Run: docker container inspect enable-default-cni-20220630204858-9950 --format={{.State.Status}}
	I0630 20:55:49.859824  204258 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49387 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/enable-default-cni-20220630204858-9950/id_rsa Username:docker}
	I0630 20:55:49.870020  204258 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.94.1 host.minikube.internal\n           fallthrough\n        }' | sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0630 20:55:49.870233  204258 node_ready.go:35] waiting up to 5m0s for node "enable-default-cni-20220630204858-9950" to be "Ready" ...
	I0630 20:55:49.880492  204258 addons.go:345] installing /etc/kubernetes/addons/storageclass.yaml
	I0630 20:55:49.880520  204258 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0630 20:55:49.880568  204258 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" enable-default-cni-20220630204858-9950
	I0630 20:55:49.917841  204258 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49387 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/enable-default-cni-20220630204858-9950/id_rsa Username:docker}
	I0630 20:55:49.926188  204258 node_ready.go:49] node "enable-default-cni-20220630204858-9950" has status "Ready":"True"
	I0630 20:55:49.926214  204258 node_ready.go:38] duration metric: took 55.942047ms waiting for node "enable-default-cni-20220630204858-9950" to be "Ready" ...
	I0630 20:55:49.926225  204258 pod_ready.go:35] extra waiting up to 5m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0630 20:55:49.942701  204258 pod_ready.go:78] waiting up to 5m0s for pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace to be "Ready" ...
	I0630 20:55:50.044298  204258 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 20:55:50.127996  204258 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0630 20:55:51.536821  204258 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.94.1 host.minikube.internal\n           fallthrough\n        }' | sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (1.666758473s)
	I0630 20:55:51.561712  204258 start.go:806] {"host.minikube.internal": 192.168.94.1} host record injected into CoreDNS
	I0630 20:55:52.099073  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:55:52.108346  204258 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (2.064004464s)
	I0630 20:55:52.108435  204258 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (1.980408563s)
	I0630 20:55:52.252343  204258 out.go:177] * Enabled addons: storage-provisioner, default-storageclass
	I0630 20:55:52.266814  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:55:54.267384  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:55:54.657023  212673 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-containerd-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v bridge-20220630204858-9950:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e -I lz4 -xf /preloaded.tar -C /extractDir: (7.119988103s)
	I0630 20:55:54.657091  212673 kic.go:188] duration metric: took 7.120203 seconds to extract preloaded images to volume
	W0630 20:55:54.657275  212673 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	I0630 20:55:54.657396  212673 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0630 20:55:54.778561  212673 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname bridge-20220630204858-9950 --name bridge-20220630204858-9950 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=bridge-20220630204858-9950 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=bridge-20220630204858-9950 --network bridge-20220630204858-9950 --ip 192.168.76.2 --volume bridge-20220630204858-9950:/var --security-opt apparmor=unconfined --memory=2048mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e
	I0630 20:55:55.227194  212673 cli_runner.go:164] Run: docker container inspect bridge-20220630204858-9950 --format={{.State.Running}}
	I0630 20:55:55.271122  212673 cli_runner.go:164] Run: docker container inspect bridge-20220630204858-9950 --format={{.State.Status}}
	I0630 20:55:55.312288  212673 cli_runner.go:164] Run: docker exec bridge-20220630204858-9950 stat /var/lib/dpkg/alternatives/iptables
	I0630 20:55:55.379124  212673 oci.go:144] the created container "bridge-20220630204858-9950" has a running status.
	I0630 20:55:55.379157  212673 kic.go:210] Creating ssh key for kic: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/bridge-20220630204858-9950/id_rsa...
	I0630 20:55:55.492394  212673 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/bridge-20220630204858-9950/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0630 20:55:55.585540  212673 cli_runner.go:164] Run: docker container inspect bridge-20220630204858-9950 --format={{.State.Status}}
	I0630 20:55:55.627175  212673 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0630 20:55:55.627209  212673 kic_runner.go:114] Args: [docker exec --privileged bridge-20220630204858-9950 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0630 20:55:55.722547  212673 cli_runner.go:164] Run: docker container inspect bridge-20220630204858-9950 --format={{.State.Status}}
	I0630 20:55:55.760752  212673 machine.go:88] provisioning docker machine ...
	I0630 20:55:55.760800  212673 ubuntu.go:169] provisioning hostname "bridge-20220630204858-9950"
	I0630 20:55:55.760885  212673 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" bridge-20220630204858-9950
	I0630 20:55:55.802550  212673 main.go:134] libmachine: Using SSH client type: native
	I0630 20:55:55.802826  212673 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil>  [] 0s} 127.0.0.1 49392 <nil> <nil>}
	I0630 20:55:55.802860  212673 main.go:134] libmachine: About to run SSH command:
	sudo hostname bridge-20220630204858-9950 && echo "bridge-20220630204858-9950" | sudo tee /etc/hostname
	I0630 20:55:55.933414  212673 main.go:134] libmachine: SSH cmd err, output: <nil>: bridge-20220630204858-9950
	
	I0630 20:55:55.933501  212673 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" bridge-20220630204858-9950
	I0630 20:55:55.975720  212673 main.go:134] libmachine: Using SSH client type: native
	I0630 20:55:55.975938  212673 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil>  [] 0s} 127.0.0.1 49392 <nil> <nil>}
	I0630 20:55:55.975967  212673 main.go:134] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sbridge-20220630204858-9950' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 bridge-20220630204858-9950/g' /etc/hosts;
				else 
					echo '127.0.1.1 bridge-20220630204858-9950' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0630 20:55:56.097075  212673 main.go:134] libmachine: SSH cmd err, output: <nil>: 
	I0630 20:55:56.097111  212673 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube CaCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/c
erts/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube}
	I0630 20:55:56.097138  212673 ubuntu.go:177] setting up certificates
	I0630 20:55:56.097148  212673 provision.go:83] configureAuth start
	I0630 20:55:56.097201  212673 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" bridge-20220630204858-9950
	I0630 20:55:56.132663  212673 provision.go:138] copyHostCerts
	I0630 20:55:56.132731  212673 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem, removing ...
	I0630 20:55:56.132745  212673 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem
	I0630 20:55:56.132827  212673 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem (1679 bytes)
	I0630 20:55:56.132924  212673 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem, removing ...
	I0630 20:55:56.132937  212673 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem
	I0630 20:55:56.132984  212673 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem (1082 bytes)
	I0630 20:55:56.133155  212673 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem, removing ...
	I0630 20:55:56.133171  212673 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem
	I0630 20:55:56.133213  212673 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem (1123 bytes)
	I0630 20:55:56.133280  212673 provision.go:112] generating server cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem org=jenkins.bridge-20220630204858-9950 san=[192.168.76.2 127.0.0.1 localhost 127.0.0.1 minikube bridge-20220630204858-9950]
	I0630 20:55:52.424782  204258 addons.go:414] enableAddons completed in 2.685935701s
	I0630 20:55:54.569634  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:55:55.450574  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:55:55.782242  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
	I0630 20:55:55.782313  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I0630 20:55:55.812323  166730 cri.go:87] found id: ""
	I0630 20:55:55.812354  166730 logs.go:274] 0 containers: []
	W0630 20:55:55.812363  166730 logs.go:276] No container was found matching "kube-apiserver"
	I0630 20:55:55.812371  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
	I0630 20:55:55.812425  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I0630 20:55:55.838877  166730 cri.go:87] found id: ""
	I0630 20:55:55.838905  166730 logs.go:274] 0 containers: []
	W0630 20:55:55.838917  166730 logs.go:276] No container was found matching "etcd"
	I0630 20:55:55.838925  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
	I0630 20:55:55.838985  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I0630 20:55:55.867225  166730 cri.go:87] found id: ""
	I0630 20:55:55.867249  166730 logs.go:274] 0 containers: []
	W0630 20:55:55.867273  166730 logs.go:276] No container was found matching "coredns"
	I0630 20:55:55.867282  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
	I0630 20:55:55.867338  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I0630 20:55:55.893546  166730 cri.go:87] found id: ""
	I0630 20:55:55.893578  166730 logs.go:274] 0 containers: []
	W0630 20:55:55.893585  166730 logs.go:276] No container was found matching "kube-scheduler"
	I0630 20:55:55.893591  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
	I0630 20:55:55.893632  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I0630 20:55:55.917280  166730 cri.go:87] found id: ""
	I0630 20:55:55.917304  166730 logs.go:274] 0 containers: []
	W0630 20:55:55.917313  166730 logs.go:276] No container was found matching "kube-proxy"
	I0630 20:55:55.917320  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
	I0630 20:55:55.917378  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
	I0630 20:55:55.942846  166730 cri.go:87] found id: ""
	I0630 20:55:55.942873  166730 logs.go:274] 0 containers: []
	W0630 20:55:55.942882  166730 logs.go:276] No container was found matching "kubernetes-dashboard"
	I0630 20:55:55.942890  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
	I0630 20:55:55.942944  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
	I0630 20:55:55.970944  166730 cri.go:87] found id: ""
	I0630 20:55:55.970972  166730 logs.go:274] 0 containers: []
	W0630 20:55:55.970981  166730 logs.go:276] No container was found matching "storage-provisioner"
	I0630 20:55:55.970990  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
	I0630 20:55:55.971044  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I0630 20:55:55.995749  166730 cri.go:87] found id: ""
	I0630 20:55:55.995773  166730 logs.go:274] 0 containers: []
	W0630 20:55:55.995779  166730 logs.go:276] No container was found matching "kube-controller-manager"
	I0630 20:55:55.995787  166730 logs.go:123] Gathering logs for kubelet ...
	I0630 20:55:55.995801  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	W0630 20:55:56.047220  166730 logs.go:138] Found kubelet problem: Jun 30 20:55:55 kubernetes-upgrade-20220630205032-9950 kubelet[7036]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	I0630 20:55:56.098827  166730 logs.go:123] Gathering logs for dmesg ...
	I0630 20:55:56.098857  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0630 20:55:56.114004  166730 logs.go:123] Gathering logs for describe nodes ...
	I0630 20:55:56.114038  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	W0630 20:55:56.165221  166730 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	 output: 
	** stderr ** 
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	
	** /stderr **
	I0630 20:55:56.165247  166730 logs.go:123] Gathering logs for containerd ...
	I0630 20:55:56.165257  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
	I0630 20:55:56.202035  166730 logs.go:123] Gathering logs for container status ...
	I0630 20:55:56.202075  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0630 20:55:56.229905  166730 out.go:309] Setting ErrFile to fd 2...
	I0630 20:55:56.229939  166730 out.go:343] TERM=,COLORTERM=, which probably does not support color
	W0630 20:55:56.230076  166730 out.go:239] X Problems detected in kubelet:
	W0630 20:55:56.230094  166730 out.go:239]   Jun 30 20:55:55 kubernetes-upgrade-20220630205032-9950 kubelet[7036]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	I0630 20:55:56.230100  166730 out.go:309] Setting ErrFile to fd 2...
	I0630 20:55:56.230107  166730 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 20:55:56.206130  212673 provision.go:172] copyRemoteCerts
	I0630 20:55:56.206183  212673 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0630 20:55:56.206213  212673 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" bridge-20220630204858-9950
	I0630 20:55:56.242358  212673 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49392 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/bridge-20220630204858-9950/id_rsa Username:docker}
	I0630 20:55:56.332675  212673 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
	I0630 20:55:56.352336  212673 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem --> /etc/docker/server.pem (1253 bytes)
	I0630 20:55:56.372659  212673 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0630 20:55:56.391569  212673 provision.go:86] duration metric: configureAuth took 294.40903ms
	I0630 20:55:56.391598  212673 ubuntu.go:193] setting minikube options for container-runtime
	I0630 20:55:56.391784  212673 config.go:178] Loaded profile config "bridge-20220630204858-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 20:55:56.391798  212673 machine.go:91] provisioned docker machine in 631.018103ms
	I0630 20:55:56.391803  212673 client.go:171] LocalClient.Create took 9.821559055s
	I0630 20:55:56.391831  212673 start.go:173] duration metric: libmachine.API.Create for "bridge-20220630204858-9950" took 9.821618626s
	I0630 20:55:56.391845  212673 start.go:306] post-start starting for "bridge-20220630204858-9950" (driver="docker")
	I0630 20:55:56.391856  212673 start.go:316] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0630 20:55:56.391910  212673 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0630 20:55:56.391959  212673 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" bridge-20220630204858-9950
	I0630 20:55:56.427609  212673 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49392 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/bridge-20220630204858-9950/id_rsa Username:docker}
	I0630 20:55:56.517207  212673 ssh_runner.go:195] Run: cat /etc/os-release
	I0630 20:55:56.520436  212673 main.go:134] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0630 20:55:56.520469  212673 main.go:134] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0630 20:55:56.520486  212673 main.go:134] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0630 20:55:56.520493  212673 info.go:137] Remote host: Ubuntu 20.04.4 LTS
	I0630 20:55:56.520506  212673 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/addons for local assets ...
	I0630 20:55:56.520572  212673 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files for local assets ...
	I0630 20:55:56.520652  212673 filesync.go:149] local asset: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem -> 99502.pem in /etc/ssl/certs
	I0630 20:55:56.520728  212673 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0630 20:55:56.529533  212673 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem --> /etc/ssl/certs/99502.pem (1708 bytes)
	I0630 20:55:56.549147  212673 start.go:309] post-start completed in 157.285272ms
	I0630 20:55:56.549626  212673 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" bridge-20220630204858-9950
	I0630 20:55:56.585571  212673 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/bridge-20220630204858-9950/config.json ...
	I0630 20:55:56.585820  212673 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0630 20:55:56.585860  212673 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" bridge-20220630204858-9950
	I0630 20:55:56.622616  212673 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49392 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/bridge-20220630204858-9950/id_rsa Username:docker}
	I0630 20:55:56.709706  212673 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0630 20:55:56.714181  212673 start.go:134] duration metric: createHost completed in 10.146405101s
	I0630 20:55:56.714204  212673 start.go:81] releasing machines lock for "bridge-20220630204858-9950", held for 10.146527662s
	I0630 20:55:56.714281  212673 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" bridge-20220630204858-9950
	I0630 20:55:56.749842  212673 ssh_runner.go:195] Run: systemctl --version
	I0630 20:55:56.749896  212673 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" bridge-20220630204858-9950
	I0630 20:55:56.749962  212673 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/
	I0630 20:55:56.750025  212673 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" bridge-20220630204858-9950
	I0630 20:55:56.791635  212673 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49392 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/bridge-20220630204858-9950/id_rsa Username:docker}
	I0630 20:55:56.792958  212673 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49392 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/bridge-20220630204858-9950/id_rsa Username:docker}
	I0630 20:55:56.873413  212673 ssh_runner.go:195] Run: sudo systemctl stop -f crio
	I0630 20:55:56.901712  212673 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0630 20:55:56.911179  212673 docker.go:179] disabling docker service ...
	I0630 20:55:56.911231  212673 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0630 20:55:56.927760  212673 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0630 20:55:56.937114  212673 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0630 20:55:57.025376  212673 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0630 20:55:57.106230  212673 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0630 20:55:57.115609  212673 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
	image-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0630 20:55:57.128489  212673 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*sandbox_image = .*$|sandbox_image = "k8s.gcr.io/pause:3.7"|' -i /etc/containerd/config.toml"
	I0630 20:55:57.136528  212673 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*restrict_oom_score_adj = .*$|restrict_oom_score_adj = false|' -i /etc/containerd/config.toml"
	I0630 20:55:57.144580  212673 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*SystemdCgroup = .*$|SystemdCgroup = false|' -i /etc/containerd/config.toml"
	I0630 20:55:57.152450  212673 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*conf_dir = .*$|conf_dir = "/etc/cni/net.d"|' -i /etc/containerd/config.toml"
	I0630 20:55:57.160485  212673 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^# imports|imports = ["/etc/containerd/containerd.conf.d/02-containerd.conf"]|' -i /etc/containerd/config.toml"
	I0630 20:55:57.168217  212673 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc/containerd/containerd.conf.d && printf %!s(MISSING) "dmVyc2lvbiA9IDIK" | base64 -d | sudo tee /etc/containerd/containerd.conf.d/02-containerd.conf"
	I0630 20:55:57.181426  212673 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0630 20:55:57.187814  212673 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0630 20:55:57.194165  212673 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0630 20:55:57.270971  212673 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0630 20:55:57.351565  212673 start.go:447] Will wait 60s for socket path /run/containerd/containerd.sock
	I0630 20:55:57.351635  212673 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
	I0630 20:55:57.355115  212673 start.go:468] Will wait 60s for crictl version
	I0630 20:55:57.355174  212673 ssh_runner.go:195] Run: sudo crictl version
	I0630 20:55:57.382252  212673 start.go:477] Version:  0.1.0
	RuntimeName:  containerd
	RuntimeVersion:  1.6.6
	RuntimeApiVersion:  v1alpha2
	I0630 20:55:57.382314  212673 ssh_runner.go:195] Run: containerd --version
	I0630 20:55:57.411658  212673 ssh_runner.go:195] Run: containerd --version
	I0630 20:55:57.441942  212673 out.go:177] * Preparing Kubernetes v1.24.2 on containerd 1.6.6 ...
	I0630 20:55:57.443202  212673 cli_runner.go:164] Run: docker network inspect bridge-20220630204858-9950 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0630 20:55:57.478316  212673 ssh_runner.go:195] Run: grep 192.168.76.1	host.minikube.internal$ /etc/hosts
	I0630 20:55:57.481544  212673 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.76.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0630 20:55:57.490769  212673 preload.go:132] Checking if preload exists for k8s version v1.24.2 and runtime containerd
	I0630 20:55:57.490829  212673 ssh_runner.go:195] Run: sudo crictl images --output json
	I0630 20:55:57.514889  212673 containerd.go:547] all images are preloaded for containerd runtime.
	I0630 20:55:57.514916  212673 containerd.go:461] Images already preloaded, skipping extraction
	I0630 20:55:57.514965  212673 ssh_runner.go:195] Run: sudo crictl images --output json
	I0630 20:55:57.541114  212673 containerd.go:547] all images are preloaded for containerd runtime.
	I0630 20:55:57.541146  212673 cache_images.go:84] Images are preloaded, skipping loading
	I0630 20:55:57.541216  212673 ssh_runner.go:195] Run: sudo crictl info
	I0630 20:55:57.565945  212673 cni.go:95] Creating CNI manager for "bridge"
	I0630 20:55:57.565975  212673 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
	I0630 20:55:57.565992  212673 kubeadm.go:158] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.24.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:bridge-20220630204858-9950 NodeName:bridge-20220630204858-9950 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.76.2 CgroupDriver:cgroupfs ClientCAFile:/var
/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}
	I0630 20:55:57.566146  212673 kubeadm.go:162] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.76.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: /run/containerd/containerd.sock
	  name: "bridge-20220630204858-9950"
	  kubeletExtraArgs:
	    node-ip: 192.168.76.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.24.2
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%!"(MISSING)
	  nodefs.inodesFree: "0%!"(MISSING)
	  imagefs.available: "0%!"(MISSING)
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0630 20:55:57.566252  212673 kubeadm.go:961] kubelet [Unit]
	Wants=containerd.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.24.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=bridge-20220630204858-9950 --image-service-endpoint=unix:///run/containerd/containerd.sock --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.76.2 --runtime-request-timeout=15m
	
	[Install]
	 config:
	{KubernetesVersion:v1.24.2 ClusterName:bridge-20220630204858-9950 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:bridge NodeIP: NodePort:8443 NodeName:}
	I0630 20:55:57.566309  212673 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.24.2
	I0630 20:55:57.573514  212673 binaries.go:44] Found k8s binaries, skipping transfer
	I0630 20:55:57.573581  212673 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0630 20:55:57.580676  212673 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (519 bytes)
	I0630 20:55:57.593558  212673 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0630 20:55:57.606351  212673 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2055 bytes)
	I0630 20:55:57.619170  212673 ssh_runner.go:195] Run: grep 192.168.76.2	control-plane.minikube.internal$ /etc/hosts
	I0630 20:55:57.622326  212673 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0630 20:55:57.631440  212673 certs.go:54] Setting up /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/bridge-20220630204858-9950 for IP: 192.168.76.2
	I0630 20:55:57.631536  212673 certs.go:182] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.key
	I0630 20:55:57.631601  212673 certs.go:182] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.key
	I0630 20:55:57.631667  212673 certs.go:302] generating minikube-user signed cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/bridge-20220630204858-9950/client.key
	I0630 20:55:57.631685  212673 crypto.go:68] Generating cert /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/bridge-20220630204858-9950/client.crt with IP's: []
	I0630 20:55:57.739977  212673 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/bridge-20220630204858-9950/client.crt ...
	I0630 20:55:57.740010  212673 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/bridge-20220630204858-9950/client.crt: {Name:mke6e0277c25124b31dbfd55a9095ff296fb5e57 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 20:55:57.740220  212673 crypto.go:164] Writing key to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/bridge-20220630204858-9950/client.key ...
	I0630 20:55:57.740233  212673 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/bridge-20220630204858-9950/client.key: {Name:mk31207fe37dadc8e8fb0be86159a561f753729a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 20:55:57.740339  212673 certs.go:302] generating minikube signed cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/bridge-20220630204858-9950/apiserver.key.31bdca25
	I0630 20:55:57.740356  212673 crypto.go:68] Generating cert /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/bridge-20220630204858-9950/apiserver.crt.31bdca25 with IP's: [192.168.76.2 10.96.0.1 127.0.0.1 10.0.0.1]
	I0630 20:55:57.847242  212673 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/bridge-20220630204858-9950/apiserver.crt.31bdca25 ...
	I0630 20:55:57.847271  212673 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/bridge-20220630204858-9950/apiserver.crt.31bdca25: {Name:mkef3ab2d396bd7bc4a1e6e3eac66a07094e9f66 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 20:55:57.847453  212673 crypto.go:164] Writing key to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/bridge-20220630204858-9950/apiserver.key.31bdca25 ...
	I0630 20:55:57.847471  212673 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/bridge-20220630204858-9950/apiserver.key.31bdca25: {Name:mk65a591a79b2ab802426a2267969384992b3f19 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 20:55:57.847555  212673 certs.go:320] copying /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/bridge-20220630204858-9950/apiserver.crt.31bdca25 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/bridge-20220630204858-9950/apiserver.crt
	I0630 20:55:57.847612  212673 certs.go:324] copying /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/bridge-20220630204858-9950/apiserver.key.31bdca25 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/bridge-20220630204858-9950/apiserver.key
	I0630 20:55:57.847657  212673 certs.go:302] generating aggregator signed cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/bridge-20220630204858-9950/proxy-client.key
	I0630 20:55:57.847671  212673 crypto.go:68] Generating cert /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/bridge-20220630204858-9950/proxy-client.crt with IP's: []
	I0630 20:55:57.991662  212673 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/bridge-20220630204858-9950/proxy-client.crt ...
	I0630 20:55:57.991690  212673 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/bridge-20220630204858-9950/proxy-client.crt: {Name:mk9bf7d4f80b03254ffe765ccc5814378ccf23dd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 20:55:57.991865  212673 crypto.go:164] Writing key to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/bridge-20220630204858-9950/proxy-client.key ...
	I0630 20:55:57.991879  212673 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/bridge-20220630204858-9950/proxy-client.key: {Name:mk3925cbd66d11df655124f6a1b9bb448c367f33 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 20:55:57.992046  212673 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950.pem (1338 bytes)
	W0630 20:55:57.992082  212673 certs.go:384] ignoring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950_empty.pem, impossibly tiny 0 bytes
	I0630 20:55:57.992096  212673 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem (1679 bytes)
	I0630 20:55:57.992122  212673 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem (1082 bytes)
	I0630 20:55:57.992145  212673 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem (1123 bytes)
	I0630 20:55:57.992168  212673 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/key.pem (1679 bytes)
	I0630 20:55:57.992204  212673 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem (1708 bytes)
	I0630 20:55:57.992739  212673 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/bridge-20220630204858-9950/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
	I0630 20:55:58.011864  212673 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/bridge-20220630204858-9950/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I0630 20:55:58.029305  212673 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/bridge-20220630204858-9950/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0630 20:55:58.046575  212673 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/bridge-20220630204858-9950/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
	I0630 20:55:58.064286  212673 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0630 20:55:58.082393  212673 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
	I0630 20:55:58.099428  212673 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0630 20:55:58.116136  212673 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
	I0630 20:55:58.132910  212673 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0630 20:55:58.150213  212673 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950.pem --> /usr/share/ca-certificates/9950.pem (1338 bytes)
	I0630 20:55:58.167331  212673 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem --> /usr/share/ca-certificates/99502.pem (1708 bytes)
	I0630 20:55:58.184814  212673 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0630 20:55:58.197448  212673 ssh_runner.go:195] Run: openssl version
	I0630 20:55:58.202381  212673 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0630 20:55:58.209813  212673 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0630 20:55:58.212769  212673 certs.go:431] hashing: -rw-r--r-- 1 root root 1111 Jun 30 20:22 /usr/share/ca-certificates/minikubeCA.pem
	I0630 20:55:58.212814  212673 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0630 20:55:58.217544  212673 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0630 20:55:58.224605  212673 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/9950.pem && ln -fs /usr/share/ca-certificates/9950.pem /etc/ssl/certs/9950.pem"
	I0630 20:55:58.231576  212673 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/9950.pem
	I0630 20:55:58.234676  212673 certs.go:431] hashing: -rw-r--r-- 1 root root 1338 Jun 30 20:26 /usr/share/ca-certificates/9950.pem
	I0630 20:55:58.234730  212673 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/9950.pem
	I0630 20:55:58.239471  212673 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/9950.pem /etc/ssl/certs/51391683.0"
	I0630 20:55:58.246703  212673 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/99502.pem && ln -fs /usr/share/ca-certificates/99502.pem /etc/ssl/certs/99502.pem"
	I0630 20:55:58.254058  212673 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/99502.pem
	I0630 20:55:58.257570  212673 certs.go:431] hashing: -rw-r--r-- 1 root root 1708 Jun 30 20:26 /usr/share/ca-certificates/99502.pem
	I0630 20:55:58.257619  212673 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/99502.pem
	I0630 20:55:58.263132  212673 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/99502.pem /etc/ssl/certs/3ec20f2e.0"
	I0630 20:55:58.271162  212673 kubeadm.go:395] StartCluster: {Name:bridge-20220630204858-9950 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:bridge-20220630204858-9950 Namespace:default APIServerName:minikube
CA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:bridge NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:5m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror:
DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 20:55:58.271274  212673 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
	I0630 20:55:58.271330  212673 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0630 20:55:58.298446  212673 cri.go:87] found id: ""
	I0630 20:55:58.298512  212673 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0630 20:55:58.305833  212673 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0630 20:55:58.312649  212673 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver
	I0630 20:55:58.312715  212673 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0630 20:55:58.319391  212673 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0630 20:55:58.319439  212673 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0630 20:55:56.267709  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:55:58.767508  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:55:58.577922  212673 out.go:204]   - Generating certificates and keys ...
	I0630 20:55:56.954225  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:55:58.954495  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:00.955091  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:00.769496  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:03.267547  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:01.441329  212673 out.go:204]   - Booting up control plane ...
	I0630 20:56:02.956084  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:05.454102  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:06.232825  166730 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:56:06.243827  166730 kubeadm.go:630] restartCluster took 4m4.449118713s
	W0630 20:56:06.243995  166730 out.go:239] ! Unable to restart cluster, will reset it: apiserver healthz: apiserver process never appeared
	I0630 20:56:06.244034  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm reset --cri-socket /run/containerd/containerd.sock --force"
	I0630 20:56:06.946910  166730 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 20:56:06.958177  166730 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0630 20:56:06.967186  166730 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver
	I0630 20:56:06.967255  166730 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0630 20:56:06.974506  166730 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0630 20:56:06.974558  166730 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0630 20:56:07.227007  166730 out.go:204]   - Generating certificates and keys ...
	I0630 20:56:09.494725  212673 out.go:204]   - Configuring RBAC rules ...
	I0630 20:56:09.933498  212673 cni.go:95] Creating CNI manager for "bridge"
	I0630 20:56:09.935412  212673 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
	I0630 20:56:05.267982  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:07.767572  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:09.936890  212673 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
	I0630 20:56:09.947228  212673 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)
	I0630 20:56:10.034620  212673 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0630 20:56:10.034684  212673 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:56:10.034705  212673 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl label nodes minikube.k8s.io/version=v1.26.0 minikube.k8s.io/commit=251ffcec0e4c997cd7732864187747cc579943c9 minikube.k8s.io/name=bridge-20220630204858-9950 minikube.k8s.io/updated_at=2022_06_30T20_56_10_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:56:10.042633  212673 ops.go:34] apiserver oom_adj: -16
	I0630 20:56:10.327568  212673 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:56:10.887764  212673 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:56:07.455661  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:09.955902  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:08.883897  166730 out.go:204]   - Booting up control plane ...
	I0630 20:56:10.266599  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:12.267197  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:14.267220  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:11.387685  212673 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:56:11.887360  212673 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:56:12.387431  212673 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:56:12.887406  212673 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:56:13.388302  212673 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:56:13.888115  212673 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:56:14.388161  212673 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:56:14.888060  212673 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:56:15.387604  212673 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:56:15.887424  212673 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:56:12.453867  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:14.454223  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:16.454995  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:16.766493  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:18.766918  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:16.387813  212673 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:56:16.888055  212673 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:56:17.388251  212673 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:56:17.888018  212673 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:56:18.387545  212673 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:56:18.887990  212673 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:56:19.387909  212673 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:56:19.887750  212673 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:56:20.387800  212673 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:56:20.887436  212673 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:56:18.954675  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:21.454198  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:21.388166  212673 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:56:21.887360  212673 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:56:22.388184  212673 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:56:22.486209  212673 kubeadm.go:1045] duration metric: took 12.451585026s to wait for elevateKubeSystemPrivileges.
	I0630 20:56:22.486245  212673 kubeadm.go:397] StartCluster complete in 24.215089821s
	I0630 20:56:22.486264  212673 settings.go:142] acquiring lock: {Name:mkcbd229caa05b60d3551ef0b47eea08424c9b5d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 20:56:22.486381  212673 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 20:56:22.487939  212673 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig: {Name:mk34e4a4e7b04f624b9adbda4f77ee20b38308ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 20:56:23.005043  212673 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "bridge-20220630204858-9950" rescaled to 1
	I0630 20:56:23.005165  212673 start.go:208] Will wait 5m0s for node &{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0630 20:56:23.005196  212673 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0630 20:56:23.007687  212673 out.go:177] * Verifying Kubernetes components...
	I0630 20:56:23.005229  212673 addons.go:412] enableAddons start: toEnable=map[], additional=[]
	I0630 20:56:23.005422  212673 config.go:178] Loaded profile config "bridge-20220630204858-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 20:56:23.009432  212673 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 20:56:23.009456  212673 addons.go:65] Setting default-storageclass=true in profile "bridge-20220630204858-9950"
	I0630 20:56:23.009458  212673 addons.go:65] Setting storage-provisioner=true in profile "bridge-20220630204858-9950"
	I0630 20:56:23.009476  212673 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "bridge-20220630204858-9950"
	I0630 20:56:23.009484  212673 addons.go:153] Setting addon storage-provisioner=true in "bridge-20220630204858-9950"
	W0630 20:56:23.009493  212673 addons.go:162] addon storage-provisioner should already be in state true
	I0630 20:56:23.009556  212673 host.go:66] Checking if "bridge-20220630204858-9950" exists ...
	I0630 20:56:23.009877  212673 cli_runner.go:164] Run: docker container inspect bridge-20220630204858-9950 --format={{.State.Status}}
	I0630 20:56:23.010079  212673 cli_runner.go:164] Run: docker container inspect bridge-20220630204858-9950 --format={{.State.Status}}
	I0630 20:56:23.070413  212673 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0630 20:56:23.071605  212673 addons.go:153] Setting addon default-storageclass=true in "bridge-20220630204858-9950"
	W0630 20:56:23.073520  212673 addons.go:162] addon default-storageclass should already be in state true
	I0630 20:56:23.073545  212673 addons.go:345] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 20:56:23.073564  212673 host.go:66] Checking if "bridge-20220630204858-9950" exists ...
	I0630 20:56:23.073568  212673 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0630 20:56:23.073631  212673 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" bridge-20220630204858-9950
	I0630 20:56:23.074017  212673 cli_runner.go:164] Run: docker container inspect bridge-20220630204858-9950 --format={{.State.Status}}
	I0630 20:56:23.115501  212673 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49392 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/bridge-20220630204858-9950/id_rsa Username:docker}
	I0630 20:56:23.120591  212673 addons.go:345] installing /etc/kubernetes/addons/storageclass.yaml
	I0630 20:56:23.120617  212673 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0630 20:56:23.120683  212673 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" bridge-20220630204858-9950
	I0630 20:56:23.124656  212673 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.76.1 host.minikube.internal\n           fallthrough\n        }' | sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0630 20:56:23.126278  212673 node_ready.go:35] waiting up to 5m0s for node "bridge-20220630204858-9950" to be "Ready" ...
	I0630 20:56:23.141976  212673 node_ready.go:49] node "bridge-20220630204858-9950" has status "Ready":"True"
	I0630 20:56:23.142001  212673 node_ready.go:38] duration metric: took 15.686277ms waiting for node "bridge-20220630204858-9950" to be "Ready" ...
	I0630 20:56:23.142012  212673 pod_ready.go:35] extra waiting up to 5m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0630 20:56:23.177884  212673 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49392 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/bridge-20220630204858-9950/id_rsa Username:docker}
	I0630 20:56:23.231559  212673 pod_ready.go:78] waiting up to 5m0s for pod "coredns-6d4b75cb6d-2d7vc" in "kube-system" namespace to be "Ready" ...
	I0630 20:56:23.343141  212673 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 20:56:23.438387  212673 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0630 20:56:24.524626  212673 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.76.1 host.minikube.internal\n           fallthrough\n        }' | sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (1.399924554s)
	I0630 20:56:24.524663  212673 start.go:806] {"host.minikube.internal": 192.168.76.1} host record injected into CoreDNS
	I0630 20:56:24.575448  212673 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (1.232252027s)
	I0630 20:56:24.575513  212673 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (1.137086474s)
	I0630 20:56:24.578504  212673 out.go:177] * Enabled addons: storage-provisioner, default-storageclass
	I0630 20:56:21.266248  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:23.267196  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:24.579993  212673 addons.go:414] enableAddons completed in 1.574773753s
	I0630 20:56:25.244470  212673 pod_ready.go:92] pod "coredns-6d4b75cb6d-2d7vc" in "kube-system" namespace has status "Ready":"True"
	I0630 20:56:25.244521  212673 pod_ready.go:81] duration metric: took 2.012924285s waiting for pod "coredns-6d4b75cb6d-2d7vc" in "kube-system" namespace to be "Ready" ...
	I0630 20:56:25.244535  212673 pod_ready.go:78] waiting up to 5m0s for pod "etcd-bridge-20220630204858-9950" in "kube-system" namespace to be "Ready" ...
	I0630 20:56:25.252574  212673 pod_ready.go:92] pod "etcd-bridge-20220630204858-9950" in "kube-system" namespace has status "Ready":"True"
	I0630 20:56:25.252599  212673 pod_ready.go:81] duration metric: took 8.055921ms waiting for pod "etcd-bridge-20220630204858-9950" in "kube-system" namespace to be "Ready" ...
	I0630 20:56:25.252611  212673 pod_ready.go:78] waiting up to 5m0s for pod "kube-apiserver-bridge-20220630204858-9950" in "kube-system" namespace to be "Ready" ...
	I0630 20:56:25.258053  212673 pod_ready.go:92] pod "kube-apiserver-bridge-20220630204858-9950" in "kube-system" namespace has status "Ready":"True"
	I0630 20:56:25.258076  212673 pod_ready.go:81] duration metric: took 5.457376ms waiting for pod "kube-apiserver-bridge-20220630204858-9950" in "kube-system" namespace to be "Ready" ...
	I0630 20:56:25.258090  212673 pod_ready.go:78] waiting up to 5m0s for pod "kube-controller-manager-bridge-20220630204858-9950" in "kube-system" namespace to be "Ready" ...
	I0630 20:56:25.263133  212673 pod_ready.go:92] pod "kube-controller-manager-bridge-20220630204858-9950" in "kube-system" namespace has status "Ready":"True"
	I0630 20:56:25.263162  212673 pod_ready.go:81] duration metric: took 5.064416ms waiting for pod "kube-controller-manager-bridge-20220630204858-9950" in "kube-system" namespace to be "Ready" ...
	I0630 20:56:25.263174  212673 pod_ready.go:78] waiting up to 5m0s for pod "kube-proxy-vqj7p" in "kube-system" namespace to be "Ready" ...
	I0630 20:56:25.270707  212673 pod_ready.go:92] pod "kube-proxy-vqj7p" in "kube-system" namespace has status "Ready":"True"
	I0630 20:56:25.270735  212673 pod_ready.go:81] duration metric: took 7.553393ms waiting for pod "kube-proxy-vqj7p" in "kube-system" namespace to be "Ready" ...
	I0630 20:56:25.270747  212673 pod_ready.go:78] waiting up to 5m0s for pod "kube-scheduler-bridge-20220630204858-9950" in "kube-system" namespace to be "Ready" ...
	I0630 20:56:25.640789  212673 pod_ready.go:92] pod "kube-scheduler-bridge-20220630204858-9950" in "kube-system" namespace has status "Ready":"True"
	I0630 20:56:25.640810  212673 pod_ready.go:81] duration metric: took 370.055923ms waiting for pod "kube-scheduler-bridge-20220630204858-9950" in "kube-system" namespace to be "Ready" ...
	I0630 20:56:25.640818  212673 pod_ready.go:38] duration metric: took 2.498795221s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0630 20:56:25.640843  212673 api_server.go:51] waiting for apiserver process to appear ...
	I0630 20:56:25.640884  212673 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:56:25.650841  212673 api_server.go:71] duration metric: took 2.645641539s to wait for apiserver process to appear ...
	I0630 20:56:25.650866  212673 api_server.go:87] waiting for apiserver healthz status ...
	I0630 20:56:25.650877  212673 api_server.go:240] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
	I0630 20:56:25.655263  212673 api_server.go:266] https://192.168.76.2:8443/healthz returned 200:
	ok
	I0630 20:56:25.656214  212673 api_server.go:140] control plane version: v1.24.2
	I0630 20:56:25.656242  212673 api_server.go:130] duration metric: took 5.370601ms to wait for apiserver health ...
	I0630 20:56:25.656253  212673 system_pods.go:43] waiting for kube-system pods to appear ...
	I0630 20:56:25.843857  212673 system_pods.go:59] 7 kube-system pods found
	I0630 20:56:25.843891  212673 system_pods.go:61] "coredns-6d4b75cb6d-2d7vc" [9e6f4b13-cb93-4ebf-8d54-9a03450f7193] Running
	I0630 20:56:25.843899  212673 system_pods.go:61] "etcd-bridge-20220630204858-9950" [a07a2b3e-d9cd-421e-ab62-27c50daa13ac] Running
	I0630 20:56:25.843905  212673 system_pods.go:61] "kube-apiserver-bridge-20220630204858-9950" [a8c62683-6ce1-4cce-b639-9121e0366a9d] Running
	I0630 20:56:25.843916  212673 system_pods.go:61] "kube-controller-manager-bridge-20220630204858-9950" [b15660ff-05cc-4505-a7f8-cfcb0a48f952] Running
	I0630 20:56:25.843923  212673 system_pods.go:61] "kube-proxy-vqj7p" [3fad7c40-a7cd-43af-9a92-57efd325e52b] Running
	I0630 20:56:25.843930  212673 system_pods.go:61] "kube-scheduler-bridge-20220630204858-9950" [29b8124f-854b-4349-9c98-782d63a08799] Running
	I0630 20:56:25.843946  212673 system_pods.go:61] "storage-provisioner" [5eb17b16-d2d1-4aa3-bc28-4633f96dbdb5] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
	I0630 20:56:25.843960  212673 system_pods.go:74] duration metric: took 187.698828ms to wait for pod list to return data ...
	I0630 20:56:25.843972  212673 default_sa.go:34] waiting for default service account to be created ...
	I0630 20:56:26.041197  212673 default_sa.go:45] found service account: "default"
	I0630 20:56:26.041220  212673 default_sa.go:55] duration metric: took 197.238332ms for default service account to be created ...
	I0630 20:56:26.041227  212673 system_pods.go:116] waiting for k8s-apps to be running ...
	I0630 20:56:26.244687  212673 system_pods.go:86] 7 kube-system pods found
	I0630 20:56:26.244731  212673 system_pods.go:89] "coredns-6d4b75cb6d-2d7vc" [9e6f4b13-cb93-4ebf-8d54-9a03450f7193] Running
	I0630 20:56:26.244741  212673 system_pods.go:89] "etcd-bridge-20220630204858-9950" [a07a2b3e-d9cd-421e-ab62-27c50daa13ac] Running
	I0630 20:56:26.244749  212673 system_pods.go:89] "kube-apiserver-bridge-20220630204858-9950" [a8c62683-6ce1-4cce-b639-9121e0366a9d] Running
	I0630 20:56:26.244756  212673 system_pods.go:89] "kube-controller-manager-bridge-20220630204858-9950" [b15660ff-05cc-4505-a7f8-cfcb0a48f952] Running
	I0630 20:56:26.244773  212673 system_pods.go:89] "kube-proxy-vqj7p" [3fad7c40-a7cd-43af-9a92-57efd325e52b] Running
	I0630 20:56:26.244782  212673 system_pods.go:89] "kube-scheduler-bridge-20220630204858-9950" [29b8124f-854b-4349-9c98-782d63a08799] Running
	I0630 20:56:26.244793  212673 system_pods.go:89] "storage-provisioner" [5eb17b16-d2d1-4aa3-bc28-4633f96dbdb5] Running
	I0630 20:56:26.244806  212673 system_pods.go:126] duration metric: took 203.573154ms to wait for k8s-apps to be running ...
	I0630 20:56:26.244818  212673 system_svc.go:44] waiting for kubelet service to be running ....
	I0630 20:56:26.244875  212673 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 20:56:26.255878  212673 system_svc.go:56] duration metric: took 11.051437ms WaitForService to wait for kubelet.
	I0630 20:56:26.255913  212673 kubeadm.go:572] duration metric: took 3.250714017s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...
	I0630 20:56:26.255940  212673 node_conditions.go:102] verifying NodePressure condition ...
	I0630 20:56:26.440917  212673 node_conditions.go:122] node storage ephemeral capacity is 304695084Ki
	I0630 20:56:26.440943  212673 node_conditions.go:123] node cpu capacity is 8
	I0630 20:56:26.440956  212673 node_conditions.go:105] duration metric: took 185.006001ms to run NodePressure ...
	I0630 20:56:26.440966  212673 start.go:213] waiting for startup goroutines ...
	I0630 20:56:26.479593  212673 start.go:506] kubectl: 1.24.2, cluster: 1.24.2 (minor skew: 0)
	I0630 20:56:26.481941  212673 out.go:177] * Done! kubectl is now configured to use "bridge-20220630204858-9950" cluster and "default" namespace by default
	I0630 20:56:23.456321  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:25.954519  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:25.270864  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:27.767716  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:29.768071  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:27.955153  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:29.955539  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:32.266879  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:34.267104  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:32.454358  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:34.454649  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:36.767348  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:39.267374  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:36.954920  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:39.454330  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:41.454501  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:41.267972  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:43.766977  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:43.455153  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:45.955314  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:45.767596  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:48.267529  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:48.454474  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:50.953742  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:50.268708  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:52.770822  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:52.954704  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:55.454327  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:55.266690  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:57.266812  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:59.766755  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:57.954245  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:59.954492  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:01.767175  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:03.767340  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:01.955202  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:03.955295  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:06.454135  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:06.267243  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:08.267493  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:08.455283  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:10.953635  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:10.267604  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:12.767831  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:12.954813  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:15.454243  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:15.267908  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:17.767619  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:17.454899  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:19.954623  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:20.268189  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:22.766829  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:24.769945  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:22.454121  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:24.454617  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:26.454994  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:27.267444  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:29.268045  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:28.954124  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:31.454576  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:31.767298  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:34.266266  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:33.454803  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:35.954706  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:36.266331  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:38.267361  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:38.453670  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:40.454674  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:40.767647  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:43.266649  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:42.955644  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:45.454193  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:45.767285  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:48.266303  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:47.954761  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:50.454790  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:50.266748  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:52.766570  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:54.770823  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:52.454914  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:54.954860  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:57.267030  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:59.267416  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:57.455058  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:59.954848  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:01.767836  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:04.266488  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:01.956047  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:04.455232  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	W0630 20:58:03.899565  166730 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
	stdout:
	[init] Using Kubernetes version: v1.24.2
	[preflight] Running pre-flight checks
	[preflight] The system verification failed. Printing the output from the verification:
	KERNEL_VERSION: 5.15.0-1012-gcp
	OS: Linux
	CGROUPS_CPU: enabled
	CGROUPS_CPUACCT: enabled
	CGROUPS_CPUSET: enabled
	CGROUPS_DEVICES: enabled
	CGROUPS_FREEZER: enabled
	CGROUPS_MEMORY: enabled
	CGROUPS_PIDS: enabled
	CGROUPS_HUGETLB: enabled
	CGROUPS_BLKIO: enabled
	[preflight] Pulling images required for setting up a Kubernetes cluster
	[preflight] This might take a minute or two, depending on the speed of your internet connection
	[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
	[certs] Using certificateDir folder "/var/lib/minikube/certs"
	[certs] Using existing ca certificate authority
	[certs] Using existing apiserver certificate and key on disk
	[certs] Using existing apiserver-kubelet-client certificate and key on disk
	[certs] Using existing front-proxy-ca certificate authority
	[certs] Using existing front-proxy-client certificate and key on disk
	[certs] Using existing etcd/ca certificate authority
	[certs] Using existing etcd/server certificate and key on disk
	[certs] Using existing etcd/peer certificate and key on disk
	[certs] Using existing etcd/healthcheck-client certificate and key on disk
	[certs] Using existing apiserver-etcd-client certificate and key on disk
	[certs] Using the existing "sa" key
	[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
	[kubeconfig] Writing "admin.conf" kubeconfig file
	[kubeconfig] Writing "kubelet.conf" kubeconfig file
	[kubeconfig] Writing "controller-manager.conf" kubeconfig file
	[kubeconfig] Writing "scheduler.conf" kubeconfig file
	[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
	[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
	[kubelet-start] Starting the kubelet
	[control-plane] Using manifest folder "/etc/kubernetes/manifests"
	[control-plane] Creating static Pod manifest for "kube-apiserver"
	[control-plane] Creating static Pod manifest for "kube-controller-manager"
	[control-plane] Creating static Pod manifest for "kube-scheduler"
	[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
	[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
	[kubelet-check] Initial timeout of 40s passed.
	[kubelet-check] It seems like the kubelet isn't running or healthy.
	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
	[kubelet-check] It seems like the kubelet isn't running or healthy.
	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
	[kubelet-check] It seems like the kubelet isn't running or healthy.
	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
	[kubelet-check] It seems like the kubelet isn't running or healthy.
	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
	[kubelet-check] It seems like the kubelet isn't running or healthy.
	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
	
	Unfortunately, an error has occurred:
		timed out waiting for the condition
	
	This error is likely caused by:
		- The kubelet is not running
		- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
	
	If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
		- 'systemctl status kubelet'
		- 'journalctl -xeu kubelet'
	
	Additionally, a control plane component may have crashed or exited when started by the container runtime.
	To troubleshoot, list all containers using your preferred container runtimes CLI.
	Here is one example how you may list all running Kubernetes containers by using crictl:
		- 'crictl --runtime-endpoint unix:///run/containerd/containerd.sock ps -a | grep kube | grep -v pause'
		Once you have found the failing container, you can inspect its logs with:
		- 'crictl --runtime-endpoint unix:///run/containerd/containerd.sock logs CONTAINERID'
	
	stderr:
	W0630 20:56:07.008038    7586 initconfiguration.go:120] Usage of CRI endpoints without URL scheme is deprecated and can cause kubelet errors in the future. Automatically prepending scheme "unix" to the "criSocket" with value "/run/containerd/containerd.sock". Please update your configuration!
		[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1012-gcp\n", err: exit status 1
		[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
	error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
	To see the stack trace of this error execute with --v=5 or higher
	
	I0630 20:58:03.899635  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm reset --cri-socket /run/containerd/containerd.sock --force"
	I0630 20:58:04.591252  166730 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 20:58:04.601287  166730 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver
	I0630 20:58:04.601351  166730 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0630 20:58:04.608513  166730 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0630 20:58:04.608564  166730 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0630 20:58:06.267464  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:08.766678  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:06.953923  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:09.454146  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:11.454724  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:10.766750  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:12.767407  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:14.767560  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:13.954829  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:16.454782  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:17.266846  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:19.767336  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:18.953606  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:20.954459  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:21.767511  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:24.267252  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:23.453769  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:25.954614  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:26.267525  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:28.767713  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:27.955380  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:30.453844  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:31.267674  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:33.766748  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:32.953384  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:34.954880  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:35.767244  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:37.767528  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:37.454850  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:39.455008  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:40.267428  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:42.766176  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:44.767181  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:41.954471  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:44.454092  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:46.767809  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:49.266904  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:46.954306  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:48.954479  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:51.454417  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:51.268184  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:53.766719  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:53.954849  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:55.954979  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:55.768768  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:58.266495  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:57.955189  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:00.454315  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:00.267616  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:02.767801  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:04.767965  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:02.955090  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:05.453946  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:07.267048  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:09.267596  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:07.454977  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:09.955336  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:11.766973  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:13.767471  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:12.453951  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:14.454847  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:16.455526  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:16.267132  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:18.766378  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:18.953607  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:20.954733  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:20.768732  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:23.266667  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:23.454571  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:25.954662  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:25.266948  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:27.267421  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:29.767806  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:27.954819  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:30.454784  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:30.272033  201358 pod_ready.go:81] duration metric: took 4m0.022637966s waiting for pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace to be "Ready" ...
	E0630 20:59:30.272057  201358 pod_ready.go:66] WaitExtra: waitPodCondition: timed out waiting for the condition
	I0630 20:59:30.272067  201358 pod_ready.go:78] waiting up to 5m0s for pod "calico-node-wkbg5" in "kube-system" namespace to be "Ready" ...
	I0630 20:59:32.284194  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:34.284965  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:32.954169  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:34.954426  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:36.784237  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:38.784754  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:37.455154  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:39.954504  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:41.283852  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:43.284466  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:41.956399  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:44.454331  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:45.284750  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:47.287832  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:49.784604  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:46.953690  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:48.954131  204258 pod_ready.go:102] pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:49.958782  204258 pod_ready.go:81] duration metric: took 4m0.01604374s waiting for pod "coredns-6d4b75cb6d-5577k" in "kube-system" namespace to be "Ready" ...
	E0630 20:59:49.958804  204258 pod_ready.go:66] WaitExtra: waitPodCondition: timed out waiting for the condition
	I0630 20:59:49.958813  204258 pod_ready.go:78] waiting up to 5m0s for pod "coredns-6d4b75cb6d-z5jnw" in "kube-system" namespace to be "Ready" ...
	I0630 20:59:49.960490  204258 pod_ready.go:97] error getting pod "coredns-6d4b75cb6d-z5jnw" in "kube-system" namespace (skipping!): pods "coredns-6d4b75cb6d-z5jnw" not found
	I0630 20:59:49.960508  204258 pod_ready.go:81] duration metric: took 1.689263ms waiting for pod "coredns-6d4b75cb6d-z5jnw" in "kube-system" namespace to be "Ready" ...
	E0630 20:59:49.960515  204258 pod_ready.go:66] WaitExtra: waitPodCondition: error getting pod "coredns-6d4b75cb6d-z5jnw" in "kube-system" namespace (skipping!): pods "coredns-6d4b75cb6d-z5jnw" not found
	I0630 20:59:49.960523  204258 pod_ready.go:78] waiting up to 5m0s for pod "etcd-enable-default-cni-20220630204858-9950" in "kube-system" namespace to be "Ready" ...
	I0630 20:59:49.964683  204258 pod_ready.go:92] pod "etcd-enable-default-cni-20220630204858-9950" in "kube-system" namespace has status "Ready":"True"
	I0630 20:59:49.964702  204258 pod_ready.go:81] duration metric: took 4.173488ms waiting for pod "etcd-enable-default-cni-20220630204858-9950" in "kube-system" namespace to be "Ready" ...
	I0630 20:59:49.964711  204258 pod_ready.go:78] waiting up to 5m0s for pod "kube-apiserver-enable-default-cni-20220630204858-9950" in "kube-system" namespace to be "Ready" ...
	I0630 20:59:49.968405  204258 pod_ready.go:92] pod "kube-apiserver-enable-default-cni-20220630204858-9950" in "kube-system" namespace has status "Ready":"True"
	I0630 20:59:49.968420  204258 pod_ready.go:81] duration metric: took 3.703287ms waiting for pod "kube-apiserver-enable-default-cni-20220630204858-9950" in "kube-system" namespace to be "Ready" ...
	I0630 20:59:49.968428  204258 pod_ready.go:78] waiting up to 5m0s for pod "kube-controller-manager-enable-default-cni-20220630204858-9950" in "kube-system" namespace to be "Ready" ...
	I0630 20:59:50.152903  204258 pod_ready.go:92] pod "kube-controller-manager-enable-default-cni-20220630204858-9950" in "kube-system" namespace has status "Ready":"True"
	I0630 20:59:50.152932  204258 pod_ready.go:81] duration metric: took 184.49678ms waiting for pod "kube-controller-manager-enable-default-cni-20220630204858-9950" in "kube-system" namespace to be "Ready" ...
	I0630 20:59:50.152949  204258 pod_ready.go:78] waiting up to 5m0s for pod "kube-proxy-98pfx" in "kube-system" namespace to be "Ready" ...
	I0630 20:59:50.555523  204258 pod_ready.go:92] pod "kube-proxy-98pfx" in "kube-system" namespace has status "Ready":"True"
	I0630 20:59:50.555547  204258 pod_ready.go:81] duration metric: took 402.591041ms waiting for pod "kube-proxy-98pfx" in "kube-system" namespace to be "Ready" ...
	I0630 20:59:50.555559  204258 pod_ready.go:78] waiting up to 5m0s for pod "kube-scheduler-enable-default-cni-20220630204858-9950" in "kube-system" namespace to be "Ready" ...
	I0630 20:59:50.952877  204258 pod_ready.go:92] pod "kube-scheduler-enable-default-cni-20220630204858-9950" in "kube-system" namespace has status "Ready":"True"
	I0630 20:59:50.952901  204258 pod_ready.go:81] duration metric: took 397.336151ms waiting for pod "kube-scheduler-enable-default-cni-20220630204858-9950" in "kube-system" namespace to be "Ready" ...
	I0630 20:59:50.952910  204258 pod_ready.go:38] duration metric: took 4m1.026664026s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0630 20:59:50.952931  204258 api_server.go:51] waiting for apiserver process to appear ...
	I0630 20:59:50.952947  204258 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
	I0630 20:59:50.952994  204258 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I0630 20:59:50.979317  204258 cri.go:87] found id: "62b811c6ffa14a2829fd32d7de984945c828fdd5dec3a2a4b9b1798a3f8789fc"
	I0630 20:59:50.979351  204258 cri.go:87] found id: ""
	I0630 20:59:50.979361  204258 logs.go:274] 1 containers: [62b811c6ffa14a2829fd32d7de984945c828fdd5dec3a2a4b9b1798a3f8789fc]
	I0630 20:59:50.979408  204258 ssh_runner.go:195] Run: which crictl
	I0630 20:59:50.982704  204258 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
	I0630 20:59:50.982779  204258 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I0630 20:59:51.007904  204258 cri.go:87] found id: "43ff3e48ab0fa1dc09c974a67ca4ffb8d9dd86186955f1c260b1d1ff6678952a"
	I0630 20:59:51.007937  204258 cri.go:87] found id: ""
	I0630 20:59:51.007945  204258 logs.go:274] 1 containers: [43ff3e48ab0fa1dc09c974a67ca4ffb8d9dd86186955f1c260b1d1ff6678952a]
	I0630 20:59:51.007995  204258 ssh_runner.go:195] Run: which crictl
	I0630 20:59:51.011506  204258 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
	I0630 20:59:51.011584  204258 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I0630 20:59:51.037245  204258 cri.go:87] found id: "f2b46f99300c8cc82d9d8388a1160b169ac4e6e48c4dbd8a34623c826b312e38"
	I0630 20:59:51.037269  204258 cri.go:87] found id: ""
	I0630 20:59:51.037275  204258 logs.go:274] 1 containers: [f2b46f99300c8cc82d9d8388a1160b169ac4e6e48c4dbd8a34623c826b312e38]
	I0630 20:59:51.037316  204258 ssh_runner.go:195] Run: which crictl
	I0630 20:59:51.040485  204258 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
	I0630 20:59:51.040550  204258 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I0630 20:59:51.065417  204258 cri.go:87] found id: "55a1817f09afa57603335e844d713f0fc6174e6abda688b905f35746d1ae59a7"
	I0630 20:59:51.065456  204258 cri.go:87] found id: ""
	I0630 20:59:51.065466  204258 logs.go:274] 1 containers: [55a1817f09afa57603335e844d713f0fc6174e6abda688b905f35746d1ae59a7]
	I0630 20:59:51.065529  204258 ssh_runner.go:195] Run: which crictl
	I0630 20:59:51.068686  204258 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
	I0630 20:59:51.068755  204258 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I0630 20:59:51.093012  204258 cri.go:87] found id: "8cfcad6cc8f0f78e60857082b51808647c3c2ab4df93788ba7f032cea1e99442"
	I0630 20:59:51.093086  204258 cri.go:87] found id: ""
	I0630 20:59:51.093097  204258 logs.go:274] 1 containers: [8cfcad6cc8f0f78e60857082b51808647c3c2ab4df93788ba7f032cea1e99442]
	I0630 20:59:51.093158  204258 ssh_runner.go:195] Run: which crictl
	I0630 20:59:51.096486  204258 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
	I0630 20:59:51.096577  204258 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
	I0630 20:59:51.120299  204258 cri.go:87] found id: ""
	I0630 20:59:51.120338  204258 logs.go:274] 0 containers: []
	W0630 20:59:51.120348  204258 logs.go:276] No container was found matching "kubernetes-dashboard"
	I0630 20:59:51.120359  204258 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
	I0630 20:59:51.120448  204258 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
	I0630 20:59:51.145822  204258 cri.go:87] found id: "459ec697c2224562149dc5e975c768fcef5502de232c45f26f23b269eae1ed64"
	I0630 20:59:51.145844  204258 cri.go:87] found id: "15419e1d1ccf663ed38f52e8605540432e16581e4754237fc230d2e135dfafc8"
	I0630 20:59:51.145851  204258 cri.go:87] found id: ""
	I0630 20:59:51.145856  204258 logs.go:274] 2 containers: [459ec697c2224562149dc5e975c768fcef5502de232c45f26f23b269eae1ed64 15419e1d1ccf663ed38f52e8605540432e16581e4754237fc230d2e135dfafc8]
	I0630 20:59:51.145900  204258 ssh_runner.go:195] Run: which crictl
	I0630 20:59:51.148909  204258 ssh_runner.go:195] Run: which crictl
	I0630 20:59:51.151875  204258 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
	I0630 20:59:51.151952  204258 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I0630 20:59:51.178414  204258 cri.go:87] found id: "7d0d5a7231d313f078021e6ba364cf4bfdd4fd52074797fa961d6c9b09cfe281"
	I0630 20:59:51.178450  204258 cri.go:87] found id: ""
	I0630 20:59:51.178461  204258 logs.go:274] 1 containers: [7d0d5a7231d313f078021e6ba364cf4bfdd4fd52074797fa961d6c9b09cfe281]
	I0630 20:59:51.178525  204258 ssh_runner.go:195] Run: which crictl
	I0630 20:59:51.181572  204258 logs.go:123] Gathering logs for etcd [43ff3e48ab0fa1dc09c974a67ca4ffb8d9dd86186955f1c260b1d1ff6678952a] ...
	I0630 20:59:51.181594  204258 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 43ff3e48ab0fa1dc09c974a67ca4ffb8d9dd86186955f1c260b1d1ff6678952a"
	I0630 20:59:51.227719  204258 logs.go:123] Gathering logs for coredns [f2b46f99300c8cc82d9d8388a1160b169ac4e6e48c4dbd8a34623c826b312e38] ...
	I0630 20:59:51.227758  204258 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f2b46f99300c8cc82d9d8388a1160b169ac4e6e48c4dbd8a34623c826b312e38"
	I0630 20:59:51.254451  204258 logs.go:123] Gathering logs for kube-scheduler [55a1817f09afa57603335e844d713f0fc6174e6abda688b905f35746d1ae59a7] ...
	I0630 20:59:51.254493  204258 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 55a1817f09afa57603335e844d713f0fc6174e6abda688b905f35746d1ae59a7"
	I0630 20:59:51.300065  204258 logs.go:123] Gathering logs for kube-proxy [8cfcad6cc8f0f78e60857082b51808647c3c2ab4df93788ba7f032cea1e99442] ...
	I0630 20:59:51.300108  204258 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8cfcad6cc8f0f78e60857082b51808647c3c2ab4df93788ba7f032cea1e99442"
	I0630 20:59:51.331866  204258 logs.go:123] Gathering logs for kube-controller-manager [7d0d5a7231d313f078021e6ba364cf4bfdd4fd52074797fa961d6c9b09cfe281] ...
	I0630 20:59:51.331904  204258 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7d0d5a7231d313f078021e6ba364cf4bfdd4fd52074797fa961d6c9b09cfe281"
	I0630 20:59:51.371714  204258 logs.go:123] Gathering logs for containerd ...
	I0630 20:59:51.371748  204258 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
	I0630 20:59:51.423922  204258 logs.go:123] Gathering logs for dmesg ...
	I0630 20:59:51.423957  204258 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0630 20:59:51.446891  204258 logs.go:123] Gathering logs for describe nodes ...
	I0630 20:59:51.446930  204258 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0630 20:59:51.784852  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:53.785175  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:51.537407  204258 logs.go:123] Gathering logs for container status ...
	I0630 20:59:51.537444  204258 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0630 20:59:51.566151  204258 logs.go:123] Gathering logs for storage-provisioner [459ec697c2224562149dc5e975c768fcef5502de232c45f26f23b269eae1ed64] ...
	I0630 20:59:51.566180  204258 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 459ec697c2224562149dc5e975c768fcef5502de232c45f26f23b269eae1ed64"
	I0630 20:59:51.596107  204258 logs.go:123] Gathering logs for storage-provisioner [15419e1d1ccf663ed38f52e8605540432e16581e4754237fc230d2e135dfafc8] ...
	I0630 20:59:51.596211  204258 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 15419e1d1ccf663ed38f52e8605540432e16581e4754237fc230d2e135dfafc8"
	I0630 20:59:51.621767  204258 logs.go:123] Gathering logs for kubelet ...
	I0630 20:59:51.621810  204258 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0630 20:59:51.694615  204258 logs.go:123] Gathering logs for kube-apiserver [62b811c6ffa14a2829fd32d7de984945c828fdd5dec3a2a4b9b1798a3f8789fc] ...
	I0630 20:59:51.694655  204258 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 62b811c6ffa14a2829fd32d7de984945c828fdd5dec3a2a4b9b1798a3f8789fc"
	I0630 20:59:54.229480  204258 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:59:54.239288  204258 api_server.go:71] duration metric: took 4m4.500497506s to wait for apiserver process to appear ...
	I0630 20:59:54.239322  204258 api_server.go:87] waiting for apiserver healthz status ...
	I0630 20:59:54.239343  204258 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
	I0630 20:59:54.239384  204258 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I0630 20:59:54.267806  204258 cri.go:87] found id: "62b811c6ffa14a2829fd32d7de984945c828fdd5dec3a2a4b9b1798a3f8789fc"
	I0630 20:59:54.267838  204258 cri.go:87] found id: ""
	I0630 20:59:54.267846  204258 logs.go:274] 1 containers: [62b811c6ffa14a2829fd32d7de984945c828fdd5dec3a2a4b9b1798a3f8789fc]
	I0630 20:59:54.267896  204258 ssh_runner.go:195] Run: which crictl
	I0630 20:59:54.271045  204258 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
	I0630 20:59:54.271117  204258 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I0630 20:59:54.296816  204258 cri.go:87] found id: "43ff3e48ab0fa1dc09c974a67ca4ffb8d9dd86186955f1c260b1d1ff6678952a"
	I0630 20:59:54.296842  204258 cri.go:87] found id: ""
	I0630 20:59:54.296849  204258 logs.go:274] 1 containers: [43ff3e48ab0fa1dc09c974a67ca4ffb8d9dd86186955f1c260b1d1ff6678952a]
	I0630 20:59:54.296891  204258 ssh_runner.go:195] Run: which crictl
	I0630 20:59:54.299954  204258 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
	I0630 20:59:54.300019  204258 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I0630 20:59:54.325250  204258 cri.go:87] found id: "f2b46f99300c8cc82d9d8388a1160b169ac4e6e48c4dbd8a34623c826b312e38"
	I0630 20:59:54.325282  204258 cri.go:87] found id: ""
	I0630 20:59:54.325290  204258 logs.go:274] 1 containers: [f2b46f99300c8cc82d9d8388a1160b169ac4e6e48c4dbd8a34623c826b312e38]
	I0630 20:59:54.325340  204258 ssh_runner.go:195] Run: which crictl
	I0630 20:59:54.328486  204258 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
	I0630 20:59:54.328549  204258 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I0630 20:59:54.353675  204258 cri.go:87] found id: "55a1817f09afa57603335e844d713f0fc6174e6abda688b905f35746d1ae59a7"
	I0630 20:59:54.353704  204258 cri.go:87] found id: ""
	I0630 20:59:54.353710  204258 logs.go:274] 1 containers: [55a1817f09afa57603335e844d713f0fc6174e6abda688b905f35746d1ae59a7]
	I0630 20:59:54.353750  204258 ssh_runner.go:195] Run: which crictl
	I0630 20:59:54.356816  204258 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
	I0630 20:59:54.356881  204258 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I0630 20:59:54.381125  204258 cri.go:87] found id: "8cfcad6cc8f0f78e60857082b51808647c3c2ab4df93788ba7f032cea1e99442"
	I0630 20:59:54.381150  204258 cri.go:87] found id: ""
	I0630 20:59:54.381158  204258 logs.go:274] 1 containers: [8cfcad6cc8f0f78e60857082b51808647c3c2ab4df93788ba7f032cea1e99442]
	I0630 20:59:54.381206  204258 ssh_runner.go:195] Run: which crictl
	I0630 20:59:54.384143  204258 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
	I0630 20:59:54.384203  204258 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
	I0630 20:59:54.411352  204258 cri.go:87] found id: ""
	I0630 20:59:54.411376  204258 logs.go:274] 0 containers: []
	W0630 20:59:54.411387  204258 logs.go:276] No container was found matching "kubernetes-dashboard"
	I0630 20:59:54.411394  204258 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
	I0630 20:59:54.411451  204258 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
	I0630 20:59:54.435468  204258 cri.go:87] found id: "459ec697c2224562149dc5e975c768fcef5502de232c45f26f23b269eae1ed64"
	I0630 20:59:54.435503  204258 cri.go:87] found id: ""
	I0630 20:59:54.435512  204258 logs.go:274] 1 containers: [459ec697c2224562149dc5e975c768fcef5502de232c45f26f23b269eae1ed64]
	I0630 20:59:54.435558  204258 ssh_runner.go:195] Run: which crictl
	I0630 20:59:54.438924  204258 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
	I0630 20:59:54.438993  204258 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I0630 20:59:54.463319  204258 cri.go:87] found id: "7d0d5a7231d313f078021e6ba364cf4bfdd4fd52074797fa961d6c9b09cfe281"
	I0630 20:59:54.463343  204258 cri.go:87] found id: ""
	I0630 20:59:54.463349  204258 logs.go:274] 1 containers: [7d0d5a7231d313f078021e6ba364cf4bfdd4fd52074797fa961d6c9b09cfe281]
	I0630 20:59:54.463391  204258 ssh_runner.go:195] Run: which crictl
	I0630 20:59:54.466589  204258 logs.go:123] Gathering logs for kube-proxy [8cfcad6cc8f0f78e60857082b51808647c3c2ab4df93788ba7f032cea1e99442] ...
	I0630 20:59:54.466609  204258 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8cfcad6cc8f0f78e60857082b51808647c3c2ab4df93788ba7f032cea1e99442"
	I0630 20:59:54.492311  204258 logs.go:123] Gathering logs for kube-controller-manager [7d0d5a7231d313f078021e6ba364cf4bfdd4fd52074797fa961d6c9b09cfe281] ...
	I0630 20:59:54.492341  204258 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7d0d5a7231d313f078021e6ba364cf4bfdd4fd52074797fa961d6c9b09cfe281"
	I0630 20:59:54.529848  204258 logs.go:123] Gathering logs for kubelet ...
	I0630 20:59:54.529879  204258 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0630 20:59:54.599564  204258 logs.go:123] Gathering logs for describe nodes ...
	I0630 20:59:54.599603  204258 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0630 20:59:54.678695  204258 logs.go:123] Gathering logs for kube-apiserver [62b811c6ffa14a2829fd32d7de984945c828fdd5dec3a2a4b9b1798a3f8789fc] ...
	I0630 20:59:54.678728  204258 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 62b811c6ffa14a2829fd32d7de984945c828fdd5dec3a2a4b9b1798a3f8789fc"
	I0630 20:59:54.710288  204258 logs.go:123] Gathering logs for etcd [43ff3e48ab0fa1dc09c974a67ca4ffb8d9dd86186955f1c260b1d1ff6678952a] ...
	I0630 20:59:54.710330  204258 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 43ff3e48ab0fa1dc09c974a67ca4ffb8d9dd86186955f1c260b1d1ff6678952a"
	I0630 20:59:54.752655  204258 logs.go:123] Gathering logs for coredns [f2b46f99300c8cc82d9d8388a1160b169ac4e6e48c4dbd8a34623c826b312e38] ...
	I0630 20:59:54.752694  204258 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f2b46f99300c8cc82d9d8388a1160b169ac4e6e48c4dbd8a34623c826b312e38"
	I0630 20:59:54.778040  204258 logs.go:123] Gathering logs for dmesg ...
	I0630 20:59:54.778071  204258 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0630 20:59:54.800904  204258 logs.go:123] Gathering logs for kube-scheduler [55a1817f09afa57603335e844d713f0fc6174e6abda688b905f35746d1ae59a7] ...
	I0630 20:59:54.800943  204258 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 55a1817f09afa57603335e844d713f0fc6174e6abda688b905f35746d1ae59a7"
	I0630 20:59:54.832676  204258 logs.go:123] Gathering logs for storage-provisioner [459ec697c2224562149dc5e975c768fcef5502de232c45f26f23b269eae1ed64] ...
	I0630 20:59:54.832718  204258 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 459ec697c2224562149dc5e975c768fcef5502de232c45f26f23b269eae1ed64"
	I0630 20:59:54.857300  204258 logs.go:123] Gathering logs for containerd ...
	I0630 20:59:54.857328  204258 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
	I0630 20:59:54.905705  204258 logs.go:123] Gathering logs for container status ...
	I0630 20:59:54.905744  204258 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0630 20:59:56.285224  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:58.784686  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:00:00.464899  166730 out.go:204]   - Generating certificates and keys ...
	I0630 20:59:57.434162  204258 api_server.go:240] Checking apiserver healthz at https://192.168.94.2:8443/healthz ...
	I0630 20:59:57.439505  204258 api_server.go:266] https://192.168.94.2:8443/healthz returned 200:
	ok
	I0630 20:59:57.440554  204258 api_server.go:140] control plane version: v1.24.2
	I0630 20:59:57.440578  204258 api_server.go:130] duration metric: took 3.201250344s to wait for apiserver health ...
	I0630 20:59:57.440586  204258 system_pods.go:43] waiting for kube-system pods to appear ...
	I0630 20:59:57.440603  204258 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
	I0630 20:59:57.440646  204258 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I0630 20:59:57.467697  204258 cri.go:87] found id: "62b811c6ffa14a2829fd32d7de984945c828fdd5dec3a2a4b9b1798a3f8789fc"
	I0630 20:59:57.467735  204258 cri.go:87] found id: ""
	I0630 20:59:57.467744  204258 logs.go:274] 1 containers: [62b811c6ffa14a2829fd32d7de984945c828fdd5dec3a2a4b9b1798a3f8789fc]
	I0630 20:59:57.467801  204258 ssh_runner.go:195] Run: which crictl
	I0630 20:59:57.471107  204258 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
	I0630 20:59:57.471167  204258 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I0630 20:59:57.498030  204258 cri.go:87] found id: "43ff3e48ab0fa1dc09c974a67ca4ffb8d9dd86186955f1c260b1d1ff6678952a"
	I0630 20:59:57.498060  204258 cri.go:87] found id: ""
	I0630 20:59:57.498068  204258 logs.go:274] 1 containers: [43ff3e48ab0fa1dc09c974a67ca4ffb8d9dd86186955f1c260b1d1ff6678952a]
	I0630 20:59:57.498120  204258 ssh_runner.go:195] Run: which crictl
	I0630 20:59:57.501635  204258 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
	I0630 20:59:57.501716  204258 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I0630 20:59:57.528336  204258 cri.go:87] found id: "f2b46f99300c8cc82d9d8388a1160b169ac4e6e48c4dbd8a34623c826b312e38"
	I0630 20:59:57.528365  204258 cri.go:87] found id: ""
	I0630 20:59:57.528374  204258 logs.go:274] 1 containers: [f2b46f99300c8cc82d9d8388a1160b169ac4e6e48c4dbd8a34623c826b312e38]
	I0630 20:59:57.528432  204258 ssh_runner.go:195] Run: which crictl
	I0630 20:59:57.531827  204258 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
	I0630 20:59:57.531899  204258 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I0630 20:59:57.556704  204258 cri.go:87] found id: "55a1817f09afa57603335e844d713f0fc6174e6abda688b905f35746d1ae59a7"
	I0630 20:59:57.556729  204258 cri.go:87] found id: ""
	I0630 20:59:57.556735  204258 logs.go:274] 1 containers: [55a1817f09afa57603335e844d713f0fc6174e6abda688b905f35746d1ae59a7]
	I0630 20:59:57.556774  204258 ssh_runner.go:195] Run: which crictl
	I0630 20:59:57.559924  204258 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
	I0630 20:59:57.559986  204258 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I0630 20:59:57.584978  204258 cri.go:87] found id: "8cfcad6cc8f0f78e60857082b51808647c3c2ab4df93788ba7f032cea1e99442"
	I0630 20:59:57.585003  204258 cri.go:87] found id: ""
	I0630 20:59:57.585009  204258 logs.go:274] 1 containers: [8cfcad6cc8f0f78e60857082b51808647c3c2ab4df93788ba7f032cea1e99442]
	I0630 20:59:57.585097  204258 ssh_runner.go:195] Run: which crictl
	I0630 20:59:57.588137  204258 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
	I0630 20:59:57.588218  204258 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
	I0630 20:59:57.614969  204258 cri.go:87] found id: ""
	I0630 20:59:57.615013  204258 logs.go:274] 0 containers: []
	W0630 20:59:57.615023  204258 logs.go:276] No container was found matching "kubernetes-dashboard"
	I0630 20:59:57.615034  204258 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
	I0630 20:59:57.615094  204258 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
	I0630 20:59:57.640634  204258 cri.go:87] found id: "459ec697c2224562149dc5e975c768fcef5502de232c45f26f23b269eae1ed64"
	I0630 20:59:57.640659  204258 cri.go:87] found id: ""
	I0630 20:59:57.640668  204258 logs.go:274] 1 containers: [459ec697c2224562149dc5e975c768fcef5502de232c45f26f23b269eae1ed64]
	I0630 20:59:57.640727  204258 ssh_runner.go:195] Run: which crictl
	I0630 20:59:57.643826  204258 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
	I0630 20:59:57.643900  204258 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I0630 20:59:57.668848  204258 cri.go:87] found id: "7d0d5a7231d313f078021e6ba364cf4bfdd4fd52074797fa961d6c9b09cfe281"
	I0630 20:59:57.668871  204258 cri.go:87] found id: ""
	I0630 20:59:57.668878  204258 logs.go:274] 1 containers: [7d0d5a7231d313f078021e6ba364cf4bfdd4fd52074797fa961d6c9b09cfe281]
	I0630 20:59:57.668924  204258 ssh_runner.go:195] Run: which crictl
	I0630 20:59:57.672088  204258 logs.go:123] Gathering logs for describe nodes ...
	I0630 20:59:57.672116  204258 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0630 20:59:57.751793  204258 logs.go:123] Gathering logs for etcd [43ff3e48ab0fa1dc09c974a67ca4ffb8d9dd86186955f1c260b1d1ff6678952a] ...
	I0630 20:59:57.751830  204258 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 43ff3e48ab0fa1dc09c974a67ca4ffb8d9dd86186955f1c260b1d1ff6678952a"
	I0630 20:59:57.802962  204258 logs.go:123] Gathering logs for coredns [f2b46f99300c8cc82d9d8388a1160b169ac4e6e48c4dbd8a34623c826b312e38] ...
	I0630 20:59:57.802998  204258 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f2b46f99300c8cc82d9d8388a1160b169ac4e6e48c4dbd8a34623c826b312e38"
	I0630 20:59:57.829859  204258 logs.go:123] Gathering logs for kube-scheduler [55a1817f09afa57603335e844d713f0fc6174e6abda688b905f35746d1ae59a7] ...
	I0630 20:59:57.829886  204258 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 55a1817f09afa57603335e844d713f0fc6174e6abda688b905f35746d1ae59a7"
	I0630 20:59:57.861172  204258 logs.go:123] Gathering logs for containerd ...
	I0630 20:59:57.861209  204258 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
	I0630 20:59:57.911802  204258 logs.go:123] Gathering logs for kubelet ...
	I0630 20:59:57.911839  204258 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0630 20:59:57.979386  204258 logs.go:123] Gathering logs for dmesg ...
	I0630 20:59:57.979425  204258 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0630 20:59:58.001788  204258 logs.go:123] Gathering logs for kube-apiserver [62b811c6ffa14a2829fd32d7de984945c828fdd5dec3a2a4b9b1798a3f8789fc] ...
	I0630 20:59:58.001823  204258 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 62b811c6ffa14a2829fd32d7de984945c828fdd5dec3a2a4b9b1798a3f8789fc"
	I0630 20:59:58.034067  204258 logs.go:123] Gathering logs for kube-proxy [8cfcad6cc8f0f78e60857082b51808647c3c2ab4df93788ba7f032cea1e99442] ...
	I0630 20:59:58.034105  204258 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8cfcad6cc8f0f78e60857082b51808647c3c2ab4df93788ba7f032cea1e99442"
	I0630 20:59:58.067392  204258 logs.go:123] Gathering logs for storage-provisioner [459ec697c2224562149dc5e975c768fcef5502de232c45f26f23b269eae1ed64] ...
	I0630 20:59:58.067421  204258 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 459ec697c2224562149dc5e975c768fcef5502de232c45f26f23b269eae1ed64"
	I0630 20:59:58.092362  204258 logs.go:123] Gathering logs for kube-controller-manager [7d0d5a7231d313f078021e6ba364cf4bfdd4fd52074797fa961d6c9b09cfe281] ...
	I0630 20:59:58.092393  204258 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7d0d5a7231d313f078021e6ba364cf4bfdd4fd52074797fa961d6c9b09cfe281"
	I0630 20:59:58.128409  204258 logs.go:123] Gathering logs for container status ...
	I0630 20:59:58.128442  204258 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0630 21:00:00.663945  204258 system_pods.go:59] 7 kube-system pods found
	I0630 21:00:00.663989  204258 system_pods.go:61] "coredns-6d4b75cb6d-5577k" [5614622f-41c8-4c3b-bec4-7716260f9e3c] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
	I0630 21:00:00.663999  204258 system_pods.go:61] "etcd-enable-default-cni-20220630204858-9950" [4b9cdffc-5698-449c-b72e-71b6d19c7a1e] Running
	I0630 21:00:00.664009  204258 system_pods.go:61] "kube-apiserver-enable-default-cni-20220630204858-9950" [c8150026-56f5-4d2c-b98d-ecb47dc4b3bb] Running
	I0630 21:00:00.664017  204258 system_pods.go:61] "kube-controller-manager-enable-default-cni-20220630204858-9950" [3cff4b69-7fc7-461f-aef0-d75c0c8a37fa] Running
	I0630 21:00:00.664030  204258 system_pods.go:61] "kube-proxy-98pfx" [6557e09c-bbc8-45ab-bbed-ffa24b3f882d] Running
	I0630 21:00:00.664043  204258 system_pods.go:61] "kube-scheduler-enable-default-cni-20220630204858-9950" [89d45250-3f87-464b-9c30-493f41f99dec] Running
	I0630 21:00:00.664058  204258 system_pods.go:61] "storage-provisioner" [465f8143-d118-43c0-920c-092dc51d9f42] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
	I0630 21:00:00.664066  204258 system_pods.go:74] duration metric: took 3.223474423s to wait for pod list to return data ...
	I0630 21:00:00.664076  204258 default_sa.go:34] waiting for default service account to be created ...
	I0630 21:00:00.666902  204258 default_sa.go:45] found service account: "default"
	I0630 21:00:00.666929  204258 default_sa.go:55] duration metric: took 2.846736ms for default service account to be created ...
	I0630 21:00:00.666938  204258 system_pods.go:116] waiting for k8s-apps to be running ...
	I0630 21:00:00.672431  204258 system_pods.go:86] 7 kube-system pods found
	I0630 21:00:00.672470  204258 system_pods.go:89] "coredns-6d4b75cb6d-5577k" [5614622f-41c8-4c3b-bec4-7716260f9e3c] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
	I0630 21:00:00.672482  204258 system_pods.go:89] "etcd-enable-default-cni-20220630204858-9950" [4b9cdffc-5698-449c-b72e-71b6d19c7a1e] Running
	I0630 21:00:00.672502  204258 system_pods.go:89] "kube-apiserver-enable-default-cni-20220630204858-9950" [c8150026-56f5-4d2c-b98d-ecb47dc4b3bb] Running
	I0630 21:00:00.672510  204258 system_pods.go:89] "kube-controller-manager-enable-default-cni-20220630204858-9950" [3cff4b69-7fc7-461f-aef0-d75c0c8a37fa] Running
	I0630 21:00:00.672522  204258 system_pods.go:89] "kube-proxy-98pfx" [6557e09c-bbc8-45ab-bbed-ffa24b3f882d] Running
	I0630 21:00:00.672537  204258 system_pods.go:89] "kube-scheduler-enable-default-cni-20220630204858-9950" [89d45250-3f87-464b-9c30-493f41f99dec] Running
	I0630 21:00:00.672549  204258 system_pods.go:89] "storage-provisioner" [465f8143-d118-43c0-920c-092dc51d9f42] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
	I0630 21:00:00.672558  204258 system_pods.go:126] duration metric: took 5.614113ms to wait for k8s-apps to be running ...
	I0630 21:00:00.672571  204258 system_svc.go:44] waiting for kubelet service to be running ....
	I0630 21:00:00.672621  204258 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 21:00:00.682748  204258 system_svc.go:56] duration metric: took 10.168132ms WaitForService to wait for kubelet.
	I0630 21:00:00.682778  204258 kubeadm.go:572] duration metric: took 4m10.943996394s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...
	I0630 21:00:00.682822  204258 node_conditions.go:102] verifying NodePressure condition ...
	I0630 21:00:00.686187  204258 node_conditions.go:122] node storage ephemeral capacity is 304695084Ki
	I0630 21:00:00.686214  204258 node_conditions.go:123] node cpu capacity is 8
	I0630 21:00:00.686226  204258 node_conditions.go:105] duration metric: took 3.394027ms to run NodePressure ...
	I0630 21:00:00.686240  204258 start.go:213] waiting for startup goroutines ...
	I0630 21:00:00.733915  204258 start.go:506] kubectl: 1.24.2, cluster: 1.24.2 (minor skew: 0)
	I0630 21:00:00.737781  204258 out.go:177] * Done! kubectl is now configured to use "enable-default-cni-20220630204858-9950" cluster and "default" namespace by default
	I0630 21:00:00.467813  166730 out.go:204]   - Booting up control plane ...
	I0630 21:00:00.470158  166730 kubeadm.go:397] StartCluster complete in 7m58.712661025s
	I0630 21:00:00.470198  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
	I0630 21:00:00.470254  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I0630 21:00:00.494852  166730 cri.go:87] found id: ""
	I0630 21:00:00.494875  166730 logs.go:274] 0 containers: []
	W0630 21:00:00.494882  166730 logs.go:276] No container was found matching "kube-apiserver"
	I0630 21:00:00.494888  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
	I0630 21:00:00.494937  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I0630 21:00:00.518642  166730 cri.go:87] found id: ""
	I0630 21:00:00.518668  166730 logs.go:274] 0 containers: []
	W0630 21:00:00.518674  166730 logs.go:276] No container was found matching "etcd"
	I0630 21:00:00.518680  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
	I0630 21:00:00.518728  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I0630 21:00:00.544697  166730 cri.go:87] found id: ""
	I0630 21:00:00.544733  166730 logs.go:274] 0 containers: []
	W0630 21:00:00.544742  166730 logs.go:276] No container was found matching "coredns"
	I0630 21:00:00.544750  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
	I0630 21:00:00.544808  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I0630 21:00:00.569280  166730 cri.go:87] found id: ""
	I0630 21:00:00.569311  166730 logs.go:274] 0 containers: []
	W0630 21:00:00.569320  166730 logs.go:276] No container was found matching "kube-scheduler"
	I0630 21:00:00.569327  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
	I0630 21:00:00.569383  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I0630 21:00:00.593566  166730 cri.go:87] found id: ""
	I0630 21:00:00.593592  166730 logs.go:274] 0 containers: []
	W0630 21:00:00.593601  166730 logs.go:276] No container was found matching "kube-proxy"
	I0630 21:00:00.593609  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
	I0630 21:00:00.593665  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
	I0630 21:00:00.618029  166730 cri.go:87] found id: ""
	I0630 21:00:00.618053  166730 logs.go:274] 0 containers: []
	W0630 21:00:00.618061  166730 logs.go:276] No container was found matching "kubernetes-dashboard"
	I0630 21:00:00.618067  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
	I0630 21:00:00.618111  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
	I0630 21:00:00.642327  166730 cri.go:87] found id: ""
	I0630 21:00:00.642352  166730 logs.go:274] 0 containers: []
	W0630 21:00:00.642358  166730 logs.go:276] No container was found matching "storage-provisioner"
	I0630 21:00:00.642365  166730 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
	I0630 21:00:00.642412  166730 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I0630 21:00:00.671530  166730 cri.go:87] found id: ""
	I0630 21:00:00.671557  166730 logs.go:274] 0 containers: []
	W0630 21:00:00.671566  166730 logs.go:276] No container was found matching "kube-controller-manager"
	I0630 21:00:00.671576  166730 logs.go:123] Gathering logs for kubelet ...
	I0630 21:00:00.671591  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	W0630 21:00:00.735542  166730 logs.go:138] Found kubelet problem: Jun 30 21:00:00 kubernetes-upgrade-20220630205032-9950 kubelet[11593]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	I0630 21:00:00.809676  166730 logs.go:123] Gathering logs for dmesg ...
	I0630 21:00:00.809714  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0630 21:00:00.837921  166730 logs.go:123] Gathering logs for describe nodes ...
	I0630 21:00:00.837959  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	W0630 21:00:00.891715  166730 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	 output: 
	** stderr ** 
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	
	** /stderr **
	I0630 21:00:00.891742  166730 logs.go:123] Gathering logs for containerd ...
	I0630 21:00:00.891751  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
	I0630 21:00:00.937402  166730 logs.go:123] Gathering logs for container status ...
	I0630 21:00:00.937438  166730 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	W0630 21:00:00.966782  166730 out.go:369] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
	stdout:
	[init] Using Kubernetes version: v1.24.2
	[preflight] Running pre-flight checks
	[preflight] The system verification failed. Printing the output from the verification:
	KERNEL_VERSION: 5.15.0-1012-gcp
	OS: Linux
	CGROUPS_CPU: enabled
	CGROUPS_CPUACCT: enabled
	CGROUPS_CPUSET: enabled
	CGROUPS_DEVICES: enabled
	CGROUPS_FREEZER: enabled
	CGROUPS_MEMORY: enabled
	CGROUPS_PIDS: enabled
	CGROUPS_HUGETLB: enabled
	CGROUPS_BLKIO: enabled
	[preflight] Pulling images required for setting up a Kubernetes cluster
	[preflight] This might take a minute or two, depending on the speed of your internet connection
	[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
	[certs] Using certificateDir folder "/var/lib/minikube/certs"
	[certs] Using existing ca certificate authority
	[certs] Using existing apiserver certificate and key on disk
	[certs] Using existing apiserver-kubelet-client certificate and key on disk
	[certs] Using existing front-proxy-ca certificate authority
	[certs] Using existing front-proxy-client certificate and key on disk
	[certs] Using existing etcd/ca certificate authority
	[certs] Using existing etcd/server certificate and key on disk
	[certs] Using existing etcd/peer certificate and key on disk
	[certs] Using existing etcd/healthcheck-client certificate and key on disk
	[certs] Using existing apiserver-etcd-client certificate and key on disk
	[certs] Using the existing "sa" key
	[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
	[kubeconfig] Writing "admin.conf" kubeconfig file
	[kubeconfig] Writing "kubelet.conf" kubeconfig file
	[kubeconfig] Writing "controller-manager.conf" kubeconfig file
	[kubeconfig] Writing "scheduler.conf" kubeconfig file
	[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
	[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
	[kubelet-start] Starting the kubelet
	[control-plane] Using manifest folder "/etc/kubernetes/manifests"
	[control-plane] Creating static Pod manifest for "kube-apiserver"
	[control-plane] Creating static Pod manifest for "kube-controller-manager"
	[control-plane] Creating static Pod manifest for "kube-scheduler"
	[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
	[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
	[kubelet-check] Initial timeout of 40s passed.
	[kubelet-check] It seems like the kubelet isn't running or healthy.
	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
	[kubelet-check] It seems like the kubelet isn't running or healthy.
	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
	[kubelet-check] It seems like the kubelet isn't running or healthy.
	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
	[kubelet-check] It seems like the kubelet isn't running or healthy.
	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
	[kubelet-check] It seems like the kubelet isn't running or healthy.
	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
	
	Unfortunately, an error has occurred:
		timed out waiting for the condition
	
	This error is likely caused by:
		- The kubelet is not running
		- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
	
	If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
		- 'systemctl status kubelet'
		- 'journalctl -xeu kubelet'
	
	Additionally, a control plane component may have crashed or exited when started by the container runtime.
	To troubleshoot, list all containers using your preferred container runtimes CLI.
	Here is one example how you may list all running Kubernetes containers by using crictl:
		- 'crictl --runtime-endpoint unix:///run/containerd/containerd.sock ps -a | grep kube | grep -v pause'
		Once you have found the failing container, you can inspect its logs with:
		- 'crictl --runtime-endpoint unix:///run/containerd/containerd.sock logs CONTAINERID'
	
	stderr:
	W0630 20:58:04.642467    9717 initconfiguration.go:120] Usage of CRI endpoints without URL scheme is deprecated and can cause kubelet errors in the future. Automatically prepending scheme "unix" to the "criSocket" with value "/run/containerd/containerd.sock". Please update your configuration!
		[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1012-gcp\n", err: exit status 1
		[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
	error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
	To see the stack trace of this error execute with --v=5 or higher
	W0630 21:00:00.966835  166730 out.go:239] * 
	W0630 21:00:00.967083  166730 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
	stdout:
	[init] Using Kubernetes version: v1.24.2
	[preflight] Running pre-flight checks
	[preflight] The system verification failed. Printing the output from the verification:
	KERNEL_VERSION: 5.15.0-1012-gcp
	OS: Linux
	CGROUPS_CPU: enabled
	CGROUPS_CPUACCT: enabled
	CGROUPS_CPUSET: enabled
	CGROUPS_DEVICES: enabled
	CGROUPS_FREEZER: enabled
	CGROUPS_MEMORY: enabled
	CGROUPS_PIDS: enabled
	CGROUPS_HUGETLB: enabled
	CGROUPS_BLKIO: enabled
	[preflight] Pulling images required for setting up a Kubernetes cluster
	[preflight] This might take a minute or two, depending on the speed of your internet connection
	[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
	[certs] Using certificateDir folder "/var/lib/minikube/certs"
	[certs] Using existing ca certificate authority
	[certs] Using existing apiserver certificate and key on disk
	[certs] Using existing apiserver-kubelet-client certificate and key on disk
	[certs] Using existing front-proxy-ca certificate authority
	[certs] Using existing front-proxy-client certificate and key on disk
	[certs] Using existing etcd/ca certificate authority
	[certs] Using existing etcd/server certificate and key on disk
	[certs] Using existing etcd/peer certificate and key on disk
	[certs] Using existing etcd/healthcheck-client certificate and key on disk
	[certs] Using existing apiserver-etcd-client certificate and key on disk
	[certs] Using the existing "sa" key
	[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
	[kubeconfig] Writing "admin.conf" kubeconfig file
	[kubeconfig] Writing "kubelet.conf" kubeconfig file
	[kubeconfig] Writing "controller-manager.conf" kubeconfig file
	[kubeconfig] Writing "scheduler.conf" kubeconfig file
	[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
	[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
	[kubelet-start] Starting the kubelet
	[control-plane] Using manifest folder "/etc/kubernetes/manifests"
	[control-plane] Creating static Pod manifest for "kube-apiserver"
	[control-plane] Creating static Pod manifest for "kube-controller-manager"
	[control-plane] Creating static Pod manifest for "kube-scheduler"
	[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
	[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
	[kubelet-check] Initial timeout of 40s passed.
	[kubelet-check] It seems like the kubelet isn't running or healthy.
	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
	[kubelet-check] It seems like the kubelet isn't running or healthy.
	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
	[kubelet-check] It seems like the kubelet isn't running or healthy.
	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
	[kubelet-check] It seems like the kubelet isn't running or healthy.
	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
	[kubelet-check] It seems like the kubelet isn't running or healthy.
	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
	
	Unfortunately, an error has occurred:
		timed out waiting for the condition
	
	This error is likely caused by:
		- The kubelet is not running
		- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
	
	If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
		- 'systemctl status kubelet'
		- 'journalctl -xeu kubelet'
	
	Additionally, a control plane component may have crashed or exited when started by the container runtime.
	To troubleshoot, list all containers using your preferred container runtimes CLI.
	Here is one example how you may list all running Kubernetes containers by using crictl:
		- 'crictl --runtime-endpoint unix:///run/containerd/containerd.sock ps -a | grep kube | grep -v pause'
		Once you have found the failing container, you can inspect its logs with:
		- 'crictl --runtime-endpoint unix:///run/containerd/containerd.sock logs CONTAINERID'
	
	stderr:
	W0630 20:58:04.642467    9717 initconfiguration.go:120] Usage of CRI endpoints without URL scheme is deprecated and can cause kubelet errors in the future. Automatically prepending scheme "unix" to the "criSocket" with value "/run/containerd/containerd.sock". Please update your configuration!
		[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1012-gcp\n", err: exit status 1
		[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
	error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
	To see the stack trace of this error execute with --v=5 or higher
	
	W0630 21:00:00.967126  166730 out.go:239] * 
	W0630 21:00:00.968129  166730 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0630 21:00:00.970508  166730 out.go:177] X Problems detected in kubelet:
	I0630 21:00:00.972058  166730 out.go:177]   Jun 30 21:00:00 kubernetes-upgrade-20220630205032-9950 kubelet[11593]: Error: failed to parse kubelet flag: unknown flag: --cni-conf-dir
	I0630 21:00:00.976653  166730 out.go:177] 
	W0630 21:00:00.978457  166730 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
	stdout:
	[init] Using Kubernetes version: v1.24.2
	[preflight] Running pre-flight checks
	[preflight] The system verification failed. Printing the output from the verification:
	KERNEL_VERSION: 5.15.0-1012-gcp
	OS: Linux
	CGROUPS_CPU: enabled
	CGROUPS_CPUACCT: enabled
	CGROUPS_CPUSET: enabled
	CGROUPS_DEVICES: enabled
	CGROUPS_FREEZER: enabled
	CGROUPS_MEMORY: enabled
	CGROUPS_PIDS: enabled
	CGROUPS_HUGETLB: enabled
	CGROUPS_BLKIO: enabled
	[preflight] Pulling images required for setting up a Kubernetes cluster
	[preflight] This might take a minute or two, depending on the speed of your internet connection
	[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
	[certs] Using certificateDir folder "/var/lib/minikube/certs"
	[certs] Using existing ca certificate authority
	[certs] Using existing apiserver certificate and key on disk
	[certs] Using existing apiserver-kubelet-client certificate and key on disk
	[certs] Using existing front-proxy-ca certificate authority
	[certs] Using existing front-proxy-client certificate and key on disk
	[certs] Using existing etcd/ca certificate authority
	[certs] Using existing etcd/server certificate and key on disk
	[certs] Using existing etcd/peer certificate and key on disk
	[certs] Using existing etcd/healthcheck-client certificate and key on disk
	[certs] Using existing apiserver-etcd-client certificate and key on disk
	[certs] Using the existing "sa" key
	[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
	[kubeconfig] Writing "admin.conf" kubeconfig file
	[kubeconfig] Writing "kubelet.conf" kubeconfig file
	[kubeconfig] Writing "controller-manager.conf" kubeconfig file
	[kubeconfig] Writing "scheduler.conf" kubeconfig file
	[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
	[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
	[kubelet-start] Starting the kubelet
	[control-plane] Using manifest folder "/etc/kubernetes/manifests"
	[control-plane] Creating static Pod manifest for "kube-apiserver"
	[control-plane] Creating static Pod manifest for "kube-controller-manager"
	[control-plane] Creating static Pod manifest for "kube-scheduler"
	[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
	[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
	[kubelet-check] Initial timeout of 40s passed.
	[kubelet-check] It seems like the kubelet isn't running or healthy.
	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
	[kubelet-check] It seems like the kubelet isn't running or healthy.
	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
	[kubelet-check] It seems like the kubelet isn't running or healthy.
	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
	[kubelet-check] It seems like the kubelet isn't running or healthy.
	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
	[kubelet-check] It seems like the kubelet isn't running or healthy.
	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
	
	Unfortunately, an error has occurred:
		timed out waiting for the condition
	
	This error is likely caused by:
		- The kubelet is not running
		- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
	
	If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
		- 'systemctl status kubelet'
		- 'journalctl -xeu kubelet'
	
	Additionally, a control plane component may have crashed or exited when started by the container runtime.
	To troubleshoot, list all containers using your preferred container runtimes CLI.
	Here is one example how you may list all running Kubernetes containers by using crictl:
		- 'crictl --runtime-endpoint unix:///run/containerd/containerd.sock ps -a | grep kube | grep -v pause'
		Once you have found the failing container, you can inspect its logs with:
		- 'crictl --runtime-endpoint unix:///run/containerd/containerd.sock logs CONTAINERID'
	
	stderr:
	W0630 20:58:04.642467    9717 initconfiguration.go:120] Usage of CRI endpoints without URL scheme is deprecated and can cause kubelet errors in the future. Automatically prepending scheme "unix" to the "criSocket" with value "/run/containerd/containerd.sock". Please update your configuration!
		[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1012-gcp\n", err: exit status 1
		[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
	error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
	To see the stack trace of this error execute with --v=5 or higher
	
	W0630 21:00:00.978591  166730 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
	W0630 21:00:00.978662  166730 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
	I0630 21:00:00.981508  166730 out.go:177] 
	
	* 
	* ==> container status <==
	* CONTAINER           IMAGE               CREATED             STATE               NAME                ATTEMPT             POD ID
	
	* 
	* ==> containerd <==
	* -- Logs begin at Thu 2022-06-30 20:51:27 UTC, end at Thu 2022-06-30 21:00:02 UTC. --
	Jun 30 20:58:04 kubernetes-upgrade-20220630205032-9950 containerd[504]: time="2022-06-30T20:58:04.376253759Z" level=error msg="StopPodSandbox for \"\\\"Using\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find sandbox \"\\\"Using\": not found"
	Jun 30 20:58:04 kubernetes-upgrade-20220630205032-9950 containerd[504]: time="2022-06-30T20:58:04.393572166Z" level=info msg="StopPodSandbox for \"this\""
	Jun 30 20:58:04 kubernetes-upgrade-20220630205032-9950 containerd[504]: time="2022-06-30T20:58:04.393635040Z" level=error msg="StopPodSandbox for \"this\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find sandbox \"this\": not found"
	Jun 30 20:58:04 kubernetes-upgrade-20220630205032-9950 containerd[504]: time="2022-06-30T20:58:04.410923206Z" level=info msg="StopPodSandbox for \"endpoint\""
	Jun 30 20:58:04 kubernetes-upgrade-20220630205032-9950 containerd[504]: time="2022-06-30T20:58:04.410994487Z" level=error msg="StopPodSandbox for \"endpoint\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find sandbox \"endpoint\": not found"
	Jun 30 20:58:04 kubernetes-upgrade-20220630205032-9950 containerd[504]: time="2022-06-30T20:58:04.428654634Z" level=info msg="StopPodSandbox for \"is\""
	Jun 30 20:58:04 kubernetes-upgrade-20220630205032-9950 containerd[504]: time="2022-06-30T20:58:04.428705019Z" level=error msg="StopPodSandbox for \"is\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find sandbox \"is\": not found"
	Jun 30 20:58:04 kubernetes-upgrade-20220630205032-9950 containerd[504]: time="2022-06-30T20:58:04.446153688Z" level=info msg="StopPodSandbox for \"deprecated,\""
	Jun 30 20:58:04 kubernetes-upgrade-20220630205032-9950 containerd[504]: time="2022-06-30T20:58:04.446208238Z" level=error msg="StopPodSandbox for \"deprecated,\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find sandbox \"deprecated,\": not found"
	Jun 30 20:58:04 kubernetes-upgrade-20220630205032-9950 containerd[504]: time="2022-06-30T20:58:04.463938104Z" level=info msg="StopPodSandbox for \"please\""
	Jun 30 20:58:04 kubernetes-upgrade-20220630205032-9950 containerd[504]: time="2022-06-30T20:58:04.464001700Z" level=error msg="StopPodSandbox for \"please\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find sandbox \"please\": not found"
	Jun 30 20:58:04 kubernetes-upgrade-20220630205032-9950 containerd[504]: time="2022-06-30T20:58:04.481241720Z" level=info msg="StopPodSandbox for \"consider\""
	Jun 30 20:58:04 kubernetes-upgrade-20220630205032-9950 containerd[504]: time="2022-06-30T20:58:04.481291044Z" level=error msg="StopPodSandbox for \"consider\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find sandbox \"consider\": not found"
	Jun 30 20:58:04 kubernetes-upgrade-20220630205032-9950 containerd[504]: time="2022-06-30T20:58:04.498254893Z" level=info msg="StopPodSandbox for \"using\""
	Jun 30 20:58:04 kubernetes-upgrade-20220630205032-9950 containerd[504]: time="2022-06-30T20:58:04.498309424Z" level=error msg="StopPodSandbox for \"using\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find sandbox \"using\": not found"
	Jun 30 20:58:04 kubernetes-upgrade-20220630205032-9950 containerd[504]: time="2022-06-30T20:58:04.515161183Z" level=info msg="StopPodSandbox for \"full\""
	Jun 30 20:58:04 kubernetes-upgrade-20220630205032-9950 containerd[504]: time="2022-06-30T20:58:04.515222508Z" level=error msg="StopPodSandbox for \"full\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find sandbox \"full\": not found"
	Jun 30 20:58:04 kubernetes-upgrade-20220630205032-9950 containerd[504]: time="2022-06-30T20:58:04.533130729Z" level=info msg="StopPodSandbox for \"URL\""
	Jun 30 20:58:04 kubernetes-upgrade-20220630205032-9950 containerd[504]: time="2022-06-30T20:58:04.533192816Z" level=error msg="StopPodSandbox for \"URL\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find sandbox \"URL\": not found"
	Jun 30 20:58:04 kubernetes-upgrade-20220630205032-9950 containerd[504]: time="2022-06-30T20:58:04.550894877Z" level=info msg="StopPodSandbox for \"format\\\"\""
	Jun 30 20:58:04 kubernetes-upgrade-20220630205032-9950 containerd[504]: time="2022-06-30T20:58:04.550995498Z" level=error msg="StopPodSandbox for \"format\\\"\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find sandbox \"format\\\"\": not found"
	Jun 30 20:58:04 kubernetes-upgrade-20220630205032-9950 containerd[504]: time="2022-06-30T20:58:04.568366789Z" level=info msg="StopPodSandbox for \"endpoint=\\\"/run/containerd/containerd.sock\\\"\""
	Jun 30 20:58:04 kubernetes-upgrade-20220630205032-9950 containerd[504]: time="2022-06-30T20:58:04.568442929Z" level=error msg="StopPodSandbox for \"endpoint=\\\"/run/containerd/containerd.sock\\\"\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find sandbox \"endpoint=\\\"/run/containerd/containerd.sock\\\"\": not found"
	Jun 30 20:58:04 kubernetes-upgrade-20220630205032-9950 containerd[504]: time="2022-06-30T20:58:04.585785757Z" level=info msg="StopPodSandbox for \"URL=\\\"unix:///run/containerd/containerd.sock\\\"\""
	Jun 30 20:58:04 kubernetes-upgrade-20220630205032-9950 containerd[504]: time="2022-06-30T20:58:04.585845269Z" level=error msg="StopPodSandbox for \"URL=\\\"unix:///run/containerd/containerd.sock\\\"\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find sandbox \"URL=\\\"unix:///run/containerd/containerd.sock\\\"\": not found"
	
	* 
	* ==> describe nodes <==
	* 
	* ==> dmesg <==
	* [  +0.000006] ll header: 00000000: ff ff ff ff ff ff 1e b8 96 f0 c5 1d 08 06
	[  +2.959763] IPv4: martian source 10.244.0.98 from 10.244.0.3, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 1e b8 96 f0 c5 1d 08 06
	[  +1.003892] IPv4: martian source 10.244.0.98 from 10.244.0.3, on dev eth0
	[  +0.000007] ll header: 00000000: ff ff ff ff ff ff 1e b8 96 f0 c5 1d 08 06
	[  +1.027898] IPv4: martian source 10.244.0.98 from 10.244.0.3, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 1e b8 96 f0 c5 1d 08 06
	[ +21.516116] IPv4: martian source 10.244.0.98 from 10.244.0.3, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 1e b8 96 f0 c5 1d 08 06
	[  +1.005700] IPv4: martian source 10.244.0.98 from 10.244.0.3, on dev eth0
	[  +0.000014] ll header: 00000000: ff ff ff ff ff ff 1e b8 96 f0 c5 1d 08 06
	[  +1.023898] IPv4: martian source 10.244.0.98 from 10.244.0.3, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 1e b8 96 f0 c5 1d 08 06
	[  +2.967774] IPv4: martian source 10.244.0.98 from 10.244.0.3, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 1e b8 96 f0 c5 1d 08 06
	[  +1.031816] IPv4: martian source 10.244.0.98 from 10.244.0.3, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 1e b8 96 f0 c5 1d 08 06
	[  +1.023920] IPv4: martian source 10.244.0.98 from 10.244.0.3, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 1e b8 96 f0 c5 1d 08 06
	[  +2.943775] IPv4: martian source 10.244.0.98 from 10.244.0.3, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 1e b8 96 f0 c5 1d 08 06
	[  +1.027830] IPv4: martian source 10.244.0.98 from 10.244.0.3, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 1e b8 96 f0 c5 1d 08 06
	[  +1.019907] IPv4: martian source 10.244.0.98 from 10.244.0.3, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 1e b8 96 f0 c5 1d 08 06
	
	* 
	* ==> kernel <==
	*  21:00:02 up 42 min,  0 users,  load average: 0.79, 2.51, 2.31
	Linux kubernetes-upgrade-20220630205032-9950 5.15.0-1012-gcp #17~20.04.1-Ubuntu SMP Thu Jun 23 16:10:34 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
	PRETTY_NAME="Ubuntu 20.04.4 LTS"
	
	* 
	* ==> kubelet <==
	* -- Logs begin at Thu 2022-06-30 20:51:27 UTC, end at Thu 2022-06-30 21:00:02 UTC. --
	Jun 30 21:00:01 kubernetes-upgrade-20220630205032-9950 kubelet[11763]:       --storage-driver-buffer-duration duration                  Writes in the storage driver will be buffered for this duration, and committed to the non memory backends as a single transaction (default 1m0s) (DEPRECATED: This is a cadvisor flag that was mistakenly registered with the Kubelet. Due to legacy concerns, it will follow the standard CLI deprecation timeline before being removed.)
	Jun 30 21:00:01 kubernetes-upgrade-20220630205032-9950 kubelet[11763]:       --storage-driver-db string                                 database name (default "cadvisor") (DEPRECATED: This is a cadvisor flag that was mistakenly registered with the Kubelet. Due to legacy concerns, it will follow the standard CLI deprecation timeline before being removed.)
	Jun 30 21:00:01 kubernetes-upgrade-20220630205032-9950 kubelet[11763]:       --storage-driver-host string                               database host:port (default "localhost:8086") (DEPRECATED: This is a cadvisor flag that was mistakenly registered with the Kubelet. Due to legacy concerns, it will follow the standard CLI deprecation timeline before being removed.)
	Jun 30 21:00:01 kubernetes-upgrade-20220630205032-9950 kubelet[11763]:       --storage-driver-password string                           database password (default "root") (DEPRECATED: This is a cadvisor flag that was mistakenly registered with the Kubelet. Due to legacy concerns, it will follow the standard CLI deprecation timeline before being removed.)
	Jun 30 21:00:01 kubernetes-upgrade-20220630205032-9950 kubelet[11763]:       --storage-driver-secure                                    use secure connection with database (DEPRECATED: This is a cadvisor flag that was mistakenly registered with the Kubelet. Due to legacy concerns, it will follow the standard CLI deprecation timeline before being removed.)
	Jun 30 21:00:01 kubernetes-upgrade-20220630205032-9950 kubelet[11763]:       --storage-driver-table string                              table name (default "stats") (DEPRECATED: This is a cadvisor flag that was mistakenly registered with the Kubelet. Due to legacy concerns, it will follow the standard CLI deprecation timeline before being removed.)
	Jun 30 21:00:01 kubernetes-upgrade-20220630205032-9950 kubelet[11763]:       --storage-driver-user string                               database username (default "root") (DEPRECATED: This is a cadvisor flag that was mistakenly registered with the Kubelet. Due to legacy concerns, it will follow the standard CLI deprecation timeline before being removed.)
	Jun 30 21:00:01 kubernetes-upgrade-20220630205032-9950 kubelet[11763]:       --streaming-connection-idle-timeout duration               Maximum time a streaming connection can be idle before the connection is automatically closed. 0 indicates no timeout. Example: '5m'. Note: All connections to the kubelet server have a maximum duration of 4 hours. (default 4h0m0s) (DEPRECATED: This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.)
	Jun 30 21:00:01 kubernetes-upgrade-20220630205032-9950 kubelet[11763]:       --sync-frequency duration                                  Max period between synchronizing running containers and config (default 1m0s) (DEPRECATED: This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.)
	Jun 30 21:00:01 kubernetes-upgrade-20220630205032-9950 kubelet[11763]:       --system-cgroups string                                    Optional absolute name of cgroups in which to place all non-kernel processes that are not already inside a cgroup under '/'. Empty for no container. Rolling back the flag requires a reboot. (DEPRECATED: This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.)
	Jun 30 21:00:01 kubernetes-upgrade-20220630205032-9950 kubelet[11763]:       --system-reserved mapStringString                          A set of ResourceName=ResourceQuantity (e.g. cpu=200m,memory=500Mi,ephemeral-storage=1Gi) pairs that describe resources reserved for non-kubernetes components. Currently only cpu and memory are supported. See https://kubernetes.io/docs/concepts/configuration/manage-resources-containers/ for more detail. [default=none] (DEPRECATED: This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.)
	Jun 30 21:00:01 kubernetes-upgrade-20220630205032-9950 kubelet[11763]:       --system-reserved-cgroup string                            Absolute name of the top level cgroup that is used to manage non-kubernetes components for which compute resources were reserved via '--system-reserved' flag. Ex. '/system-reserved'. [default=''] (DEPRECATED: This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.)
	Jun 30 21:00:01 kubernetes-upgrade-20220630205032-9950 kubelet[11763]:       --tls-cert-file string                                     File containing x509 Certificate used for serving HTTPS (with intermediate certs, if any, concatenated after server cert). If --tls-cert-file and --tls-private-key-file are not provided, a self-signed certificate and key are generated for the public address and saved to the directory passed to --cert-dir. (DEPRECATED: This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.)
	Jun 30 21:00:01 kubernetes-upgrade-20220630205032-9950 kubelet[11763]:       --tls-cipher-suites strings                                Comma-separated list of cipher suites for the server. If omitted, the default Go cipher suites will be used.
	Jun 30 21:00:01 kubernetes-upgrade-20220630205032-9950 kubelet[11763]:                 Preferred values: TLS_AES_128_GCM_SHA256, TLS_AES_256_GCM_SHA384, TLS_CHACHA20_POLY1305_SHA256, TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA, TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256, TLS_ECDHE_ECDSA_WITH_AES_256_CBC_SHA, TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384, TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305, TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305_SHA256, TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA, TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256, TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA, TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384, TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305, TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305_SHA256, TLS_RSA_WITH_AES_128_CBC_SHA, TLS_RSA_WITH_AES_128_GCM_SHA256, TLS_RSA_WITH_AES_256_CBC_SHA, TLS_RSA_WITH_AES_256_GCM_SHA384.
	Jun 30 21:00:01 kubernetes-upgrade-20220630205032-9950 kubelet[11763]:                 Insecure values: TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256, TLS_ECDHE_ECDSA_WITH_RC4_128_SHA, TLS_ECDHE_RSA_WITH_3DES_EDE_CBC_SHA, TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256, TLS_ECDHE_RSA_WITH_RC4_128_SHA, TLS_RSA_WITH_3DES_EDE_CBC_SHA, TLS_RSA_WITH_AES_128_CBC_SHA256, TLS_RSA_WITH_RC4_128_SHA. (DEPRECATED: This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.)
	Jun 30 21:00:01 kubernetes-upgrade-20220630205032-9950 kubelet[11763]:       --tls-min-version string                                   Minimum TLS version supported. Possible values: VersionTLS10, VersionTLS11, VersionTLS12, VersionTLS13 (DEPRECATED: This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.)
	Jun 30 21:00:01 kubernetes-upgrade-20220630205032-9950 kubelet[11763]:       --tls-private-key-file string                              File containing x509 private key matching --tls-cert-file. (DEPRECATED: This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.)
	Jun 30 21:00:01 kubernetes-upgrade-20220630205032-9950 kubelet[11763]:       --topology-manager-policy string                           Topology Manager policy to use. Possible values: 'none', 'best-effort', 'restricted', 'single-numa-node'. (default "none") (DEPRECATED: This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.)
	Jun 30 21:00:01 kubernetes-upgrade-20220630205032-9950 kubelet[11763]:       --topology-manager-scope string                            Scope to which topology hints applied. Topology Manager collects hints from Hint Providers and applies them to defined scope to ensure the pod admission. Possible values: 'container', 'pod'. (default "container") (DEPRECATED: This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.)
	Jun 30 21:00:01 kubernetes-upgrade-20220630205032-9950 kubelet[11763]:   -v, --v Level                                                  number for the log level verbosity
	Jun 30 21:00:01 kubernetes-upgrade-20220630205032-9950 kubelet[11763]:       --version version[=true]                                   Print version information and quit
	Jun 30 21:00:01 kubernetes-upgrade-20220630205032-9950 kubelet[11763]:       --vmodule pattern=N,...                                    comma-separated list of pattern=N settings for file-filtered logging (only works for text log format)
	Jun 30 21:00:01 kubernetes-upgrade-20220630205032-9950 kubelet[11763]:       --volume-plugin-dir string                                 The full path of the directory in which to search for additional third party volume plugins (default "/usr/libexec/kubernetes/kubelet-plugins/volume/exec/") (DEPRECATED: This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.)
	Jun 30 21:00:01 kubernetes-upgrade-20220630205032-9950 kubelet[11763]:       --volume-stats-agg-period duration                         Specifies interval for kubelet to calculate and cache the volume disk usage for all pods and volumes.  To disable volume calculations, set to a negative number. (default 1m0s) (DEPRECATED: This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.)
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	E0630 21:00:02.426023  228084 logs.go:192] command /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" failed with error: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	 output: "\n** stderr ** \nThe connection to the server localhost:8443 was refused - did you specify the right host or port?\n\n** /stderr **"
	! unable to fetch logs for: describe nodes

                                                
                                                
** /stderr **
helpers_test.go:254: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p kubernetes-upgrade-20220630205032-9950 -n kubernetes-upgrade-20220630205032-9950
helpers_test.go:254: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p kubernetes-upgrade-20220630205032-9950 -n kubernetes-upgrade-20220630205032-9950: exit status 2 (476.347377ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:254: status error: exit status 2 (may be ok)
helpers_test.go:256: "kubernetes-upgrade-20220630205032-9950" apiserver is not running, skipping kubectl commands (state="Stopped")
helpers_test.go:175: Cleaning up "kubernetes-upgrade-20220630205032-9950" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p kubernetes-upgrade-20220630205032-9950
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p kubernetes-upgrade-20220630205032-9950: (2.375287003s)
--- FAIL: TestKubernetesUpgrade (572.65s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/Start (520.3s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/Start
net_test.go:101: (dbg) Run:  out/minikube-linux-amd64 start -p calico-20220630204859-9950 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=calico --driver=docker  --container-runtime=containerd

                                                
                                                
=== CONT  TestNetworkPlugins/group/calico/Start
net_test.go:101: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p calico-20220630204859-9950 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=calico --driver=docker  --container-runtime=containerd: exit status 80 (8m40.28359025s)

                                                
                                                
-- stdout --
	* [calico-20220630204859-9950] minikube v1.26.0 on Ubuntu 20.04 (kvm/amd64)
	  - MINIKUBE_LOCATION=14420
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-amd64
	* Using the docker driver based on user configuration
	* Using Docker driver with root privileges
	* Starting control plane node calico-20220630204859-9950 in cluster calico-20220630204859-9950
	* Pulling base image ...
	* Creating docker container (CPUs=2, Memory=2048MB) ...
	* Preparing Kubernetes v1.24.2 on containerd 1.6.6 ...
	  - Generating certificates and keys ...
	  - Booting up control plane ...
	  - Configuring RBAC rules ...
	* Configuring Calico (Container Networking Interface) ...
	* Verifying Kubernetes components...
	  - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	* Enabled addons: storage-provisioner, default-storageclass
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0630 20:54:50.108933  201358 out.go:296] Setting OutFile to fd 1 ...
	I0630 20:54:50.109239  201358 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 20:54:50.109255  201358 out.go:309] Setting ErrFile to fd 2...
	I0630 20:54:50.109261  201358 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 20:54:50.109713  201358 root.go:329] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/bin
	I0630 20:54:50.109989  201358 out.go:303] Setting JSON to false
	I0630 20:54:50.111568  201358 start.go:115] hostinfo: {"hostname":"ubuntu-20-agent-8","uptime":2242,"bootTime":1656620248,"procs":766,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1012-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0630 20:54:50.111650  201358 start.go:125] virtualization: kvm guest
	I0630 20:54:50.114768  201358 out.go:177] * [calico-20220630204859-9950] minikube v1.26.0 on Ubuntu 20.04 (kvm/amd64)
	I0630 20:54:50.116463  201358 out.go:177]   - MINIKUBE_LOCATION=14420
	I0630 20:54:50.116404  201358 notify.go:193] Checking for updates...
	I0630 20:54:50.118047  201358 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0630 20:54:50.119647  201358 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 20:54:50.121232  201358 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube
	I0630 20:54:50.122676  201358 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0630 20:54:50.125234  201358 config.go:178] Loaded profile config "cilium-20220630204859-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 20:54:50.125371  201358 config.go:178] Loaded profile config "kindnet-20220630204858-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 20:54:50.125497  201358 config.go:178] Loaded profile config "kubernetes-upgrade-20220630205032-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 20:54:50.125568  201358 driver.go:360] Setting default libvirt URI to qemu:///system
	I0630 20:54:50.177623  201358 docker.go:137] docker version: linux-20.10.17
	I0630 20:54:50.177709  201358 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0630 20:54:50.320071  201358 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:3 ContainersPaused:0 ContainersStopped:0 Images:8 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:56 OomKillDisable:true NGoroutines:57 SystemTime:2022-06-30 20:54:50.214532663 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1012-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexServ
erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662451712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-8 Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Client
Info:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
	I0630 20:54:50.320170  201358 docker.go:254] overlay module found
	I0630 20:54:50.323609  201358 out.go:177] * Using the docker driver based on user configuration
	I0630 20:54:50.325398  201358 start.go:284] selected driver: docker
	I0630 20:54:50.325419  201358 start.go:808] validating driver "docker" against <nil>
	I0630 20:54:50.325438  201358 start.go:819] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0630 20:54:50.330005  201358 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0630 20:54:50.467729  201358 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:3 ContainersPaused:0 ContainersStopped:0 Images:8 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:56 OomKillDisable:true NGoroutines:57 SystemTime:2022-06-30 20:54:50.371618826 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1012-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexServ
erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662451712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-8 Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Client
Info:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
	I0630 20:54:50.467850  201358 start_flags.go:296] no existing cluster config was found, will generate one from the flags 
	I0630 20:54:50.468044  201358 start_flags.go:853] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0630 20:54:50.470341  201358 out.go:177] * Using Docker driver with root privileges
	I0630 20:54:50.471858  201358 cni.go:95] Creating CNI manager for "calico"
	I0630 20:54:50.471884  201358 start_flags.go:305] Found "Calico" CNI - setting NetworkPlugin=cni
	I0630 20:54:50.471903  201358 start_flags.go:310] config:
	{Name:calico-20220630204859-9950 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:calico-20220630204859-9950 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:calico NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:5m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 20:54:50.473929  201358 out.go:177] * Starting control plane node calico-20220630204859-9950 in cluster calico-20220630204859-9950
	I0630 20:54:50.475413  201358 cache.go:120] Beginning downloading kic base image for docker with containerd
	I0630 20:54:50.477096  201358 out.go:177] * Pulling base image ...
	I0630 20:54:50.478668  201358 preload.go:132] Checking if preload exists for k8s version v1.24.2 and runtime containerd
	I0630 20:54:50.478721  201358 preload.go:148] Found local preload: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-containerd-overlay2-amd64.tar.lz4
	I0630 20:54:50.478736  201358 cache.go:57] Caching tarball of preloaded images
	I0630 20:54:50.478764  201358 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e in local docker daemon
	I0630 20:54:50.479001  201358 preload.go:174] Found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-containerd-overlay2-amd64.tar.lz4 in cache, skipping download
	I0630 20:54:50.479024  201358 cache.go:60] Finished verifying existence of preloaded tar for  v1.24.2 on containerd
	I0630 20:54:50.479132  201358 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/calico-20220630204859-9950/config.json ...
	I0630 20:54:50.479165  201358 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/calico-20220630204859-9950/config.json: {Name:mk87b5d5b53822f39b78ba959ce266d69f03fe56 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 20:54:50.528667  201358 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e in local docker daemon, skipping pull
	I0630 20:54:50.528699  201358 cache.go:142] gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e exists in daemon, skipping load
	I0630 20:54:50.528725  201358 cache.go:208] Successfully downloaded all kic artifacts
	I0630 20:54:50.528770  201358 start.go:352] acquiring machines lock for calico-20220630204859-9950: {Name:mk58204a7c85e18b4d0f538276f60f76388aab8e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0630 20:54:50.528942  201358 start.go:356] acquired machines lock for "calico-20220630204859-9950" in 133.378µs
	I0630 20:54:50.528981  201358 start.go:91] Provisioning new machine with config: &{Name:calico-20220630204859-9950 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:calico-20220630204859-9950 Namespace:default
APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:calico NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:5m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker Bin
aryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:} &{Name: IP: Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0630 20:54:50.529118  201358 start.go:131] createHost starting for "" (driver="docker")
	I0630 20:54:50.532569  201358 out.go:204] * Creating docker container (CPUs=2, Memory=2048MB) ...
	I0630 20:54:50.532929  201358 start.go:165] libmachine.API.Create for "calico-20220630204859-9950" (driver="docker")
	I0630 20:54:50.532975  201358 client.go:168] LocalClient.Create starting
	I0630 20:54:50.533238  201358 main.go:134] libmachine: Reading certificate data from /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem
	I0630 20:54:50.533663  201358 main.go:134] libmachine: Decoding PEM data...
	I0630 20:54:50.533710  201358 main.go:134] libmachine: Parsing certificate...
	I0630 20:54:50.533811  201358 main.go:134] libmachine: Reading certificate data from /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem
	I0630 20:54:50.533850  201358 main.go:134] libmachine: Decoding PEM data...
	I0630 20:54:50.533873  201358 main.go:134] libmachine: Parsing certificate...
	I0630 20:54:50.534530  201358 cli_runner.go:164] Run: docker network inspect calico-20220630204859-9950 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	W0630 20:54:50.575345  201358 cli_runner.go:211] docker network inspect calico-20220630204859-9950 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
	I0630 20:54:50.575418  201358 network_create.go:272] running [docker network inspect calico-20220630204859-9950] to gather additional debugging logs...
	I0630 20:54:50.575434  201358 cli_runner.go:164] Run: docker network inspect calico-20220630204859-9950
	W0630 20:54:50.612303  201358 cli_runner.go:211] docker network inspect calico-20220630204859-9950 returned with exit code 1
	I0630 20:54:50.612355  201358 network_create.go:275] error running [docker network inspect calico-20220630204859-9950]: docker network inspect calico-20220630204859-9950: exit status 1
	stdout:
	[]
	
	stderr:
	Error: No such network: calico-20220630204859-9950
	I0630 20:54:50.612378  201358 network_create.go:277] output of [docker network inspect calico-20220630204859-9950]: -- stdout --
	[]
	
	-- /stdout --
	** stderr ** 
	Error: No such network: calico-20220630204859-9950
	
	** /stderr **
	I0630 20:54:50.612442  201358 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0630 20:54:50.654924  201358 network.go:240] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName:br-c7ee26fec5a3 IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:02:42:cc:d0:4a:9e}}
	I0630 20:54:50.655949  201358 network.go:240] skipping subnet 192.168.58.0/24 that is taken: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 Interface:{IfaceName:br-3e97afadef02 IfaceIPv4:192.168.58.1 IfaceMTU:1500 IfaceMAC:02:42:9e:e7:fd:62}}
	I0630 20:54:50.656942  201358 network.go:240] skipping subnet 192.168.67.0/24 that is taken: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 Interface:{IfaceName:br-fbd8d6c05e6b IfaceIPv4:192.168.67.1 IfaceMTU:1500 IfaceMAC:02:42:6b:9f:58:b3}}
	I0630 20:54:50.658152  201358 network.go:240] skipping subnet 192.168.76.0/24 that is taken: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 Interface:{IfaceName:br-06afeb383285 IfaceIPv4:192.168.76.1 IfaceMTU:1500 IfaceMAC:02:42:c9:6c:8f:6b}}
	I0630 20:54:50.659419  201358 network.go:288] reserving subnet 192.168.85.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[] amended:true}} dirty:map[192.168.85.0:0xc000a87110] misses:0}
	I0630 20:54:50.659462  201358 network.go:235] using free private subnet 192.168.85.0/24: &{IP:192.168.85.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.85.0/24 Gateway:192.168.85.1 ClientMin:192.168.85.2 ClientMax:192.168.85.254 Broadcast:192.168.85.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
	I0630 20:54:50.659477  201358 network_create.go:115] attempt to create docker network calico-20220630204859-9950 192.168.85.0/24 with gateway 192.168.85.1 and MTU of 1500 ...
	I0630 20:54:50.659544  201358 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.85.0/24 --gateway=192.168.85.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=calico-20220630204859-9950 calico-20220630204859-9950
	I0630 20:54:50.750197  201358 network_create.go:99] docker network calico-20220630204859-9950 192.168.85.0/24 created
	I0630 20:54:50.750242  201358 kic.go:106] calculated static IP "192.168.85.2" for the "calico-20220630204859-9950" container
	I0630 20:54:50.750322  201358 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I0630 20:54:50.802105  201358 cli_runner.go:164] Run: docker volume create calico-20220630204859-9950 --label name.minikube.sigs.k8s.io=calico-20220630204859-9950 --label created_by.minikube.sigs.k8s.io=true
	I0630 20:54:50.844510  201358 oci.go:103] Successfully created a docker volume calico-20220630204859-9950
	I0630 20:54:50.844605  201358 cli_runner.go:164] Run: docker run --rm --name calico-20220630204859-9950-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=calico-20220630204859-9950 --entrypoint /usr/bin/test -v calico-20220630204859-9950:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e -d /var/lib
	I0630 20:54:51.823846  201358 oci.go:107] Successfully prepared a docker volume calico-20220630204859-9950
	I0630 20:54:51.823904  201358 preload.go:132] Checking if preload exists for k8s version v1.24.2 and runtime containerd
	I0630 20:54:51.823923  201358 kic.go:179] Starting extracting preloaded images to volume ...
	I0630 20:54:51.823998  201358 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-containerd-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v calico-20220630204859-9950:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e -I lz4 -xf /preloaded.tar -C /extractDir
	I0630 20:54:59.144346  201358 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-containerd-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v calico-20220630204859-9950:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e -I lz4 -xf /preloaded.tar -C /extractDir: (7.32026386s)
	I0630 20:54:59.144384  201358 kic.go:188] duration metric: took 7.320457 seconds to extract preloaded images to volume
	W0630 20:54:59.144554  201358 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	I0630 20:54:59.144672  201358 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0630 20:54:59.278379  201358 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname calico-20220630204859-9950 --name calico-20220630204859-9950 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=calico-20220630204859-9950 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=calico-20220630204859-9950 --network calico-20220630204859-9950 --ip 192.168.85.2 --volume calico-20220630204859-9950:/var --security-opt apparmor=unconfined --memory=2048mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e
	I0630 20:55:00.130504  201358 cli_runner.go:164] Run: docker container inspect calico-20220630204859-9950 --format={{.State.Running}}
	I0630 20:55:00.177146  201358 cli_runner.go:164] Run: docker container inspect calico-20220630204859-9950 --format={{.State.Status}}
	I0630 20:55:00.222732  201358 cli_runner.go:164] Run: docker exec calico-20220630204859-9950 stat /var/lib/dpkg/alternatives/iptables
	I0630 20:55:00.319723  201358 oci.go:144] the created container "calico-20220630204859-9950" has a running status.
	I0630 20:55:00.319757  201358 kic.go:210] Creating ssh key for kic: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/calico-20220630204859-9950/id_rsa...
	I0630 20:55:00.670857  201358 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/calico-20220630204859-9950/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0630 20:55:01.087848  201358 cli_runner.go:164] Run: docker container inspect calico-20220630204859-9950 --format={{.State.Status}}
	I0630 20:55:01.133325  201358 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0630 20:55:01.133355  201358 kic_runner.go:114] Args: [docker exec --privileged calico-20220630204859-9950 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0630 20:55:01.238145  201358 cli_runner.go:164] Run: docker container inspect calico-20220630204859-9950 --format={{.State.Status}}
	I0630 20:55:01.289338  201358 machine.go:88] provisioning docker machine ...
	I0630 20:55:01.289382  201358 ubuntu.go:169] provisioning hostname "calico-20220630204859-9950"
	I0630 20:55:01.289449  201358 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" calico-20220630204859-9950
	I0630 20:55:01.336910  201358 main.go:134] libmachine: Using SSH client type: native
	I0630 20:55:01.337249  201358 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil>  [] 0s} 127.0.0.1 49382 <nil> <nil>}
	I0630 20:55:01.337276  201358 main.go:134] libmachine: About to run SSH command:
	sudo hostname calico-20220630204859-9950 && echo "calico-20220630204859-9950" | sudo tee /etc/hostname
	I0630 20:55:01.479163  201358 main.go:134] libmachine: SSH cmd err, output: <nil>: calico-20220630204859-9950
	
	I0630 20:55:01.479247  201358 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" calico-20220630204859-9950
	I0630 20:55:01.524856  201358 main.go:134] libmachine: Using SSH client type: native
	I0630 20:55:01.525032  201358 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil>  [] 0s} 127.0.0.1 49382 <nil> <nil>}
	I0630 20:55:01.525112  201358 main.go:134] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\scalico-20220630204859-9950' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 calico-20220630204859-9950/g' /etc/hosts;
				else 
					echo '127.0.1.1 calico-20220630204859-9950' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0630 20:55:01.653533  201358 main.go:134] libmachine: SSH cmd err, output: <nil>: 
	I0630 20:55:01.653569  201358 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube CaCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/c
erts/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube}
	I0630 20:55:01.653605  201358 ubuntu.go:177] setting up certificates
	I0630 20:55:01.653617  201358 provision.go:83] configureAuth start
	I0630 20:55:01.653676  201358 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" calico-20220630204859-9950
	I0630 20:55:01.701742  201358 provision.go:138] copyHostCerts
	I0630 20:55:01.701797  201358 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem, removing ...
	I0630 20:55:01.701808  201358 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem
	I0630 20:55:01.701865  201358 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem (1082 bytes)
	I0630 20:55:01.701937  201358 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem, removing ...
	I0630 20:55:01.701949  201358 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem
	I0630 20:55:01.701976  201358 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem (1123 bytes)
	I0630 20:55:01.702023  201358 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem, removing ...
	I0630 20:55:01.702038  201358 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem
	I0630 20:55:01.702064  201358 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem (1679 bytes)
	I0630 20:55:01.702108  201358 provision.go:112] generating server cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem org=jenkins.calico-20220630204859-9950 san=[192.168.85.2 127.0.0.1 localhost 127.0.0.1 minikube calico-20220630204859-9950]
	I0630 20:55:01.870137  201358 provision.go:172] copyRemoteCerts
	I0630 20:55:01.870199  201358 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0630 20:55:01.870247  201358 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" calico-20220630204859-9950
	I0630 20:55:01.911500  201358 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49382 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/calico-20220630204859-9950/id_rsa Username:docker}
	I0630 20:55:02.001279  201358 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem --> /etc/docker/server.pem (1253 bytes)
	I0630 20:55:02.028586  201358 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
	I0630 20:55:02.052307  201358 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
	I0630 20:55:02.076331  201358 provision.go:86] duration metric: configureAuth took 422.684523ms
	I0630 20:55:02.076371  201358 ubuntu.go:193] setting minikube options for container-runtime
	I0630 20:55:02.076575  201358 config.go:178] Loaded profile config "calico-20220630204859-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 20:55:02.076586  201358 machine.go:91] provisioned docker machine in 787.22115ms
	I0630 20:55:02.076595  201358 client.go:171] LocalClient.Create took 11.54360842s
	I0630 20:55:02.076628  201358 start.go:173] duration metric: libmachine.API.Create for "calico-20220630204859-9950" took 11.543690784s
	I0630 20:55:02.076639  201358 start.go:306] post-start starting for "calico-20220630204859-9950" (driver="docker")
	I0630 20:55:02.076647  201358 start.go:316] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0630 20:55:02.076708  201358 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0630 20:55:02.076756  201358 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" calico-20220630204859-9950
	I0630 20:55:02.122060  201358 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49382 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/calico-20220630204859-9950/id_rsa Username:docker}
	I0630 20:55:02.217145  201358 ssh_runner.go:195] Run: cat /etc/os-release
	I0630 20:55:02.220101  201358 main.go:134] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0630 20:55:02.220125  201358 main.go:134] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0630 20:55:02.220137  201358 main.go:134] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0630 20:55:02.220146  201358 info.go:137] Remote host: Ubuntu 20.04.4 LTS
	I0630 20:55:02.220158  201358 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/addons for local assets ...
	I0630 20:55:02.220218  201358 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files for local assets ...
	I0630 20:55:02.220330  201358 filesync.go:149] local asset: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem -> 99502.pem in /etc/ssl/certs
	I0630 20:55:02.220444  201358 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0630 20:55:02.228767  201358 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem --> /etc/ssl/certs/99502.pem (1708 bytes)
	I0630 20:55:02.251224  201358 start.go:309] post-start completed in 174.562658ms
	I0630 20:55:02.251590  201358 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" calico-20220630204859-9950
	I0630 20:55:02.300475  201358 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/calico-20220630204859-9950/config.json ...
	I0630 20:55:02.300750  201358 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0630 20:55:02.300806  201358 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" calico-20220630204859-9950
	I0630 20:55:02.343071  201358 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49382 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/calico-20220630204859-9950/id_rsa Username:docker}
	I0630 20:55:02.430090  201358 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0630 20:55:02.434894  201358 start.go:134] duration metric: createHost completed in 11.905761311s
	I0630 20:55:02.434924  201358 start.go:81] releasing machines lock for "calico-20220630204859-9950", held for 11.905959247s
	I0630 20:55:02.435007  201358 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" calico-20220630204859-9950
	I0630 20:55:02.479727  201358 ssh_runner.go:195] Run: systemctl --version
	I0630 20:55:02.479783  201358 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" calico-20220630204859-9950
	I0630 20:55:02.479797  201358 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/
	I0630 20:55:02.479865  201358 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" calico-20220630204859-9950
	I0630 20:55:02.519124  201358 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49382 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/calico-20220630204859-9950/id_rsa Username:docker}
	I0630 20:55:02.519426  201358 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49382 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/calico-20220630204859-9950/id_rsa Username:docker}
	I0630 20:55:02.630410  201358 ssh_runner.go:195] Run: sudo systemctl stop -f crio
	I0630 20:55:02.643653  201358 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0630 20:55:02.656222  201358 docker.go:179] disabling docker service ...
	I0630 20:55:02.656287  201358 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0630 20:55:02.678632  201358 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0630 20:55:02.690939  201358 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0630 20:55:02.788537  201358 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0630 20:55:02.941818  201358 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0630 20:55:02.952740  201358 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
	image-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0630 20:55:02.967996  201358 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*sandbox_image = .*$|sandbox_image = "k8s.gcr.io/pause:3.7"|' -i /etc/containerd/config.toml"
	I0630 20:55:02.979607  201358 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*restrict_oom_score_adj = .*$|restrict_oom_score_adj = false|' -i /etc/containerd/config.toml"
	I0630 20:55:02.991536  201358 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*SystemdCgroup = .*$|SystemdCgroup = false|' -i /etc/containerd/config.toml"
	I0630 20:55:03.002912  201358 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*conf_dir = .*$|conf_dir = "/etc/cni/net.d"|' -i /etc/containerd/config.toml"
	I0630 20:55:03.011030  201358 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^# imports|imports = ["/etc/containerd/containerd.conf.d/02-containerd.conf"]|' -i /etc/containerd/config.toml"
	I0630 20:55:03.019681  201358 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc/containerd/containerd.conf.d && printf %s "dmVyc2lvbiA9IDIK" | base64 -d | sudo tee /etc/containerd/containerd.conf.d/02-containerd.conf"
	I0630 20:55:03.035698  201358 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0630 20:55:03.043840  201358 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0630 20:55:03.051611  201358 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0630 20:55:03.138823  201358 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0630 20:55:03.252305  201358 start.go:447] Will wait 60s for socket path /run/containerd/containerd.sock
	I0630 20:55:03.252388  201358 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
	I0630 20:55:03.258255  201358 start.go:468] Will wait 60s for crictl version
	I0630 20:55:03.258357  201358 ssh_runner.go:195] Run: sudo crictl version
	I0630 20:55:03.296183  201358 start.go:477] Version:  0.1.0
	RuntimeName:  containerd
	RuntimeVersion:  1.6.6
	RuntimeApiVersion:  v1alpha2
	I0630 20:55:03.296334  201358 ssh_runner.go:195] Run: containerd --version
	I0630 20:55:03.335551  201358 ssh_runner.go:195] Run: containerd --version
	I0630 20:55:03.378029  201358 out.go:177] * Preparing Kubernetes v1.24.2 on containerd 1.6.6 ...
	I0630 20:55:03.379651  201358 cli_runner.go:164] Run: docker network inspect calico-20220630204859-9950 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0630 20:55:03.422014  201358 ssh_runner.go:195] Run: grep 192.168.85.1	host.minikube.internal$ /etc/hosts
	I0630 20:55:03.426118  201358 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.85.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0630 20:55:03.459134  201358 preload.go:132] Checking if preload exists for k8s version v1.24.2 and runtime containerd
	I0630 20:55:03.459186  201358 ssh_runner.go:195] Run: sudo crictl images --output json
	I0630 20:55:03.503471  201358 containerd.go:547] all images are preloaded for containerd runtime.
	I0630 20:55:03.503507  201358 containerd.go:461] Images already preloaded, skipping extraction
	I0630 20:55:03.503566  201358 ssh_runner.go:195] Run: sudo crictl images --output json
	I0630 20:55:03.535315  201358 containerd.go:547] all images are preloaded for containerd runtime.
	I0630 20:55:03.535344  201358 cache_images.go:84] Images are preloaded, skipping loading
	I0630 20:55:03.535397  201358 ssh_runner.go:195] Run: sudo crictl info
	I0630 20:55:03.568526  201358 cni.go:95] Creating CNI manager for "calico"
	I0630 20:55:03.568566  201358 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
	I0630 20:55:03.568584  201358 kubeadm.go:158] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.85.2 APIServerPort:8443 KubernetesVersion:v1.24.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:calico-20220630204859-9950 NodeName:calico-20220630204859-9950 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.85.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.85.2 CgroupDriver:cgroupfs ClientCAFile:/var
/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}
	I0630 20:55:03.568770  201358 kubeadm.go:162] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.85.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: /run/containerd/containerd.sock
	  name: "calico-20220630204859-9950"
	  kubeletExtraArgs:
	    node-ip: 192.168.85.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.85.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.24.2
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%"
	  nodefs.inodesFree: "0%"
	  imagefs.available: "0%"
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0630 20:55:03.568888  201358 kubeadm.go:961] kubelet [Unit]
	Wants=containerd.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.24.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=calico-20220630204859-9950 --image-service-endpoint=unix:///run/containerd/containerd.sock --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.85.2 --runtime-request-timeout=15m
	
	[Install]
	 config:
	{KubernetesVersion:v1.24.2 ClusterName:calico-20220630204859-9950 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:calico NodeIP: NodePort:8443 NodeName:}
	I0630 20:55:03.568953  201358 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.24.2
	I0630 20:55:03.630763  201358 binaries.go:44] Found k8s binaries, skipping transfer
	I0630 20:55:03.630853  201358 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0630 20:55:03.659677  201358 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (519 bytes)
	I0630 20:55:03.676088  201358 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0630 20:55:03.693578  201358 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2055 bytes)
	I0630 20:55:03.709498  201358 ssh_runner.go:195] Run: grep 192.168.85.2	control-plane.minikube.internal$ /etc/hosts
	I0630 20:55:03.712695  201358 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.85.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0630 20:55:03.730831  201358 certs.go:54] Setting up /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/calico-20220630204859-9950 for IP: 192.168.85.2
	I0630 20:55:03.730954  201358 certs.go:182] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.key
	I0630 20:55:03.731010  201358 certs.go:182] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.key
	I0630 20:55:03.731076  201358 certs.go:302] generating minikube-user signed cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/calico-20220630204859-9950/client.key
	I0630 20:55:03.731096  201358 crypto.go:68] Generating cert /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/calico-20220630204859-9950/client.crt with IP's: []
	I0630 20:55:03.954037  201358 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/calico-20220630204859-9950/client.crt ...
	I0630 20:55:03.954119  201358 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/calico-20220630204859-9950/client.crt: {Name:mkf20a661e66cd2763f69c6187960706669d6794 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 20:55:03.954346  201358 crypto.go:164] Writing key to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/calico-20220630204859-9950/client.key ...
	I0630 20:55:03.954364  201358 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/calico-20220630204859-9950/client.key: {Name:mk75ccf2acf69e6c6e827432b9af19c4fb763708 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 20:55:03.954498  201358 certs.go:302] generating minikube signed cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/calico-20220630204859-9950/apiserver.key.43b9df8c
	I0630 20:55:03.954522  201358 crypto.go:68] Generating cert /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/calico-20220630204859-9950/apiserver.crt.43b9df8c with IP's: [192.168.85.2 10.96.0.1 127.0.0.1 10.0.0.1]
	I0630 20:55:04.035707  201358 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/calico-20220630204859-9950/apiserver.crt.43b9df8c ...
	I0630 20:55:04.035753  201358 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/calico-20220630204859-9950/apiserver.crt.43b9df8c: {Name:mk8655fab4dbba8c7da0fb43364631910fdf6d1c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 20:55:04.035990  201358 crypto.go:164] Writing key to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/calico-20220630204859-9950/apiserver.key.43b9df8c ...
	I0630 20:55:04.036011  201358 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/calico-20220630204859-9950/apiserver.key.43b9df8c: {Name:mk6aa00da9a2881a2278a75cfc27534f90480149 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 20:55:04.036146  201358 certs.go:320] copying /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/calico-20220630204859-9950/apiserver.crt.43b9df8c -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/calico-20220630204859-9950/apiserver.crt
	I0630 20:55:04.036237  201358 certs.go:324] copying /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/calico-20220630204859-9950/apiserver.key.43b9df8c -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/calico-20220630204859-9950/apiserver.key
	I0630 20:55:04.036317  201358 certs.go:302] generating aggregator signed cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/calico-20220630204859-9950/proxy-client.key
	I0630 20:55:04.036342  201358 crypto.go:68] Generating cert /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/calico-20220630204859-9950/proxy-client.crt with IP's: []
	I0630 20:55:04.141412  201358 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/calico-20220630204859-9950/proxy-client.crt ...
	I0630 20:55:04.141444  201358 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/calico-20220630204859-9950/proxy-client.crt: {Name:mkef7e02285cd289aa98094eed55596296b2e30a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 20:55:04.141650  201358 crypto.go:164] Writing key to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/calico-20220630204859-9950/proxy-client.key ...
	I0630 20:55:04.141669  201358 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/calico-20220630204859-9950/proxy-client.key: {Name:mk9a7ab4ca0ee4da77baf6cb0f2c0cf51ef2f9de Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 20:55:04.141906  201358 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950.pem (1338 bytes)
	W0630 20:55:04.141967  201358 certs.go:384] ignoring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950_empty.pem, impossibly tiny 0 bytes
	I0630 20:55:04.141989  201358 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem (1679 bytes)
	I0630 20:55:04.142022  201358 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem (1082 bytes)
	I0630 20:55:04.142060  201358 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem (1123 bytes)
	I0630 20:55:04.142096  201358 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/key.pem (1679 bytes)
	I0630 20:55:04.142164  201358 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem (1708 bytes)
	I0630 20:55:04.142885  201358 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/calico-20220630204859-9950/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
	I0630 20:55:04.162416  201358 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/calico-20220630204859-9950/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
	I0630 20:55:04.184034  201358 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/calico-20220630204859-9950/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0630 20:55:04.240862  201358 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/calico-20220630204859-9950/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
	I0630 20:55:04.263551  201358 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0630 20:55:04.284412  201358 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
	I0630 20:55:04.304138  201358 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0630 20:55:04.325181  201358 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
	I0630 20:55:04.346179  201358 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0630 20:55:04.365286  201358 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950.pem --> /usr/share/ca-certificates/9950.pem (1338 bytes)
	I0630 20:55:04.382910  201358 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem --> /usr/share/ca-certificates/99502.pem (1708 bytes)
	I0630 20:55:04.401009  201358 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0630 20:55:04.414226  201358 ssh_runner.go:195] Run: openssl version
	I0630 20:55:04.419011  201358 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0630 20:55:04.426975  201358 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0630 20:55:04.430231  201358 certs.go:431] hashing: -rw-r--r-- 1 root root 1111 Jun 30 20:22 /usr/share/ca-certificates/minikubeCA.pem
	I0630 20:55:04.430287  201358 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0630 20:55:04.435063  201358 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0630 20:55:04.443031  201358 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/9950.pem && ln -fs /usr/share/ca-certificates/9950.pem /etc/ssl/certs/9950.pem"
	I0630 20:55:04.451095  201358 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/9950.pem
	I0630 20:55:04.454420  201358 certs.go:431] hashing: -rw-r--r-- 1 root root 1338 Jun 30 20:26 /usr/share/ca-certificates/9950.pem
	I0630 20:55:04.454485  201358 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/9950.pem
	I0630 20:55:04.459600  201358 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/9950.pem /etc/ssl/certs/51391683.0"
	I0630 20:55:04.467304  201358 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/99502.pem && ln -fs /usr/share/ca-certificates/99502.pem /etc/ssl/certs/99502.pem"
	I0630 20:55:04.476526  201358 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/99502.pem
	I0630 20:55:04.480458  201358 certs.go:431] hashing: -rw-r--r-- 1 root root 1708 Jun 30 20:26 /usr/share/ca-certificates/99502.pem
	I0630 20:55:04.480527  201358 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/99502.pem
	I0630 20:55:04.485881  201358 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/99502.pem /etc/ssl/certs/3ec20f2e.0"
	I0630 20:55:04.494469  201358 kubeadm.go:395] StartCluster: {Name:calico-20220630204859-9950 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:calico-20220630204859-9950 Namespace:default APIServerName:minikube
CA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:calico NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:5m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror:
DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 20:55:04.494932  201358 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
	I0630 20:55:04.495013  201358 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0630 20:55:04.523185  201358 cri.go:87] found id: ""
	I0630 20:55:04.523270  201358 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0630 20:55:04.532758  201358 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0630 20:55:04.540702  201358 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver
	I0630 20:55:04.540773  201358 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0630 20:55:04.548600  201358 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0630 20:55:04.548652  201358 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0630 20:55:04.975499  201358 out.go:204]   - Generating certificates and keys ...
	I0630 20:55:07.311540  201358 out.go:204]   - Booting up control plane ...
	I0630 20:55:15.857359  201358 out.go:204]   - Configuring RBAC rules ...
	I0630 20:55:16.329098  201358 cni.go:95] Creating CNI manager for "calico"
	I0630 20:55:16.330907  201358 out.go:177] * Configuring Calico (Container Networking Interface) ...
	I0630 20:55:16.332514  201358 cni.go:189] applying CNI manifest using /var/lib/minikube/binaries/v1.24.2/kubectl ...
	I0630 20:55:16.332540  201358 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (202050 bytes)
	I0630 20:55:16.348960  201358 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0630 20:55:17.846180  201358 ssh_runner.go:235] Completed: sudo /var/lib/minikube/binaries/v1.24.2/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml: (1.497180355s)
	I0630 20:55:17.846228  201358 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0630 20:55:17.846315  201358 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:55:17.846332  201358 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl label nodes minikube.k8s.io/version=v1.26.0 minikube.k8s.io/commit=251ffcec0e4c997cd7732864187747cc579943c9 minikube.k8s.io/name=calico-20220630204859-9950 minikube.k8s.io/updated_at=2022_06_30T20_55_17_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:55:17.854222  201358 ops.go:34] apiserver oom_adj: -16
	I0630 20:55:17.944558  201358 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:55:18.513586  201358 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:55:19.013552  201358 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:55:19.513281  201358 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:55:20.013159  201358 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:55:20.513384  201358 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:55:21.013092  201358 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:55:21.513191  201358 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:55:22.013832  201358 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:55:22.513459  201358 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:55:23.013220  201358 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:55:23.513210  201358 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:55:24.012992  201358 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:55:24.513829  201358 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:55:25.013281  201358 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:55:25.513374  201358 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:55:26.013006  201358 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:55:26.513984  201358 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:55:27.012940  201358 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:55:27.513009  201358 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:55:28.013871  201358 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:55:28.513241  201358 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:55:29.014004  201358 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:55:29.513854  201358 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 20:55:29.626983  201358 kubeadm.go:1045] duration metric: took 11.780727667s to wait for elevateKubeSystemPrivileges.
	I0630 20:55:29.627018  201358 kubeadm.go:397] StartCluster complete in 25.132562795s
	I0630 20:55:29.627040  201358 settings.go:142] acquiring lock: {Name:mkcbd229caa05b60d3551ef0b47eea08424c9b5d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 20:55:29.627143  201358 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 20:55:29.628820  201358 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig: {Name:mk34e4a4e7b04f624b9adbda4f77ee20b38308ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 20:55:30.155654  201358 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "calico-20220630204859-9950" rescaled to 1
	I0630 20:55:30.155717  201358 start.go:208] Will wait 5m0s for node &{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0630 20:55:30.155749  201358 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0630 20:55:30.155840  201358 addons.go:412] enableAddons start: toEnable=map[], additional=[]
	I0630 20:55:30.157992  201358 out.go:177] * Verifying Kubernetes components...
	I0630 20:55:30.155901  201358 addons.go:65] Setting storage-provisioner=true in profile "calico-20220630204859-9950"
	I0630 20:55:30.155938  201358 addons.go:65] Setting default-storageclass=true in profile "calico-20220630204859-9950"
	I0630 20:55:30.155948  201358 config.go:178] Loaded profile config "calico-20220630204859-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 20:55:30.159294  201358 addons.go:153] Setting addon storage-provisioner=true in "calico-20220630204859-9950"
	W0630 20:55:30.159312  201358 addons.go:162] addon storage-provisioner should already be in state true
	I0630 20:55:30.159316  201358 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 20:55:30.159331  201358 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "calico-20220630204859-9950"
	I0630 20:55:30.159362  201358 host.go:66] Checking if "calico-20220630204859-9950" exists ...
	I0630 20:55:30.159692  201358 cli_runner.go:164] Run: docker container inspect calico-20220630204859-9950 --format={{.State.Status}}
	I0630 20:55:30.159870  201358 cli_runner.go:164] Run: docker container inspect calico-20220630204859-9950 --format={{.State.Status}}
	I0630 20:55:30.206808  201358 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0630 20:55:30.207410  201358 addons.go:153] Setting addon default-storageclass=true in "calico-20220630204859-9950"
	W0630 20:55:30.208472  201358 addons.go:162] addon default-storageclass should already be in state true
	I0630 20:55:30.208497  201358 host.go:66] Checking if "calico-20220630204859-9950" exists ...
	I0630 20:55:30.208460  201358 addons.go:345] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 20:55:30.208566  201358 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0630 20:55:30.208640  201358 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" calico-20220630204859-9950
	I0630 20:55:30.208855  201358 cli_runner.go:164] Run: docker container inspect calico-20220630204859-9950 --format={{.State.Status}}
	I0630 20:55:30.232159  201358 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.85.1 host.minikube.internal\n           fallthrough\n        }' | sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0630 20:55:30.233549  201358 node_ready.go:35] waiting up to 5m0s for node "calico-20220630204859-9950" to be "Ready" ...
	I0630 20:55:30.236859  201358 node_ready.go:49] node "calico-20220630204859-9950" has status "Ready":"True"
	I0630 20:55:30.236880  201358 node_ready.go:38] duration metric: took 3.297952ms waiting for node "calico-20220630204859-9950" to be "Ready" ...
	I0630 20:55:30.236890  201358 pod_ready.go:35] extra waiting up to 5m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0630 20:55:30.249305  201358 pod_ready.go:78] waiting up to 5m0s for pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace to be "Ready" ...
	I0630 20:55:30.257450  201358 addons.go:345] installing /etc/kubernetes/addons/storageclass.yaml
	I0630 20:55:30.257474  201358 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0630 20:55:30.257529  201358 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" calico-20220630204859-9950
	I0630 20:55:30.272933  201358 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49382 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/calico-20220630204859-9950/id_rsa Username:docker}
	I0630 20:55:30.311841  201358 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49382 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/calico-20220630204859-9950/id_rsa Username:docker}
	I0630 20:55:30.438970  201358 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 20:55:30.451073  201358 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0630 20:55:31.629437  201358 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.85.1 host.minikube.internal\n           fallthrough\n        }' | sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (1.397235613s)
	I0630 20:55:31.629472  201358 start.go:806] {"host.minikube.internal": 192.168.85.1} host record injected into CoreDNS
	I0630 20:55:31.689954  201358 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (1.250942658s)
	I0630 20:55:31.690018  201358 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (1.238909963s)
	I0630 20:55:31.691795  201358 out.go:177] * Enabled addons: storage-provisioner, default-storageclass
	I0630 20:55:31.693028  201358 addons.go:414] enableAddons completed in 1.537194278s
	I0630 20:55:32.268335  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:55:34.766282  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:55:36.766937  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:55:38.767975  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:55:41.266436  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:55:43.267750  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:55:45.267856  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:55:47.768421  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:55:49.773482  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:55:52.266814  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:55:54.267384  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:55:56.267709  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:55:58.767508  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:00.769496  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:03.267547  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:05.267982  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:07.767572  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:10.266599  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:12.267197  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:14.267220  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:16.766493  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:18.766918  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:21.266248  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:23.267196  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:25.270864  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:27.767716  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:29.768071  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:32.266879  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:34.267104  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:36.767348  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:39.267374  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:41.267972  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:43.766977  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:45.767596  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:48.267529  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:50.268708  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:52.770822  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:55.266690  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:57.266812  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:56:59.766755  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:01.767175  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:03.767340  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:06.267243  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:08.267493  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:10.267604  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:12.767831  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:15.267908  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:17.767619  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:20.268189  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:22.766829  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:24.769945  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:27.267444  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:29.268045  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:31.767298  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:34.266266  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:36.266331  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:38.267361  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:40.767647  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:43.266649  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:45.767285  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:48.266303  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:50.266748  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:52.766570  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:54.770823  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:57.267030  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:57:59.267416  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:01.767836  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:04.266488  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:06.267464  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:08.766678  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:10.766750  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:12.767407  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:14.767560  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:17.266846  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:19.767336  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:21.767511  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:24.267252  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:26.267525  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:28.767713  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:31.267674  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:33.766748  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:35.767244  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:37.767528  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:40.267428  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:42.766176  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:44.767181  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:46.767809  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:49.266904  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:51.268184  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:53.766719  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:55.768768  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:58:58.266495  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:00.267616  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:02.767801  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:04.767965  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:07.267048  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:09.267596  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:11.766973  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:13.767471  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:16.267132  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:18.766378  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:20.768732  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:23.266667  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:25.266948  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:27.267421  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:29.767806  201358 pod_ready.go:102] pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:30.272033  201358 pod_ready.go:81] duration metric: took 4m0.022637966s waiting for pod "calico-kube-controllers-c44b4545-jtql7" in "kube-system" namespace to be "Ready" ...
	E0630 20:59:30.272057  201358 pod_ready.go:66] WaitExtra: waitPodCondition: timed out waiting for the condition
	I0630 20:59:30.272067  201358 pod_ready.go:78] waiting up to 5m0s for pod "calico-node-wkbg5" in "kube-system" namespace to be "Ready" ...
	I0630 20:59:32.284194  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:34.284965  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:36.784237  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:38.784754  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:41.283852  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:43.284466  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:45.284750  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:47.287832  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:49.784604  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:51.784852  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:53.785175  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:56.285224  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 20:59:58.784686  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:00:00.785839  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:00:03.286247  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:00:05.785672  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:00:08.285034  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:00:10.353031  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:00:12.784379  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:00:14.787360  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:00:17.284414  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:00:19.285725  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:00:21.784379  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:00:23.784714  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:00:25.784921  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:00:28.284429  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:00:30.285686  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:00:32.784082  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:00:34.784967  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:00:37.286404  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:00:39.785285  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:00:42.284530  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:00:44.287462  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:00:46.799196  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:00:49.285308  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:00:51.785020  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:00:54.284596  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:00:56.284836  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:00:58.285523  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:01:00.785018  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:01:02.787477  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:01:05.284827  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:01:07.285685  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:01:09.786797  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:01:12.285233  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:01:14.285356  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:01:16.784494  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:01:18.785560  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:01:21.285036  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:01:23.286493  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:01:25.784860  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:01:27.785230  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:01:30.284913  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:01:32.784224  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:01:34.784778  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:01:37.285221  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:01:39.785322  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:01:42.284950  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:01:44.285028  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:01:46.784722  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:01:49.284827  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:01:51.284879  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:01:53.784313  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:01:55.786561  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:01:58.284222  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:02:00.284707  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:02:02.285687  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:02:04.784548  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:02:06.785025  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:02:09.284710  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:02:11.784216  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:02:13.784404  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:02:15.784698  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:02:17.785529  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:02:20.285117  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:02:22.784967  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:02:25.285309  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:02:27.784536  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:02:29.785648  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:02:32.284803  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:02:34.285866  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:02:36.785286  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:02:39.284830  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:02:41.286045  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:02:43.286455  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:02:45.785150  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:02:47.785885  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:02:50.284956  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:02:52.785223  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:02:54.786648  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:02:57.285644  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:02:59.785950  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:03:02.284891  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:03:04.284978  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:03:06.784686  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:03:08.785994  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:03:11.284861  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:03:13.286053  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:03:15.785547  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:03:17.786058  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:03:19.786358  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:03:22.284505  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:03:24.284806  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:03:26.785155  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:03:28.785861  201358 pod_ready.go:102] pod "calico-node-wkbg5" in "kube-system" namespace has status "Ready":"False"
	I0630 21:03:30.291033  201358 pod_ready.go:81] duration metric: took 4m0.018955087s waiting for pod "calico-node-wkbg5" in "kube-system" namespace to be "Ready" ...
	E0630 21:03:30.291066  201358 pod_ready.go:66] WaitExtra: waitPodCondition: timed out waiting for the condition
	I0630 21:03:30.291083  201358 pod_ready.go:38] duration metric: took 8m0.054180605s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0630 21:03:30.293850  201358 out.go:177] 
	W0630 21:03:30.295482  201358 out.go:239] X Exiting due to GUEST_START: wait 5m0s for node: extra waiting: timed out waiting 5m0s for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready"
	X Exiting due to GUEST_START: wait 5m0s for node: extra waiting: timed out waiting 5m0s for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready"
	W0630 21:03:30.295502  201358 out.go:239] * 
	* 
	W0630 21:03:30.296212  201358 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0630 21:03:30.298456  201358 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:103: failed start: exit status 80
--- FAIL: TestNetworkPlugins/group/calico/Start (520.30s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/DNS (357.8s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/DNS
net_test.go:169: (dbg) Run:  kubectl --context bridge-20220630204858-9950 exec deployment/netcat -- nslookup kubernetes.default
net_test.go:169: (dbg) Non-zero exit: kubectl --context bridge-20220630204858-9950 exec deployment/netcat -- nslookup kubernetes.default: exit status 1 (15.138991831s)

                                                
                                                
-- stdout --
	;; connection timed out; no servers could be reached
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	command terminated with exit code 1

                                                
                                                
** /stderr **
net_test.go:169: (dbg) Run:  kubectl --context bridge-20220630204858-9950 exec deployment/netcat -- nslookup kubernetes.default
net_test.go:169: (dbg) Non-zero exit: kubectl --context bridge-20220630204858-9950 exec deployment/netcat -- nslookup kubernetes.default: exit status 1 (15.129960612s)

                                                
                                                
-- stdout --
	;; connection timed out; no servers could be reached
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	command terminated with exit code 1

                                                
                                                
** /stderr **
net_test.go:169: (dbg) Run:  kubectl --context bridge-20220630204858-9950 exec deployment/netcat -- nslookup kubernetes.default
net_test.go:169: (dbg) Non-zero exit: kubectl --context bridge-20220630204858-9950 exec deployment/netcat -- nslookup kubernetes.default: exit status 1 (15.126442522s)

                                                
                                                
-- stdout --
	;; connection timed out; no servers could be reached
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	command terminated with exit code 1

                                                
                                                
** /stderr **
net_test.go:169: (dbg) Run:  kubectl --context bridge-20220630204858-9950 exec deployment/netcat -- nslookup kubernetes.default
net_test.go:169: (dbg) Non-zero exit: kubectl --context bridge-20220630204858-9950 exec deployment/netcat -- nslookup kubernetes.default: exit status 1 (15.143452079s)

                                                
                                                
-- stdout --
	;; connection timed out; no servers could be reached
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	command terminated with exit code 1

                                                
                                                
** /stderr **
net_test.go:169: (dbg) Run:  kubectl --context bridge-20220630204858-9950 exec deployment/netcat -- nslookup kubernetes.default
net_test.go:169: (dbg) Non-zero exit: kubectl --context bridge-20220630204858-9950 exec deployment/netcat -- nslookup kubernetes.default: exit status 1 (15.123474137s)

                                                
                                                
-- stdout --
	;; connection timed out; no servers could be reached
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	command terminated with exit code 1

                                                
                                                
** /stderr **
net_test.go:169: (dbg) Run:  kubectl --context bridge-20220630204858-9950 exec deployment/netcat -- nslookup kubernetes.default
net_test.go:169: (dbg) Non-zero exit: kubectl --context bridge-20220630204858-9950 exec deployment/netcat -- nslookup kubernetes.default: exit status 1 (15.14143282s)

                                                
                                                
-- stdout --
	;; connection timed out; no servers could be reached
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	command terminated with exit code 1

                                                
                                                
** /stderr **
E0630 20:58:30.280593    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/functional-20220630202638-9950/client.crt: no such file or directory
net_test.go:169: (dbg) Run:  kubectl --context bridge-20220630204858-9950 exec deployment/netcat -- nslookup kubernetes.default
net_test.go:169: (dbg) Non-zero exit: kubectl --context bridge-20220630204858-9950 exec deployment/netcat -- nslookup kubernetes.default: exit status 1 (15.136775182s)

                                                
                                                
-- stdout --
	;; connection timed out; no servers could be reached
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	command terminated with exit code 1

                                                
                                                
** /stderr **
E0630 20:58:50.204150    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/addons-20220630202117-9950/client.crt: no such file or directory
net_test.go:169: (dbg) Run:  kubectl --context bridge-20220630204858-9950 exec deployment/netcat -- nslookup kubernetes.default
net_test.go:169: (dbg) Non-zero exit: kubectl --context bridge-20220630204858-9950 exec deployment/netcat -- nslookup kubernetes.default: exit status 1 (15.137160108s)

                                                
                                                
-- stdout --
	;; connection timed out; no servers could be reached
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	command terminated with exit code 1

                                                
                                                
** /stderr **
net_test.go:169: (dbg) Run:  kubectl --context bridge-20220630204858-9950 exec deployment/netcat -- nslookup kubernetes.default
E0630 20:59:37.806776    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/auto-20220630204858-9950/client.crt: no such file or directory
E0630 20:59:37.812011    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/auto-20220630204858-9950/client.crt: no such file or directory
E0630 20:59:37.822211    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/auto-20220630204858-9950/client.crt: no such file or directory
E0630 20:59:37.842451    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/auto-20220630204858-9950/client.crt: no such file or directory
E0630 20:59:37.882728    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/auto-20220630204858-9950/client.crt: no such file or directory
E0630 20:59:37.963022    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/auto-20220630204858-9950/client.crt: no such file or directory
E0630 20:59:38.123424    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/auto-20220630204858-9950/client.crt: no such file or directory
E0630 20:59:38.443993    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/auto-20220630204858-9950/client.crt: no such file or directory
E0630 20:59:39.084233    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/auto-20220630204858-9950/client.crt: no such file or directory
E0630 20:59:40.365401    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/auto-20220630204858-9950/client.crt: no such file or directory
E0630 20:59:41.441429    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/kindnet-20220630204858-9950/client.crt: no such file or directory
E0630 20:59:41.446699    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/kindnet-20220630204858-9950/client.crt: no such file or directory
E0630 20:59:41.456942    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/kindnet-20220630204858-9950/client.crt: no such file or directory
E0630 20:59:41.477208    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/kindnet-20220630204858-9950/client.crt: no such file or directory
E0630 20:59:41.517448    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/kindnet-20220630204858-9950/client.crt: no such file or directory
E0630 20:59:41.597719    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/kindnet-20220630204858-9950/client.crt: no such file or directory
E0630 20:59:41.757915    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/kindnet-20220630204858-9950/client.crt: no such file or directory
E0630 20:59:42.078745    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/kindnet-20220630204858-9950/client.crt: no such file or directory
E0630 20:59:42.719644    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/kindnet-20220630204858-9950/client.crt: no such file or directory
E0630 20:59:42.926000    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/auto-20220630204858-9950/client.crt: no such file or directory
E0630 20:59:44.000221    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/kindnet-20220630204858-9950/client.crt: no such file or directory
E0630 20:59:46.561394    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/kindnet-20220630204858-9950/client.crt: no such file or directory
net_test.go:169: (dbg) Non-zero exit: kubectl --context bridge-20220630204858-9950 exec deployment/netcat -- nslookup kubernetes.default: exit status 1 (15.131539569s)

                                                
                                                
-- stdout --
	;; connection timed out; no servers could be reached
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	command terminated with exit code 1

                                                
                                                
** /stderr **
E0630 20:59:48.046969    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/auto-20220630204858-9950/client.crt: no such file or directory
E0630 20:59:51.682093    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/kindnet-20220630204858-9950/client.crt: no such file or directory
E0630 20:59:58.287806    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/auto-20220630204858-9950/client.crt: no such file or directory

                                                
                                                
=== CONT  TestNetworkPlugins/group/bridge/DNS
net_test.go:169: (dbg) Run:  kubectl --context bridge-20220630204858-9950 exec deployment/netcat -- nslookup kubernetes.default
E0630 21:00:18.768507    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/auto-20220630204858-9950/client.crt: no such file or directory
E0630 21:00:22.403220    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/kindnet-20220630204858-9950/client.crt: no such file or directory
E0630 21:00:25.851322    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/cilium-20220630204859-9950/client.crt: no such file or directory
E0630 21:00:25.856634    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/cilium-20220630204859-9950/client.crt: no such file or directory
E0630 21:00:25.866887    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/cilium-20220630204859-9950/client.crt: no such file or directory
E0630 21:00:25.887195    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/cilium-20220630204859-9950/client.crt: no such file or directory
E0630 21:00:25.927493    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/cilium-20220630204859-9950/client.crt: no such file or directory
E0630 21:00:26.007836    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/cilium-20220630204859-9950/client.crt: no such file or directory
E0630 21:00:26.168257    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/cilium-20220630204859-9950/client.crt: no such file or directory
E0630 21:00:26.488918    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/cilium-20220630204859-9950/client.crt: no such file or directory

                                                
                                                
=== CONT  TestNetworkPlugins/group/bridge/DNS
net_test.go:169: (dbg) Non-zero exit: kubectl --context bridge-20220630204858-9950 exec deployment/netcat -- nslookup kubernetes.default: exit status 1 (15.127962917s)

                                                
                                                
-- stdout --
	;; connection timed out; no servers could be reached
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	command terminated with exit code 1

                                                
                                                
** /stderr **
E0630 21:00:28.410833    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/cilium-20220630204859-9950/client.crt: no such file or directory
E0630 21:00:30.971327    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/cilium-20220630204859-9950/client.crt: no such file or directory
E0630 21:00:36.091673    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/cilium-20220630204859-9950/client.crt: no such file or directory

                                                
                                                
=== CONT  TestNetworkPlugins/group/bridge/DNS
net_test.go:169: (dbg) Run:  kubectl --context bridge-20220630204858-9950 exec deployment/netcat -- nslookup kubernetes.default
E0630 21:01:06.812747    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/cilium-20220630204859-9950/client.crt: no such file or directory

                                                
                                                
=== CONT  TestNetworkPlugins/group/bridge/DNS
net_test.go:169: (dbg) Non-zero exit: kubectl --context bridge-20220630204858-9950 exec deployment/netcat -- nslookup kubernetes.default: exit status 1 (15.123292702s)

                                                
                                                
-- stdout --
	;; connection timed out; no servers could be reached
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	command terminated with exit code 1

                                                
                                                
** /stderr **

                                                
                                                
=== CONT  TestNetworkPlugins/group/bridge/DNS
net_test.go:169: (dbg) Run:  kubectl --context bridge-20220630204858-9950 exec deployment/netcat -- nslookup kubernetes.default

                                                
                                                
=== CONT  TestNetworkPlugins/group/bridge/DNS
net_test.go:169: (dbg) Non-zero exit: kubectl --context bridge-20220630204858-9950 exec deployment/netcat -- nslookup kubernetes.default: exit status 1 (15.146247892s)

                                                
                                                
-- stdout --
	;; connection timed out; no servers could be reached
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	command terminated with exit code 1

                                                
                                                
** /stderr **
net_test.go:175: failed to do nslookup on kubernetes.default: exit status 1
net_test.go:180: failed nslookup: got=";; connection timed out; no servers could be reached\n\n\n", want=*"10.96.0.1"*
--- FAIL: TestNetworkPlugins/group/bridge/DNS (357.80s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/FirstStart (281.95s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-amd64 start -p old-k8s-version-20220630210005-9950 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.16.0

                                                
                                                
=== CONT  TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-20220630210005-9950 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.16.0: exit status 80 (4m39.861860379s)

                                                
                                                
-- stdout --
	* [old-k8s-version-20220630210005-9950] minikube v1.26.0 on Ubuntu 20.04 (kvm/amd64)
	  - MINIKUBE_LOCATION=14420
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-amd64
	* Using the docker driver based on user configuration
	* Using Docker driver with root privileges
	* Starting control plane node old-k8s-version-20220630210005-9950 in cluster old-k8s-version-20220630210005-9950
	* Pulling base image ...
	* Creating docker container (CPUs=2, Memory=2200MB) ...
	* Preparing Kubernetes v1.16.0 on containerd 1.6.6 ...
	  - kubelet.cni-conf-dir=/etc/cni/net.mk
	  - Generating certificates and keys ...
	  - Booting up control plane ...
	  - Configuring RBAC rules ...
	* Configuring CNI (Container Networking Interface) ...
	* Verifying Kubernetes components...
	  - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	* Enabled addons: storage-provisioner, default-storageclass
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0630 21:00:05.503549  228981 out.go:296] Setting OutFile to fd 1 ...
	I0630 21:00:05.503679  228981 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 21:00:05.503689  228981 out.go:309] Setting ErrFile to fd 2...
	I0630 21:00:05.503694  228981 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 21:00:05.504177  228981 root.go:329] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/bin
	I0630 21:00:05.504547  228981 out.go:303] Setting JSON to false
	I0630 21:00:05.506254  228981 start.go:115] hostinfo: {"hostname":"ubuntu-20-agent-8","uptime":2558,"bootTime":1656620248,"procs":637,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1012-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0630 21:00:05.506340  228981 start.go:125] virtualization: kvm guest
	I0630 21:00:05.510096  228981 out.go:177] * [old-k8s-version-20220630210005-9950] minikube v1.26.0 on Ubuntu 20.04 (kvm/amd64)
	I0630 21:00:05.511882  228981 notify.go:193] Checking for updates...
	I0630 21:00:05.511930  228981 out.go:177]   - MINIKUBE_LOCATION=14420
	I0630 21:00:05.513670  228981 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0630 21:00:05.515528  228981 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:00:05.517173  228981 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube
	I0630 21:00:05.518783  228981 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0630 21:00:05.522418  228981 config.go:178] Loaded profile config "bridge-20220630204858-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:00:05.522536  228981 config.go:178] Loaded profile config "calico-20220630204859-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:00:05.522632  228981 config.go:178] Loaded profile config "enable-default-cni-20220630204858-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:00:05.522692  228981 driver.go:360] Setting default libvirt URI to qemu:///system
	I0630 21:00:05.568496  228981 docker.go:137] docker version: linux-20.10.17
	I0630 21:00:05.568623  228981 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0630 21:00:05.685029  228981 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:3 ContainersPaused:0 ContainersStopped:0 Images:8 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:51 OomKillDisable:true NGoroutines:49 SystemTime:2022-06-30 21:00:05.602469192 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1012-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexServ
erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662451712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-8 Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Client
Info:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
	I0630 21:00:05.685272  228981 docker.go:254] overlay module found
	I0630 21:00:05.687482  228981 out.go:177] * Using the docker driver based on user configuration
	I0630 21:00:05.688975  228981 start.go:284] selected driver: docker
	I0630 21:00:05.688991  228981 start.go:808] validating driver "docker" against <nil>
	I0630 21:00:05.689018  228981 start.go:819] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0630 21:00:05.690033  228981 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0630 21:00:05.810139  228981 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:3 ContainersPaused:0 ContainersStopped:0 Images:8 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:51 OomKillDisable:true NGoroutines:49 SystemTime:2022-06-30 21:00:05.724796446 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1012-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexServ
erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662451712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-8 Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Client
Info:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
	I0630 21:00:05.810247  228981 start_flags.go:296] no existing cluster config was found, will generate one from the flags 
	I0630 21:00:05.810411  228981 start_flags.go:853] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0630 21:00:05.812424  228981 out.go:177] * Using Docker driver with root privileges
	I0630 21:00:05.813726  228981 cni.go:95] Creating CNI manager for ""
	I0630 21:00:05.813749  228981 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:00:05.813768  228981 cni.go:225] auto-setting extra-config to "kubelet.cni-conf-dir=/etc/cni/net.mk"
	I0630 21:00:05.813776  228981 cni.go:230] extra-config set to "kubelet.cni-conf-dir=/etc/cni/net.mk"
	I0630 21:00:05.813781  228981 start_flags.go:305] Found "CNI" CNI - setting NetworkPlugin=cni
	I0630 21:00:05.813808  228981 start_flags.go:310] config:
	{Name:old-k8s-version-20220630210005-9950 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-20220630210005-9950 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDom
ain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 21:00:05.815477  228981 out.go:177] * Starting control plane node old-k8s-version-20220630210005-9950 in cluster old-k8s-version-20220630210005-9950
	I0630 21:00:05.817081  228981 cache.go:120] Beginning downloading kic base image for docker with containerd
	I0630 21:00:05.818742  228981 out.go:177] * Pulling base image ...
	I0630 21:00:05.820256  228981 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime containerd
	I0630 21:00:05.820289  228981 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e in local docker daemon
	I0630 21:00:05.820309  228981 preload.go:148] Found local preload: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-containerd-overlay2-amd64.tar.lz4
	I0630 21:00:05.820318  228981 cache.go:57] Caching tarball of preloaded images
	I0630 21:00:05.820531  228981 preload.go:174] Found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-containerd-overlay2-amd64.tar.lz4 in cache, skipping download
	I0630 21:00:05.820545  228981 cache.go:60] Finished verifying existence of preloaded tar for  v1.16.0 on containerd
	I0630 21:00:05.820662  228981 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/config.json ...
	I0630 21:00:05.820707  228981 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/config.json: {Name:mkfe906b08cfa1010b94ebcaa6a11f4bb54244f6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:00:05.858277  228981 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e in local docker daemon, skipping pull
	I0630 21:00:05.858302  228981 cache.go:142] gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e exists in daemon, skipping load
	I0630 21:00:05.858312  228981 cache.go:208] Successfully downloaded all kic artifacts
	I0630 21:00:05.858370  228981 start.go:352] acquiring machines lock for old-k8s-version-20220630210005-9950: {Name:mkf719e729d8bddb1fc7c2bc9e00e82ad1c17213 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0630 21:00:05.858518  228981 start.go:356] acquired machines lock for "old-k8s-version-20220630210005-9950" in 120.042µs
	I0630 21:00:05.858546  228981 start.go:91] Provisioning new machine with config: &{Name:old-k8s-version-20220630210005-9950 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-20220630210005-9950 N
amespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSiz
e:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:} &{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0630 21:00:05.858665  228981 start.go:131] createHost starting for "" (driver="docker")
	I0630 21:00:05.861907  228981 out.go:204] * Creating docker container (CPUs=2, Memory=2200MB) ...
	I0630 21:00:05.862168  228981 start.go:165] libmachine.API.Create for "old-k8s-version-20220630210005-9950" (driver="docker")
	I0630 21:00:05.862205  228981 client.go:168] LocalClient.Create starting
	I0630 21:00:05.862296  228981 main.go:134] libmachine: Reading certificate data from /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem
	I0630 21:00:05.862341  228981 main.go:134] libmachine: Decoding PEM data...
	I0630 21:00:05.862364  228981 main.go:134] libmachine: Parsing certificate...
	I0630 21:00:05.862439  228981 main.go:134] libmachine: Reading certificate data from /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem
	I0630 21:00:05.862469  228981 main.go:134] libmachine: Decoding PEM data...
	I0630 21:00:05.862489  228981 main.go:134] libmachine: Parsing certificate...
	I0630 21:00:05.862862  228981 cli_runner.go:164] Run: docker network inspect old-k8s-version-20220630210005-9950 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	W0630 21:00:05.904174  228981 cli_runner.go:211] docker network inspect old-k8s-version-20220630210005-9950 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
	I0630 21:00:05.904238  228981 network_create.go:272] running [docker network inspect old-k8s-version-20220630210005-9950] to gather additional debugging logs...
	I0630 21:00:05.904256  228981 cli_runner.go:164] Run: docker network inspect old-k8s-version-20220630210005-9950
	W0630 21:00:05.939856  228981 cli_runner.go:211] docker network inspect old-k8s-version-20220630210005-9950 returned with exit code 1
	I0630 21:00:05.939898  228981 network_create.go:275] error running [docker network inspect old-k8s-version-20220630210005-9950]: docker network inspect old-k8s-version-20220630210005-9950: exit status 1
	stdout:
	[]
	
	stderr:
	Error: No such network: old-k8s-version-20220630210005-9950
	I0630 21:00:05.939924  228981 network_create.go:277] output of [docker network inspect old-k8s-version-20220630210005-9950]: -- stdout --
	[]
	
	-- /stdout --
	** stderr ** 
	Error: No such network: old-k8s-version-20220630210005-9950
	
	** /stderr **
	I0630 21:00:05.940000  228981 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0630 21:00:05.979178  228981 network.go:240] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName:br-c7ee26fec5a3 IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:02:42:cc:d0:4a:9e}}
	I0630 21:00:05.980149  228981 network.go:240] skipping subnet 192.168.58.0/24 that is taken: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 Interface:{IfaceName:br-3e97afadef02 IfaceIPv4:192.168.58.1 IfaceMTU:1500 IfaceMAC:02:42:9e:e7:fd:62}}
	I0630 21:00:05.981243  228981 network.go:288] reserving subnet 192.168.67.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[] amended:true}} dirty:map[192.168.67.0:0xc00055c010] misses:0}
	I0630 21:00:05.981289  228981 network.go:235] using free private subnet 192.168.67.0/24: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
	I0630 21:00:05.981310  228981 network_create.go:115] attempt to create docker network old-k8s-version-20220630210005-9950 192.168.67.0/24 with gateway 192.168.67.1 and MTU of 1500 ...
	I0630 21:00:05.981370  228981 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.67.0/24 --gateway=192.168.67.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-20220630210005-9950 old-k8s-version-20220630210005-9950
	I0630 21:00:06.056721  228981 network_create.go:99] docker network old-k8s-version-20220630210005-9950 192.168.67.0/24 created
	I0630 21:00:06.056758  228981 kic.go:106] calculated static IP "192.168.67.2" for the "old-k8s-version-20220630210005-9950" container
	I0630 21:00:06.056831  228981 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I0630 21:00:06.097755  228981 cli_runner.go:164] Run: docker volume create old-k8s-version-20220630210005-9950 --label name.minikube.sigs.k8s.io=old-k8s-version-20220630210005-9950 --label created_by.minikube.sigs.k8s.io=true
	I0630 21:00:06.134827  228981 oci.go:103] Successfully created a docker volume old-k8s-version-20220630210005-9950
	I0630 21:00:06.134926  228981 cli_runner.go:164] Run: docker run --rm --name old-k8s-version-20220630210005-9950-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=old-k8s-version-20220630210005-9950 --entrypoint /usr/bin/test -v old-k8s-version-20220630210005-9950:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e -d /var/lib
	I0630 21:00:06.783018  228981 oci.go:107] Successfully prepared a docker volume old-k8s-version-20220630210005-9950
	I0630 21:00:06.783066  228981 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime containerd
	I0630 21:00:06.783085  228981 kic.go:179] Starting extracting preloaded images to volume ...
	I0630 21:00:06.783169  228981 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-containerd-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v old-k8s-version-20220630210005-9950:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e -I lz4 -xf /preloaded.tar -C /extractDir
	I0630 21:00:13.779875  228981 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-containerd-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v old-k8s-version-20220630210005-9950:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e -I lz4 -xf /preloaded.tar -C /extractDir: (6.996654491s)
	I0630 21:00:13.779904  228981 kic.go:188] duration metric: took 6.996815 seconds to extract preloaded images to volume
	W0630 21:00:13.780059  228981 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	I0630 21:00:13.780203  228981 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0630 21:00:13.892305  228981 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname old-k8s-version-20220630210005-9950 --name old-k8s-version-20220630210005-9950 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=old-k8s-version-20220630210005-9950 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=old-k8s-version-20220630210005-9950 --network old-k8s-version-20220630210005-9950 --ip 192.168.67.2 --volume old-k8s-version-20220630210005-9950:/var --security-opt apparmor=unconfined --memory=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e
	I0630 21:00:14.365399  228981 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220630210005-9950 --format={{.State.Running}}
	I0630 21:00:14.404985  228981 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220630210005-9950 --format={{.State.Status}}
	I0630 21:00:14.444022  228981 cli_runner.go:164] Run: docker exec old-k8s-version-20220630210005-9950 stat /var/lib/dpkg/alternatives/iptables
	I0630 21:00:14.525595  228981 oci.go:144] the created container "old-k8s-version-20220630210005-9950" has a running status.
	I0630 21:00:14.525631  228981 kic.go:210] Creating ssh key for kic: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/old-k8s-version-20220630210005-9950/id_rsa...
	I0630 21:00:14.627208  228981 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/old-k8s-version-20220630210005-9950/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0630 21:00:14.730331  228981 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220630210005-9950 --format={{.State.Status}}
	I0630 21:00:14.776179  228981 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0630 21:00:14.776212  228981 kic_runner.go:114] Args: [docker exec --privileged old-k8s-version-20220630210005-9950 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0630 21:00:14.882208  228981 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220630210005-9950 --format={{.State.Status}}
	I0630 21:00:14.925209  228981 machine.go:88] provisioning docker machine ...
	I0630 21:00:14.925250  228981 ubuntu.go:169] provisioning hostname "old-k8s-version-20220630210005-9950"
	I0630 21:00:14.925300  228981 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220630210005-9950
	I0630 21:00:14.965437  228981 main.go:134] libmachine: Using SSH client type: native
	I0630 21:00:14.965630  228981 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil>  [] 0s} 127.0.0.1 49397 <nil> <nil>}
	I0630 21:00:14.965657  228981 main.go:134] libmachine: About to run SSH command:
	sudo hostname old-k8s-version-20220630210005-9950 && echo "old-k8s-version-20220630210005-9950" | sudo tee /etc/hostname
	I0630 21:00:15.104659  228981 main.go:134] libmachine: SSH cmd err, output: <nil>: old-k8s-version-20220630210005-9950
	
	I0630 21:00:15.104732  228981 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220630210005-9950
	I0630 21:00:15.142309  228981 main.go:134] libmachine: Using SSH client type: native
	I0630 21:00:15.142521  228981 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil>  [] 0s} 127.0.0.1 49397 <nil> <nil>}
	I0630 21:00:15.142557  228981 main.go:134] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sold-k8s-version-20220630210005-9950' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-20220630210005-9950/g' /etc/hosts;
				else 
					echo '127.0.1.1 old-k8s-version-20220630210005-9950' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0630 21:00:15.261224  228981 main.go:134] libmachine: SSH cmd err, output: <nil>: 
	I0630 21:00:15.261262  228981 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube CaCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/c
erts/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube}
	I0630 21:00:15.261295  228981 ubuntu.go:177] setting up certificates
	I0630 21:00:15.261308  228981 provision.go:83] configureAuth start
	I0630 21:00:15.261366  228981 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-20220630210005-9950
	I0630 21:00:15.298357  228981 provision.go:138] copyHostCerts
	I0630 21:00:15.298423  228981 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem, removing ...
	I0630 21:00:15.298434  228981 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem
	I0630 21:00:15.298505  228981 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem (1082 bytes)
	I0630 21:00:15.298647  228981 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem, removing ...
	I0630 21:00:15.298661  228981 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem
	I0630 21:00:15.298696  228981 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem (1123 bytes)
	I0630 21:00:15.298758  228981 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem, removing ...
	I0630 21:00:15.298767  228981 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem
	I0630 21:00:15.298791  228981 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem (1679 bytes)
	I0630 21:00:15.298844  228981 provision.go:112] generating server cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-20220630210005-9950 san=[192.168.67.2 127.0.0.1 localhost 127.0.0.1 minikube old-k8s-version-20220630210005-9950]
	I0630 21:00:15.351976  228981 provision.go:172] copyRemoteCerts
	I0630 21:00:15.352033  228981 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0630 21:00:15.352066  228981 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220630210005-9950
	I0630 21:00:15.387731  228981 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49397 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/old-k8s-version-20220630210005-9950/id_rsa Username:docker}
	I0630 21:00:15.472896  228981 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
	I0630 21:00:15.491748  228981 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem --> /etc/docker/server.pem (1277 bytes)
	I0630 21:00:15.510354  228981 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
	I0630 21:00:15.529034  228981 provision.go:86] duration metric: configureAuth took 267.704861ms
	I0630 21:00:15.529082  228981 ubuntu.go:193] setting minikube options for container-runtime
	I0630 21:00:15.529295  228981 config.go:178] Loaded profile config "old-k8s-version-20220630210005-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.16.0
	I0630 21:00:15.529310  228981 machine.go:91] provisioned docker machine in 604.077016ms
	I0630 21:00:15.529316  228981 client.go:171] LocalClient.Create took 9.667100559s
	I0630 21:00:15.529345  228981 start.go:173] duration metric: libmachine.API.Create for "old-k8s-version-20220630210005-9950" took 9.667167588s
	I0630 21:00:15.529360  228981 start.go:306] post-start starting for "old-k8s-version-20220630210005-9950" (driver="docker")
	I0630 21:00:15.529367  228981 start.go:316] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0630 21:00:15.529420  228981 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0630 21:00:15.529470  228981 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220630210005-9950
	I0630 21:00:15.564621  228981 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49397 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/old-k8s-version-20220630210005-9950/id_rsa Username:docker}
	I0630 21:00:15.653156  228981 ssh_runner.go:195] Run: cat /etc/os-release
	I0630 21:00:15.656024  228981 main.go:134] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0630 21:00:15.656052  228981 main.go:134] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0630 21:00:15.656063  228981 main.go:134] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0630 21:00:15.656069  228981 info.go:137] Remote host: Ubuntu 20.04.4 LTS
	I0630 21:00:15.656083  228981 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/addons for local assets ...
	I0630 21:00:15.656135  228981 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files for local assets ...
	I0630 21:00:15.656200  228981 filesync.go:149] local asset: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem -> 99502.pem in /etc/ssl/certs
	I0630 21:00:15.656280  228981 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0630 21:00:15.663243  228981 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem --> /etc/ssl/certs/99502.pem (1708 bytes)
	I0630 21:00:15.681882  228981 start.go:309] post-start completed in 152.508777ms
	I0630 21:00:15.682242  228981 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-20220630210005-9950
	I0630 21:00:15.718118  228981 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/config.json ...
	I0630 21:00:15.718369  228981 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0630 21:00:15.718407  228981 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220630210005-9950
	I0630 21:00:15.753635  228981 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49397 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/old-k8s-version-20220630210005-9950/id_rsa Username:docker}
	I0630 21:00:15.841988  228981 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0630 21:00:15.846071  228981 start.go:134] duration metric: createHost completed in 9.987392217s
	I0630 21:00:15.846100  228981 start.go:81] releasing machines lock for "old-k8s-version-20220630210005-9950", held for 9.987569271s
	I0630 21:00:15.846202  228981 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-20220630210005-9950
	I0630 21:00:15.881429  228981 ssh_runner.go:195] Run: systemctl --version
	I0630 21:00:15.881484  228981 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220630210005-9950
	I0630 21:00:15.881500  228981 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/
	I0630 21:00:15.881567  228981 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220630210005-9950
	I0630 21:00:15.919189  228981 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49397 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/old-k8s-version-20220630210005-9950/id_rsa Username:docker}
	I0630 21:00:15.919472  228981 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49397 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/old-k8s-version-20220630210005-9950/id_rsa Username:docker}
	I0630 21:00:16.001583  228981 ssh_runner.go:195] Run: sudo systemctl stop -f crio
	I0630 21:00:16.047649  228981 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0630 21:00:16.058483  228981 docker.go:179] disabling docker service ...
	I0630 21:00:16.058535  228981 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0630 21:00:16.076347  228981 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0630 21:00:16.086507  228981 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0630 21:00:16.171660  228981 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0630 21:00:16.246902  228981 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0630 21:00:16.257162  228981 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
	image-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0630 21:00:16.272675  228981 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*sandbox_image = .*$|sandbox_image = "k8s.gcr.io/pause:3.1"|' -i /etc/containerd/config.toml"
	I0630 21:00:16.282813  228981 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*restrict_oom_score_adj = .*$|restrict_oom_score_adj = false|' -i /etc/containerd/config.toml"
	I0630 21:00:16.292284  228981 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*SystemdCgroup = .*$|SystemdCgroup = false|' -i /etc/containerd/config.toml"
	I0630 21:00:16.302459  228981 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*conf_dir = .*$|conf_dir = "/etc/cni/net.mk"|' -i /etc/containerd/config.toml"
	I0630 21:00:16.311298  228981 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^# imports|imports = ["/etc/containerd/containerd.conf.d/02-containerd.conf"]|' -i /etc/containerd/config.toml"
	I0630 21:00:16.320124  228981 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc/containerd/containerd.conf.d && printf %s "dmVyc2lvbiA9IDIK" | base64 -d | sudo tee /etc/containerd/containerd.conf.d/02-containerd.conf"
	I0630 21:00:16.334753  228981 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0630 21:00:16.342339  228981 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0630 21:00:16.350111  228981 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0630 21:00:16.427585  228981 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0630 21:00:16.505854  228981 start.go:447] Will wait 60s for socket path /run/containerd/containerd.sock
	I0630 21:00:16.505909  228981 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
	I0630 21:00:16.509439  228981 start.go:468] Will wait 60s for crictl version
	I0630 21:00:16.509504  228981 ssh_runner.go:195] Run: sudo crictl version
	I0630 21:00:16.538856  228981 start.go:477] Version:  0.1.0
	RuntimeName:  containerd
	RuntimeVersion:  1.6.6
	RuntimeApiVersion:  v1alpha2
	I0630 21:00:16.538927  228981 ssh_runner.go:195] Run: containerd --version
	I0630 21:00:16.570881  228981 ssh_runner.go:195] Run: containerd --version
	I0630 21:00:16.603186  228981 out.go:177] * Preparing Kubernetes v1.16.0 on containerd 1.6.6 ...
	I0630 21:00:16.604600  228981 cli_runner.go:164] Run: docker network inspect old-k8s-version-20220630210005-9950 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0630 21:00:16.641290  228981 ssh_runner.go:195] Run: grep 192.168.67.1	host.minikube.internal$ /etc/hosts
	I0630 21:00:16.644760  228981 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.67.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0630 21:00:16.657300  228981 out.go:177]   - kubelet.cni-conf-dir=/etc/cni/net.mk
	I0630 21:00:16.659001  228981 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime containerd
	I0630 21:00:16.659082  228981 ssh_runner.go:195] Run: sudo crictl images --output json
	I0630 21:00:16.684166  228981 containerd.go:547] all images are preloaded for containerd runtime.
	I0630 21:00:16.684189  228981 containerd.go:461] Images already preloaded, skipping extraction
	I0630 21:00:16.684243  228981 ssh_runner.go:195] Run: sudo crictl images --output json
	I0630 21:00:16.709371  228981 containerd.go:547] all images are preloaded for containerd runtime.
	I0630 21:00:16.709392  228981 cache_images.go:84] Images are preloaded, skipping loading
	I0630 21:00:16.709443  228981 ssh_runner.go:195] Run: sudo crictl info
	I0630 21:00:16.734538  228981 cni.go:95] Creating CNI manager for ""
	I0630 21:00:16.734563  228981 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:00:16.734579  228981 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
	I0630 21:00:16.734591  228981 kubeadm.go:158] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.67.2 APIServerPort:8443 KubernetesVersion:v1.16.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-20220630210005-9950 NodeName:old-k8s-version-20220630210005-9950 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.67.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.67.2 CgroupDriver:cgroupfs
ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}
	I0630 21:00:16.734716  228981 kubeadm.go:162] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta1
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.67.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: /run/containerd/containerd.sock
	  name: "old-k8s-version-20220630210005-9950"
	  kubeletExtraArgs:
	    node-ip: 192.168.67.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta1
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.67.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: old-k8s-version-20220630210005-9950
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	dns:
	  type: CoreDNS
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      listen-metrics-urls: http://127.0.0.1:2381,http://192.168.67.2:2381
	kubernetesVersion: v1.16.0
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%"
	  nodefs.inodesFree: "0%"
	  imagefs.available: "0%"
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0630 21:00:16.734791  228981 kubeadm.go:961] kubelet [Unit]
	Wants=containerd.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.16.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cni-conf-dir=/etc/cni/net.mk --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=old-k8s-version-20220630210005-9950 --image-service-endpoint=unix:///run/containerd/containerd.sock --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.67.2 --runtime-request-timeout=15m
	
	[Install]
	 config:
	{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-20220630210005-9950 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
	I0630 21:00:16.734841  228981 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.16.0
	I0630 21:00:16.742481  228981 binaries.go:44] Found k8s binaries, skipping transfer
	I0630 21:00:16.742555  228981 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0630 21:00:16.750164  228981 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (580 bytes)
	I0630 21:00:16.763864  228981 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0630 21:00:16.777972  228981 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2154 bytes)
	I0630 21:00:16.793070  228981 ssh_runner.go:195] Run: grep 192.168.67.2	control-plane.minikube.internal$ /etc/hosts
	I0630 21:00:16.796077  228981 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.67.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0630 21:00:16.806329  228981 certs.go:54] Setting up /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950 for IP: 192.168.67.2
	I0630 21:00:16.806445  228981 certs.go:182] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.key
	I0630 21:00:16.806495  228981 certs.go:182] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.key
	I0630 21:00:16.806557  228981 certs.go:302] generating minikube-user signed cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/client.key
	I0630 21:00:16.806572  228981 crypto.go:68] Generating cert /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/client.crt with IP's: []
	I0630 21:00:16.978426  228981 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/client.crt ...
	I0630 21:00:16.978458  228981 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/client.crt: {Name:mk6b9813b761e77a82130473423c624f89c14e62 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:00:16.978697  228981 crypto.go:164] Writing key to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/client.key ...
	I0630 21:00:16.978714  228981 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/client.key: {Name:mk29ec18267f70a4ebacc2909a4c522044605bcf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:00:16.978852  228981 certs.go:302] generating minikube signed cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/apiserver.key.c7fa3a9e
	I0630 21:00:16.978876  228981 crypto.go:68] Generating cert /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/apiserver.crt.c7fa3a9e with IP's: [192.168.67.2 10.96.0.1 127.0.0.1 10.0.0.1]
	I0630 21:00:17.134094  228981 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/apiserver.crt.c7fa3a9e ...
	I0630 21:00:17.134130  228981 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/apiserver.crt.c7fa3a9e: {Name:mk43ad93379ab0a383d3c5af357ee3a3b331205f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:00:17.134356  228981 crypto.go:164] Writing key to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/apiserver.key.c7fa3a9e ...
	I0630 21:00:17.134376  228981 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/apiserver.key.c7fa3a9e: {Name:mk0beebe05dfff3167fca40a8825d688cbf4c582 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:00:17.134498  228981 certs.go:320] copying /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/apiserver.crt.c7fa3a9e -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/apiserver.crt
	I0630 21:00:17.134575  228981 certs.go:324] copying /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/apiserver.key.c7fa3a9e -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/apiserver.key
	I0630 21:00:17.134655  228981 certs.go:302] generating aggregator signed cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/proxy-client.key
	I0630 21:00:17.134683  228981 crypto.go:68] Generating cert /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/proxy-client.crt with IP's: []
	I0630 21:00:17.230929  228981 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/proxy-client.crt ...
	I0630 21:00:17.230968  228981 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/proxy-client.crt: {Name:mka4c15cdac2789c32978508d3616409c19af1e3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:00:17.231185  228981 crypto.go:164] Writing key to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/proxy-client.key ...
	I0630 21:00:17.231203  228981 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/proxy-client.key: {Name:mk0ed273e1999b2c31c6c589f6006d6a3f4c331f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:00:17.231420  228981 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950.pem (1338 bytes)
	W0630 21:00:17.231472  228981 certs.go:384] ignoring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950_empty.pem, impossibly tiny 0 bytes
	I0630 21:00:17.231493  228981 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem (1679 bytes)
	I0630 21:00:17.231526  228981 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem (1082 bytes)
	I0630 21:00:17.231561  228981 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem (1123 bytes)
	I0630 21:00:17.231602  228981 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/key.pem (1679 bytes)
	I0630 21:00:17.231663  228981 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem (1708 bytes)
	I0630 21:00:17.232257  228981 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
	I0630 21:00:17.251068  228981 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I0630 21:00:17.269562  228981 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0630 21:00:17.288024  228981 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
	I0630 21:00:17.306515  228981 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0630 21:00:17.325536  228981 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
	I0630 21:00:17.344828  228981 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0630 21:00:17.364807  228981 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
	I0630 21:00:17.384278  228981 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem --> /usr/share/ca-certificates/99502.pem (1708 bytes)
	I0630 21:00:17.403184  228981 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0630 21:00:17.421781  228981 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950.pem --> /usr/share/ca-certificates/9950.pem (1338 bytes)
	I0630 21:00:17.440772  228981 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0630 21:00:17.454557  228981 ssh_runner.go:195] Run: openssl version
	I0630 21:00:17.459691  228981 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/9950.pem && ln -fs /usr/share/ca-certificates/9950.pem /etc/ssl/certs/9950.pem"
	I0630 21:00:17.467525  228981 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/9950.pem
	I0630 21:00:17.470901  228981 certs.go:431] hashing: -rw-r--r-- 1 root root 1338 Jun 30 20:26 /usr/share/ca-certificates/9950.pem
	I0630 21:00:17.470974  228981 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/9950.pem
	I0630 21:00:17.475933  228981 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/9950.pem /etc/ssl/certs/51391683.0"
	I0630 21:00:17.483836  228981 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/99502.pem && ln -fs /usr/share/ca-certificates/99502.pem /etc/ssl/certs/99502.pem"
	I0630 21:00:17.491873  228981 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/99502.pem
	I0630 21:00:17.495198  228981 certs.go:431] hashing: -rw-r--r-- 1 root root 1708 Jun 30 20:26 /usr/share/ca-certificates/99502.pem
	I0630 21:00:17.495269  228981 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/99502.pem
	I0630 21:00:17.500165  228981 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/99502.pem /etc/ssl/certs/3ec20f2e.0"
	I0630 21:00:17.508133  228981 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0630 21:00:17.516018  228981 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:00:17.519364  228981 certs.go:431] hashing: -rw-r--r-- 1 root root 1111 Jun 30 20:22 /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:00:17.519419  228981 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:00:17.524645  228981 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0630 21:00:17.532410  228981 kubeadm.go:395] StartCluster: {Name:old-k8s-version-20220630210005-9950 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-20220630210005-9950 Namespace:default APISe
rverName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.67.2 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 M
ountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 21:00:17.532504  228981 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
	I0630 21:00:17.532600  228981 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0630 21:00:17.557763  228981 cri.go:87] found id: ""
	I0630 21:00:17.557829  228981 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0630 21:00:17.565303  228981 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0630 21:00:17.572897  228981 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver
	I0630 21:00:17.572954  228981 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0630 21:00:17.580394  228981 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0630 21:00:17.580451  228981 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0630 21:00:17.969459  228981 out.go:204]   - Generating certificates and keys ...
	I0630 21:00:19.965807  228981 out.go:204]   - Booting up control plane ...
	I0630 21:00:29.510285  228981 out.go:204]   - Configuring RBAC rules ...
	I0630 21:00:29.933482  228981 cni.go:95] Creating CNI manager for ""
	I0630 21:00:29.933506  228981 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:00:29.935830  228981 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0630 21:00:29.937711  228981 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0630 21:00:29.941705  228981 cni.go:189] applying CNI manifest using /var/lib/minikube/binaries/v1.16.0/kubectl ...
	I0630 21:00:29.941726  228981 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2429 bytes)
	I0630 21:00:29.956450  228981 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0630 21:00:30.309517  228981 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0630 21:00:30.309592  228981 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:00:30.309594  228981 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl label nodes minikube.k8s.io/version=v1.26.0 minikube.k8s.io/commit=251ffcec0e4c997cd7732864187747cc579943c9 minikube.k8s.io/name=old-k8s-version-20220630210005-9950 minikube.k8s.io/updated_at=2022_06_30T21_00_30_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:00:30.385435  228981 ops.go:34] apiserver oom_adj: -16
	I0630 21:00:30.385549  228981 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:00:30.992604  228981 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:00:31.492648  228981 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:00:31.992767  228981 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:00:32.492691  228981 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:00:32.992395  228981 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:00:33.492789  228981 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:00:33.992339  228981 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:00:34.492116  228981 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:00:34.992612  228981 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:00:35.492471  228981 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:00:35.992303  228981 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:00:36.491931  228981 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:00:36.992877  228981 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:00:37.492877  228981 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:00:37.992639  228981 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:00:38.492078  228981 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:00:38.992098  228981 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:00:39.492459  228981 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:00:39.992241  228981 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:00:40.492770  228981 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:00:40.992487  228981 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:00:41.492789  228981 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:00:41.991905  228981 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:00:42.492226  228981 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:00:42.992223  228981 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:00:43.492553  228981 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:00:43.992465  228981 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:00:44.491968  228981 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:00:44.624904  228981 kubeadm.go:1045] duration metric: took 14.315381531s to wait for elevateKubeSystemPrivileges.
	I0630 21:00:44.624938  228981 kubeadm.go:397] StartCluster complete in 27.092536154s
	I0630 21:00:44.624958  228981 settings.go:142] acquiring lock: {Name:mkcbd229caa05b60d3551ef0b47eea08424c9b5d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:00:44.625099  228981 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:00:44.627418  228981 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig: {Name:mk34e4a4e7b04f624b9adbda4f77ee20b38308ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:00:45.147376  228981 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "old-k8s-version-20220630210005-9950" rescaled to 1
	I0630 21:00:45.147445  228981 start.go:208] Will wait 6m0s for node &{Name: IP:192.168.67.2 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0630 21:00:45.149703  228981 out.go:177] * Verifying Kubernetes components...
	I0630 21:00:45.147497  228981 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0630 21:00:45.147542  228981 addons.go:412] enableAddons start: toEnable=map[], additional=[]
	I0630 21:00:45.147780  228981 config.go:178] Loaded profile config "old-k8s-version-20220630210005-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.16.0
	I0630 21:00:45.151449  228981 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 21:00:45.151498  228981 addons.go:65] Setting storage-provisioner=true in profile "old-k8s-version-20220630210005-9950"
	I0630 21:00:45.151519  228981 addons.go:153] Setting addon storage-provisioner=true in "old-k8s-version-20220630210005-9950"
	I0630 21:00:45.151521  228981 addons.go:65] Setting default-storageclass=true in profile "old-k8s-version-20220630210005-9950"
	W0630 21:00:45.151527  228981 addons.go:162] addon storage-provisioner should already be in state true
	I0630 21:00:45.151541  228981 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-20220630210005-9950"
	I0630 21:00:45.151580  228981 host.go:66] Checking if "old-k8s-version-20220630210005-9950" exists ...
	I0630 21:00:45.151957  228981 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220630210005-9950 --format={{.State.Status}}
	I0630 21:00:45.152158  228981 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220630210005-9950 --format={{.State.Status}}
	I0630 21:00:45.200016  228981 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0630 21:00:45.201467  228981 addons.go:345] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 21:00:45.201486  228981 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0630 21:00:45.201533  228981 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220630210005-9950
	I0630 21:00:45.227315  228981 addons.go:153] Setting addon default-storageclass=true in "old-k8s-version-20220630210005-9950"
	W0630 21:00:45.227343  228981 addons.go:162] addon default-storageclass should already be in state true
	I0630 21:00:45.227373  228981 host.go:66] Checking if "old-k8s-version-20220630210005-9950" exists ...
	I0630 21:00:45.227933  228981 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220630210005-9950 --format={{.State.Status}}
	I0630 21:00:45.246313  228981 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49397 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/old-k8s-version-20220630210005-9950/id_rsa Username:docker}
	I0630 21:00:45.271695  228981 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.67.1 host.minikube.internal\n           fallthrough\n        }' | sudo /var/lib/minikube/binaries/v1.16.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0630 21:00:45.273029  228981 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-20220630210005-9950" to be "Ready" ...
	I0630 21:00:45.277250  228981 addons.go:345] installing /etc/kubernetes/addons/storageclass.yaml
	I0630 21:00:45.277280  228981 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0630 21:00:45.277344  228981 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220630210005-9950
	I0630 21:00:45.315404  228981 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49397 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/old-k8s-version-20220630210005-9950/id_rsa Username:docker}
	I0630 21:00:45.440905  228981 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.16.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 21:00:45.442576  228981 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.16.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0630 21:00:45.731529  228981 start.go:806] {"host.minikube.internal": 192.168.67.1} host record injected into CoreDNS
	I0630 21:00:45.861092  228981 out.go:177] * Enabled addons: storage-provisioner, default-storageclass
	I0630 21:00:45.862689  228981 addons.go:414] enableAddons completed in 715.166477ms
	I0630 21:00:47.283372  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:00:49.283710  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:00:51.783171  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:00:53.783247  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:00:55.784165  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:00:58.283968  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:01:00.783850  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:01:02.785299  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:01:05.283677  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:01:07.283945  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:01:09.785295  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:01:12.283940  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:01:14.783664  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:01:17.284047  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:01:19.783571  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:01:22.283160  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:01:24.284295  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:01:26.783330  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:01:28.783772  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:01:30.784029  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:01:33.283797  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:01:35.783988  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:01:37.784151  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:01:40.283773  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:01:42.284048  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:01:44.284082  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:01:46.783310  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:01:49.283260  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:01:51.283864  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:01:53.284145  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:01:55.783379  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:01:57.783861  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:02:00.283630  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:02:02.283932  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:02:04.783138  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:02:07.283836  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:02:09.784034  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:02:12.283519  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:02:14.783200  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:02:17.284067  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:02:19.783561  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:02:22.283052  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:02:24.283823  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:02:26.783579  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:02:28.784201  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:02:31.283433  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:02:33.783189  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:02:36.283578  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:02:38.783482  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:02:40.785806  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:02:43.284563  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:02:45.784099  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:02:48.283742  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:02:50.783883  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:02:53.283713  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:02:55.283910  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:02:57.283994  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:02:59.784056  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:03:02.283935  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:03:04.284063  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:03:06.784203  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:03:09.283781  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:03:11.783590  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:03:14.283476  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:03:16.284099  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:03:18.784006  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:03:20.784061  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:03:23.283944  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:03:25.783815  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:03:27.783890  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:03:29.784028  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:03:32.283711  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:03:34.783224  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:03:36.783824  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:03:38.783917  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:03:41.282883  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:03:43.283485  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:03:45.783831  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:03:48.283767  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:03:50.783608  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:03:53.283806  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:03:55.283941  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:03:57.783752  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:04:00.283822  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:04:02.783504  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:04:05.283476  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:04:07.783968  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:04:10.284204  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:04:12.782945  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:04:14.783282  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:04:17.283296  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:04:19.284268  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:04:21.783224  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:04:23.783363  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:04:25.783906  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:04:28.283327  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:04:30.283691  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:04:32.283944  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:04:34.783483  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:04:36.783686  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:04:39.283178  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:04:41.283374  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:04:43.783725  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:04:45.285374  228981 node_ready.go:38] duration metric: took 4m0.012257221s waiting for node "old-k8s-version-20220630210005-9950" to be "Ready" ...
	I0630 21:04:45.287575  228981 out.go:177] 
	W0630 21:04:45.289206  228981 out.go:239] X Exiting due to GUEST_START: wait 6m0s for node: waiting for node to be ready: waitNodeCondition: timed out waiting for the condition
	X Exiting due to GUEST_START: wait 6m0s for node: waiting for node to be ready: waitNodeCondition: timed out waiting for the condition
	W0630 21:04:45.289230  228981 out.go:239] * 
	* 
	W0630 21:04:45.289962  228981 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0630 21:04:45.292018  228981 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-20220630210005-9950 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.16.0": exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestStartStop/group/old-k8s-version/serial/FirstStart]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect old-k8s-version-20220630210005-9950
helpers_test.go:235: (dbg) docker inspect old-k8s-version-20220630210005-9950:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "1b84433fb68bbf2bd151038738e402e5c525e45c0c466b954c0a2fc61a335d66",
	        "Created": "2022-06-30T21:00:13.927977074Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 229888,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2022-06-30T21:00:14.354950284Z",
	            "FinishedAt": "0001-01-01T00:00:00Z"
	        },
	        "Image": "sha256:573e7be5768273a7845baee1ae90fa2e33b83b10a7fbb0f0f41efbf29b53d1f1",
	        "ResolvConfPath": "/var/lib/docker/containers/1b84433fb68bbf2bd151038738e402e5c525e45c0c466b954c0a2fc61a335d66/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/1b84433fb68bbf2bd151038738e402e5c525e45c0c466b954c0a2fc61a335d66/hostname",
	        "HostsPath": "/var/lib/docker/containers/1b84433fb68bbf2bd151038738e402e5c525e45c0c466b954c0a2fc61a335d66/hosts",
	        "LogPath": "/var/lib/docker/containers/1b84433fb68bbf2bd151038738e402e5c525e45c0c466b954c0a2fc61a335d66/1b84433fb68bbf2bd151038738e402e5c525e45c0c466b954c0a2fc61a335d66-json.log",
	        "Name": "/old-k8s-version-20220630210005-9950",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "old-k8s-version-20220630210005-9950:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "old-k8s-version-20220630210005-9950",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 2306867200,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": null,
	            "BlkioDeviceWriteBps": null,
	            "BlkioDeviceReadIOps": null,
	            "BlkioDeviceWriteIOps": null,
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "KernelMemory": 0,
	            "KernelMemoryTCP": 0,
	            "MemoryReservation": 0,
	            "MemorySwap": 4613734400,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": null,
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/d94571e47e569545ea7c101defd143650d23877c940361aa1535ed742bae26c1-init/diff:/var/lib/docker/overlay2/8b88d9f6f12c48be642a133456203e58549a93f1da67d0349744bd0f78917fba/diff:/var/lib/docker/overlay2/2bcbb3b4718a64188802301a25d7f413bb307cb16d077e7e5af799f9152a2970/diff:/var/lib/docker/overlay2/70b0888bf22fcef1c004704b71288ac581cf26a3b3b19fbca3da296ba10d6978/diff:/var/lib/docker/overlay2/7c5332f38fe652f379ef9b6d23e795158e9994317cfb547b581dd2b1fdf1303b/diff:/var/lib/docker/overlay2/0ddb5a3abf433b644a8bfa124e3c87878eed67878faa35493f2befc2b392e9cb/diff:/var/lib/docker/overlay2/3b7cda5fb0232fdeecbec0531ac704a59eb38fe57664c25777193b07e2df0077/diff:/var/lib/docker/overlay2/a14687ada786c65465b9924ae2d77ba27afc07942851cafaade28e80dfe9da16/diff:/var/lib/docker/overlay2/c49a9b7157aa6e8714e192b2849866d035b59e18de462c0ee9b72f898cc5a485/diff:/var/lib/docker/overlay2/efd71a50e3a1044a6d1c4c1a7d4d91d9f070c066e03e51c6c73a5764b778ad72/diff:/var/lib/docker/overlay2/55476a
1c0a20aa4238a0bb0e43c6402c33dcad312938ad48ee81be0160e12a49/diff:/var/lib/docker/overlay2/c48c4a348a797b9a38f01568a6adbcb4b05b4f56f7b986a4bf1b509d8cb00732/diff:/var/lib/docker/overlay2/568e3f354ab0428de5cf82d1fdfb780c3377f5cc55d9f524731c53e39e0ecae7/diff:/var/lib/docker/overlay2/2857943e320cdcdae9af3d8c2acda1fb61e2f142a88b8b902908071cea67816e/diff:/var/lib/docker/overlay2/bdd9a57f0b65e65c5a16395f239425e794c678b0e8db2f4a368e0a9427fe5116/diff:/var/lib/docker/overlay2/b150183f1b73e8c13c751911bcee09fed8ef973478f4dc3cfdb9e509118bf1ea/diff:/var/lib/docker/overlay2/0a053e7c29417cd6feafb351c7944e81342a52898871bc779f7bf61868c78ec4/diff:/var/lib/docker/overlay2/d3c0de3a44d75d0a05acb7843d53deba5ce0457649d6ed757da9b4c532a81e4f/diff:/var/lib/docker/overlay2/53f6170132880e1697dd802b8577382b31c6f1ba144256f8cc62542998842a6b/diff:/var/lib/docker/overlay2/b5c0be6d8efdb1fcb12e73b8f72853f77baa4bc014ac2c1e28b7b972b07f3325/diff:/var/lib/docker/overlay2/36c908f082a1e5388bb25277f1c957eaecf70fcd958080422fa85a3105724fb2/diff:/var/lib/d
ocker/overlay2/b147fe9dce365cfaf9bfeca2e370829e4d87e2671c133a9836ecb02a85422cc7/diff:/var/lib/docker/overlay2/65f488eb9181a721f01b333f5fa0cb91d216abd7842a9ae193bd95316f378721/diff:/var/lib/docker/overlay2/b04269aa247b68912ddc5b1c98ad55d67af4103f576a900eef4069c196b8a263/diff:/var/lib/docker/overlay2/b714c37e15257ae9d0e15d271dd18a330c38ad765901d9b7e7e3feb73e1b03e4/diff:/var/lib/docker/overlay2/3c253b721193edeaade7bba7ce25ff687c889b8fa86e9489c7ee20d5624e6c5b/diff:/var/lib/docker/overlay2/7f67b74e101fa21dd320393c10576eefa4ce1cec2e210bff405784fa45b360f3/diff:/var/lib/docker/overlay2/c3b2adaa63a06a5e6ed966d7b6f20a757aeadd3f25eb09ef3c7e9a66a8904143/diff:/var/lib/docker/overlay2/ddb5d653d19e8cafc4625a8fe9597667d98b277a7f679e532ad84caa2c6da636/diff:/var/lib/docker/overlay2/03eb172b20323ebeee7cb09025726a6e10de6c3dd8661f4f6bbc5a3a3778bad4/diff:/var/lib/docker/overlay2/80ea9bf34d028e95a8a418b3aeb634be72ab3336448946d7855c51ffdf8258d7/diff:/var/lib/docker/overlay2/e28987ea3fb4d431dee111f38cc76814b85f73e86434be3c463c01fdd59
9ad46/diff:/var/lib/docker/overlay2/6f9a46c7c6cf4fd30ce32a1eb08ed9b1e8dd61cb0e42ce54f0f736f06558c306/diff:/var/lib/docker/overlay2/6fc942eb9ccfc09898edc9a5ef3b3d305a6fcb22e8cefb1a9f9c344d10b59b25/diff:/var/lib/docker/overlay2/f6b8c57540e798dc1dfd51fd29c020193c02a4362f31c6d07aa220327bb07b90/diff:/var/lib/docker/overlay2/85d0aa01a3fab8c77262c59d8a7b0809a72673a3da7d33e4e19c04a66db44a11/diff:/var/lib/docker/overlay2/58dcd81a1605641f785ced5aeb38657eec1f02a31b7adfaf4f6fdd49f4bab1d6/diff:/var/lib/docker/overlay2/9d537e0a65325e4bf85b26da9828002339f5c442ca85f931b340457a80ec8c94/diff:/var/lib/docker/overlay2/a6f73707ee6a74e948a02d03c4a3f12b57c2eb408dc67da3c39961bb3cefcc97/diff:/var/lib/docker/overlay2/922526c310b066dbb73b9a106eef8bf0064ad7907a8d7d7b353f5307a17a4901/diff:/var/lib/docker/overlay2/a4185854870ebf8d34a4c7e1827dbe3bc461559839301ffb23c5efff5e3c9f14/diff:/var/lib/docker/overlay2/8c02b1fcb9d79f5d7b2ee4d44f6625a692c44a0d18df0a5c01cac0cca0fdf3f3/diff",
	                "MergedDir": "/var/lib/docker/overlay2/d94571e47e569545ea7c101defd143650d23877c940361aa1535ed742bae26c1/merged",
	                "UpperDir": "/var/lib/docker/overlay2/d94571e47e569545ea7c101defd143650d23877c940361aa1535ed742bae26c1/diff",
	                "WorkDir": "/var/lib/docker/overlay2/d94571e47e569545ea7c101defd143650d23877c940361aa1535ed742bae26c1/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "old-k8s-version-20220630210005-9950",
	                "Source": "/var/lib/docker/volumes/old-k8s-version-20220630210005-9950/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "old-k8s-version-20220630210005-9950",
	            "Domainname": "",
	            "User": "root",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e",
	            "Volumes": null,
	            "WorkingDir": "",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "old-k8s-version-20220630210005-9950",
	                "name.minikube.sigs.k8s.io": "old-k8s-version-20220630210005-9950",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "ec7fc0e156b0aa4af84fc726351cbb9f7e2ff99be8702d21728abb4b2e5727a3",
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49397"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49396"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49393"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49395"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49394"
	                    }
	                ]
	            },
	            "SandboxKey": "/var/run/docker/netns/ec7fc0e156b0",
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "old-k8s-version-20220630210005-9950": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.67.2"
	                    },
	                    "Links": null,
	                    "Aliases": [
	                        "1b84433fb68b",
	                        "old-k8s-version-20220630210005-9950"
	                    ],
	                    "NetworkID": "2a33e496d49b578848c27ed72b0172cf6807dc7dbeec46561e901ef8145b93e7",
	                    "EndpointID": "3e37099b34556312803f62e1d2ae2bcf3204c44287b61d98bcdde49b6700ecc8",
	                    "Gateway": "192.168.67.1",
	                    "IPAddress": "192.168.67.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "MacAddress": "02:42:c0:a8:43:02",
	                    "DriverOpts": null
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-20220630210005-9950 -n old-k8s-version-20220630210005-9950
helpers_test.go:244: <<< TestStartStop/group/old-k8s-version/serial/FirstStart FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======>  post-mortem[TestStartStop/group/old-k8s-version/serial/FirstStart]: minikube logs <======
helpers_test.go:247: (dbg) Run:  out/minikube-linux-amd64 -p old-k8s-version-20220630210005-9950 logs -n 25
helpers_test.go:252: TestStartStop/group/old-k8s-version/serial/FirstStart logs: 
-- stdout --
	* 
	* ==> Audit <==
	* |---------|---------------------------------------------------|----------|---------|---------|---------------------|---------------------|
	| Command |                       Args                        | Profile  |  User   | Version |     Start Time      |      End Time       |
	|---------|---------------------------------------------------|----------|---------|---------|---------------------|---------------------|
	| delete  | -p pause-20220630205252-9950                      | minikube | jenkins | v1.26.0 | 30 Jun 22 20:54 UTC | 30 Jun 22 20:54 UTC |
	|         | --alsologtostderr -v=5                            |          |         |         |                     |                     |
	| profile | list --output json                                | minikube | jenkins | v1.26.0 | 30 Jun 22 20:54 UTC | 30 Jun 22 20:54 UTC |
	| delete  | -p pause-20220630205252-9950                      | minikube | jenkins | v1.26.0 | 30 Jun 22 20:54 UTC | 30 Jun 22 20:54 UTC |
	| start   | -p cilium-20220630204859-9950                     | minikube | jenkins | v1.26.0 | 30 Jun 22 20:54 UTC | 30 Jun 22 20:55 UTC |
	|         | --memory=2048                                     |          |         |         |                     |                     |
	|         | --alsologtostderr                                 |          |         |         |                     |                     |
	|         | --wait=true --wait-timeout=5m                     |          |         |         |                     |                     |
	|         | --cni=cilium --driver=docker                      |          |         |         |                     |                     |
	|         | --container-runtime=containerd                    |          |         |         |                     |                     |
	| ssh     | -p auto-20220630204858-9950                       | minikube | jenkins | v1.26.0 | 30 Jun 22 20:54 UTC | 30 Jun 22 20:54 UTC |
	|         | pgrep -a kubelet                                  |          |         |         |                     |                     |
	| ssh     | -p kindnet-20220630204858-9950                    | minikube | jenkins | v1.26.0 | 30 Jun 22 20:54 UTC | 30 Jun 22 20:54 UTC |
	|         | pgrep -a kubelet                                  |          |         |         |                     |                     |
	| delete  | -p auto-20220630204858-9950                       | minikube | jenkins | v1.26.0 | 30 Jun 22 20:54 UTC | 30 Jun 22 20:54 UTC |
	| start   | -p calico-20220630204859-9950                     | minikube | jenkins | v1.26.0 | 30 Jun 22 20:54 UTC |                     |
	|         | --memory=2048                                     |          |         |         |                     |                     |
	|         | --alsologtostderr                                 |          |         |         |                     |                     |
	|         | --wait=true --wait-timeout=5m                     |          |         |         |                     |                     |
	|         | --cni=calico --driver=docker                      |          |         |         |                     |                     |
	|         | --container-runtime=containerd                    |          |         |         |                     |                     |
	| delete  | -p kindnet-20220630204858-9950                    | minikube | jenkins | v1.26.0 | 30 Jun 22 20:54 UTC | 30 Jun 22 20:55 UTC |
	| start   | -p                                                | minikube | jenkins | v1.26.0 | 30 Jun 22 20:55 UTC | 30 Jun 22 21:00 UTC |
	|         | enable-default-cni-20220630204858-9950            |          |         |         |                     |                     |
	|         | --memory=2048 --alsologtostderr                   |          |         |         |                     |                     |
	|         | --wait=true --wait-timeout=5m                     |          |         |         |                     |                     |
	|         | --enable-default-cni=true                         |          |         |         |                     |                     |
	|         | --driver=docker                                   |          |         |         |                     |                     |
	|         | --container-runtime=containerd                    |          |         |         |                     |                     |
	| ssh     | -p cilium-20220630204859-9950                     | minikube | jenkins | v1.26.0 | 30 Jun 22 20:55 UTC | 30 Jun 22 20:55 UTC |
	|         | pgrep -a kubelet                                  |          |         |         |                     |                     |
	| delete  | -p cilium-20220630204859-9950                     | minikube | jenkins | v1.26.0 | 30 Jun 22 20:55 UTC | 30 Jun 22 20:55 UTC |
	| start   | -p bridge-20220630204858-9950                     | minikube | jenkins | v1.26.0 | 30 Jun 22 20:55 UTC | 30 Jun 22 20:56 UTC |
	|         | --memory=2048                                     |          |         |         |                     |                     |
	|         | --alsologtostderr                                 |          |         |         |                     |                     |
	|         | --wait=true --wait-timeout=5m                     |          |         |         |                     |                     |
	|         | --cni=bridge --driver=docker                      |          |         |         |                     |                     |
	|         | --container-runtime=containerd                    |          |         |         |                     |                     |
	| ssh     | -p bridge-20220630204858-9950                     | minikube | jenkins | v1.26.0 | 30 Jun 22 20:56 UTC | 30 Jun 22 20:56 UTC |
	|         | pgrep -a kubelet                                  |          |         |         |                     |                     |
	| ssh     | -p                                                | minikube | jenkins | v1.26.0 | 30 Jun 22 21:00 UTC | 30 Jun 22 21:00 UTC |
	|         | enable-default-cni-20220630204858-9950            |          |         |         |                     |                     |
	|         | pgrep -a kubelet                                  |          |         |         |                     |                     |
	| delete  | -p                                                | minikube | jenkins | v1.26.0 | 30 Jun 22 21:00 UTC | 30 Jun 22 21:00 UTC |
	|         | kubernetes-upgrade-20220630205032-9950            |          |         |         |                     |                     |
	| start   | -p                                                | minikube | jenkins | v1.26.0 | 30 Jun 22 21:00 UTC |                     |
	|         | old-k8s-version-20220630210005-9950               |          |         |         |                     |                     |
	|         | --memory=2200 --alsologtostderr                   |          |         |         |                     |                     |
	|         | --wait=true --kvm-network=default                 |          |         |         |                     |                     |
	|         | --kvm-qemu-uri=qemu:///system                     |          |         |         |                     |                     |
	|         | --disable-driver-mounts                           |          |         |         |                     |                     |
	|         | --keep-context=false                              |          |         |         |                     |                     |
	|         | --driver=docker                                   |          |         |         |                     |                     |
	|         | --container-runtime=containerd                    |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.16.0                      |          |         |         |                     |                     |
	| delete  | -p bridge-20220630204858-9950                     | minikube | jenkins | v1.26.0 | 30 Jun 22 21:02 UTC | 30 Jun 22 21:02 UTC |
	| start   | -p                                                | minikube | jenkins | v1.26.0 | 30 Jun 22 21:02 UTC | 30 Jun 22 21:03 UTC |
	|         | no-preload-20220630210237-9950                    |          |         |         |                     |                     |
	|         | --memory=2200                                     |          |         |         |                     |                     |
	|         | --alsologtostderr                                 |          |         |         |                     |                     |
	|         | --wait=true --preload=false                       |          |         |         |                     |                     |
	|         | --driver=docker                                   |          |         |         |                     |                     |
	|         | --container-runtime=containerd                    |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                      |          |         |         |                     |                     |
	| delete  | -p calico-20220630204859-9950                     | minikube | jenkins | v1.26.0 | 30 Jun 22 21:03 UTC | 30 Jun 22 21:03 UTC |
	| start   | -p                                                | minikube | jenkins | v1.26.0 | 30 Jun 22 21:03 UTC |                     |
	|         | default-k8s-different-port-20220630210335-9950    |          |         |         |                     |                     |
	|         | --memory=2200 --alsologtostderr --wait=true       |          |         |         |                     |                     |
	|         | --apiserver-port=8444 --driver=docker             |          |         |         |                     |                     |
	|         |  --container-runtime=containerd                   |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                      |          |         |         |                     |                     |
	| addons  | enable metrics-server -p                          | minikube | jenkins | v1.26.0 | 30 Jun 22 21:03 UTC | 30 Jun 22 21:03 UTC |
	|         | no-preload-20220630210237-9950                    |          |         |         |                     |                     |
	|         | --images=MetricsServer=k8s.gcr.io/echoserver:1.4  |          |         |         |                     |                     |
	|         | --registries=MetricsServer=fake.domain            |          |         |         |                     |                     |
	| stop    | -p                                                | minikube | jenkins | v1.26.0 | 30 Jun 22 21:03 UTC | 30 Jun 22 21:04 UTC |
	|         | no-preload-20220630210237-9950                    |          |         |         |                     |                     |
	|         | --alsologtostderr -v=3                            |          |         |         |                     |                     |
	| addons  | enable dashboard -p                               | minikube | jenkins | v1.26.0 | 30 Jun 22 21:04 UTC | 30 Jun 22 21:04 UTC |
	|         | no-preload-20220630210237-9950                    |          |         |         |                     |                     |
	|         | --images=MetricsScraper=k8s.gcr.io/echoserver:1.4 |          |         |         |                     |                     |
	| start   | -p                                                | minikube | jenkins | v1.26.0 | 30 Jun 22 21:04 UTC |                     |
	|         | no-preload-20220630210237-9950                    |          |         |         |                     |                     |
	|         | --memory=2200                                     |          |         |         |                     |                     |
	|         | --alsologtostderr                                 |          |         |         |                     |                     |
	|         | --wait=true --preload=false                       |          |         |         |                     |                     |
	|         | --driver=docker                                   |          |         |         |                     |                     |
	|         | --container-runtime=containerd                    |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                      |          |         |         |                     |                     |
	|---------|---------------------------------------------------|----------|---------|---------|---------------------|---------------------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2022/06/30 21:04:00
	Running on machine: ubuntu-20-agent-8
	Binary: Built with gc go1.18.3 for linux/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0630 21:04:00.450314  244832 out.go:296] Setting OutFile to fd 1 ...
	I0630 21:04:00.450533  244832 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 21:04:00.450547  244832 out.go:309] Setting ErrFile to fd 2...
	I0630 21:04:00.450553  244832 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 21:04:00.451038  244832 root.go:329] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/bin
	I0630 21:04:00.451299  244832 out.go:303] Setting JSON to false
	I0630 21:04:00.452834  244832 start.go:115] hostinfo: {"hostname":"ubuntu-20-agent-8","uptime":2793,"bootTime":1656620248,"procs":520,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1012-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0630 21:04:00.452911  244832 start.go:125] virtualization: kvm guest
	I0630 21:04:00.455839  244832 out.go:177] * [no-preload-20220630210237-9950] minikube v1.26.0 on Ubuntu 20.04 (kvm/amd64)
	I0630 21:04:00.457440  244832 notify.go:193] Checking for updates...
	I0630 21:04:00.457447  244832 out.go:177]   - MINIKUBE_LOCATION=14420
	I0630 21:04:00.458994  244832 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0630 21:04:00.460497  244832 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:04:00.461932  244832 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube
	I0630 21:04:00.463367  244832 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0630 21:03:57.783752  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:04:00.283822  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:04:00.464957  244832 config.go:178] Loaded profile config "no-preload-20220630210237-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:04:00.465471  244832 driver.go:360] Setting default libvirt URI to qemu:///system
	I0630 21:04:00.507928  244832 docker.go:137] docker version: linux-20.10.17
	I0630 21:04:00.508042  244832 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0630 21:04:00.619927  244832 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:8 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:55 OomKillDisable:true NGoroutines:49 SystemTime:2022-06-30 21:04:00.538329426 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1012-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexServ
erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662451712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-8 Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Client
Info:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
	I0630 21:04:00.620069  244832 docker.go:254] overlay module found
	I0630 21:04:00.622266  244832 out.go:177] * Using the docker driver based on existing profile
	I0630 21:04:00.623525  244832 start.go:284] selected driver: docker
	I0630 21:04:00.623540  244832 start.go:808] validating driver "docker" against &{Name:no-preload-20220630210237-9950 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:no-preload-20220630210237-9950 Namespace:de
fault APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[Dashboard:kubernetesui/dashboard:v2.6.0@sha256:4af9580485920635d888efe1eddbd67e12f9d5d84dba87100e93feb4e46636b3 MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0
s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 21:04:00.623646  244832 start.go:819] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0630 21:04:00.624547  244832 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0630 21:04:00.734769  244832 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:8 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:55 OomKillDisable:true NGoroutines:49 SystemTime:2022-06-30 21:04:00.655397365 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1012-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexServ
erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662451712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-8 Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Client
Info:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
	I0630 21:04:00.735026  244832 start_flags.go:853] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0630 21:04:00.735048  244832 cni.go:95] Creating CNI manager for ""
	I0630 21:04:00.735056  244832 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:04:00.735068  244832 start_flags.go:310] config:
	{Name:no-preload-20220630210237-9950 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:no-preload-20220630210237-9950 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:clust
er.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[Dashboard:kubernetesui/dashboard:v2.6.0@sha256:4af9580485920635d888efe1eddbd67e12f9d5d84dba87100e93feb4e46636b3 MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeR
equested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 21:04:00.737275  244832 out.go:177] * Starting control plane node no-preload-20220630210237-9950 in cluster no-preload-20220630210237-9950
	I0630 21:04:00.738756  244832 cache.go:120] Beginning downloading kic base image for docker with containerd
	I0630 21:04:00.740198  244832 out.go:177] * Pulling base image ...
	I0630 21:04:00.741734  244832 preload.go:132] Checking if preload exists for k8s version v1.24.2 and runtime containerd
	I0630 21:04:00.741836  244832 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e in local docker daemon
	I0630 21:04:00.741884  244832 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/no-preload-20220630210237-9950/config.json ...
	I0630 21:04:00.742072  244832 cache.go:107] acquiring lock: {Name:mkf77a5fea6c9d282488b9dd2e60eefb39d5197d Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0630 21:04:00.742120  244832 cache.go:107] acquiring lock: {Name:mk284e7881bbf6d26cf34c22a41ddc0e57767949 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0630 21:04:00.742135  244832 cache.go:107] acquiring lock: {Name:mk8e4e3b860069b6b1c016c47e50711fe0a6eed2 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0630 21:04:00.742167  244832 cache.go:107] acquiring lock: {Name:mkae680d56ae49e56a3141ef8220d2176f1a0950 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0630 21:04:00.742174  244832 cache.go:107] acquiring lock: {Name:mkf1f373b29ae922f70dfa0a1e2a65937287ff1f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0630 21:04:00.742140  244832 cache.go:107] acquiring lock: {Name:mkd6e2b14adfd19dbcd705e90853864307d7f27f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0630 21:04:00.742226  244832 cache.go:107] acquiring lock: {Name:mk45497888b311831e4da6ebd1a1cbc738ed81b5 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0630 21:04:00.742269  244832 cache.go:107] acquiring lock: {Name:mkc3dd82b365c79a7c0f038dc6c2f1631877011a Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0630 21:04:00.742309  244832 cache.go:115] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5 exists
	I0630 21:04:00.742329  244832 cache.go:96] cache image "gcr.io/k8s-minikube/storage-provisioner:v5" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5" took 269.393µs
	I0630 21:04:00.742337  244832 cache.go:80] save to tar file gcr.io/k8s-minikube/storage-provisioner:v5 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5 succeeded
	I0630 21:04:00.742356  244832 cache.go:115] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/images/amd64/k8s.gcr.io/pause_3.7 exists
	I0630 21:04:00.742360  244832 cache.go:115] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/images/amd64/k8s.gcr.io/kube-proxy_v1.24.2 exists
	I0630 21:04:00.742376  244832 cache.go:96] cache image "k8s.gcr.io/kube-proxy:v1.24.2" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/images/amd64/k8s.gcr.io/kube-proxy_v1.24.2" took 268.395µs
	I0630 21:04:00.742380  244832 cache.go:96] cache image "k8s.gcr.io/pause:3.7" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/images/amd64/k8s.gcr.io/pause_3.7" took 132.103µs
	I0630 21:04:00.742386  244832 cache.go:80] save to tar file k8s.gcr.io/kube-proxy:v1.24.2 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/images/amd64/k8s.gcr.io/kube-proxy_v1.24.2 succeeded
	I0630 21:04:00.742394  244832 cache.go:80] save to tar file k8s.gcr.io/pause:3.7 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/images/amd64/k8s.gcr.io/pause_3.7 succeeded
	I0630 21:04:00.742431  244832 cache.go:115] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/images/amd64/k8s.gcr.io/kube-scheduler_v1.24.2 exists
	I0630 21:04:00.742457  244832 cache.go:96] cache image "k8s.gcr.io/kube-scheduler:v1.24.2" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/images/amd64/k8s.gcr.io/kube-scheduler_v1.24.2" took 328.65µs
	I0630 21:04:00.742468  244832 cache.go:80] save to tar file k8s.gcr.io/kube-scheduler:v1.24.2 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/images/amd64/k8s.gcr.io/kube-scheduler_v1.24.2 succeeded
	I0630 21:04:00.742472  244832 cache.go:115] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/images/amd64/k8s.gcr.io/etcd_3.5.3-0 exists
	I0630 21:04:00.742495  244832 cache.go:96] cache image "k8s.gcr.io/etcd:3.5.3-0" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/images/amd64/k8s.gcr.io/etcd_3.5.3-0" took 329.519µs
	I0630 21:04:00.742516  244832 cache.go:80] save to tar file k8s.gcr.io/etcd:3.5.3-0 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/images/amd64/k8s.gcr.io/etcd_3.5.3-0 succeeded
	I0630 21:04:00.742540  244832 cache.go:115] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/images/amd64/k8s.gcr.io/kube-apiserver_v1.24.2 exists
	I0630 21:04:00.742578  244832 cache.go:115] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/images/amd64/k8s.gcr.io/kube-controller-manager_v1.24.2 exists
	I0630 21:04:00.742576  244832 cache.go:96] cache image "k8s.gcr.io/kube-apiserver:v1.24.2" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/images/amd64/k8s.gcr.io/kube-apiserver_v1.24.2" took 433.038µs
	I0630 21:04:00.742589  244832 cache.go:80] save to tar file k8s.gcr.io/kube-apiserver:v1.24.2 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/images/amd64/k8s.gcr.io/kube-apiserver_v1.24.2 succeeded
	I0630 21:04:00.742597  244832 cache.go:96] cache image "k8s.gcr.io/kube-controller-manager:v1.24.2" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/images/amd64/k8s.gcr.io/kube-controller-manager_v1.24.2" took 490.566µs
	I0630 21:04:00.742616  244832 cache.go:80] save to tar file k8s.gcr.io/kube-controller-manager:v1.24.2 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/images/amd64/k8s.gcr.io/kube-controller-manager_v1.24.2 succeeded
	I0630 21:04:00.742621  244832 cache.go:115] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/images/amd64/k8s.gcr.io/coredns/coredns_v1.8.6 exists
	I0630 21:04:00.742638  244832 cache.go:96] cache image "k8s.gcr.io/coredns/coredns:v1.8.6" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/images/amd64/k8s.gcr.io/coredns/coredns_v1.8.6" took 416.008µs
	I0630 21:04:00.742654  244832 cache.go:80] save to tar file k8s.gcr.io/coredns/coredns:v1.8.6 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/images/amd64/k8s.gcr.io/coredns/coredns_v1.8.6 succeeded
	I0630 21:04:00.742678  244832 cache.go:87] Successfully saved all images to host disk.
	I0630 21:04:00.781172  244832 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e in local docker daemon, skipping pull
	I0630 21:04:00.781201  244832 cache.go:142] gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e exists in daemon, skipping load
	I0630 21:04:00.781212  244832 cache.go:208] Successfully downloaded all kic artifacts
	I0630 21:04:00.781256  244832 start.go:352] acquiring machines lock for no-preload-20220630210237-9950: {Name:mk178342f2bbd892688ba42fc70cd496adaadf69 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0630 21:04:00.781355  244832 start.go:356] acquired machines lock for "no-preload-20220630210237-9950" in 76.579µs
	I0630 21:04:00.781383  244832 start.go:94] Skipping create...Using existing machine configuration
	I0630 21:04:00.781388  244832 fix.go:55] fixHost starting: 
	I0630 21:04:00.781651  244832 cli_runner.go:164] Run: docker container inspect no-preload-20220630210237-9950 --format={{.State.Status}}
	I0630 21:04:00.816081  244832 fix.go:103] recreateIfNeeded on no-preload-20220630210237-9950: state=Stopped err=<nil>
	W0630 21:04:00.816117  244832 fix.go:129] unexpected machine state, will restart: <nil>
	I0630 21:04:00.818446  244832 out.go:177] * Restarting existing docker container for "no-preload-20220630210237-9950" ...
	I0630 21:04:00.819979  244832 cli_runner.go:164] Run: docker start no-preload-20220630210237-9950
	I0630 21:04:01.251639  244832 cli_runner.go:164] Run: docker container inspect no-preload-20220630210237-9950 --format={{.State.Status}}
	I0630 21:04:01.290108  244832 kic.go:416] container "no-preload-20220630210237-9950" state is running.
	I0630 21:04:01.290459  244832 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-20220630210237-9950
	I0630 21:04:01.327776  244832 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/no-preload-20220630210237-9950/config.json ...
	I0630 21:04:01.328062  244832 machine.go:88] provisioning docker machine ...
	I0630 21:04:01.328095  244832 ubuntu.go:169] provisioning hostname "no-preload-20220630210237-9950"
	I0630 21:04:01.328144  244832 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-20220630210237-9950
	I0630 21:04:01.372593  244832 main.go:134] libmachine: Using SSH client type: native
	I0630 21:04:01.372838  244832 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil>  [] 0s} 127.0.0.1 49412 <nil> <nil>}
	I0630 21:04:01.372866  244832 main.go:134] libmachine: About to run SSH command:
	sudo hostname no-preload-20220630210237-9950 && echo "no-preload-20220630210237-9950" | sudo tee /etc/hostname
	I0630 21:04:01.373547  244832 main.go:134] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:34898->127.0.0.1:49412: read: connection reset by peer
	I0630 21:04:04.502783  244832 main.go:134] libmachine: SSH cmd err, output: <nil>: no-preload-20220630210237-9950
	
	I0630 21:04:04.502867  244832 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-20220630210237-9950
	I0630 21:04:04.541932  244832 main.go:134] libmachine: Using SSH client type: native
	I0630 21:04:04.542108  244832 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil>  [] 0s} 127.0.0.1 49412 <nil> <nil>}
	I0630 21:04:04.542140  244832 main.go:134] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sno-preload-20220630210237-9950' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 no-preload-20220630210237-9950/g' /etc/hosts;
				else 
					echo '127.0.1.1 no-preload-20220630210237-9950' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0630 21:04:04.665297  244832 main.go:134] libmachine: SSH cmd err, output: <nil>: 
	I0630 21:04:04.665329  244832 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube CaCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/c
erts/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube}
	I0630 21:04:04.665369  244832 ubuntu.go:177] setting up certificates
	I0630 21:04:04.665380  244832 provision.go:83] configureAuth start
	I0630 21:04:04.665437  244832 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-20220630210237-9950
	I0630 21:04:04.705549  244832 provision.go:138] copyHostCerts
	I0630 21:04:04.705636  244832 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem, removing ...
	I0630 21:04:04.705652  244832 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem
	I0630 21:04:04.705737  244832 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem (1082 bytes)
	I0630 21:04:04.705853  244832 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem, removing ...
	I0630 21:04:04.705867  244832 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem
	I0630 21:04:04.705903  244832 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem (1123 bytes)
	I0630 21:04:04.705980  244832 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem, removing ...
	I0630 21:04:04.705994  244832 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem
	I0630 21:04:04.706026  244832 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem (1679 bytes)
	I0630 21:04:04.706075  244832 provision.go:112] generating server cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem org=jenkins.no-preload-20220630210237-9950 san=[192.168.76.2 127.0.0.1 localhost 127.0.0.1 minikube no-preload-20220630210237-9950]
	I0630 21:04:05.007204  244832 provision.go:172] copyRemoteCerts
	I0630 21:04:05.007279  244832 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0630 21:04:05.007323  244832 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-20220630210237-9950
	I0630 21:04:05.049187  244832 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49412 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/no-preload-20220630210237-9950/id_rsa Username:docker}
	I0630 21:04:05.140924  244832 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0630 21:04:05.160532  244832 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
	I0630 21:04:05.180174  244832 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem --> /etc/docker/server.pem (1265 bytes)
	I0630 21:04:05.199017  244832 provision.go:86] duration metric: configureAuth took 533.617876ms
	I0630 21:04:05.199053  244832 ubuntu.go:193] setting minikube options for container-runtime
	I0630 21:04:05.199263  244832 config.go:178] Loaded profile config "no-preload-20220630210237-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:04:05.199277  244832 machine.go:91] provisioned docker machine in 3.871195747s
	I0630 21:04:05.199284  244832 start.go:306] post-start starting for "no-preload-20220630210237-9950" (driver="docker")
	I0630 21:04:05.199291  244832 start.go:316] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0630 21:04:05.199347  244832 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0630 21:04:05.199392  244832 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-20220630210237-9950
	I0630 21:04:05.238873  244832 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49412 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/no-preload-20220630210237-9950/id_rsa Username:docker}
	I0630 21:04:05.324797  244832 ssh_runner.go:195] Run: cat /etc/os-release
	I0630 21:04:05.327717  244832 main.go:134] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0630 21:04:05.327751  244832 main.go:134] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0630 21:04:05.327764  244832 main.go:134] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0630 21:04:05.327775  244832 info.go:137] Remote host: Ubuntu 20.04.4 LTS
	I0630 21:04:05.327786  244832 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/addons for local assets ...
	I0630 21:04:05.327855  244832 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files for local assets ...
	I0630 21:04:05.327947  244832 filesync.go:149] local asset: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem -> 99502.pem in /etc/ssl/certs
	I0630 21:04:05.328053  244832 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0630 21:04:05.335253  244832 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem --> /etc/ssl/certs/99502.pem (1708 bytes)
	I0630 21:04:05.353749  244832 start.go:309] post-start completed in 154.446244ms
	I0630 21:04:05.353834  244832 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0630 21:04:05.353876  244832 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-20220630210237-9950
	I0630 21:04:05.388997  244832 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49412 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/no-preload-20220630210237-9950/id_rsa Username:docker}
	I0630 21:04:02.783504  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:04:05.283476  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:04:09.634789  242039 out.go:204]   - Generating certificates and keys ...
	I0630 21:04:09.638413  242039 out.go:204]   - Booting up control plane ...
	I0630 21:04:09.641524  242039 out.go:204]   - Configuring RBAC rules ...
	I0630 21:04:09.644033  242039 cni.go:95] Creating CNI manager for ""
	I0630 21:04:09.644052  242039 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:04:09.645981  242039 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0630 21:04:09.647353  242039 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0630 21:04:09.651861  242039 cni.go:189] applying CNI manifest using /var/lib/minikube/binaries/v1.24.2/kubectl ...
	I0630 21:04:09.651887  242039 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2429 bytes)
	I0630 21:04:09.723830  242039 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0630 21:04:05.477789  244832 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0630 21:04:05.481976  244832 fix.go:57] fixHost completed within 4.70058164s
	I0630 21:04:05.482008  244832 start.go:81] releasing machines lock for "no-preload-20220630210237-9950", held for 4.70063311s
	I0630 21:04:05.482104  244832 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-20220630210237-9950
	I0630 21:04:05.519916  244832 ssh_runner.go:195] Run: systemctl --version
	I0630 21:04:05.519989  244832 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-20220630210237-9950
	I0630 21:04:05.520005  244832 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/
	I0630 21:04:05.520079  244832 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-20220630210237-9950
	I0630 21:04:05.556970  244832 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49412 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/no-preload-20220630210237-9950/id_rsa Username:docker}
	I0630 21:04:05.558947  244832 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49412 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/no-preload-20220630210237-9950/id_rsa Username:docker}
	I0630 21:04:05.667182  244832 ssh_runner.go:195] Run: sudo systemctl stop -f crio
	I0630 21:04:05.680960  244832 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0630 21:04:05.691871  244832 docker.go:179] disabling docker service ...
	I0630 21:04:05.691919  244832 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0630 21:04:05.703033  244832 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0630 21:04:05.713316  244832 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0630 21:04:05.817915  244832 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0630 21:04:05.895867  244832 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0630 21:04:05.905330  244832 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
	image-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0630 21:04:05.918396  244832 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*sandbox_image = .*$|sandbox_image = "k8s.gcr.io/pause:3.7"|' -i /etc/containerd/config.toml"
	I0630 21:04:05.926643  244832 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*restrict_oom_score_adj = .*$|restrict_oom_score_adj = false|' -i /etc/containerd/config.toml"
	I0630 21:04:05.941247  244832 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*SystemdCgroup = .*$|SystemdCgroup = false|' -i /etc/containerd/config.toml"
	I0630 21:04:05.951277  244832 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*conf_dir = .*$|conf_dir = "/etc/cni/net.mk"|' -i /etc/containerd/config.toml"
	I0630 21:04:05.959315  244832 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^# imports|imports = ["/etc/containerd/containerd.conf.d/02-containerd.conf"]|' -i /etc/containerd/config.toml"
	I0630 21:04:05.967370  244832 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc/containerd/containerd.conf.d && printf %!s(MISSING) "dmVyc2lvbiA9IDIK" | base64 -d | sudo tee /etc/containerd/containerd.conf.d/02-containerd.conf"
	I0630 21:04:05.980546  244832 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0630 21:04:05.986927  244832 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0630 21:04:05.993487  244832 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0630 21:04:06.071331  244832 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0630 21:04:06.150904  244832 start.go:447] Will wait 60s for socket path /run/containerd/containerd.sock
	I0630 21:04:06.150975  244832 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
	I0630 21:04:06.154509  244832 start.go:468] Will wait 60s for crictl version
	I0630 21:04:06.154582  244832 ssh_runner.go:195] Run: sudo crictl version
	I0630 21:04:06.188893  244832 retry.go:31] will retry after 11.04660288s: Temporary Error: sudo crictl version: Process exited with status 1
	stdout:
	
	stderr:
	time="2022-06-30T21:04:06Z" level=fatal msg="getting the runtime version: rpc error: code = Unknown desc = server is not initialized yet"
	I0630 21:04:07.783968  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:04:10.284204  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:04:10.665243  242039 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0630 21:04:10.665372  242039 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:04:10.665389  242039 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl label nodes minikube.k8s.io/version=v1.26.0 minikube.k8s.io/commit=251ffcec0e4c997cd7732864187747cc579943c9 minikube.k8s.io/name=default-k8s-different-port-20220630210335-9950 minikube.k8s.io/updated_at=2022_06_30T21_04_10_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:04:10.738525  242039 ops.go:34] apiserver oom_adj: -16
	I0630 21:04:10.746316  242039 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:04:11.305281  242039 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:04:11.805201  242039 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:04:12.305607  242039 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:04:12.805886  242039 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:04:13.305183  242039 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:04:13.805829  242039 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:04:14.305194  242039 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:04:14.805700  242039 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:04:12.782945  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:04:14.783282  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:04:17.237040  244832 ssh_runner.go:195] Run: sudo crictl version
	I0630 21:04:17.260063  244832 start.go:477] Version:  0.1.0
	RuntimeName:  containerd
	RuntimeVersion:  1.6.6
	RuntimeApiVersion:  v1alpha2
	I0630 21:04:17.260117  244832 ssh_runner.go:195] Run: containerd --version
	I0630 21:04:17.289102  244832 ssh_runner.go:195] Run: containerd --version
	I0630 21:04:17.323321  244832 out.go:177] * Preparing Kubernetes v1.24.2 on containerd 1.6.6 ...
	I0630 21:04:15.305709  242039 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:04:15.804983  242039 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:04:16.305210  242039 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:04:16.806005  242039 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:04:17.305761  242039 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:04:17.805955  242039 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:04:18.305837  242039 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:04:18.805206  242039 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:04:19.305179  242039 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:04:19.805546  242039 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:04:17.324946  244832 cli_runner.go:164] Run: docker network inspect no-preload-20220630210237-9950 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0630 21:04:17.361104  244832 ssh_runner.go:195] Run: grep 192.168.76.1	host.minikube.internal$ /etc/hosts
	I0630 21:04:17.364769  244832 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.76.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0630 21:04:17.374163  244832 preload.go:132] Checking if preload exists for k8s version v1.24.2 and runtime containerd
	I0630 21:04:17.374214  244832 ssh_runner.go:195] Run: sudo crictl images --output json
	I0630 21:04:17.397831  244832 containerd.go:547] all images are preloaded for containerd runtime.
	I0630 21:04:17.397852  244832 cache_images.go:84] Images are preloaded, skipping loading
	I0630 21:04:17.397895  244832 ssh_runner.go:195] Run: sudo crictl info
	I0630 21:04:17.423452  244832 cni.go:95] Creating CNI manager for ""
	I0630 21:04:17.423479  244832 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:04:17.423493  244832 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
	I0630 21:04:17.423524  244832 kubeadm.go:158] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.24.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:no-preload-20220630210237-9950 NodeName:no-preload-20220630210237-9950 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.76.2 CgroupDriver:cgroupfs ClientCAF
ile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}
	I0630 21:04:17.423650  244832 kubeadm.go:162] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.76.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: /run/containerd/containerd.sock
	  name: "no-preload-20220630210237-9950"
	  kubeletExtraArgs:
	    node-ip: 192.168.76.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.24.2
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%!"(MISSING)
	  nodefs.inodesFree: "0%!"(MISSING)
	  imagefs.available: "0%!"(MISSING)
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0630 21:04:17.423731  244832 kubeadm.go:961] kubelet [Unit]
	Wants=containerd.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.24.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=no-preload-20220630210237-9950 --image-service-endpoint=unix:///run/containerd/containerd.sock --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.76.2 --runtime-request-timeout=15m
	
	[Install]
	 config:
	{KubernetesVersion:v1.24.2 ClusterName:no-preload-20220630210237-9950 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
	I0630 21:04:17.423780  244832 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.24.2
	I0630 21:04:17.430920  244832 binaries.go:44] Found k8s binaries, skipping transfer
	I0630 21:04:17.430987  244832 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0630 21:04:17.437832  244832 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (523 bytes)
	I0630 21:04:17.450334  244832 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0630 21:04:17.463608  244832 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2059 bytes)
	I0630 21:04:17.476738  244832 ssh_runner.go:195] Run: grep 192.168.76.2	control-plane.minikube.internal$ /etc/hosts
	I0630 21:04:17.479961  244832 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0630 21:04:17.489959  244832 certs.go:54] Setting up /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/no-preload-20220630210237-9950 for IP: 192.168.76.2
	I0630 21:04:17.490060  244832 certs.go:182] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.key
	I0630 21:04:17.490093  244832 certs.go:182] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.key
	I0630 21:04:17.490163  244832 certs.go:298] skipping minikube-user signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/no-preload-20220630210237-9950/client.key
	I0630 21:04:17.490225  244832 certs.go:298] skipping minikube signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/no-preload-20220630210237-9950/apiserver.key.31bdca25
	I0630 21:04:17.490260  244832 certs.go:298] skipping aggregator signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/no-preload-20220630210237-9950/proxy-client.key
	I0630 21:04:17.490376  244832 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950.pem (1338 bytes)
	W0630 21:04:17.490413  244832 certs.go:384] ignoring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950_empty.pem, impossibly tiny 0 bytes
	I0630 21:04:17.490431  244832 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem (1679 bytes)
	I0630 21:04:17.490455  244832 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem (1082 bytes)
	I0630 21:04:17.490477  244832 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem (1123 bytes)
	I0630 21:04:17.490499  244832 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/key.pem (1679 bytes)
	I0630 21:04:17.490541  244832 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem (1708 bytes)
	I0630 21:04:17.491108  244832 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/no-preload-20220630210237-9950/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
	I0630 21:04:17.509542  244832 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/no-preload-20220630210237-9950/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
	I0630 21:04:17.527125  244832 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/no-preload-20220630210237-9950/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0630 21:04:17.544746  244832 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/no-preload-20220630210237-9950/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
	I0630 21:04:17.562463  244832 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0630 21:04:17.580511  244832 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
	I0630 21:04:17.598257  244832 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0630 21:04:17.615663  244832 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
	I0630 21:04:17.632772  244832 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem --> /usr/share/ca-certificates/99502.pem (1708 bytes)
	I0630 21:04:17.649622  244832 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0630 21:04:17.667290  244832 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950.pem --> /usr/share/ca-certificates/9950.pem (1338 bytes)
	I0630 21:04:17.684335  244832 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0630 21:04:17.697212  244832 ssh_runner.go:195] Run: openssl version
	I0630 21:04:17.702183  244832 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/99502.pem && ln -fs /usr/share/ca-certificates/99502.pem /etc/ssl/certs/99502.pem"
	I0630 21:04:17.709980  244832 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/99502.pem
	I0630 21:04:17.713460  244832 certs.go:431] hashing: -rw-r--r-- 1 root root 1708 Jun 30 20:26 /usr/share/ca-certificates/99502.pem
	I0630 21:04:17.713529  244832 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/99502.pem
	I0630 21:04:17.718814  244832 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/99502.pem /etc/ssl/certs/3ec20f2e.0"
	I0630 21:04:17.725881  244832 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0630 21:04:17.733659  244832 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:04:17.736752  244832 certs.go:431] hashing: -rw-r--r-- 1 root root 1111 Jun 30 20:22 /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:04:17.736806  244832 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:04:17.741618  244832 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0630 21:04:17.749193  244832 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/9950.pem && ln -fs /usr/share/ca-certificates/9950.pem /etc/ssl/certs/9950.pem"
	I0630 21:04:17.756560  244832 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/9950.pem
	I0630 21:04:17.759471  244832 certs.go:431] hashing: -rw-r--r-- 1 root root 1338 Jun 30 20:26 /usr/share/ca-certificates/9950.pem
	I0630 21:04:17.759519  244832 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/9950.pem
	I0630 21:04:17.764107  244832 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/9950.pem /etc/ssl/certs/51391683.0"
	I0630 21:04:17.770780  244832 kubeadm.go:395] StartCluster: {Name:no-preload-20220630210237-9950 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:no-preload-20220630210237-9950 Namespace:default APIServerName:
minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[Dashboard:kubernetesui/dashboard:v2.6.0@sha256:4af9580485920635d888efe1eddbd67e12f9d5d84dba87100e93feb4e46636b3 MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil
> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 21:04:17.770877  244832 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
	I0630 21:04:17.770927  244832 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0630 21:04:17.795714  244832 cri.go:87] found id: "7dbd0f819e567c79c81d8c68674e41e75a400324b8693a801af8229894d3817b"
	I0630 21:04:17.795743  244832 cri.go:87] found id: "1667283ff0dcd11ddf5e59dc43be92d495a9bc915627fc2dc156f717af012d4b"
	I0630 21:04:17.795754  244832 cri.go:87] found id: "a143f85bb65b242e4b7b9104c0e0b9769e6ad2426401c7b1837a644cb24b83e1"
	I0630 21:04:17.795764  244832 cri.go:87] found id: "ddb13f5a47859f3390182356af18992758d2216cb452b08a30072db5f3762295"
	I0630 21:04:17.795773  244832 cri.go:87] found id: "d10fabde68c9be09a0ee81741f53a2368b0fff3c3bac52e511e3d6a26d8fe3bf"
	I0630 21:04:17.795783  244832 cri.go:87] found id: "aa7c34d355e07116b45781a9b66e7be4f905e0f86661ede6b5e2de65fed93913"
	I0630 21:04:17.795793  244832 cri.go:87] found id: "d8028b589ae0fb0230b67b28d6d6c4c53ff6507434b092a872fb9c5e54926465"
	I0630 21:04:17.795806  244832 cri.go:87] found id: "b93929e941ee7fb19c32175b31b0d6f1e98e972924c5878c6568761dda755834"
	I0630 21:04:17.795812  244832 cri.go:87] found id: ""
	I0630 21:04:17.795849  244832 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
	I0630 21:04:17.808169  244832 cri.go:114] JSON = null
	W0630 21:04:17.808225  244832 kubeadm.go:402] unpause failed: list paused: list returned 0 containers, but ps returned 8
	I0630 21:04:17.808277  244832 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0630 21:04:17.815083  244832 kubeadm.go:410] found existing configuration files, will attempt cluster restart
	I0630 21:04:17.815106  244832 kubeadm.go:626] restartCluster start
	I0630 21:04:17.815149  244832 ssh_runner.go:195] Run: sudo test -d /data/minikube
	I0630 21:04:17.821790  244832 kubeadm.go:127] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:04:17.822435  244832 kubeconfig.go:116] verify returned: extract IP: "no-preload-20220630210237-9950" does not appear in /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:04:17.822828  244832 kubeconfig.go:127] "no-preload-20220630210237-9950" context is missing from /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig - will repair!
	I0630 21:04:17.823469  244832 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig: {Name:mk34e4a4e7b04f624b9adbda4f77ee20b38308ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:04:17.824813  244832 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
	I0630 21:04:17.832141  244832 api_server.go:165] Checking apiserver status ...
	I0630 21:04:17.832208  244832 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:04:17.841027  244832 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:04:18.041460  244832 api_server.go:165] Checking apiserver status ...
	I0630 21:04:18.041604  244832 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:04:18.050335  244832 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:04:18.241566  244832 api_server.go:165] Checking apiserver status ...
	I0630 21:04:18.241641  244832 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:04:18.250646  244832 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:04:18.441966  244832 api_server.go:165] Checking apiserver status ...
	I0630 21:04:18.442066  244832 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:04:18.450669  244832 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:04:18.641944  244832 api_server.go:165] Checking apiserver status ...
	I0630 21:04:18.642032  244832 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:04:18.650769  244832 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:04:18.842077  244832 api_server.go:165] Checking apiserver status ...
	I0630 21:04:18.842160  244832 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:04:18.851894  244832 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:04:19.042157  244832 api_server.go:165] Checking apiserver status ...
	I0630 21:04:19.042247  244832 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:04:19.050865  244832 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:04:19.242141  244832 api_server.go:165] Checking apiserver status ...
	I0630 21:04:19.242225  244832 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:04:19.250921  244832 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:04:19.442200  244832 api_server.go:165] Checking apiserver status ...
	I0630 21:04:19.442274  244832 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:04:19.451054  244832 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:04:19.641132  244832 api_server.go:165] Checking apiserver status ...
	I0630 21:04:19.641230  244832 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:04:19.649872  244832 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:04:19.842026  244832 api_server.go:165] Checking apiserver status ...
	I0630 21:04:19.842121  244832 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:04:19.851234  244832 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:04:20.041567  244832 api_server.go:165] Checking apiserver status ...
	I0630 21:04:20.041673  244832 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:04:20.050471  244832 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:04:20.241764  244832 api_server.go:165] Checking apiserver status ...
	I0630 21:04:20.241835  244832 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:04:20.250517  244832 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:04:20.441946  244832 api_server.go:165] Checking apiserver status ...
	I0630 21:04:20.442039  244832 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 21:04:17.283296  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:04:19.284268  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:04:20.305229  242039 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:04:20.805030  242039 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:04:21.305150  242039 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:04:21.805969  242039 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:04:22.305070  242039 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:04:22.445410  242039 kubeadm.go:1045] duration metric: took 11.780092951s to wait for elevateKubeSystemPrivileges.
	I0630 21:04:22.445445  242039 kubeadm.go:397] StartCluster complete in 23.95079965s
	I0630 21:04:22.445465  242039 settings.go:142] acquiring lock: {Name:mkcbd229caa05b60d3551ef0b47eea08424c9b5d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:04:22.445596  242039 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:04:22.447615  242039 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig: {Name:mk34e4a4e7b04f624b9adbda4f77ee20b38308ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:04:22.967006  242039 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "default-k8s-different-port-20220630210335-9950" rescaled to 1
	I0630 21:04:22.967085  242039 start.go:208] Will wait 6m0s for node &{Name: IP:192.168.85.2 Port:8444 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0630 21:04:22.967105  242039 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0630 21:04:22.970209  242039 out.go:177] * Verifying Kubernetes components...
	I0630 21:04:22.967409  242039 config.go:178] Loaded profile config "default-k8s-different-port-20220630210335-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:04:22.967427  242039 addons.go:412] enableAddons start: toEnable=map[], additional=[]
	I0630 21:04:22.972052  242039 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 21:04:22.972098  242039 addons.go:65] Setting storage-provisioner=true in profile "default-k8s-different-port-20220630210335-9950"
	I0630 21:04:22.972127  242039 addons.go:153] Setting addon storage-provisioner=true in "default-k8s-different-port-20220630210335-9950"
	W0630 21:04:22.972136  242039 addons.go:162] addon storage-provisioner should already be in state true
	I0630 21:04:22.972192  242039 host.go:66] Checking if "default-k8s-different-port-20220630210335-9950" exists ...
	I0630 21:04:22.972209  242039 addons.go:65] Setting default-storageclass=true in profile "default-k8s-different-port-20220630210335-9950"
	I0630 21:04:22.972225  242039 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "default-k8s-different-port-20220630210335-9950"
	I0630 21:04:22.972600  242039 cli_runner.go:164] Run: docker container inspect default-k8s-different-port-20220630210335-9950 --format={{.State.Status}}
	I0630 21:04:22.972795  242039 cli_runner.go:164] Run: docker container inspect default-k8s-different-port-20220630210335-9950 --format={{.State.Status}}
	I0630 21:04:23.016583  242039 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0630 21:04:23.018185  242039 addons.go:345] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 21:04:23.018210  242039 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0630 21:04:23.018271  242039 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	I0630 21:04:23.019616  242039 addons.go:153] Setting addon default-storageclass=true in "default-k8s-different-port-20220630210335-9950"
	W0630 21:04:23.019636  242039 addons.go:162] addon default-storageclass should already be in state true
	I0630 21:04:23.019657  242039 host.go:66] Checking if "default-k8s-different-port-20220630210335-9950" exists ...
	I0630 21:04:23.019978  242039 cli_runner.go:164] Run: docker container inspect default-k8s-different-port-20220630210335-9950 --format={{.State.Status}}
	I0630 21:04:23.051111  242039 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.85.1 host.minikube.internal\n           fallthrough\n        }' | sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0630 21:04:23.052773  242039 node_ready.go:35] waiting up to 6m0s for node "default-k8s-different-port-20220630210335-9950" to be "Ready" ...
	I0630 21:04:23.077750  242039 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49407 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/default-k8s-different-port-20220630210335-9950/id_rsa Username:docker}
	I0630 21:04:23.080553  242039 addons.go:345] installing /etc/kubernetes/addons/storageclass.yaml
	I0630 21:04:23.080577  242039 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0630 21:04:23.080638  242039 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	I0630 21:04:23.124266  242039 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49407 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/default-k8s-different-port-20220630210335-9950/id_rsa Username:docker}
	I0630 21:04:23.232795  242039 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 21:04:23.246024  242039 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0630 21:04:23.351917  242039 start.go:806] {"host.minikube.internal": 192.168.85.1} host record injected into CoreDNS
	I0630 21:04:23.584662  242039 out.go:177] * Enabled addons: storage-provisioner, default-storageclass
	I0630 21:04:23.586075  242039 addons.go:414] enableAddons completed in 618.649204ms
	I0630 21:04:25.060040  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	W0630 21:04:20.450773  244832 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:04:20.642070  244832 api_server.go:165] Checking apiserver status ...
	I0630 21:04:20.642174  244832 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:04:20.651043  244832 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:04:20.841153  244832 api_server.go:165] Checking apiserver status ...
	I0630 21:04:20.841259  244832 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:04:20.850722  244832 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:04:20.850749  244832 api_server.go:165] Checking apiserver status ...
	I0630 21:04:20.850792  244832 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:04:20.859577  244832 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:04:20.859609  244832 kubeadm.go:601] needs reconfigure: apiserver error: timed out waiting for the condition
	I0630 21:04:20.859616  244832 kubeadm.go:1092] stopping kube-system containers ...
	I0630 21:04:20.859628  244832 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name: Namespaces:[kube-system]}
	I0630 21:04:20.859677  244832 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0630 21:04:20.884447  244832 cri.go:87] found id: "7dbd0f819e567c79c81d8c68674e41e75a400324b8693a801af8229894d3817b"
	I0630 21:04:20.884476  244832 cri.go:87] found id: "1667283ff0dcd11ddf5e59dc43be92d495a9bc915627fc2dc156f717af012d4b"
	I0630 21:04:20.884487  244832 cri.go:87] found id: "a143f85bb65b242e4b7b9104c0e0b9769e6ad2426401c7b1837a644cb24b83e1"
	I0630 21:04:20.884494  244832 cri.go:87] found id: "ddb13f5a47859f3390182356af18992758d2216cb452b08a30072db5f3762295"
	I0630 21:04:20.884500  244832 cri.go:87] found id: "d10fabde68c9be09a0ee81741f53a2368b0fff3c3bac52e511e3d6a26d8fe3bf"
	I0630 21:04:20.884506  244832 cri.go:87] found id: "aa7c34d355e07116b45781a9b66e7be4f905e0f86661ede6b5e2de65fed93913"
	I0630 21:04:20.884513  244832 cri.go:87] found id: "d8028b589ae0fb0230b67b28d6d6c4c53ff6507434b092a872fb9c5e54926465"
	I0630 21:04:20.884527  244832 cri.go:87] found id: "b93929e941ee7fb19c32175b31b0d6f1e98e972924c5878c6568761dda755834"
	I0630 21:04:20.884541  244832 cri.go:87] found id: ""
	I0630 21:04:20.884552  244832 cri.go:232] Stopping containers: [7dbd0f819e567c79c81d8c68674e41e75a400324b8693a801af8229894d3817b 1667283ff0dcd11ddf5e59dc43be92d495a9bc915627fc2dc156f717af012d4b a143f85bb65b242e4b7b9104c0e0b9769e6ad2426401c7b1837a644cb24b83e1 ddb13f5a47859f3390182356af18992758d2216cb452b08a30072db5f3762295 d10fabde68c9be09a0ee81741f53a2368b0fff3c3bac52e511e3d6a26d8fe3bf aa7c34d355e07116b45781a9b66e7be4f905e0f86661ede6b5e2de65fed93913 d8028b589ae0fb0230b67b28d6d6c4c53ff6507434b092a872fb9c5e54926465 b93929e941ee7fb19c32175b31b0d6f1e98e972924c5878c6568761dda755834]
	I0630 21:04:20.884601  244832 ssh_runner.go:195] Run: which crictl
	I0630 21:04:20.887556  244832 ssh_runner.go:195] Run: sudo /usr/bin/crictl stop 7dbd0f819e567c79c81d8c68674e41e75a400324b8693a801af8229894d3817b 1667283ff0dcd11ddf5e59dc43be92d495a9bc915627fc2dc156f717af012d4b a143f85bb65b242e4b7b9104c0e0b9769e6ad2426401c7b1837a644cb24b83e1 ddb13f5a47859f3390182356af18992758d2216cb452b08a30072db5f3762295 d10fabde68c9be09a0ee81741f53a2368b0fff3c3bac52e511e3d6a26d8fe3bf aa7c34d355e07116b45781a9b66e7be4f905e0f86661ede6b5e2de65fed93913 d8028b589ae0fb0230b67b28d6d6c4c53ff6507434b092a872fb9c5e54926465 b93929e941ee7fb19c32175b31b0d6f1e98e972924c5878c6568761dda755834
	I0630 21:04:20.913603  244832 ssh_runner.go:195] Run: sudo systemctl stop kubelet
	I0630 21:04:20.923548  244832 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0630 21:04:20.930533  244832 kubeadm.go:155] found existing configuration files:
	-rw------- 1 root root 5639 Jun 30 21:02 /etc/kubernetes/admin.conf
	-rw------- 1 root root 5656 Jun 30 21:02 /etc/kubernetes/controller-manager.conf
	-rw------- 1 root root 2059 Jun 30 21:03 /etc/kubernetes/kubelet.conf
	-rw------- 1 root root 5600 Jun 30 21:02 /etc/kubernetes/scheduler.conf
	
	I0630 21:04:20.930587  244832 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
	I0630 21:04:20.936999  244832 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
	I0630 21:04:20.943565  244832 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
	I0630 21:04:20.949808  244832 kubeadm.go:166] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:04:20.949871  244832 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
	I0630 21:04:20.955985  244832 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
	I0630 21:04:20.963133  244832 kubeadm.go:166] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:04:20.963170  244832 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
	I0630 21:04:20.969511  244832 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0630 21:04:20.976785  244832 kubeadm.go:703] reconfiguring cluster from /var/tmp/minikube/kubeadm.yaml
	I0630 21:04:20.976958  244832 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:04:21.025179  244832 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:04:21.936950  244832 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:04:22.148144  244832 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:04:22.203613  244832 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:04:22.343892  244832 api_server.go:51] waiting for apiserver process to appear ...
	I0630 21:04:22.343963  244832 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 21:04:22.856547  244832 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 21:04:23.356408  244832 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 21:04:23.432827  244832 api_server.go:71] duration metric: took 1.088939148s to wait for apiserver process to appear ...
	I0630 21:04:23.432858  244832 api_server.go:87] waiting for apiserver healthz status ...
	I0630 21:04:23.432871  244832 api_server.go:240] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
	I0630 21:04:23.433255  244832 api_server.go:256] stopped: https://192.168.76.2:8443/healthz: Get "https://192.168.76.2:8443/healthz": dial tcp 192.168.76.2:8443: connect: connection refused
	I0630 21:04:23.934077  244832 api_server.go:240] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
	I0630 21:04:21.783224  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:04:23.783363  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:04:26.850524  244832 api_server.go:266] https://192.168.76.2:8443/healthz returned 403:
	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
	W0630 21:04:26.850558  244832 api_server.go:102] status: https://192.168.76.2:8443/healthz returned error 403:
	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
	I0630 21:04:26.933740  244832 api_server.go:240] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
	I0630 21:04:26.941935  244832 api_server.go:266] https://192.168.76.2:8443/healthz returned 403:
	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
	W0630 21:04:26.941963  244832 api_server.go:102] status: https://192.168.76.2:8443/healthz returned error 403:
	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
	I0630 21:04:27.434326  244832 api_server.go:240] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
	I0630 21:04:27.439298  244832 api_server.go:266] https://192.168.76.2:8443/healthz returned 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/bootstrap-controller ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-registration-controller ok
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	W0630 21:04:27.439335  244832 api_server.go:102] status: https://192.168.76.2:8443/healthz returned error 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/bootstrap-controller ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-registration-controller ok
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	I0630 21:04:27.934018  244832 api_server.go:240] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
	I0630 21:04:27.938620  244832 api_server.go:266] https://192.168.76.2:8443/healthz returned 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/bootstrap-controller ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-registration-controller ok
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	W0630 21:04:27.938655  244832 api_server.go:102] status: https://192.168.76.2:8443/healthz returned error 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/bootstrap-controller ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-registration-controller ok
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	I0630 21:04:28.434225  244832 api_server.go:240] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
	I0630 21:04:28.439143  244832 api_server.go:266] https://192.168.76.2:8443/healthz returned 200:
	ok
	I0630 21:04:28.444920  244832 api_server.go:140] control plane version: v1.24.2
	I0630 21:04:28.444942  244832 api_server.go:130] duration metric: took 5.012078888s to wait for apiserver health ...
	I0630 21:04:28.444951  244832 cni.go:95] Creating CNI manager for ""
	I0630 21:04:28.444960  244832 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:04:28.447848  244832 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0630 21:04:27.560437  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:04:30.060214  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:04:28.449288  244832 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0630 21:04:28.453384  244832 cni.go:189] applying CNI manifest using /var/lib/minikube/binaries/v1.24.2/kubectl ...
	I0630 21:04:28.453400  244832 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2429 bytes)
	I0630 21:04:28.467344  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0630 21:04:29.610661  244832 ssh_runner.go:235] Completed: sudo /var/lib/minikube/binaries/v1.24.2/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml: (1.143283851s)
	I0630 21:04:29.610692  244832 system_pods.go:43] waiting for kube-system pods to appear ...
	I0630 21:04:29.618010  244832 system_pods.go:59] 9 kube-system pods found
	I0630 21:04:29.618045  244832 system_pods.go:61] "coredns-6d4b75cb6d-k5r82" [1b9941db-6271-45a8-a7a7-351273fb1f5a] Running
	I0630 21:04:29.618054  244832 system_pods.go:61] "etcd-no-preload-20220630210237-9950" [f2f6af09-2a21-4062-877f-12feb0393fba] Running
	I0630 21:04:29.618059  244832 system_pods.go:61] "kindnet-stdpc" [b2617cd9-45a9-4023-804b-78c1e8bf322e] Running
	I0630 21:04:29.618068  244832 system_pods.go:61] "kube-apiserver-no-preload-20220630210237-9950" [2418e646-29b4-40de-9ccd-c9d8eb53ceb4] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
	I0630 21:04:29.618079  244832 system_pods.go:61] "kube-controller-manager-no-preload-20220630210237-9950" [c33b3d84-ca29-4e0d-be2e-23539f8ccc63] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
	I0630 21:04:29.618091  244832 system_pods.go:61] "kube-proxy-qlvpj" [3ea54d58-bbc3-4c77-a64a-420becd954ba] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])
	I0630 21:04:29.618104  244832 system_pods.go:61] "kube-scheduler-no-preload-20220630210237-9950" [53ba894b-6a3b-4a92-bfb8-d4155bc85320] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
	I0630 21:04:29.618114  244832 system_pods.go:61] "metrics-server-5c6f97fb75-n5f6r" [316111e4-528c-4d37-b24f-b0b90dea5432] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
	I0630 21:04:29.618122  244832 system_pods.go:61] "storage-provisioner" [d95b68ae-b7b1-49ce-99f4-1c887b1fd327] Running
	I0630 21:04:29.618128  244832 system_pods.go:74] duration metric: took 7.430732ms to wait for pod list to return data ...
	I0630 21:04:29.618138  244832 node_conditions.go:102] verifying NodePressure condition ...
	I0630 21:04:29.620804  244832 node_conditions.go:122] node storage ephemeral capacity is 304695084Ki
	I0630 21:04:29.620831  244832 node_conditions.go:123] node cpu capacity is 8
	I0630 21:04:29.620842  244832 node_conditions.go:105] duration metric: took 2.700633ms to run NodePressure ...
	I0630 21:04:29.620859  244832 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:04:29.765121  244832 kubeadm.go:762] waiting for restarted kubelet to initialise ...
	I0630 21:04:29.769414  244832 kubeadm.go:777] kubelet initialised
	I0630 21:04:29.769436  244832 kubeadm.go:778] duration metric: took 4.291243ms waiting for restarted kubelet to initialise ...
	I0630 21:04:29.769443  244832 pod_ready.go:35] extra waiting up to 4m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0630 21:04:29.774502  244832 pod_ready.go:78] waiting up to 4m0s for pod "coredns-6d4b75cb6d-k5r82" in "kube-system" namespace to be "Ready" ...
	I0630 21:04:29.778804  244832 pod_ready.go:92] pod "coredns-6d4b75cb6d-k5r82" in "kube-system" namespace has status "Ready":"True"
	I0630 21:04:29.778825  244832 pod_ready.go:81] duration metric: took 4.296264ms waiting for pod "coredns-6d4b75cb6d-k5r82" in "kube-system" namespace to be "Ready" ...
	I0630 21:04:29.778836  244832 pod_ready.go:78] waiting up to 4m0s for pod "etcd-no-preload-20220630210237-9950" in "kube-system" namespace to be "Ready" ...
	I0630 21:04:29.782716  244832 pod_ready.go:92] pod "etcd-no-preload-20220630210237-9950" in "kube-system" namespace has status "Ready":"True"
	I0630 21:04:29.782738  244832 pod_ready.go:81] duration metric: took 3.894835ms waiting for pod "etcd-no-preload-20220630210237-9950" in "kube-system" namespace to be "Ready" ...
	I0630 21:04:29.782753  244832 pod_ready.go:78] waiting up to 4m0s for pod "kube-apiserver-no-preload-20220630210237-9950" in "kube-system" namespace to be "Ready" ...
	I0630 21:04:25.783906  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:04:28.283327  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:04:30.283691  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:04:32.560319  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:04:35.060680  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:04:31.792993  244832 pod_ready.go:102] pod "kube-apiserver-no-preload-20220630210237-9950" in "kube-system" namespace has status "Ready":"False"
	I0630 21:04:33.793203  244832 pod_ready.go:102] pod "kube-apiserver-no-preload-20220630210237-9950" in "kube-system" namespace has status "Ready":"False"
	I0630 21:04:32.283944  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:04:34.783483  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:04:37.559816  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:04:40.060623  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:04:36.292894  244832 pod_ready.go:102] pod "kube-apiserver-no-preload-20220630210237-9950" in "kube-system" namespace has status "Ready":"False"
	I0630 21:04:38.292693  244832 pod_ready.go:92] pod "kube-apiserver-no-preload-20220630210237-9950" in "kube-system" namespace has status "Ready":"True"
	I0630 21:04:38.292727  244832 pod_ready.go:81] duration metric: took 8.509967911s waiting for pod "kube-apiserver-no-preload-20220630210237-9950" in "kube-system" namespace to be "Ready" ...
	I0630 21:04:38.292738  244832 pod_ready.go:78] waiting up to 4m0s for pod "kube-controller-manager-no-preload-20220630210237-9950" in "kube-system" namespace to be "Ready" ...
	I0630 21:04:38.298184  244832 pod_ready.go:92] pod "kube-controller-manager-no-preload-20220630210237-9950" in "kube-system" namespace has status "Ready":"True"
	I0630 21:04:38.298204  244832 pod_ready.go:81] duration metric: took 5.460001ms waiting for pod "kube-controller-manager-no-preload-20220630210237-9950" in "kube-system" namespace to be "Ready" ...
	I0630 21:04:38.298213  244832 pod_ready.go:78] waiting up to 4m0s for pod "kube-proxy-qlvpj" in "kube-system" namespace to be "Ready" ...
	I0630 21:04:38.302113  244832 pod_ready.go:92] pod "kube-proxy-qlvpj" in "kube-system" namespace has status "Ready":"True"
	I0630 21:04:38.302130  244832 pod_ready.go:81] duration metric: took 3.911421ms waiting for pod "kube-proxy-qlvpj" in "kube-system" namespace to be "Ready" ...
	I0630 21:04:38.302137  244832 pod_ready.go:78] waiting up to 4m0s for pod "kube-scheduler-no-preload-20220630210237-9950" in "kube-system" namespace to be "Ready" ...
	I0630 21:04:38.811745  244832 pod_ready.go:92] pod "kube-scheduler-no-preload-20220630210237-9950" in "kube-system" namespace has status "Ready":"True"
	I0630 21:04:38.811773  244832 pod_ready.go:81] duration metric: took 509.629ms waiting for pod "kube-scheduler-no-preload-20220630210237-9950" in "kube-system" namespace to be "Ready" ...
	I0630 21:04:38.811784  244832 pod_ready.go:78] waiting up to 4m0s for pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace to be "Ready" ...
	I0630 21:04:36.783686  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:04:39.283178  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:04:42.560398  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:04:45.059731  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:04:41.283374  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:04:43.783725  228981 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:04:45.285374  228981 node_ready.go:38] duration metric: took 4m0.012257221s waiting for node "old-k8s-version-20220630210005-9950" to be "Ready" ...
	I0630 21:04:45.287575  228981 out.go:177] 
	W0630 21:04:45.289206  228981 out.go:239] X Exiting due to GUEST_START: wait 6m0s for node: waiting for node to be ready: waitNodeCondition: timed out waiting for the condition
	W0630 21:04:45.289230  228981 out.go:239] * 
	W0630 21:04:45.289962  228981 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0630 21:04:45.292018  228981 out.go:177] 
	I0630 21:04:40.822194  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:04:43.321627  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:04:45.323434  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	
	* 
	* ==> container status <==
	* CONTAINER           IMAGE               CREATED              STATE               NAME                      ATTEMPT             POD ID
	5dc3e41a57454       6fb66cd78abfe       About a minute ago   Running             kindnet-cni               1                   b15f9ad19c2f6
	f3c9296d1934a       6fb66cd78abfe       3 minutes ago        Exited              kindnet-cni               0                   b15f9ad19c2f6
	27b91b4e15954       c21b0c7400f98       4 minutes ago        Running             kube-proxy                0                   29779e553ffd2
	998b774f4f284       b305571ca60a5       4 minutes ago        Running             kube-apiserver            0                   6697c3421bd89
	b8604fd1030fa       06a629a7e51cd       4 minutes ago        Running             kube-controller-manager   0                   acea3993dd031
	fa267cd65f4ee       301ddc62b80b1       4 minutes ago        Running             kube-scheduler            0                   fe605286ea071
	f60b30d7e822c       b2756210eeabf       4 minutes ago        Running             etcd                      0                   b94b9bf357242
	
	* 
	* ==> containerd <==
	* -- Logs begin at Thu 2022-06-30 21:00:14 UTC, end at Thu 2022-06-30 21:04:46 UTC. --
	Jun 30 21:00:44 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:00:44.957031767Z" level=info msg="starting signal loop" namespace=k8s.io path=/run/containerd/io.containerd.runtime.v2.task/k8s.io/b15f9ad19c2f6c96abd88ffd829a0f93c6e061772e32718825b5b3d3af616046 pid=1804 runtime=io.containerd.runc.v2
	Jun 30 21:00:45 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:00:45.024590916Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kube-proxy-twls5,Uid:13daeab7-4a9e-4c35-bcc3-ca38e5008060,Namespace:kube-system,Attempt:0,} returns sandbox id \"29779e553ffd225c9b4c31920afbca734586b720f264847f66d64672d3bf6f57\""
	Jun 30 21:00:45 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:00:45.027772987Z" level=info msg="CreateContainer within sandbox \"29779e553ffd225c9b4c31920afbca734586b720f264847f66d64672d3bf6f57\" for container &ContainerMetadata{Name:kube-proxy,Attempt:0,}"
	Jun 30 21:00:45 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:00:45.043412530Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kindnet-4gs84,Uid:0eb5f5b6-6c40-401a-95c4-bef42040561c,Namespace:kube-system,Attempt:0,} returns sandbox id \"b15f9ad19c2f6c96abd88ffd829a0f93c6e061772e32718825b5b3d3af616046\""
	Jun 30 21:00:45 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:00:45.044842934Z" level=info msg="CreateContainer within sandbox \"29779e553ffd225c9b4c31920afbca734586b720f264847f66d64672d3bf6f57\" for &ContainerMetadata{Name:kube-proxy,Attempt:0,} returns container id \"27b91b4e1595400f52e6c0fd5fb8e3732c524b9757a79a5a9108333797eb3788\""
	Jun 30 21:00:45 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:00:45.045464957Z" level=info msg="StartContainer for \"27b91b4e1595400f52e6c0fd5fb8e3732c524b9757a79a5a9108333797eb3788\""
	Jun 30 21:00:45 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:00:45.045537614Z" level=info msg="PullImage \"kindest/kindnetd:v20220510-4929dd75\""
	Jun 30 21:00:45 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:00:45.126606346Z" level=info msg="StartContainer for \"27b91b4e1595400f52e6c0fd5fb8e3732c524b9757a79a5a9108333797eb3788\" returns successfully"
	Jun 30 21:00:48 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:00:48.994146062Z" level=info msg="ImageCreate event &ImageCreate{Name:docker.io/kindest/kindnetd:v20220510-4929dd75,Labels:map[string]string{io.cri-containerd.image: managed,},XXX_unrecognized:[],}"
	Jun 30 21:00:48 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:00:48.996679690Z" level=info msg="ImageCreate event &ImageCreate{Name:sha256:6fb66cd78abfe9e0735a9a751f2586b7984e0d279e87fa8dd175781de6595627,Labels:map[string]string{io.cri-containerd.image: managed,},XXX_unrecognized:[],}"
	Jun 30 21:00:48 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:00:48.998475238Z" level=info msg="ImageUpdate event &ImageUpdate{Name:docker.io/kindest/kindnetd:v20220510-4929dd75,Labels:map[string]string{io.cri-containerd.image: managed,},XXX_unrecognized:[],}"
	Jun 30 21:00:49 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:00:49.000456639Z" level=info msg="ImageCreate event &ImageCreate{Name:docker.io/kindest/kindnetd@sha256:39494477a3fa001aae716b704a8991f4f62d2ccf1aaaa65692da6c805b18856c,Labels:map[string]string{io.cri-containerd.image: managed,},XXX_unrecognized:[],}"
	Jun 30 21:00:49 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:00:49.001003007Z" level=info msg="PullImage \"kindest/kindnetd:v20220510-4929dd75\" returns image reference \"sha256:6fb66cd78abfe9e0735a9a751f2586b7984e0d279e87fa8dd175781de6595627\""
	Jun 30 21:00:49 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:00:49.003405314Z" level=info msg="CreateContainer within sandbox \"b15f9ad19c2f6c96abd88ffd829a0f93c6e061772e32718825b5b3d3af616046\" for container &ContainerMetadata{Name:kindnet-cni,Attempt:0,}"
	Jun 30 21:00:49 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:00:49.036903927Z" level=info msg="CreateContainer within sandbox \"b15f9ad19c2f6c96abd88ffd829a0f93c6e061772e32718825b5b3d3af616046\" for &ContainerMetadata{Name:kindnet-cni,Attempt:0,} returns container id \"f3c9296d1934a714fc6e1f5c8f9667857513425cd1b3879bf4e33ddc11939aff\""
	Jun 30 21:00:49 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:00:49.037572198Z" level=info msg="StartContainer for \"f3c9296d1934a714fc6e1f5c8f9667857513425cd1b3879bf4e33ddc11939aff\""
	Jun 30 21:00:49 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:00:49.228097609Z" level=info msg="StartContainer for \"f3c9296d1934a714fc6e1f5c8f9667857513425cd1b3879bf4e33ddc11939aff\" returns successfully"
	Jun 30 21:03:29 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:03:29.799791384Z" level=info msg="shim disconnected" id=f3c9296d1934a714fc6e1f5c8f9667857513425cd1b3879bf4e33ddc11939aff
	Jun 30 21:03:29 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:03:29.799864103Z" level=warning msg="cleaning up after shim disconnected" id=f3c9296d1934a714fc6e1f5c8f9667857513425cd1b3879bf4e33ddc11939aff namespace=k8s.io
	Jun 30 21:03:29 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:03:29.799878513Z" level=info msg="cleaning up dead shim"
	Jun 30 21:03:29 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:03:29.809397488Z" level=warning msg="cleanup warnings time=\"2022-06-30T21:03:29Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=2494 runtime=io.containerd.runc.v2\n"
	Jun 30 21:03:30 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:03:30.515441807Z" level=info msg="CreateContainer within sandbox \"b15f9ad19c2f6c96abd88ffd829a0f93c6e061772e32718825b5b3d3af616046\" for container &ContainerMetadata{Name:kindnet-cni,Attempt:1,}"
	Jun 30 21:03:30 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:03:30.529916350Z" level=info msg="CreateContainer within sandbox \"b15f9ad19c2f6c96abd88ffd829a0f93c6e061772e32718825b5b3d3af616046\" for &ContainerMetadata{Name:kindnet-cni,Attempt:1,} returns container id \"5dc3e41a57454c30adbf0679811124e6cc2011e688038f983b2fe03abac5041e\""
	Jun 30 21:03:30 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:03:30.530598131Z" level=info msg="StartContainer for \"5dc3e41a57454c30adbf0679811124e6cc2011e688038f983b2fe03abac5041e\""
	Jun 30 21:03:30 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:03:30.640643843Z" level=info msg="StartContainer for \"5dc3e41a57454c30adbf0679811124e6cc2011e688038f983b2fe03abac5041e\" returns successfully"
	
	* 
	* ==> describe nodes <==
	* Name:               old-k8s-version-20220630210005-9950
	Roles:              master
	Labels:             beta.kubernetes.io/arch=amd64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=amd64
	                    kubernetes.io/hostname=old-k8s-version-20220630210005-9950
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=251ffcec0e4c997cd7732864187747cc579943c9
	                    minikube.k8s.io/name=old-k8s-version-20220630210005-9950
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2022_06_30T21_00_30_0700
	                    minikube.k8s.io/version=v1.26.0
	                    node-role.kubernetes.io/master=
	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: /run/containerd/containerd.sock
	                    node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Thu, 30 Jun 2022 21:00:25 +0000
	Taints:             node.kubernetes.io/not-ready:NoSchedule
	Unschedulable:      false
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Thu, 30 Jun 2022 21:03:55 +0000   Thu, 30 Jun 2022 21:00:21 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Thu, 30 Jun 2022 21:03:55 +0000   Thu, 30 Jun 2022 21:00:21 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Thu, 30 Jun 2022 21:03:55 +0000   Thu, 30 Jun 2022 21:00:21 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            False   Thu, 30 Jun 2022 21:03:55 +0000   Thu, 30 Jun 2022 21:00:21 +0000   KubeletNotReady              runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Addresses:
	  InternalIP:  192.168.67.2
	  Hostname:    old-k8s-version-20220630210005-9950
	Capacity:
	 cpu:                8
	 ephemeral-storage:  304695084Ki
	 hugepages-1Gi:      0
	 hugepages-2Mi:      0
	 memory:             32873488Ki
	 pods:               110
	Allocatable:
	 cpu:                8
	 ephemeral-storage:  304695084Ki
	 hugepages-1Gi:      0
	 hugepages-2Mi:      0
	 memory:             32873488Ki
	 pods:               110
	System Info:
	 Machine ID:                 bbe1e1cef6e940328962dca52b3c5731
	 System UUID:                2ca00556-ba1f-4dc3-b97e-bb738f788e2a
	 Boot ID:                    471c4729-f046-4a15-bc49-46f3ad561708
	 Kernel Version:             5.15.0-1012-gcp
	 OS Image:                   Ubuntu 20.04.4 LTS
	 Operating System:           linux
	 Architecture:               amd64
	 Container Runtime Version:  containerd://1.6.6
	 Kubelet Version:            v1.16.0
	 Kube-Proxy Version:         v1.16.0
	PodCIDR:                     10.244.0.0/24
	PodCIDRs:                    10.244.0.0/24
	Non-terminated Pods:         (6 in total)
	  Namespace                  Name                                                           CPU Requests  CPU Limits  Memory Requests  Memory Limits  AGE
	  ---------                  ----                                                           ------------  ----------  ---------------  -------------  ---
	  kube-system                etcd-old-k8s-version-20220630210005-9950                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m9s
	  kube-system                kindnet-4gs84                                                  100m (1%!)(MISSING)     100m (1%!)(MISSING)   50Mi (0%!)(MISSING)        50Mi (0%!)(MISSING)      4m2s
	  kube-system                kube-apiserver-old-k8s-version-20220630210005-9950             250m (3%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m59s
	  kube-system                kube-controller-manager-old-k8s-version-20220630210005-9950    200m (2%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m5s
	  kube-system                kube-proxy-twls5                                               0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m2s
	  kube-system                kube-scheduler-old-k8s-version-20220630210005-9950             100m (1%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m16s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests   Limits
	  --------           --------   ------
	  cpu                650m (8%!)(MISSING)  100m (1%!)(MISSING)
	  memory             50Mi (0%!)(MISSING)  50Mi (0%!)(MISSING)
	  ephemeral-storage  0 (0%!)(MISSING)     0 (0%!)(MISSING)
	Events:
	  Type    Reason                   Age                    From                                             Message
	  ----    ------                   ----                   ----                                             -------
	  Normal  Starting                 4m26s                  kubelet, old-k8s-version-20220630210005-9950     Starting kubelet.
	  Normal  NodeHasSufficientMemory  4m26s (x8 over 4m26s)  kubelet, old-k8s-version-20220630210005-9950     Node old-k8s-version-20220630210005-9950 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    4m26s (x8 over 4m26s)  kubelet, old-k8s-version-20220630210005-9950     Node old-k8s-version-20220630210005-9950 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     4m26s (x7 over 4m26s)  kubelet, old-k8s-version-20220630210005-9950     Node old-k8s-version-20220630210005-9950 status is now: NodeHasSufficientPID
	  Normal  NodeAllocatableEnforced  4m26s                  kubelet, old-k8s-version-20220630210005-9950     Updated Node Allocatable limit across pods
	  Normal  Starting                 4m1s                   kube-proxy, old-k8s-version-20220630210005-9950  Starting kube-proxy.
	
	* 
	* ==> dmesg <==
	* [  +2.947791] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.019829] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.027909] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000007] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[ +35.115095] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000007] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.005457] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.023907] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000007] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +2.967767] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[Jun30 21:04] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000007] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.023896] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +2.939825] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000011] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.027789] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.019913] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[ +21.968090] IPv4: martian destination 127.0.0.11 from 10.244.0.3, dev veth8071d138
	
	* 
	* ==> etcd [f60b30d7e822cbe35e12b31f9d3517de2de1004b26577e8f27750257f416aae1] <==
	* 2022-06-30 21:00:21.133717 I | etcdserver: initial cluster = old-k8s-version-20220630210005-9950=https://192.168.67.2:2380
	2022-06-30 21:00:21.137233 I | etcdserver: starting member 8688e899f7831fc7 in cluster 9d8fdeb88b6def78
	2022-06-30 21:00:21.137270 I | raft: 8688e899f7831fc7 became follower at term 0
	2022-06-30 21:00:21.137280 I | raft: newRaft 8688e899f7831fc7 [peers: [], term: 0, commit: 0, applied: 0, lastindex: 0, lastterm: 0]
	2022-06-30 21:00:21.137285 I | raft: 8688e899f7831fc7 became follower at term 1
	2022-06-30 21:00:21.142437 W | auth: simple token is not cryptographically signed
	2022-06-30 21:00:21.146144 I | etcdserver: starting server... [version: 3.3.15, cluster version: to_be_decided]
	2022-06-30 21:00:21.146596 I | etcdserver: 8688e899f7831fc7 as single-node; fast-forwarding 9 ticks (election ticks 10)
	2022-06-30 21:00:21.146824 I | etcdserver/membership: added member 8688e899f7831fc7 [https://192.168.67.2:2380] to cluster 9d8fdeb88b6def78
	2022-06-30 21:00:21.148068 I | embed: ClientTLS: cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, ca = , trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = 
	2022-06-30 21:00:21.148212 I | embed: listening for metrics on http://192.168.67.2:2381
	2022-06-30 21:00:21.148326 I | embed: listening for metrics on http://127.0.0.1:2381
	2022-06-30 21:00:22.037647 I | raft: 8688e899f7831fc7 is starting a new election at term 1
	2022-06-30 21:00:22.037692 I | raft: 8688e899f7831fc7 became candidate at term 2
	2022-06-30 21:00:22.037716 I | raft: 8688e899f7831fc7 received MsgVoteResp from 8688e899f7831fc7 at term 2
	2022-06-30 21:00:22.037741 I | raft: 8688e899f7831fc7 became leader at term 2
	2022-06-30 21:00:22.037750 I | raft: raft.node: 8688e899f7831fc7 elected leader 8688e899f7831fc7 at term 2
	2022-06-30 21:00:22.038107 I | etcdserver: published {Name:old-k8s-version-20220630210005-9950 ClientURLs:[https://192.168.67.2:2379]} to cluster 9d8fdeb88b6def78
	2022-06-30 21:00:22.038200 I | embed: ready to serve client requests
	2022-06-30 21:00:22.038309 I | embed: ready to serve client requests
	2022-06-30 21:00:22.039774 I | embed: serving client requests on 127.0.0.1:2379
	2022-06-30 21:00:22.040324 I | embed: serving client requests on 192.168.67.2:2379
	2022-06-30 21:00:22.065264 I | etcdserver: setting up the initial cluster version to 3.3
	2022-06-30 21:00:22.075609 N | etcdserver/membership: set the initial cluster version to 3.3
	2022-06-30 21:00:22.075977 I | etcdserver/api: enabled capabilities for version 3.3
	
	* 
	* ==> kernel <==
	*  21:04:46 up 47 min,  0 users,  load average: 2.00, 2.04, 2.13
	Linux old-k8s-version-20220630210005-9950 5.15.0-1012-gcp #17~20.04.1-Ubuntu SMP Thu Jun 23 16:10:34 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
	PRETTY_NAME="Ubuntu 20.04.4 LTS"
	
	* 
	* ==> kube-apiserver [998b774f4f284a1fcf3dbd179faaa8c69e39ab084d30662575ac04f0146604f3] <==
	* I0630 21:00:24.949248       1 nonstructuralschema_controller.go:191] Starting NonStructuralSchemaConditionController
	I0630 21:00:24.949265       1 apiapproval_controller.go:185] Starting KubernetesAPIApprovalPolicyConformantConditionController
	I0630 21:00:24.948849       1 controller.go:81] Starting OpenAPI AggregationController
	E0630 21:00:24.950202       1 controller.go:154] Unable to remove old endpoints from kubernetes service: StorageError: key not found, Code: 1, Key: /registry/masterleases/192.168.67.2, ResourceVersion: 0, AdditionalErrorMsg: 
	I0630 21:00:25.049002       1 cache.go:39] Caches are synced for AvailableConditionController controller
	I0630 21:00:25.049043       1 cache.go:39] Caches are synced for APIServiceRegistrationController controller
	I0630 21:00:25.049119       1 shared_informer.go:204] Caches are synced for crd-autoregister 
	I0630 21:00:25.049016       1 cache.go:39] Caches are synced for autoregister controller
	I0630 21:00:25.948863       1 controller.go:107] OpenAPI AggregationController: Processing item 
	I0630 21:00:25.948905       1 controller.go:130] OpenAPI AggregationController: action for item : Nothing (removed from the queue).
	I0630 21:00:25.948917       1 controller.go:130] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).
	I0630 21:00:25.952956       1 storage_scheduling.go:139] created PriorityClass system-node-critical with value 2000001000
	I0630 21:00:25.956204       1 storage_scheduling.go:139] created PriorityClass system-cluster-critical with value 2000000000
	I0630 21:00:25.956228       1 storage_scheduling.go:148] all system priority classes are created successfully or already exist.
	I0630 21:00:26.733262       1 controller.go:606] quota admission added evaluator for: leases.coordination.k8s.io
	I0630 21:00:27.730109       1 controller.go:606] quota admission added evaluator for: roles.rbac.authorization.k8s.io
	I0630 21:00:28.010061       1 controller.go:606] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
	W0630 21:00:28.355670       1 lease.go:222] Resetting endpoints for master service "kubernetes" to [192.168.67.2]
	I0630 21:00:28.356311       1 controller.go:606] quota admission added evaluator for: endpoints
	I0630 21:00:29.247950       1 controller.go:606] quota admission added evaluator for: serviceaccounts
	I0630 21:00:29.559245       1 controller.go:606] quota admission added evaluator for: deployments.apps
	I0630 21:00:29.917364       1 controller.go:606] quota admission added evaluator for: daemonsets.apps
	I0630 21:00:44.554471       1 controller.go:606] quota admission added evaluator for: controllerrevisions.apps
	I0630 21:00:44.569493       1 controller.go:606] quota admission added evaluator for: events.events.k8s.io
	I0630 21:00:44.669578       1 controller.go:606] quota admission added evaluator for: replicasets.apps
	
	* 
	* ==> kube-controller-manager [b8604fd1030fac170f4591063a20f1abfb86602e188695c1be545614d1b4e8a0] <==
	* I0630 21:00:44.503669       1 shared_informer.go:197] Waiting for caches to sync for cidrallocator
	I0630 21:00:44.505172       1 shared_informer.go:204] Caches are synced for TTL 
	I0630 21:00:44.522066       1 shared_informer.go:204] Caches are synced for persistent volume 
	I0630 21:00:44.527506       1 shared_informer.go:204] Caches are synced for attach detach 
	I0630 21:00:44.546533       1 shared_informer.go:204] Caches are synced for daemon sets 
	I0630 21:00:44.563035       1 event.go:255] Event(v1.ObjectReference{Kind:"DaemonSet", Namespace:"kube-system", Name:"kube-proxy", UID:"4dfe461e-1e01-4e37-b387-4caf9b091e6e", APIVersion:"apps/v1", ResourceVersion:"204", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: kube-proxy-twls5
	I0630 21:00:44.565383       1 event.go:255] Event(v1.ObjectReference{Kind:"DaemonSet", Namespace:"kube-system", Name:"kindnet", UID:"4d27e7c9-7dc6-4d5f-bacf-6fc3835a67e6", APIVersion:"apps/v1", ResourceVersion:"212", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: kindnet-4gs84
	I0630 21:00:44.623202       1 shared_informer.go:204] Caches are synced for cidrallocator 
	I0630 21:00:44.629310       1 range_allocator.go:359] Set node old-k8s-version-20220630210005-9950 PodCIDR to [10.244.0.0/24]
	I0630 21:00:44.667272       1 shared_informer.go:204] Caches are synced for deployment 
	I0630 21:00:44.672031       1 event.go:255] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"kube-system", Name:"coredns", UID:"4670cf8e-481a-421e-a11d-7ec907e8c283", APIVersion:"apps/v1", ResourceVersion:"348", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled up replica set coredns-5644d7b6d9 to 1
	I0630 21:00:44.676702       1 event.go:255] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kube-system", Name:"coredns-5644d7b6d9", UID:"40553f62-8c8a-4503-b0fb-c4c0a693baf1", APIVersion:"apps/v1", ResourceVersion:"351", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: coredns-5644d7b6d9-dw8lr
	I0630 21:00:44.680500       1 shared_informer.go:204] Caches are synced for taint 
	I0630 21:00:44.680614       1 node_lifecycle_controller.go:1208] Initializing eviction metric for zone: 
	W0630 21:00:44.680718       1 node_lifecycle_controller.go:903] Missing timestamp for Node old-k8s-version-20220630210005-9950. Assuming now as a timestamp.
	I0630 21:00:44.680771       1 node_lifecycle_controller.go:1058] Controller detected that all Nodes are not-Ready. Entering master disruption mode.
	I0630 21:00:44.680817       1 event.go:255] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"old-k8s-version-20220630210005-9950", UID:"4800bcdf-0e4c-4b5c-b919-e996b18087ab", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'RegisteredNode' Node old-k8s-version-20220630210005-9950 event: Registered Node old-k8s-version-20220630210005-9950 in Controller
	I0630 21:00:44.680849       1 taint_manager.go:186] Starting NoExecuteTaintManager
	I0630 21:00:44.755613       1 shared_informer.go:204] Caches are synced for disruption 
	I0630 21:00:44.755650       1 disruption.go:341] Sending events to api server.
	I0630 21:00:44.955933       1 shared_informer.go:204] Caches are synced for resource quota 
	I0630 21:00:44.957188       1 shared_informer.go:204] Caches are synced for garbage collector 
	I0630 21:00:44.960086       1 shared_informer.go:204] Caches are synced for resource quota 
	I0630 21:00:44.960086       1 shared_informer.go:204] Caches are synced for garbage collector 
	I0630 21:00:44.960164       1 garbagecollector.go:139] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
	
	* 
	* ==> kube-proxy [27b91b4e1595400f52e6c0fd5fb8e3732c524b9757a79a5a9108333797eb3788] <==
	* W0630 21:00:45.177711       1 server_others.go:329] Flag proxy-mode="" unknown, assuming iptables proxy
	I0630 21:00:45.186039       1 node.go:135] Successfully retrieved node IP: 192.168.67.2
	I0630 21:00:45.186134       1 server_others.go:149] Using iptables Proxier.
	I0630 21:00:45.188027       1 server.go:529] Version: v1.16.0
	I0630 21:00:45.188832       1 config.go:131] Starting endpoints config controller
	I0630 21:00:45.188867       1 shared_informer.go:197] Waiting for caches to sync for endpoints config
	I0630 21:00:45.188954       1 config.go:313] Starting service config controller
	I0630 21:00:45.188977       1 shared_informer.go:197] Waiting for caches to sync for service config
	I0630 21:00:45.323127       1 shared_informer.go:204] Caches are synced for endpoints config 
	I0630 21:00:45.323142       1 shared_informer.go:204] Caches are synced for service config 
	
	* 
	* ==> kube-scheduler [fa267cd65f4eefef8993b275f8625ee5daf30304f18337e27a9944d1b5f03a02] <==
	* W0630 21:00:25.044088       1 authentication.go:79] Authentication is disabled
	I0630 21:00:25.044103       1 deprecated_insecure_serving.go:51] Serving healthz insecurely on [::]:10251
	I0630 21:00:25.045554       1 secure_serving.go:123] Serving securely on 127.0.0.1:10259
	E0630 21:00:25.131167       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E0630 21:00:25.132503       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E0630 21:00:25.133014       1 reflector.go:123] k8s.io/kubernetes/cmd/kube-scheduler/app/server.go:236: Failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E0630 21:00:25.134979       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E0630 21:00:25.135062       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	E0630 21:00:25.135104       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	E0630 21:00:25.135146       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0630 21:00:25.135256       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	E0630 21:00:25.135513       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	E0630 21:00:25.137975       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1beta1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E0630 21:00:25.225117       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	E0630 21:00:26.132387       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E0630 21:00:26.133463       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E0630 21:00:26.135507       1 reflector.go:123] k8s.io/kubernetes/cmd/kube-scheduler/app/server.go:236: Failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E0630 21:00:26.136422       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E0630 21:00:26.139047       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	E0630 21:00:26.141958       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1beta1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E0630 21:00:26.142771       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	E0630 21:00:26.144164       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0630 21:00:26.145881       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	E0630 21:00:26.146811       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	E0630 21:00:26.226419       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	
	* 
	* ==> kubelet <==
	* -- Logs begin at Thu 2022-06-30 21:00:14 UTC, end at Thu 2022-06-30 21:04:46 UTC. --
	Jun 30 21:02:45 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:02:45.248119     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:02:50 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:02:50.248961     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:02:55 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:02:55.249845     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:03:00 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:03:00.250746     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:03:05 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:03:05.251593     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:03:10 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:03:10.252413     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:03:15 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:03:15.253545     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:03:20 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:03:20.254949     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:03:25 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:03:25.255757     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:03:30 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:03:30.256627     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:03:35 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:03:35.257524     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:03:40 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:03:40.258536     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:03:45 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:03:45.259303     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:03:50 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:03:50.260139     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:03:55 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:03:55.261020     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:04:00 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:04:00.261855     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:04:05 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:04:05.262766     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:04:10 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:04:10.263664     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:04:15 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:04:15.264436     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:04:20 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:04:20.265318     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:04:25 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:04:25.266174     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:04:30 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:04:30.266917     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:04:35 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:04:35.267717     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:04:40 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:04:40.268485     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:04:45 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:04:45.269344     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	

                                                
                                                
-- /stdout --
helpers_test.go:254: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p old-k8s-version-20220630210005-9950 -n old-k8s-version-20220630210005-9950
helpers_test.go:261: (dbg) Run:  kubectl --context old-k8s-version-20220630210005-9950 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:270: non-running pods: coredns-5644d7b6d9-dw8lr storage-provisioner
helpers_test.go:272: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/FirstStart]: describe non-running pods <======
helpers_test.go:275: (dbg) Run:  kubectl --context old-k8s-version-20220630210005-9950 describe pod coredns-5644d7b6d9-dw8lr storage-provisioner
helpers_test.go:275: (dbg) Non-zero exit: kubectl --context old-k8s-version-20220630210005-9950 describe pod coredns-5644d7b6d9-dw8lr storage-provisioner: exit status 1 (53.654721ms)

                                                
                                                
** stderr ** 
	Error from server (NotFound): pods "coredns-5644d7b6d9-dw8lr" not found
	Error from server (NotFound): pods "storage-provisioner" not found

                                                
                                                
** /stderr **
helpers_test.go:277: kubectl --context old-k8s-version-20220630210005-9950 describe pod coredns-5644d7b6d9-dw8lr storage-provisioner: exit status 1
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (281.95s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/DNS (298.01s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/DNS
net_test.go:169: (dbg) Run:  kubectl --context enable-default-cni-20220630204858-9950 exec deployment/netcat -- nslookup kubernetes.default

                                                
                                                
=== CONT  TestNetworkPlugins/group/enable-default-cni/DNS
net_test.go:169: (dbg) Non-zero exit: kubectl --context enable-default-cni-20220630204858-9950 exec deployment/netcat -- nslookup kubernetes.default: exit status 1 (15.146148648s)

                                                
                                                
-- stdout --
	;; connection timed out; no servers could be reached
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	command terminated with exit code 1

                                                
                                                
** /stderr **
E0630 21:00:27.129755    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/cilium-20220630204859-9950/client.crt: no such file or directory
net_test.go:169: (dbg) Run:  kubectl --context enable-default-cni-20220630204858-9950 exec deployment/netcat -- nslookup kubernetes.default

                                                
                                                
=== CONT  TestNetworkPlugins/group/enable-default-cni/DNS
net_test.go:169: (dbg) Non-zero exit: kubectl --context enable-default-cni-20220630204858-9950 exec deployment/netcat -- nslookup kubernetes.default: exit status 1 (15.140864832s)

                                                
                                                
-- stdout --
	;; connection timed out; no servers could be reached
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	command terminated with exit code 1

                                                
                                                
** /stderr **
net_test.go:169: (dbg) Run:  kubectl --context enable-default-cni-20220630204858-9950 exec deployment/netcat -- nslookup kubernetes.default
E0630 21:00:46.331986    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/cilium-20220630204859-9950/client.crt: no such file or directory
E0630 21:00:47.269093    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/ingress-addon-legacy-20220630202923-9950/client.crt: no such file or directory
net_test.go:169: (dbg) Non-zero exit: kubectl --context enable-default-cni-20220630204858-9950 exec deployment/netcat -- nslookup kubernetes.default: exit status 1 (15.123146269s)

                                                
                                                
-- stdout --
	;; connection timed out; no servers could be reached
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	command terminated with exit code 1

                                                
                                                
** /stderr **
E0630 21:00:59.729213    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/auto-20220630204858-9950/client.crt: no such file or directory
net_test.go:169: (dbg) Run:  kubectl --context enable-default-cni-20220630204858-9950 exec deployment/netcat -- nslookup kubernetes.default
E0630 21:01:03.364318    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/kindnet-20220630204858-9950/client.crt: no such file or directory

                                                
                                                
=== CONT  TestNetworkPlugins/group/enable-default-cni/DNS
net_test.go:169: (dbg) Non-zero exit: kubectl --context enable-default-cni-20220630204858-9950 exec deployment/netcat -- nslookup kubernetes.default: exit status 1 (15.127338723s)

                                                
                                                
-- stdout --
	;; connection timed out; no servers could be reached
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	command terminated with exit code 1

                                                
                                                
** /stderr **

                                                
                                                
=== CONT  TestNetworkPlugins/group/enable-default-cni/DNS
net_test.go:169: (dbg) Run:  kubectl --context enable-default-cni-20220630204858-9950 exec deployment/netcat -- nslookup kubernetes.default
net_test.go:169: (dbg) Non-zero exit: kubectl --context enable-default-cni-20220630204858-9950 exec deployment/netcat -- nslookup kubernetes.default: exit status 1 (15.129989005s)

                                                
                                                
-- stdout --
	;; connection timed out; no servers could be reached
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	command terminated with exit code 1

                                                
                                                
** /stderr **
net_test.go:169: (dbg) Run:  kubectl --context enable-default-cni-20220630204858-9950 exec deployment/netcat -- nslookup kubernetes.default
E0630 21:01:47.773921    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/cilium-20220630204859-9950/client.crt: no such file or directory
E0630 21:01:53.252611    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/addons-20220630202117-9950/client.crt: no such file or directory
net_test.go:169: (dbg) Non-zero exit: kubectl --context enable-default-cni-20220630204858-9950 exec deployment/netcat -- nslookup kubernetes.default: exit status 1 (15.129047138s)

                                                
                                                
-- stdout --
	;; connection timed out; no servers could be reached
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	command terminated with exit code 1

                                                
                                                
** /stderr **
net_test.go:169: (dbg) Run:  kubectl --context enable-default-cni-20220630204858-9950 exec deployment/netcat -- nslookup kubernetes.default

                                                
                                                
=== CONT  TestNetworkPlugins/group/enable-default-cni/DNS
net_test.go:169: (dbg) Non-zero exit: kubectl --context enable-default-cni-20220630204858-9950 exec deployment/netcat -- nslookup kubernetes.default: exit status 1 (15.119862526s)

                                                
                                                
-- stdout --
	;; connection timed out; no servers could be reached
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	command terminated with exit code 1

                                                
                                                
** /stderr **
E0630 21:02:21.650181    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/auto-20220630204858-9950/client.crt: no such file or directory
E0630 21:02:25.285452    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/kindnet-20220630204858-9950/client.crt: no such file or directory
net_test.go:169: (dbg) Run:  kubectl --context enable-default-cni-20220630204858-9950 exec deployment/netcat -- nslookup kubernetes.default

                                                
                                                
=== CONT  TestNetworkPlugins/group/enable-default-cni/DNS
net_test.go:169: (dbg) Non-zero exit: kubectl --context enable-default-cni-20220630204858-9950 exec deployment/netcat -- nslookup kubernetes.default: exit status 1 (15.132147217s)

                                                
                                                
-- stdout --
	;; connection timed out; no servers could be reached
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	command terminated with exit code 1

                                                
                                                
** /stderr **
net_test.go:169: (dbg) Run:  kubectl --context enable-default-cni-20220630204858-9950 exec deployment/netcat -- nslookup kubernetes.default
E0630 21:03:09.694143    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/cilium-20220630204859-9950/client.crt: no such file or directory
net_test.go:169: (dbg) Non-zero exit: kubectl --context enable-default-cni-20220630204858-9950 exec deployment/netcat -- nslookup kubernetes.default: exit status 1 (15.124197695s)

                                                
                                                
-- stdout --
	;; connection timed out; no servers could be reached
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	command terminated with exit code 1

                                                
                                                
** /stderr **

                                                
                                                
=== CONT  TestNetworkPlugins/group/enable-default-cni/DNS
net_test.go:169: (dbg) Run:  kubectl --context enable-default-cni-20220630204858-9950 exec deployment/netcat -- nslookup kubernetes.default

                                                
                                                
=== CONT  TestNetworkPlugins/group/enable-default-cni/DNS
net_test.go:169: (dbg) Non-zero exit: kubectl --context enable-default-cni-20220630204858-9950 exec deployment/netcat -- nslookup kubernetes.default: exit status 1 (15.12826604s)

                                                
                                                
-- stdout --
	;; connection timed out; no servers could be reached
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	command terminated with exit code 1

                                                
                                                
** /stderr **
E0630 21:04:37.807320    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/auto-20220630204858-9950/client.crt: no such file or directory
E0630 21:04:41.441023    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/kindnet-20220630204858-9950/client.crt: no such file or directory

                                                
                                                
=== CONT  TestNetworkPlugins/group/enable-default-cni/DNS
net_test.go:169: (dbg) Run:  kubectl --context enable-default-cni-20220630204858-9950 exec deployment/netcat -- nslookup kubernetes.default
E0630 21:05:05.490543    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/auto-20220630204858-9950/client.crt: no such file or directory
E0630 21:05:09.126191    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/kindnet-20220630204858-9950/client.crt: no such file or directory
net_test.go:169: (dbg) Non-zero exit: kubectl --context enable-default-cni-20220630204858-9950 exec deployment/netcat -- nslookup kubernetes.default: exit status 1 (15.122408089s)

                                                
                                                
-- stdout --
	;; connection timed out; no servers could be reached
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	command terminated with exit code 1

                                                
                                                
** /stderr **
net_test.go:175: failed to do nslookup on kubernetes.default: exit status 1
net_test.go:180: failed nslookup: got=";; connection timed out; no servers could be reached\n\n\n", want=*"10.96.0.1"*
--- FAIL: TestNetworkPlugins/group/enable-default-cni/DNS (298.01s)
E0630 21:09:37.806638    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/auto-20220630204858-9950/client.crt: no such file or directory
E0630 21:09:41.440984    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/kindnet-20220630204858-9950/client.crt: no such file or directory
E0630 21:10:01.427627    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/enable-default-cni-20220630204858-9950/client.crt: no such file or directory
E0630 21:10:01.432929    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/enable-default-cni-20220630204858-9950/client.crt: no such file or directory
E0630 21:10:01.443284    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/enable-default-cni-20220630204858-9950/client.crt: no such file or directory
E0630 21:10:01.463575    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/enable-default-cni-20220630204858-9950/client.crt: no such file or directory
E0630 21:10:01.504024    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/enable-default-cni-20220630204858-9950/client.crt: no such file or directory
E0630 21:10:01.584940    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/enable-default-cni-20220630204858-9950/client.crt: no such file or directory
E0630 21:10:01.745407    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/enable-default-cni-20220630204858-9950/client.crt: no such file or directory
E0630 21:10:02.066010    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/enable-default-cni-20220630204858-9950/client.crt: no such file or directory
E0630 21:10:02.706847    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/enable-default-cni-20220630204858-9950/client.crt: no such file or directory
E0630 21:10:03.988006    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/enable-default-cni-20220630204858-9950/client.crt: no such file or directory
E0630 21:10:06.548665    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/enable-default-cni-20220630204858-9950/client.crt: no such file or directory
E0630 21:10:11.669622    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/enable-default-cni-20220630204858-9950/client.crt: no such file or directory
E0630 21:10:21.909894    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/enable-default-cni-20220630204858-9950/client.crt: no such file or directory
E0630 21:10:25.850506    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/cilium-20220630204859-9950/client.crt: no such file or directory
E0630 21:10:42.390247    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/enable-default-cni-20220630204858-9950/client.crt: no such file or directory
E0630 21:10:47.269182    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/ingress-addon-legacy-20220630202923-9950/client.crt: no such file or directory
E0630 21:11:23.351134    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/enable-default-cni-20220630204858-9950/client.crt: no such file or directory
E0630 21:11:27.108679    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/bridge-20220630204858-9950/client.crt: no such file or directory

                                                
                                    
x
+
TestStartStop/group/default-k8s-different-port/serial/FirstStart (290.16s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-different-port/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-amd64 start -p default-k8s-different-port-20220630210335-9950 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.24.2

                                                
                                                
=== CONT  TestStartStop/group/default-k8s-different-port/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p default-k8s-different-port-20220630210335-9950 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.24.2: exit status 80 (4m48.064952757s)

                                                
                                                
-- stdout --
	* [default-k8s-different-port-20220630210335-9950] minikube v1.26.0 on Ubuntu 20.04 (kvm/amd64)
	  - MINIKUBE_LOCATION=14420
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-amd64
	* Using the docker driver based on user configuration
	* Using Docker driver with root privileges
	* Starting control plane node default-k8s-different-port-20220630210335-9950 in cluster default-k8s-different-port-20220630210335-9950
	* Pulling base image ...
	* Creating docker container (CPUs=2, Memory=2200MB) ...
	* Preparing Kubernetes v1.24.2 on containerd 1.6.6 ...
	  - Generating certificates and keys ...
	  - Booting up control plane ...
	  - Configuring RBAC rules ...
	* Configuring CNI (Container Networking Interface) ...
	* Verifying Kubernetes components...
	  - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	* Enabled addons: storage-provisioner, default-storageclass
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0630 21:03:35.070697  242039 out.go:296] Setting OutFile to fd 1 ...
	I0630 21:03:35.070850  242039 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 21:03:35.070862  242039 out.go:309] Setting ErrFile to fd 2...
	I0630 21:03:35.070869  242039 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 21:03:35.071292  242039 root.go:329] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/bin
	I0630 21:03:35.071606  242039 out.go:303] Setting JSON to false
	I0630 21:03:35.072976  242039 start.go:115] hostinfo: {"hostname":"ubuntu-20-agent-8","uptime":2767,"bootTime":1656620248,"procs":368,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1012-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0630 21:03:35.073077  242039 start.go:125] virtualization: kvm guest
	I0630 21:03:35.075943  242039 out.go:177] * [default-k8s-different-port-20220630210335-9950] minikube v1.26.0 on Ubuntu 20.04 (kvm/amd64)
	I0630 21:03:35.077459  242039 out.go:177]   - MINIKUBE_LOCATION=14420
	I0630 21:03:35.077477  242039 notify.go:193] Checking for updates...
	I0630 21:03:35.078954  242039 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0630 21:03:35.080479  242039 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:03:35.081950  242039 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube
	I0630 21:03:35.083419  242039 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0630 21:03:35.085354  242039 config.go:178] Loaded profile config "enable-default-cni-20220630204858-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:03:35.085450  242039 config.go:178] Loaded profile config "no-preload-20220630210237-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:03:35.085536  242039 config.go:178] Loaded profile config "old-k8s-version-20220630210005-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.16.0
	I0630 21:03:35.085574  242039 driver.go:360] Setting default libvirt URI to qemu:///system
	I0630 21:03:35.130918  242039 docker.go:137] docker version: linux-20.10.17
	I0630 21:03:35.131026  242039 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0630 21:03:35.246031  242039 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:3 ContainersPaused:0 ContainersStopped:0 Images:8 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:48 OomKillDisable:true NGoroutines:49 SystemTime:2022-06-30 21:03:35.163508342 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1012-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexServ
erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662451712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-8 Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Client
Info:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
	I0630 21:03:35.246153  242039 docker.go:254] overlay module found
	I0630 21:03:35.248659  242039 out.go:177] * Using the docker driver based on user configuration
	I0630 21:03:35.250434  242039 start.go:284] selected driver: docker
	I0630 21:03:35.250455  242039 start.go:808] validating driver "docker" against <nil>
	I0630 21:03:35.250482  242039 start.go:819] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0630 21:03:35.251412  242039 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0630 21:03:35.367435  242039 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:3 ContainersPaused:0 ContainersStopped:0 Images:8 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:48 OomKillDisable:true NGoroutines:49 SystemTime:2022-06-30 21:03:35.284499086 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1012-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexServ
erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662451712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-8 Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Client
Info:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
	I0630 21:03:35.367586  242039 start_flags.go:296] no existing cluster config was found, will generate one from the flags 
	I0630 21:03:35.367736  242039 start_flags.go:853] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0630 21:03:35.370295  242039 out.go:177] * Using Docker driver with root privileges
	I0630 21:03:35.371835  242039 cni.go:95] Creating CNI manager for ""
	I0630 21:03:35.371875  242039 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:03:35.371897  242039 start_flags.go:305] Found "CNI" CNI - setting NetworkPlugin=cni
	I0630 21:03:35.371914  242039 start_flags.go:310] config:
	{Name:default-k8s-different-port-20220630210335-9950 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:default-k8s-different-port-20220630210335-9950 Namespace:default APIServerName:minikubeCA APIServerNames:[]
APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8444 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 21:03:35.373710  242039 out.go:177] * Starting control plane node default-k8s-different-port-20220630210335-9950 in cluster default-k8s-different-port-20220630210335-9950
	I0630 21:03:35.375101  242039 cache.go:120] Beginning downloading kic base image for docker with containerd
	I0630 21:03:35.376563  242039 out.go:177] * Pulling base image ...
	I0630 21:03:35.377817  242039 preload.go:132] Checking if preload exists for k8s version v1.24.2 and runtime containerd
	I0630 21:03:35.377850  242039 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e in local docker daemon
	I0630 21:03:35.377868  242039 preload.go:148] Found local preload: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-containerd-overlay2-amd64.tar.lz4
	I0630 21:03:35.377878  242039 cache.go:57] Caching tarball of preloaded images
	I0630 21:03:35.378184  242039 preload.go:174] Found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-containerd-overlay2-amd64.tar.lz4 in cache, skipping download
	I0630 21:03:35.378214  242039 cache.go:60] Finished verifying existence of preloaded tar for  v1.24.2 on containerd
	I0630 21:03:35.378357  242039 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950/config.json ...
	I0630 21:03:35.378383  242039 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950/config.json: {Name:mk6b4bf5152e2fa0d5565f9690714d64cf134ec8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:03:35.416004  242039 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e in local docker daemon, skipping pull
	I0630 21:03:35.416032  242039 cache.go:142] gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e exists in daemon, skipping load
	I0630 21:03:35.416049  242039 cache.go:208] Successfully downloaded all kic artifacts
	I0630 21:03:35.416095  242039 start.go:352] acquiring machines lock for default-k8s-different-port-20220630210335-9950: {Name:mkd6267dded0280a468a53ba1411e87336e1a91d Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0630 21:03:35.416256  242039 start.go:356] acquired machines lock for "default-k8s-different-port-20220630210335-9950" in 138.333µs
	I0630 21:03:35.416289  242039 start.go:91] Provisioning new machine with config: &{Name:default-k8s-different-port-20220630210335-9950 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:default-k8s-different-por
t-20220630210335-9950 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8444 NodeName:} Nodes:[{Name: IP: Port:8444 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:
0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:} &{Name: IP: Port:8444 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0630 21:03:35.416393  242039 start.go:131] createHost starting for "" (driver="docker")
	I0630 21:03:35.418860  242039 out.go:204] * Creating docker container (CPUs=2, Memory=2200MB) ...
	I0630 21:03:35.419094  242039 start.go:165] libmachine.API.Create for "default-k8s-different-port-20220630210335-9950" (driver="docker")
	I0630 21:03:35.419123  242039 client.go:168] LocalClient.Create starting
	I0630 21:03:35.419197  242039 main.go:134] libmachine: Reading certificate data from /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem
	I0630 21:03:35.419231  242039 main.go:134] libmachine: Decoding PEM data...
	I0630 21:03:35.419248  242039 main.go:134] libmachine: Parsing certificate...
	I0630 21:03:35.419300  242039 main.go:134] libmachine: Reading certificate data from /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem
	I0630 21:03:35.419319  242039 main.go:134] libmachine: Decoding PEM data...
	I0630 21:03:35.419328  242039 main.go:134] libmachine: Parsing certificate...
	I0630 21:03:35.419633  242039 cli_runner.go:164] Run: docker network inspect default-k8s-different-port-20220630210335-9950 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	W0630 21:03:35.456448  242039 cli_runner.go:211] docker network inspect default-k8s-different-port-20220630210335-9950 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
	I0630 21:03:35.456533  242039 network_create.go:272] running [docker network inspect default-k8s-different-port-20220630210335-9950] to gather additional debugging logs...
	I0630 21:03:35.456562  242039 cli_runner.go:164] Run: docker network inspect default-k8s-different-port-20220630210335-9950
	W0630 21:03:35.491894  242039 cli_runner.go:211] docker network inspect default-k8s-different-port-20220630210335-9950 returned with exit code 1
	I0630 21:03:35.491928  242039 network_create.go:275] error running [docker network inspect default-k8s-different-port-20220630210335-9950]: docker network inspect default-k8s-different-port-20220630210335-9950: exit status 1
	stdout:
	[]
	
	stderr:
	Error: No such network: default-k8s-different-port-20220630210335-9950
	I0630 21:03:35.491946  242039 network_create.go:277] output of [docker network inspect default-k8s-different-port-20220630210335-9950]: -- stdout --
	[]
	
	-- /stdout --
	** stderr ** 
	Error: No such network: default-k8s-different-port-20220630210335-9950
	
	** /stderr **
	I0630 21:03:35.491995  242039 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0630 21:03:35.528039  242039 network.go:240] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName:br-c7ee26fec5a3 IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:02:42:cc:d0:4a:9e}}
	I0630 21:03:35.529385  242039 network.go:240] skipping subnet 192.168.58.0/24 that is taken: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 Interface:{IfaceName:br-3e97afadef02 IfaceIPv4:192.168.58.1 IfaceMTU:1500 IfaceMAC:02:42:9e:e7:fd:62}}
	I0630 21:03:35.530352  242039 network.go:240] skipping subnet 192.168.67.0/24 that is taken: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 Interface:{IfaceName:br-2a33e496d49b IfaceIPv4:192.168.67.1 IfaceMTU:1500 IfaceMAC:02:42:21:56:17:cb}}
	I0630 21:03:35.531146  242039 network.go:240] skipping subnet 192.168.76.0/24 that is taken: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 Interface:{IfaceName:br-5e7b405f6aaf IfaceIPv4:192.168.76.1 IfaceMTU:1500 IfaceMAC:02:42:7b:eb:36:d4}}
	I0630 21:03:35.532121  242039 network.go:288] reserving subnet 192.168.85.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[] amended:true}} dirty:map[192.168.85.0:0xc000712608] misses:0}
	I0630 21:03:35.532169  242039 network.go:235] using free private subnet 192.168.85.0/24: &{IP:192.168.85.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.85.0/24 Gateway:192.168.85.1 ClientMin:192.168.85.2 ClientMax:192.168.85.254 Broadcast:192.168.85.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
	I0630 21:03:35.532181  242039 network_create.go:115] attempt to create docker network default-k8s-different-port-20220630210335-9950 192.168.85.0/24 with gateway 192.168.85.1 and MTU of 1500 ...
	I0630 21:03:35.532237  242039 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.85.0/24 --gateway=192.168.85.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=default-k8s-different-port-20220630210335-9950 default-k8s-different-port-20220630210335-9950
	I0630 21:03:35.607371  242039 network_create.go:99] docker network default-k8s-different-port-20220630210335-9950 192.168.85.0/24 created
	I0630 21:03:35.607422  242039 kic.go:106] calculated static IP "192.168.85.2" for the "default-k8s-different-port-20220630210335-9950" container
	I0630 21:03:35.607480  242039 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I0630 21:03:35.645415  242039 cli_runner.go:164] Run: docker volume create default-k8s-different-port-20220630210335-9950 --label name.minikube.sigs.k8s.io=default-k8s-different-port-20220630210335-9950 --label created_by.minikube.sigs.k8s.io=true
	I0630 21:03:35.682829  242039 oci.go:103] Successfully created a docker volume default-k8s-different-port-20220630210335-9950
	I0630 21:03:35.682941  242039 cli_runner.go:164] Run: docker run --rm --name default-k8s-different-port-20220630210335-9950-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=default-k8s-different-port-20220630210335-9950 --entrypoint /usr/bin/test -v default-k8s-different-port-20220630210335-9950:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e -d /var/lib
	I0630 21:03:36.322979  242039 oci.go:107] Successfully prepared a docker volume default-k8s-different-port-20220630210335-9950
	I0630 21:03:36.323044  242039 preload.go:132] Checking if preload exists for k8s version v1.24.2 and runtime containerd
	I0630 21:03:36.323074  242039 kic.go:179] Starting extracting preloaded images to volume ...
	I0630 21:03:36.323137  242039 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-containerd-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v default-k8s-different-port-20220630210335-9950:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e -I lz4 -xf /preloaded.tar -C /extractDir
	I0630 21:03:43.218693  242039 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-containerd-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v default-k8s-different-port-20220630210335-9950:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e -I lz4 -xf /preloaded.tar -C /extractDir: (6.895487291s)
	I0630 21:03:43.218731  242039 kic.go:188] duration metric: took 6.895646 seconds to extract preloaded images to volume
	W0630 21:03:43.218866  242039 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	I0630 21:03:43.218959  242039 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0630 21:03:43.332071  242039 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname default-k8s-different-port-20220630210335-9950 --name default-k8s-different-port-20220630210335-9950 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=default-k8s-different-port-20220630210335-9950 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=default-k8s-different-port-20220630210335-9950 --network default-k8s-different-port-20220630210335-9950 --ip 192.168.85.2 --volume default-k8s-different-port-20220630210335-9950:/var --security-opt apparmor=unconfined --memory=2200mb --cpus=2 -e container=docker --expose 8444 --publish=127.0.0.1::8444 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b03
8ca4e
	I0630 21:03:43.759212  242039 cli_runner.go:164] Run: docker container inspect default-k8s-different-port-20220630210335-9950 --format={{.State.Running}}
	I0630 21:03:43.798130  242039 cli_runner.go:164] Run: docker container inspect default-k8s-different-port-20220630210335-9950 --format={{.State.Status}}
	I0630 21:03:43.834643  242039 cli_runner.go:164] Run: docker exec default-k8s-different-port-20220630210335-9950 stat /var/lib/dpkg/alternatives/iptables
	I0630 21:03:43.923171  242039 oci.go:144] the created container "default-k8s-different-port-20220630210335-9950" has a running status.
	I0630 21:03:43.923203  242039 kic.go:210] Creating ssh key for kic: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/default-k8s-different-port-20220630210335-9950/id_rsa...
	I0630 21:03:44.251311  242039 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/default-k8s-different-port-20220630210335-9950/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0630 21:03:44.340483  242039 cli_runner.go:164] Run: docker container inspect default-k8s-different-port-20220630210335-9950 --format={{.State.Status}}
	I0630 21:03:44.377493  242039 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0630 21:03:44.377521  242039 kic_runner.go:114] Args: [docker exec --privileged default-k8s-different-port-20220630210335-9950 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0630 21:03:44.475562  242039 cli_runner.go:164] Run: docker container inspect default-k8s-different-port-20220630210335-9950 --format={{.State.Status}}
	I0630 21:03:44.512403  242039 machine.go:88] provisioning docker machine ...
	I0630 21:03:44.512439  242039 ubuntu.go:169] provisioning hostname "default-k8s-different-port-20220630210335-9950"
	I0630 21:03:44.512491  242039 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	I0630 21:03:44.548610  242039 main.go:134] libmachine: Using SSH client type: native
	I0630 21:03:44.548835  242039 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil>  [] 0s} 127.0.0.1 49407 <nil> <nil>}
	I0630 21:03:44.548861  242039 main.go:134] libmachine: About to run SSH command:
	sudo hostname default-k8s-different-port-20220630210335-9950 && echo "default-k8s-different-port-20220630210335-9950" | sudo tee /etc/hostname
	I0630 21:03:44.677672  242039 main.go:134] libmachine: SSH cmd err, output: <nil>: default-k8s-different-port-20220630210335-9950
	
	I0630 21:03:44.677764  242039 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	I0630 21:03:44.712928  242039 main.go:134] libmachine: Using SSH client type: native
	I0630 21:03:44.713120  242039 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil>  [] 0s} 127.0.0.1 49407 <nil> <nil>}
	I0630 21:03:44.713153  242039 main.go:134] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sdefault-k8s-different-port-20220630210335-9950' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 default-k8s-different-port-20220630210335-9950/g' /etc/hosts;
				else 
					echo '127.0.1.1 default-k8s-different-port-20220630210335-9950' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0630 21:03:44.829035  242039 main.go:134] libmachine: SSH cmd err, output: <nil>: 
	I0630 21:03:44.829096  242039 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube CaCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/c
erts/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube}
	I0630 21:03:44.829158  242039 ubuntu.go:177] setting up certificates
	I0630 21:03:44.829171  242039 provision.go:83] configureAuth start
	I0630 21:03:44.829235  242039 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" default-k8s-different-port-20220630210335-9950
	I0630 21:03:44.863843  242039 provision.go:138] copyHostCerts
	I0630 21:03:44.863900  242039 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem, removing ...
	I0630 21:03:44.863908  242039 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem
	I0630 21:03:44.863978  242039 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem (1082 bytes)
	I0630 21:03:44.864065  242039 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem, removing ...
	I0630 21:03:44.864079  242039 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem
	I0630 21:03:44.864108  242039 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem (1123 bytes)
	I0630 21:03:44.864162  242039 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem, removing ...
	I0630 21:03:44.864170  242039 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem
	I0630 21:03:44.864195  242039 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem (1679 bytes)
	I0630 21:03:44.864236  242039 provision.go:112] generating server cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem org=jenkins.default-k8s-different-port-20220630210335-9950 san=[192.168.85.2 127.0.0.1 localhost 127.0.0.1 minikube default-k8s-different-port-20220630210335-9950]
	I0630 21:03:44.952885  242039 provision.go:172] copyRemoteCerts
	I0630 21:03:44.952945  242039 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0630 21:03:44.952978  242039 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	I0630 21:03:44.988292  242039 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49407 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/default-k8s-different-port-20220630210335-9950/id_rsa Username:docker}
	I0630 21:03:45.077701  242039 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
	I0630 21:03:45.095343  242039 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem --> /etc/docker/server.pem (1306 bytes)
	I0630 21:03:45.114293  242039 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0630 21:03:45.133209  242039 provision.go:86] duration metric: configureAuth took 304.018042ms
	I0630 21:03:45.133241  242039 ubuntu.go:193] setting minikube options for container-runtime
	I0630 21:03:45.133391  242039 config.go:178] Loaded profile config "default-k8s-different-port-20220630210335-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:03:45.133402  242039 machine.go:91] provisioned docker machine in 620.978242ms
	I0630 21:03:45.133407  242039 client.go:171] LocalClient.Create took 9.714279916s
	I0630 21:03:45.133428  242039 start.go:173] duration metric: libmachine.API.Create for "default-k8s-different-port-20220630210335-9950" took 9.714329219s
	I0630 21:03:45.133438  242039 start.go:306] post-start starting for "default-k8s-different-port-20220630210335-9950" (driver="docker")
	I0630 21:03:45.133443  242039 start.go:316] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0630 21:03:45.133482  242039 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0630 21:03:45.133519  242039 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	I0630 21:03:45.167706  242039 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49407 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/default-k8s-different-port-20220630210335-9950/id_rsa Username:docker}
	I0630 21:03:45.256801  242039 ssh_runner.go:195] Run: cat /etc/os-release
	I0630 21:03:45.259697  242039 main.go:134] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0630 21:03:45.259723  242039 main.go:134] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0630 21:03:45.259739  242039 main.go:134] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0630 21:03:45.259746  242039 info.go:137] Remote host: Ubuntu 20.04.4 LTS
	I0630 21:03:45.259759  242039 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/addons for local assets ...
	I0630 21:03:45.259826  242039 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files for local assets ...
	I0630 21:03:45.259929  242039 filesync.go:149] local asset: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem -> 99502.pem in /etc/ssl/certs
	I0630 21:03:45.260033  242039 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0630 21:03:45.266924  242039 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem --> /etc/ssl/certs/99502.pem (1708 bytes)
	I0630 21:03:45.285564  242039 start.go:309] post-start completed in 152.112373ms
	I0630 21:03:45.285951  242039 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" default-k8s-different-port-20220630210335-9950
	I0630 21:03:45.321202  242039 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950/config.json ...
	I0630 21:03:45.321494  242039 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0630 21:03:45.321546  242039 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	I0630 21:03:45.355102  242039 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49407 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/default-k8s-different-port-20220630210335-9950/id_rsa Username:docker}
	I0630 21:03:45.437487  242039 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0630 21:03:45.441249  242039 start.go:134] duration metric: createHost completed in 10.024841864s
	I0630 21:03:45.441278  242039 start.go:81] releasing machines lock for "default-k8s-different-port-20220630210335-9950", held for 10.025006073s
	I0630 21:03:45.441370  242039 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" default-k8s-different-port-20220630210335-9950
	I0630 21:03:45.476565  242039 ssh_runner.go:195] Run: systemctl --version
	I0630 21:03:45.476625  242039 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	I0630 21:03:45.476643  242039 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/
	I0630 21:03:45.476699  242039 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	I0630 21:03:45.515029  242039 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49407 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/default-k8s-different-port-20220630210335-9950/id_rsa Username:docker}
	I0630 21:03:45.515860  242039 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49407 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/default-k8s-different-port-20220630210335-9950/id_rsa Username:docker}
	I0630 21:03:45.626154  242039 ssh_runner.go:195] Run: sudo systemctl stop -f crio
	I0630 21:03:45.636270  242039 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0630 21:03:45.645544  242039 docker.go:179] disabling docker service ...
	I0630 21:03:45.645604  242039 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0630 21:03:45.662313  242039 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0630 21:03:45.671752  242039 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0630 21:03:45.754435  242039 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0630 21:03:45.830748  242039 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0630 21:03:45.840270  242039 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
	image-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0630 21:03:45.853601  242039 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*sandbox_image = .*$|sandbox_image = "k8s.gcr.io/pause:3.7"|' -i /etc/containerd/config.toml"
	I0630 21:03:45.861975  242039 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*restrict_oom_score_adj = .*$|restrict_oom_score_adj = false|' -i /etc/containerd/config.toml"
	I0630 21:03:45.870520  242039 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*SystemdCgroup = .*$|SystemdCgroup = false|' -i /etc/containerd/config.toml"
	I0630 21:03:45.878865  242039 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*conf_dir = .*$|conf_dir = "/etc/cni/net.mk"|' -i /etc/containerd/config.toml"
	I0630 21:03:45.886981  242039 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^# imports|imports = ["/etc/containerd/containerd.conf.d/02-containerd.conf"]|' -i /etc/containerd/config.toml"
	I0630 21:03:45.895126  242039 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc/containerd/containerd.conf.d && printf %s "dmVyc2lvbiA9IDIK" | base64 -d | sudo tee /etc/containerd/containerd.conf.d/02-containerd.conf"
	I0630 21:03:45.908266  242039 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0630 21:03:45.914934  242039 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0630 21:03:45.921848  242039 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0630 21:03:45.995984  242039 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0630 21:03:46.071834  242039 start.go:447] Will wait 60s for socket path /run/containerd/containerd.sock
	I0630 21:03:46.071910  242039 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
	I0630 21:03:46.075358  242039 start.go:468] Will wait 60s for crictl version
	I0630 21:03:46.075419  242039 ssh_runner.go:195] Run: sudo crictl version
	I0630 21:03:46.102814  242039 retry.go:31] will retry after 11.04660288s: Temporary Error: sudo crictl version: Process exited with status 1
	stdout:
	
	stderr:
	time="2022-06-30T21:03:46Z" level=fatal msg="getting the runtime version: rpc error: code = Unknown desc = server is not initialized yet"
	I0630 21:03:57.151558  242039 ssh_runner.go:195] Run: sudo crictl version
	I0630 21:03:57.174419  242039 start.go:477] Version:  0.1.0
	RuntimeName:  containerd
	RuntimeVersion:  1.6.6
	RuntimeApiVersion:  v1alpha2
	I0630 21:03:57.174487  242039 ssh_runner.go:195] Run: containerd --version
	I0630 21:03:57.203527  242039 ssh_runner.go:195] Run: containerd --version
	I0630 21:03:57.235874  242039 out.go:177] * Preparing Kubernetes v1.24.2 on containerd 1.6.6 ...
	I0630 21:03:57.237462  242039 cli_runner.go:164] Run: docker network inspect default-k8s-different-port-20220630210335-9950 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0630 21:03:57.271542  242039 ssh_runner.go:195] Run: grep 192.168.85.1	host.minikube.internal$ /etc/hosts
	I0630 21:03:57.274772  242039 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.85.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0630 21:03:57.284585  242039 preload.go:132] Checking if preload exists for k8s version v1.24.2 and runtime containerd
	I0630 21:03:57.284653  242039 ssh_runner.go:195] Run: sudo crictl images --output json
	I0630 21:03:57.307663  242039 containerd.go:547] all images are preloaded for containerd runtime.
	I0630 21:03:57.307686  242039 containerd.go:461] Images already preloaded, skipping extraction
	I0630 21:03:57.307728  242039 ssh_runner.go:195] Run: sudo crictl images --output json
	I0630 21:03:57.329794  242039 containerd.go:547] all images are preloaded for containerd runtime.
	I0630 21:03:57.329816  242039 cache_images.go:84] Images are preloaded, skipping loading
	I0630 21:03:57.329860  242039 ssh_runner.go:195] Run: sudo crictl info
	I0630 21:03:57.353042  242039 cni.go:95] Creating CNI manager for ""
	I0630 21:03:57.353085  242039 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:03:57.353101  242039 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
	I0630 21:03:57.353114  242039 kubeadm.go:158] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.85.2 APIServerPort:8444 KubernetesVersion:v1.24.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:default-k8s-different-port-20220630210335-9950 NodeName:default-k8s-different-port-20220630210335-9950 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.85.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.85.2
CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}
	I0630 21:03:57.353262  242039 kubeadm.go:162] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.85.2
	  bindPort: 8444
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: /run/containerd/containerd.sock
	  name: "default-k8s-different-port-20220630210335-9950"
	  kubeletExtraArgs:
	    node-ip: 192.168.85.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.85.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8444
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.24.2
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%"
	  nodefs.inodesFree: "0%"
	  imagefs.available: "0%"
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0630 21:03:57.353365  242039 kubeadm.go:961] kubelet [Unit]
	Wants=containerd.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.24.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=default-k8s-different-port-20220630210335-9950 --image-service-endpoint=unix:///run/containerd/containerd.sock --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.85.2 --runtime-request-timeout=15m
	
	[Install]
	 config:
	{KubernetesVersion:v1.24.2 ClusterName:default-k8s-different-port-20220630210335-9950 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8444 NodeName:}
	I0630 21:03:57.353414  242039 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.24.2
	I0630 21:03:57.360561  242039 binaries.go:44] Found k8s binaries, skipping transfer
	I0630 21:03:57.360638  242039 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0630 21:03:57.368132  242039 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (539 bytes)
	I0630 21:03:57.381928  242039 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0630 21:03:57.394960  242039 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2075 bytes)
	I0630 21:03:57.408211  242039 ssh_runner.go:195] Run: grep 192.168.85.2	control-plane.minikube.internal$ /etc/hosts
	I0630 21:03:57.411148  242039 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.85.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0630 21:03:57.420171  242039 certs.go:54] Setting up /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950 for IP: 192.168.85.2
	I0630 21:03:57.420304  242039 certs.go:182] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.key
	I0630 21:03:57.420344  242039 certs.go:182] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.key
	I0630 21:03:57.420394  242039 certs.go:302] generating minikube-user signed cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950/client.key
	I0630 21:03:57.420408  242039 crypto.go:68] Generating cert /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950/client.crt with IP's: []
	I0630 21:03:57.643439  242039 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950/client.crt ...
	I0630 21:03:57.643469  242039 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950/client.crt: {Name:mkb52e337b25d0ff43a3b79c82441dcafde144a3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:03:57.643670  242039 crypto.go:164] Writing key to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950/client.key ...
	I0630 21:03:57.643686  242039 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950/client.key: {Name:mkf5a4e5ba3ee26632c4f9198b03c0b1a6f2529b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:03:57.643770  242039 certs.go:302] generating minikube signed cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950/apiserver.key.43b9df8c
	I0630 21:03:57.643788  242039 crypto.go:68] Generating cert /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950/apiserver.crt.43b9df8c with IP's: [192.168.85.2 10.96.0.1 127.0.0.1 10.0.0.1]
	I0630 21:03:57.788506  242039 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950/apiserver.crt.43b9df8c ...
	I0630 21:03:57.788539  242039 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950/apiserver.crt.43b9df8c: {Name:mke5b3858342a52210a9dd372275d0f345c3e87e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:03:57.788747  242039 crypto.go:164] Writing key to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950/apiserver.key.43b9df8c ...
	I0630 21:03:57.788763  242039 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950/apiserver.key.43b9df8c: {Name:mk1c60d069bba6b3a57e225caed132d2effbff85 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:03:57.788855  242039 certs.go:320] copying /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950/apiserver.crt.43b9df8c -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950/apiserver.crt
	I0630 21:03:57.788927  242039 certs.go:324] copying /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950/apiserver.key.43b9df8c -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950/apiserver.key
	I0630 21:03:57.788986  242039 certs.go:302] generating aggregator signed cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950/proxy-client.key
	I0630 21:03:57.789004  242039 crypto.go:68] Generating cert /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950/proxy-client.crt with IP's: []
	I0630 21:03:58.204916  242039 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950/proxy-client.crt ...
	I0630 21:03:58.204955  242039 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950/proxy-client.crt: {Name:mk2859218f5c541f1507dfbb6b9c486fd5bcd3be Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:03:58.205172  242039 crypto.go:164] Writing key to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950/proxy-client.key ...
	I0630 21:03:58.205187  242039 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950/proxy-client.key: {Name:mkb921904bc5aaef128b8daa4a2520a80cd8e996 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:03:58.205357  242039 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950.pem (1338 bytes)
	W0630 21:03:58.205394  242039 certs.go:384] ignoring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950_empty.pem, impossibly tiny 0 bytes
	I0630 21:03:58.205415  242039 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem (1679 bytes)
	I0630 21:03:58.205445  242039 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem (1082 bytes)
	I0630 21:03:58.205470  242039 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem (1123 bytes)
	I0630 21:03:58.205492  242039 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/key.pem (1679 bytes)
	I0630 21:03:58.205532  242039 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem (1708 bytes)
	I0630 21:03:58.206151  242039 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
	I0630 21:03:58.224393  242039 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I0630 21:03:58.241617  242039 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0630 21:03:58.259351  242039 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
	I0630 21:03:58.276837  242039 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0630 21:03:58.293928  242039 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
	I0630 21:03:58.313836  242039 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0630 21:03:58.332088  242039 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
	I0630 21:03:58.350745  242039 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950.pem --> /usr/share/ca-certificates/9950.pem (1338 bytes)
	I0630 21:03:58.369211  242039 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem --> /usr/share/ca-certificates/99502.pem (1708 bytes)
	I0630 21:03:58.387766  242039 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0630 21:03:58.406193  242039 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0630 21:03:58.419682  242039 ssh_runner.go:195] Run: openssl version
	I0630 21:03:58.424615  242039 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/99502.pem && ln -fs /usr/share/ca-certificates/99502.pem /etc/ssl/certs/99502.pem"
	I0630 21:03:58.432779  242039 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/99502.pem
	I0630 21:03:58.435983  242039 certs.go:431] hashing: -rw-r--r-- 1 root root 1708 Jun 30 20:26 /usr/share/ca-certificates/99502.pem
	I0630 21:03:58.436037  242039 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/99502.pem
	I0630 21:03:58.440810  242039 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/99502.pem /etc/ssl/certs/3ec20f2e.0"
	I0630 21:03:58.448295  242039 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0630 21:03:58.455809  242039 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:03:58.459013  242039 certs.go:431] hashing: -rw-r--r-- 1 root root 1111 Jun 30 20:22 /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:03:58.459075  242039 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:03:58.463991  242039 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0630 21:03:58.471679  242039 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/9950.pem && ln -fs /usr/share/ca-certificates/9950.pem /etc/ssl/certs/9950.pem"
	I0630 21:03:58.479396  242039 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/9950.pem
	I0630 21:03:58.482472  242039 certs.go:431] hashing: -rw-r--r-- 1 root root 1338 Jun 30 20:26 /usr/share/ca-certificates/9950.pem
	I0630 21:03:58.482517  242039 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/9950.pem
	I0630 21:03:58.487289  242039 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/9950.pem /etc/ssl/certs/51391683.0"
	I0630 21:03:58.494652  242039 kubeadm.go:395] StartCluster: {Name:default-k8s-different-port-20220630210335-9950 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:default-k8s-different-port-20220630210335-9950
Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8444 NodeName:} Nodes:[{Name: IP:192.168.85.2 Port:8444 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountTyp
e:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 21:03:58.494744  242039 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
	I0630 21:03:58.494791  242039 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0630 21:03:58.519131  242039 cri.go:87] found id: ""
	I0630 21:03:58.519192  242039 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0630 21:03:58.526460  242039 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0630 21:03:58.533607  242039 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver
	I0630 21:03:58.533662  242039 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0630 21:03:58.540590  242039 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0630 21:03:58.540635  242039 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0630 21:04:09.634789  242039 out.go:204]   - Generating certificates and keys ...
	I0630 21:04:09.638413  242039 out.go:204]   - Booting up control plane ...
	I0630 21:04:09.641524  242039 out.go:204]   - Configuring RBAC rules ...
	I0630 21:04:09.644033  242039 cni.go:95] Creating CNI manager for ""
	I0630 21:04:09.644052  242039 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:04:09.645981  242039 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0630 21:04:09.647353  242039 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0630 21:04:09.651861  242039 cni.go:189] applying CNI manifest using /var/lib/minikube/binaries/v1.24.2/kubectl ...
	I0630 21:04:09.651887  242039 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2429 bytes)
	I0630 21:04:09.723830  242039 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0630 21:04:10.665243  242039 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0630 21:04:10.665372  242039 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:04:10.665389  242039 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl label nodes minikube.k8s.io/version=v1.26.0 minikube.k8s.io/commit=251ffcec0e4c997cd7732864187747cc579943c9 minikube.k8s.io/name=default-k8s-different-port-20220630210335-9950 minikube.k8s.io/updated_at=2022_06_30T21_04_10_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:04:10.738525  242039 ops.go:34] apiserver oom_adj: -16
	I0630 21:04:10.746316  242039 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:04:11.305281  242039 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:04:11.805201  242039 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:04:12.305607  242039 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:04:12.805886  242039 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:04:13.305183  242039 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:04:13.805829  242039 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:04:14.305194  242039 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:04:14.805700  242039 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:04:15.305709  242039 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:04:15.804983  242039 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:04:16.305210  242039 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:04:16.806005  242039 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:04:17.305761  242039 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:04:17.805955  242039 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:04:18.305837  242039 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:04:18.805206  242039 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:04:19.305179  242039 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:04:19.805546  242039 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:04:20.305229  242039 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:04:20.805030  242039 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:04:21.305150  242039 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:04:21.805969  242039 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:04:22.305070  242039 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:04:22.445410  242039 kubeadm.go:1045] duration metric: took 11.780092951s to wait for elevateKubeSystemPrivileges.
	I0630 21:04:22.445445  242039 kubeadm.go:397] StartCluster complete in 23.95079965s
	I0630 21:04:22.445465  242039 settings.go:142] acquiring lock: {Name:mkcbd229caa05b60d3551ef0b47eea08424c9b5d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:04:22.445596  242039 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:04:22.447615  242039 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig: {Name:mk34e4a4e7b04f624b9adbda4f77ee20b38308ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:04:22.967006  242039 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "default-k8s-different-port-20220630210335-9950" rescaled to 1
	I0630 21:04:22.967085  242039 start.go:208] Will wait 6m0s for node &{Name: IP:192.168.85.2 Port:8444 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0630 21:04:22.967105  242039 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0630 21:04:22.970209  242039 out.go:177] * Verifying Kubernetes components...
	I0630 21:04:22.967409  242039 config.go:178] Loaded profile config "default-k8s-different-port-20220630210335-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:04:22.967427  242039 addons.go:412] enableAddons start: toEnable=map[], additional=[]
	I0630 21:04:22.972052  242039 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 21:04:22.972098  242039 addons.go:65] Setting storage-provisioner=true in profile "default-k8s-different-port-20220630210335-9950"
	I0630 21:04:22.972127  242039 addons.go:153] Setting addon storage-provisioner=true in "default-k8s-different-port-20220630210335-9950"
	W0630 21:04:22.972136  242039 addons.go:162] addon storage-provisioner should already be in state true
	I0630 21:04:22.972192  242039 host.go:66] Checking if "default-k8s-different-port-20220630210335-9950" exists ...
	I0630 21:04:22.972209  242039 addons.go:65] Setting default-storageclass=true in profile "default-k8s-different-port-20220630210335-9950"
	I0630 21:04:22.972225  242039 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "default-k8s-different-port-20220630210335-9950"
	I0630 21:04:22.972600  242039 cli_runner.go:164] Run: docker container inspect default-k8s-different-port-20220630210335-9950 --format={{.State.Status}}
	I0630 21:04:22.972795  242039 cli_runner.go:164] Run: docker container inspect default-k8s-different-port-20220630210335-9950 --format={{.State.Status}}
	I0630 21:04:23.016583  242039 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0630 21:04:23.018185  242039 addons.go:345] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 21:04:23.018210  242039 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0630 21:04:23.018271  242039 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	I0630 21:04:23.019616  242039 addons.go:153] Setting addon default-storageclass=true in "default-k8s-different-port-20220630210335-9950"
	W0630 21:04:23.019636  242039 addons.go:162] addon default-storageclass should already be in state true
	I0630 21:04:23.019657  242039 host.go:66] Checking if "default-k8s-different-port-20220630210335-9950" exists ...
	I0630 21:04:23.019978  242039 cli_runner.go:164] Run: docker container inspect default-k8s-different-port-20220630210335-9950 --format={{.State.Status}}
	I0630 21:04:23.051111  242039 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.85.1 host.minikube.internal\n           fallthrough\n        }' | sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0630 21:04:23.052773  242039 node_ready.go:35] waiting up to 6m0s for node "default-k8s-different-port-20220630210335-9950" to be "Ready" ...
	I0630 21:04:23.077750  242039 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49407 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/default-k8s-different-port-20220630210335-9950/id_rsa Username:docker}
	I0630 21:04:23.080553  242039 addons.go:345] installing /etc/kubernetes/addons/storageclass.yaml
	I0630 21:04:23.080577  242039 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0630 21:04:23.080638  242039 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	I0630 21:04:23.124266  242039 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49407 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/default-k8s-different-port-20220630210335-9950/id_rsa Username:docker}
	I0630 21:04:23.232795  242039 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 21:04:23.246024  242039 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0630 21:04:23.351917  242039 start.go:806] {"host.minikube.internal": 192.168.85.1} host record injected into CoreDNS
	I0630 21:04:23.584662  242039 out.go:177] * Enabled addons: storage-provisioner, default-storageclass
	I0630 21:04:23.586075  242039 addons.go:414] enableAddons completed in 618.649204ms
	I0630 21:04:25.060040  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:04:27.560437  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:04:30.060214  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:04:32.560319  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:04:35.060680  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:04:37.559816  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:04:40.060623  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:04:42.560398  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:04:45.059731  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:04:47.560387  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:04:50.059665  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:04:52.559939  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:04:55.060153  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:04:57.060711  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:04:59.560377  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:05:02.060178  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:05:04.559909  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:05:07.060273  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:05:09.559869  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:05:12.060318  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:05:14.560381  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:05:16.560439  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:05:19.060222  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:05:21.558954  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:05:23.559945  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:05:26.059692  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:05:28.559927  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:05:31.060078  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:05:33.559961  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:05:35.560374  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:05:38.059930  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:05:40.060224  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:05:42.060725  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:05:44.560104  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:05:47.060846  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:05:49.559632  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:05:52.059451  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:05:54.060177  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:05:56.559996  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:05:59.059919  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:06:01.060721  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:06:03.559587  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:06:06.059897  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:06:08.060012  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:06:10.573221  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:06:13.060301  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:06:15.560204  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:06:18.059607  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:06:20.059682  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:06:22.060020  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:06:24.060048  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:06:26.060611  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:06:28.559732  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:06:30.559956  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:06:33.059800  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:06:35.060331  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:06:37.560142  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:06:40.060140  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:06:42.060488  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:06:44.559562  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:06:46.560084  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:06:48.560205  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:06:50.560519  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:06:53.060069  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:06:55.060906  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:06:57.559842  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:06:59.560333  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:02.060819  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:04.559635  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:06.559671  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:08.560388  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:11.060021  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:13.559886  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:15.560115  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:18.060545  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:20.560389  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:23.059986  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:25.060230  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:27.560295  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:30.060032  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:32.559626  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:34.559784  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:37.059624  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:39.059792  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:41.060328  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:43.060458  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:45.560281  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:48.059772  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:50.059801  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:52.060088  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:54.559829  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:56.560117  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:59.060638  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:08:01.559922  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:08:03.560005  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:08:06.059907  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:08:08.060375  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:08:10.559488  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:08:12.560562  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:08:15.060921  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:08:17.559310  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:08:19.560222  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:08:22.059940  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:08:23.062928  242039 node_ready.go:38] duration metric: took 4m0.010106635s waiting for node "default-k8s-different-port-20220630210335-9950" to be "Ready" ...
	I0630 21:08:23.064921  242039 out.go:177] 
	W0630 21:08:23.066357  242039 out.go:239] X Exiting due to GUEST_START: wait 6m0s for node: waiting for node to be ready: waitNodeCondition: timed out waiting for the condition
	X Exiting due to GUEST_START: wait 6m0s for node: waiting for node to be ready: waitNodeCondition: timed out waiting for the condition
	W0630 21:08:23.066374  242039 out.go:239] * 
	* 
	W0630 21:08:23.067132  242039 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0630 21:08:23.069099  242039 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p default-k8s-different-port-20220630210335-9950 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.24.2": exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestStartStop/group/default-k8s-different-port/serial/FirstStart]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect default-k8s-different-port-20220630210335-9950
helpers_test.go:235: (dbg) docker inspect default-k8s-different-port-20220630210335-9950:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "99f8da15dcfc83187a1db4c0b15dfeb5920d55fd52718f4f99a491d1ec9f59fc",
	        "Created": "2022-06-30T21:03:43.366289202Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 243225,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2022-06-30T21:03:43.749415396Z",
	            "FinishedAt": "0001-01-01T00:00:00Z"
	        },
	        "Image": "sha256:573e7be5768273a7845baee1ae90fa2e33b83b10a7fbb0f0f41efbf29b53d1f1",
	        "ResolvConfPath": "/var/lib/docker/containers/99f8da15dcfc83187a1db4c0b15dfeb5920d55fd52718f4f99a491d1ec9f59fc/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/99f8da15dcfc83187a1db4c0b15dfeb5920d55fd52718f4f99a491d1ec9f59fc/hostname",
	        "HostsPath": "/var/lib/docker/containers/99f8da15dcfc83187a1db4c0b15dfeb5920d55fd52718f4f99a491d1ec9f59fc/hosts",
	        "LogPath": "/var/lib/docker/containers/99f8da15dcfc83187a1db4c0b15dfeb5920d55fd52718f4f99a491d1ec9f59fc/99f8da15dcfc83187a1db4c0b15dfeb5920d55fd52718f4f99a491d1ec9f59fc-json.log",
	        "Name": "/default-k8s-different-port-20220630210335-9950",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "default-k8s-different-port-20220630210335-9950:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "default-k8s-different-port-20220630210335-9950",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8444/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 2306867200,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": null,
	            "BlkioDeviceWriteBps": null,
	            "BlkioDeviceReadIOps": null,
	            "BlkioDeviceWriteIOps": null,
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "KernelMemory": 0,
	            "KernelMemoryTCP": 0,
	            "MemoryReservation": 0,
	            "MemorySwap": 4613734400,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": null,
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/6cae4fbb3ff06bafae7d678b8be88c46f728f7e162403189e54b6a928eed1dda-init/diff:/var/lib/docker/overlay2/8b88d9f6f12c48be642a133456203e58549a93f1da67d0349744bd0f78917fba/diff:/var/lib/docker/overlay2/2bcbb3b4718a64188802301a25d7f413bb307cb16d077e7e5af799f9152a2970/diff:/var/lib/docker/overlay2/70b0888bf22fcef1c004704b71288ac581cf26a3b3b19fbca3da296ba10d6978/diff:/var/lib/docker/overlay2/7c5332f38fe652f379ef9b6d23e795158e9994317cfb547b581dd2b1fdf1303b/diff:/var/lib/docker/overlay2/0ddb5a3abf433b644a8bfa124e3c87878eed67878faa35493f2befc2b392e9cb/diff:/var/lib/docker/overlay2/3b7cda5fb0232fdeecbec0531ac704a59eb38fe57664c25777193b07e2df0077/diff:/var/lib/docker/overlay2/a14687ada786c65465b9924ae2d77ba27afc07942851cafaade28e80dfe9da16/diff:/var/lib/docker/overlay2/c49a9b7157aa6e8714e192b2849866d035b59e18de462c0ee9b72f898cc5a485/diff:/var/lib/docker/overlay2/efd71a50e3a1044a6d1c4c1a7d4d91d9f070c066e03e51c6c73a5764b778ad72/diff:/var/lib/docker/overlay2/55476a
1c0a20aa4238a0bb0e43c6402c33dcad312938ad48ee81be0160e12a49/diff:/var/lib/docker/overlay2/c48c4a348a797b9a38f01568a6adbcb4b05b4f56f7b986a4bf1b509d8cb00732/diff:/var/lib/docker/overlay2/568e3f354ab0428de5cf82d1fdfb780c3377f5cc55d9f524731c53e39e0ecae7/diff:/var/lib/docker/overlay2/2857943e320cdcdae9af3d8c2acda1fb61e2f142a88b8b902908071cea67816e/diff:/var/lib/docker/overlay2/bdd9a57f0b65e65c5a16395f239425e794c678b0e8db2f4a368e0a9427fe5116/diff:/var/lib/docker/overlay2/b150183f1b73e8c13c751911bcee09fed8ef973478f4dc3cfdb9e509118bf1ea/diff:/var/lib/docker/overlay2/0a053e7c29417cd6feafb351c7944e81342a52898871bc779f7bf61868c78ec4/diff:/var/lib/docker/overlay2/d3c0de3a44d75d0a05acb7843d53deba5ce0457649d6ed757da9b4c532a81e4f/diff:/var/lib/docker/overlay2/53f6170132880e1697dd802b8577382b31c6f1ba144256f8cc62542998842a6b/diff:/var/lib/docker/overlay2/b5c0be6d8efdb1fcb12e73b8f72853f77baa4bc014ac2c1e28b7b972b07f3325/diff:/var/lib/docker/overlay2/36c908f082a1e5388bb25277f1c957eaecf70fcd958080422fa85a3105724fb2/diff:/var/lib/d
ocker/overlay2/b147fe9dce365cfaf9bfeca2e370829e4d87e2671c133a9836ecb02a85422cc7/diff:/var/lib/docker/overlay2/65f488eb9181a721f01b333f5fa0cb91d216abd7842a9ae193bd95316f378721/diff:/var/lib/docker/overlay2/b04269aa247b68912ddc5b1c98ad55d67af4103f576a900eef4069c196b8a263/diff:/var/lib/docker/overlay2/b714c37e15257ae9d0e15d271dd18a330c38ad765901d9b7e7e3feb73e1b03e4/diff:/var/lib/docker/overlay2/3c253b721193edeaade7bba7ce25ff687c889b8fa86e9489c7ee20d5624e6c5b/diff:/var/lib/docker/overlay2/7f67b74e101fa21dd320393c10576eefa4ce1cec2e210bff405784fa45b360f3/diff:/var/lib/docker/overlay2/c3b2adaa63a06a5e6ed966d7b6f20a757aeadd3f25eb09ef3c7e9a66a8904143/diff:/var/lib/docker/overlay2/ddb5d653d19e8cafc4625a8fe9597667d98b277a7f679e532ad84caa2c6da636/diff:/var/lib/docker/overlay2/03eb172b20323ebeee7cb09025726a6e10de6c3dd8661f4f6bbc5a3a3778bad4/diff:/var/lib/docker/overlay2/80ea9bf34d028e95a8a418b3aeb634be72ab3336448946d7855c51ffdf8258d7/diff:/var/lib/docker/overlay2/e28987ea3fb4d431dee111f38cc76814b85f73e86434be3c463c01fdd59
9ad46/diff:/var/lib/docker/overlay2/6f9a46c7c6cf4fd30ce32a1eb08ed9b1e8dd61cb0e42ce54f0f736f06558c306/diff:/var/lib/docker/overlay2/6fc942eb9ccfc09898edc9a5ef3b3d305a6fcb22e8cefb1a9f9c344d10b59b25/diff:/var/lib/docker/overlay2/f6b8c57540e798dc1dfd51fd29c020193c02a4362f31c6d07aa220327bb07b90/diff:/var/lib/docker/overlay2/85d0aa01a3fab8c77262c59d8a7b0809a72673a3da7d33e4e19c04a66db44a11/diff:/var/lib/docker/overlay2/58dcd81a1605641f785ced5aeb38657eec1f02a31b7adfaf4f6fdd49f4bab1d6/diff:/var/lib/docker/overlay2/9d537e0a65325e4bf85b26da9828002339f5c442ca85f931b340457a80ec8c94/diff:/var/lib/docker/overlay2/a6f73707ee6a74e948a02d03c4a3f12b57c2eb408dc67da3c39961bb3cefcc97/diff:/var/lib/docker/overlay2/922526c310b066dbb73b9a106eef8bf0064ad7907a8d7d7b353f5307a17a4901/diff:/var/lib/docker/overlay2/a4185854870ebf8d34a4c7e1827dbe3bc461559839301ffb23c5efff5e3c9f14/diff:/var/lib/docker/overlay2/8c02b1fcb9d79f5d7b2ee4d44f6625a692c44a0d18df0a5c01cac0cca0fdf3f3/diff",
	                "MergedDir": "/var/lib/docker/overlay2/6cae4fbb3ff06bafae7d678b8be88c46f728f7e162403189e54b6a928eed1dda/merged",
	                "UpperDir": "/var/lib/docker/overlay2/6cae4fbb3ff06bafae7d678b8be88c46f728f7e162403189e54b6a928eed1dda/diff",
	                "WorkDir": "/var/lib/docker/overlay2/6cae4fbb3ff06bafae7d678b8be88c46f728f7e162403189e54b6a928eed1dda/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "default-k8s-different-port-20220630210335-9950",
	                "Source": "/var/lib/docker/volumes/default-k8s-different-port-20220630210335-9950/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "default-k8s-different-port-20220630210335-9950",
	            "Domainname": "",
	            "User": "root",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8444/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e",
	            "Volumes": null,
	            "WorkingDir": "",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "default-k8s-different-port-20220630210335-9950",
	                "name.minikube.sigs.k8s.io": "default-k8s-different-port-20220630210335-9950",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "91a4e2a23477a089405a3194b25b1263bcc345054fdee7c0681d4ae4b4dfdbca",
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49407"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49406"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49403"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49405"
	                    }
	                ],
	                "8444/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49404"
	                    }
	                ]
	            },
	            "SandboxKey": "/var/run/docker/netns/91a4e2a23477",
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "default-k8s-different-port-20220630210335-9950": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.85.2"
	                    },
	                    "Links": null,
	                    "Aliases": [
	                        "99f8da15dcfc",
	                        "default-k8s-different-port-20220630210335-9950"
	                    ],
	                    "NetworkID": "88cfda28f4387ea19e39fbebceded21d3930034fa00fca0cacdd2b97de1da8d9",
	                    "EndpointID": "222afaea3384676d2c5a7ff861094912ad678c6a88a78ac77f7423c8583a4b1b",
	                    "Gateway": "192.168.85.1",
	                    "IPAddress": "192.168.85.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "MacAddress": "02:42:c0:a8:55:02",
	                    "DriverOpts": null
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p default-k8s-different-port-20220630210335-9950 -n default-k8s-different-port-20220630210335-9950
helpers_test.go:244: <<< TestStartStop/group/default-k8s-different-port/serial/FirstStart FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======>  post-mortem[TestStartStop/group/default-k8s-different-port/serial/FirstStart]: minikube logs <======
helpers_test.go:247: (dbg) Run:  out/minikube-linux-amd64 -p default-k8s-different-port-20220630210335-9950 logs -n 25
helpers_test.go:252: TestStartStop/group/default-k8s-different-port/serial/FirstStart logs: 
-- stdout --
	* 
	* ==> Audit <==
	* |---------|------------------------------------------------------------|----------|---------|---------|---------------------|---------------------|
	| Command |                            Args                            | Profile  |  User   | Version |     Start Time      |      End Time       |
	|---------|------------------------------------------------------------|----------|---------|---------|---------------------|---------------------|
	| ssh     | -p bridge-20220630204858-9950                              | minikube | jenkins | v1.26.0 | 30 Jun 22 20:56 UTC | 30 Jun 22 20:56 UTC |
	|         | pgrep -a kubelet                                           |          |         |         |                     |                     |
	| ssh     | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:00 UTC | 30 Jun 22 21:00 UTC |
	|         | enable-default-cni-20220630204858-9950                     |          |         |         |                     |                     |
	|         | pgrep -a kubelet                                           |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:00 UTC | 30 Jun 22 21:00 UTC |
	|         | kubernetes-upgrade-20220630205032-9950                     |          |         |         |                     |                     |
	| start   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:00 UTC |                     |
	|         | old-k8s-version-20220630210005-9950                        |          |         |         |                     |                     |
	|         | --memory=2200 --alsologtostderr                            |          |         |         |                     |                     |
	|         | --wait=true --kvm-network=default                          |          |         |         |                     |                     |
	|         | --kvm-qemu-uri=qemu:///system                              |          |         |         |                     |                     |
	|         | --disable-driver-mounts                                    |          |         |         |                     |                     |
	|         | --keep-context=false                                       |          |         |         |                     |                     |
	|         | --driver=docker                                            |          |         |         |                     |                     |
	|         | --container-runtime=containerd                             |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.16.0                               |          |         |         |                     |                     |
	| delete  | -p bridge-20220630204858-9950                              | minikube | jenkins | v1.26.0 | 30 Jun 22 21:02 UTC | 30 Jun 22 21:02 UTC |
	| start   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:02 UTC | 30 Jun 22 21:03 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|         | --memory=2200                                              |          |         |         |                     |                     |
	|         | --alsologtostderr                                          |          |         |         |                     |                     |
	|         | --wait=true --preload=false                                |          |         |         |                     |                     |
	|         | --driver=docker                                            |          |         |         |                     |                     |
	|         | --container-runtime=containerd                             |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                               |          |         |         |                     |                     |
	| delete  | -p calico-20220630204859-9950                              | minikube | jenkins | v1.26.0 | 30 Jun 22 21:03 UTC | 30 Jun 22 21:03 UTC |
	| start   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:03 UTC |                     |
	|         | default-k8s-different-port-20220630210335-9950             |          |         |         |                     |                     |
	|         | --memory=2200 --alsologtostderr --wait=true                |          |         |         |                     |                     |
	|         | --apiserver-port=8444 --driver=docker                      |          |         |         |                     |                     |
	|         |  --container-runtime=containerd                            |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                               |          |         |         |                     |                     |
	| addons  | enable metrics-server -p                                   | minikube | jenkins | v1.26.0 | 30 Jun 22 21:03 UTC | 30 Jun 22 21:03 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|         | --images=MetricsServer=k8s.gcr.io/echoserver:1.4           |          |         |         |                     |                     |
	|         | --registries=MetricsServer=fake.domain                     |          |         |         |                     |                     |
	| stop    | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:03 UTC | 30 Jun 22 21:04 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=3                                     |          |         |         |                     |                     |
	| addons  | enable dashboard -p                                        | minikube | jenkins | v1.26.0 | 30 Jun 22 21:04 UTC | 30 Jun 22 21:04 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|         | --images=MetricsScraper=k8s.gcr.io/echoserver:1.4          |          |         |         |                     |                     |
	| start   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:04 UTC |                     |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|         | --memory=2200                                              |          |         |         |                     |                     |
	|         | --alsologtostderr                                          |          |         |         |                     |                     |
	|         | --wait=true --preload=false                                |          |         |         |                     |                     |
	|         | --driver=docker                                            |          |         |         |                     |                     |
	|         | --container-runtime=containerd                             |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                               |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:05 UTC | 30 Jun 22 21:05 UTC |
	|         | enable-default-cni-20220630204858-9950                     |          |         |         |                     |                     |
	| start   | -p newest-cni-20220630210514-9950 --memory=2200            | minikube | jenkins | v1.26.0 | 30 Jun 22 21:05 UTC | 30 Jun 22 21:06 UTC |
	|         | --alsologtostderr --wait=apiserver,system_pods,default_sa  |          |         |         |                     |                     |
	|         | --feature-gates ServerSideApply=true --network-plugin=cni  |          |         |         |                     |                     |
	|         | --extra-config=kubeadm.pod-network-cidr=192.168.111.111/16 |          |         |         |                     |                     |
	|         | --driver=docker  --container-runtime=containerd            |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                               |          |         |         |                     |                     |
	| addons  | enable metrics-server -p                                   | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | --images=MetricsServer=k8s.gcr.io/echoserver:1.4           |          |         |         |                     |                     |
	|         | --registries=MetricsServer=fake.domain                     |          |         |         |                     |                     |
	| stop    | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=3                                     |          |         |         |                     |                     |
	| addons  | enable dashboard -p                                        | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | --images=MetricsScraper=k8s.gcr.io/echoserver:1.4          |          |         |         |                     |                     |
	| start   | -p newest-cni-20220630210514-9950 --memory=2200            | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | --alsologtostderr --wait=apiserver,system_pods,default_sa  |          |         |         |                     |                     |
	|         | --feature-gates ServerSideApply=true --network-plugin=cni  |          |         |         |                     |                     |
	|         | --extra-config=kubeadm.pod-network-cidr=192.168.111.111/16 |          |         |         |                     |                     |
	|         | --driver=docker  --container-runtime=containerd            |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                               |          |         |         |                     |                     |
	| ssh     | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | sudo crictl images -o json                                 |          |         |         |                     |                     |
	| pause   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                     |          |         |         |                     |                     |
	| unpause | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                     |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | disable-driver-mounts-20220630210659-9950                  |          |         |         |                     |                     |
	| start   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC |                     |
	|         | embed-certs-20220630210659-9950                            |          |         |         |                     |                     |
	|         | --memory=2200 --alsologtostderr                            |          |         |         |                     |                     |
	|         | --wait=true --embed-certs                                  |          |         |         |                     |                     |
	|         | --driver=docker                                            |          |         |         |                     |                     |
	|         | --container-runtime=containerd                             |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                               |          |         |         |                     |                     |
	|---------|------------------------------------------------------------|----------|---------|---------|---------------------|---------------------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2022/06/30 21:06:59
	Running on machine: ubuntu-20-agent-8
	Binary: Built with gc go1.18.3 for linux/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0630 21:06:59.738083  258418 out.go:296] Setting OutFile to fd 1 ...
	I0630 21:06:59.738291  258418 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 21:06:59.738303  258418 out.go:309] Setting ErrFile to fd 2...
	I0630 21:06:59.738308  258418 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 21:06:59.738724  258418 root.go:329] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/bin
	I0630 21:06:59.739016  258418 out.go:303] Setting JSON to false
	I0630 21:06:59.740481  258418 start.go:115] hostinfo: {"hostname":"ubuntu-20-agent-8","uptime":2972,"bootTime":1656620248,"procs":586,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1012-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0630 21:06:59.740554  258418 start.go:125] virtualization: kvm guest
	I0630 21:06:59.743370  258418 out.go:177] * [embed-certs-20220630210659-9950] minikube v1.26.0 on Ubuntu 20.04 (kvm/amd64)
	I0630 21:06:59.744868  258418 out.go:177]   - MINIKUBE_LOCATION=14420
	I0630 21:06:59.744862  258418 notify.go:193] Checking for updates...
	I0630 21:06:59.746487  258418 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0630 21:06:59.747925  258418 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:06:59.749264  258418 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube
	I0630 21:06:59.750647  258418 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0630 21:06:59.752427  258418 config.go:178] Loaded profile config "default-k8s-different-port-20220630210335-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:06:59.752560  258418 config.go:178] Loaded profile config "no-preload-20220630210237-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:06:59.752664  258418 config.go:178] Loaded profile config "old-k8s-version-20220630210005-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.16.0
	I0630 21:06:59.752733  258418 driver.go:360] Setting default libvirt URI to qemu:///system
	I0630 21:06:59.793157  258418 docker.go:137] docker version: linux-20.10.17
	I0630 21:06:59.793329  258418 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0630 21:06:59.904539  258418 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:3 ContainersPaused:0 ContainersStopped:0 Images:8 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:50 OomKillDisable:true NGoroutines:49 SystemTime:2022-06-30 21:06:59.825756368 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1012-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexServ
erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662451712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-8 Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Client
Info:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
	I0630 21:06:59.904699  258418 docker.go:254] overlay module found
	I0630 21:06:59.908463  258418 out.go:177] * Using the docker driver based on user configuration
	I0630 21:06:59.909872  258418 start.go:284] selected driver: docker
	I0630 21:06:59.909886  258418 start.go:808] validating driver "docker" against <nil>
	I0630 21:06:59.909904  258418 start.go:819] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0630 21:06:59.910758  258418 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0630 21:07:00.020059  258418 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:3 ContainersPaused:0 ContainersStopped:0 Images:8 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:50 OomKillDisable:true NGoroutines:49 SystemTime:2022-06-30 21:06:59.94317636 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1012-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexServe
rAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662451712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-8 Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] ClientI
nfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
	I0630 21:07:00.020196  258418 start_flags.go:296] no existing cluster config was found, will generate one from the flags 
	I0630 21:07:00.020755  258418 start_flags.go:853] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0630 21:07:00.022859  258418 out.go:177] * Using Docker driver with root privileges
	I0630 21:07:00.024184  258418 cni.go:95] Creating CNI manager for ""
	I0630 21:07:00.024208  258418 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:07:00.024223  258418 start_flags.go:305] Found "CNI" CNI - setting NetworkPlugin=cni
	I0630 21:07:00.024246  258418 start_flags.go:310] config:
	{Name:embed-certs-20220630210659-9950 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:embed-certs-20220630210659-9950 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:clus
ter.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 21:07:00.025866  258418 out.go:177] * Starting control plane node embed-certs-20220630210659-9950 in cluster embed-certs-20220630210659-9950
	I0630 21:07:00.027139  258418 cache.go:120] Beginning downloading kic base image for docker with containerd
	I0630 21:07:00.028673  258418 out.go:177] * Pulling base image ...
	I0630 21:07:00.029951  258418 preload.go:132] Checking if preload exists for k8s version v1.24.2 and runtime containerd
	I0630 21:07:00.029992  258418 preload.go:148] Found local preload: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-containerd-overlay2-amd64.tar.lz4
	I0630 21:07:00.030001  258418 cache.go:57] Caching tarball of preloaded images
	I0630 21:07:00.030041  258418 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e in local docker daemon
	I0630 21:07:00.030250  258418 preload.go:174] Found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-containerd-overlay2-amd64.tar.lz4 in cache, skipping download
	I0630 21:07:00.030266  258418 cache.go:60] Finished verifying existence of preloaded tar for  v1.24.2 on containerd
	I0630 21:07:00.030363  258418 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/config.json ...
	I0630 21:07:00.030388  258418 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/config.json: {Name:mk3d06fce107c3c107ba91de67a3c2827092ffff Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:07:00.065813  258418 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e in local docker daemon, skipping pull
	I0630 21:07:00.065840  258418 cache.go:142] gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e exists in daemon, skipping load
	I0630 21:07:00.065850  258418 cache.go:208] Successfully downloaded all kic artifacts
	I0630 21:07:00.065886  258418 start.go:352] acquiring machines lock for embed-certs-20220630210659-9950: {Name:mk6619dbb09b46cdd2b244e5bf2112b3274a30ef Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0630 21:07:00.066018  258418 start.go:356] acquired machines lock for "embed-certs-20220630210659-9950" in 103.406µs
	I0630 21:07:00.066043  258418 start.go:91] Provisioning new machine with config: &{Name:embed-certs-20220630210659-9950 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:embed-certs-20220630210659-9950 Namespace
:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker
BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:} &{Name: IP: Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0630 21:07:00.066120  258418 start.go:131] createHost starting for "" (driver="docker")
	I0630 21:06:57.559842  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:06:59.560333  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:06:57.322367  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:06:59.322499  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:00.068356  258418 out.go:204] * Creating docker container (CPUs=2, Memory=2200MB) ...
	I0630 21:07:00.068557  258418 start.go:165] libmachine.API.Create for "embed-certs-20220630210659-9950" (driver="docker")
	I0630 21:07:00.068584  258418 client.go:168] LocalClient.Create starting
	I0630 21:07:00.068653  258418 main.go:134] libmachine: Reading certificate data from /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem
	I0630 21:07:00.068682  258418 main.go:134] libmachine: Decoding PEM data...
	I0630 21:07:00.068698  258418 main.go:134] libmachine: Parsing certificate...
	I0630 21:07:00.068753  258418 main.go:134] libmachine: Reading certificate data from /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem
	I0630 21:07:00.068774  258418 main.go:134] libmachine: Decoding PEM data...
	I0630 21:07:00.068784  258418 main.go:134] libmachine: Parsing certificate...
	I0630 21:07:00.069116  258418 cli_runner.go:164] Run: docker network inspect embed-certs-20220630210659-9950 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	W0630 21:07:00.108024  258418 cli_runner.go:211] docker network inspect embed-certs-20220630210659-9950 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
	I0630 21:07:00.108116  258418 network_create.go:272] running [docker network inspect embed-certs-20220630210659-9950] to gather additional debugging logs...
	I0630 21:07:00.108144  258418 cli_runner.go:164] Run: docker network inspect embed-certs-20220630210659-9950
	W0630 21:07:00.141588  258418 cli_runner.go:211] docker network inspect embed-certs-20220630210659-9950 returned with exit code 1
	I0630 21:07:00.141617  258418 network_create.go:275] error running [docker network inspect embed-certs-20220630210659-9950]: docker network inspect embed-certs-20220630210659-9950: exit status 1
	stdout:
	[]
	
	stderr:
	Error: No such network: embed-certs-20220630210659-9950
	I0630 21:07:00.141631  258418 network_create.go:277] output of [docker network inspect embed-certs-20220630210659-9950]: -- stdout --
	[]
	
	-- /stdout --
	** stderr ** 
	Error: No such network: embed-certs-20220630210659-9950
	
	** /stderr **
	I0630 21:07:00.141686  258418 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0630 21:07:00.178261  258418 network.go:240] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName:br-c7ee26fec5a3 IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:02:42:cc:d0:4a:9e}}
	I0630 21:07:00.179334  258418 network.go:240] skipping subnet 192.168.58.0/24 that is taken: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 Interface:{IfaceName:br-3e97afadef02 IfaceIPv4:192.168.58.1 IfaceMTU:1500 IfaceMAC:02:42:9e:e7:fd:62}}
	I0630 21:07:00.179967  258418 network.go:240] skipping subnet 192.168.67.0/24 that is taken: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 Interface:{IfaceName:br-2a33e496d49b IfaceIPv4:192.168.67.1 IfaceMTU:1500 IfaceMAC:02:42:21:56:17:cb}}
	I0630 21:07:00.180760  258418 network.go:240] skipping subnet 192.168.76.0/24 that is taken: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 Interface:{IfaceName:br-5e7b405f6aaf IfaceIPv4:192.168.76.1 IfaceMTU:1500 IfaceMAC:02:42:7b:eb:36:d4}}
	I0630 21:07:00.181503  258418 network.go:240] skipping subnet 192.168.85.0/24 that is taken: &{IP:192.168.85.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.85.0/24 Gateway:192.168.85.1 ClientMin:192.168.85.2 ClientMax:192.168.85.254 Broadcast:192.168.85.255 Interface:{IfaceName:br-88cfda28f438 IfaceIPv4:192.168.85.1 IfaceMTU:1500 IfaceMAC:02:42:12:4c:db:ca}}
	I0630 21:07:00.182506  258418 network.go:288] reserving subnet 192.168.94.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[] amended:true}} dirty:map[192.168.94.0:0xc000790098] misses:0}
	I0630 21:07:00.182557  258418 network.go:235] using free private subnet 192.168.94.0/24: &{IP:192.168.94.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.94.0/24 Gateway:192.168.94.1 ClientMin:192.168.94.2 ClientMax:192.168.94.254 Broadcast:192.168.94.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
	I0630 21:07:00.182573  258418 network_create.go:115] attempt to create docker network embed-certs-20220630210659-9950 192.168.94.0/24 with gateway 192.168.94.1 and MTU of 1500 ...
	I0630 21:07:00.182643  258418 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.94.0/24 --gateway=192.168.94.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=embed-certs-20220630210659-9950 embed-certs-20220630210659-9950
	I0630 21:07:00.257759  258418 network_create.go:99] docker network embed-certs-20220630210659-9950 192.168.94.0/24 created
	I0630 21:07:00.257800  258418 kic.go:106] calculated static IP "192.168.94.2" for the "embed-certs-20220630210659-9950" container
	I0630 21:07:00.257889  258418 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I0630 21:07:00.297023  258418 cli_runner.go:164] Run: docker volume create embed-certs-20220630210659-9950 --label name.minikube.sigs.k8s.io=embed-certs-20220630210659-9950 --label created_by.minikube.sigs.k8s.io=true
	I0630 21:07:00.333425  258418 oci.go:103] Successfully created a docker volume embed-certs-20220630210659-9950
	I0630 21:07:00.333505  258418 cli_runner.go:164] Run: docker run --rm --name embed-certs-20220630210659-9950-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=embed-certs-20220630210659-9950 --entrypoint /usr/bin/test -v embed-certs-20220630210659-9950:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e -d /var/lib
	I0630 21:07:00.910665  258418 oci.go:107] Successfully prepared a docker volume embed-certs-20220630210659-9950
	I0630 21:07:00.910711  258418 preload.go:132] Checking if preload exists for k8s version v1.24.2 and runtime containerd
	I0630 21:07:00.910729  258418 kic.go:179] Starting extracting preloaded images to volume ...
	I0630 21:07:00.910788  258418 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-containerd-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v embed-certs-20220630210659-9950:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e -I lz4 -xf /preloaded.tar -C /extractDir
	I0630 21:07:02.060819  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:04.559635  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:01.822187  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:04.321625  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:07.402589  258418 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-containerd-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v embed-certs-20220630210659-9950:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e -I lz4 -xf /preloaded.tar -C /extractDir: (6.49174022s)
	I0630 21:07:07.402619  258418 kic.go:188] duration metric: took 6.491886 seconds to extract preloaded images to volume
	W0630 21:07:07.402757  258418 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	I0630 21:07:07.402858  258418 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0630 21:07:07.511838  258418 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname embed-certs-20220630210659-9950 --name embed-certs-20220630210659-9950 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=embed-certs-20220630210659-9950 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=embed-certs-20220630210659-9950 --network embed-certs-20220630210659-9950 --ip 192.168.94.2 --volume embed-certs-20220630210659-9950:/var --security-opt apparmor=unconfined --memory=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e
	I0630 21:07:07.934143  258418 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Running}}
	I0630 21:07:07.973385  258418 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:07:08.010245  258418 cli_runner.go:164] Run: docker exec embed-certs-20220630210659-9950 stat /var/lib/dpkg/alternatives/iptables
	I0630 21:07:08.090553  258418 oci.go:144] the created container "embed-certs-20220630210659-9950" has a running status.
	I0630 21:07:08.090607  258418 kic.go:210] Creating ssh key for kic: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa...
	I0630 21:07:08.314972  258418 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0630 21:07:08.427784  258418 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:07:08.468895  258418 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0630 21:07:08.468925  258418 kic_runner.go:114] Args: [docker exec --privileged embed-certs-20220630210659-9950 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0630 21:07:08.566253  258418 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:07:08.600997  258418 machine.go:88] provisioning docker machine ...
	I0630 21:07:08.601037  258418 ubuntu.go:169] provisioning hostname "embed-certs-20220630210659-9950"
	I0630 21:07:08.601149  258418 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:07:08.636297  258418 main.go:134] libmachine: Using SSH client type: native
	I0630 21:07:08.636495  258418 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil>  [] 0s} 127.0.0.1 49427 <nil> <nil>}
	I0630 21:07:08.636521  258418 main.go:134] libmachine: About to run SSH command:
	sudo hostname embed-certs-20220630210659-9950 && echo "embed-certs-20220630210659-9950" | sudo tee /etc/hostname
	I0630 21:07:08.771633  258418 main.go:134] libmachine: SSH cmd err, output: <nil>: embed-certs-20220630210659-9950
	
	I0630 21:07:08.771709  258418 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:07:08.807559  258418 main.go:134] libmachine: Using SSH client type: native
	I0630 21:07:08.807748  258418 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil>  [] 0s} 127.0.0.1 49427 <nil> <nil>}
	I0630 21:07:08.807776  258418 main.go:134] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sembed-certs-20220630210659-9950' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 embed-certs-20220630210659-9950/g' /etc/hosts;
				else 
					echo '127.0.1.1 embed-certs-20220630210659-9950' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0630 21:07:08.925119  258418 main.go:134] libmachine: SSH cmd err, output: <nil>: 
	I0630 21:07:08.925147  258418 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube CaCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/c
erts/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube}
	I0630 21:07:08.925201  258418 ubuntu.go:177] setting up certificates
	I0630 21:07:08.925214  258418 provision.go:83] configureAuth start
	I0630 21:07:08.925265  258418 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-20220630210659-9950
	I0630 21:07:08.960061  258418 provision.go:138] copyHostCerts
	I0630 21:07:08.960154  258418 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem, removing ...
	I0630 21:07:08.960170  258418 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem
	I0630 21:07:08.960258  258418 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem (1082 bytes)
	I0630 21:07:08.960358  258418 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem, removing ...
	I0630 21:07:08.960373  258418 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem
	I0630 21:07:08.960415  258418 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem (1123 bytes)
	I0630 21:07:08.960487  258418 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem, removing ...
	I0630 21:07:08.960500  258418 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem
	I0630 21:07:08.960537  258418 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem (1679 bytes)
	I0630 21:07:08.960643  258418 provision.go:112] generating server cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem org=jenkins.embed-certs-20220630210659-9950 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-20220630210659-9950]
	I0630 21:07:09.146367  258418 provision.go:172] copyRemoteCerts
	I0630 21:07:09.146434  258418 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0630 21:07:09.146467  258418 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:07:09.181391  258418 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49427 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:07:09.268359  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
	I0630 21:07:09.286430  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem --> /etc/docker/server.pem (1265 bytes)
	I0630 21:07:09.303887  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
	I0630 21:07:09.321968  258418 provision.go:86] duration metric: configureAuth took 396.737856ms
	I0630 21:07:09.321996  258418 ubuntu.go:193] setting minikube options for container-runtime
	I0630 21:07:09.322190  258418 config.go:178] Loaded profile config "embed-certs-20220630210659-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:07:09.322207  258418 machine.go:91] provisioned docker machine in 721.186892ms
	I0630 21:07:09.322214  258418 client.go:171] LocalClient.Create took 9.253625617s
	I0630 21:07:09.322232  258418 start.go:173] duration metric: libmachine.API.Create for "embed-certs-20220630210659-9950" took 9.253674873s
	I0630 21:07:09.322245  258418 start.go:306] post-start starting for "embed-certs-20220630210659-9950" (driver="docker")
	I0630 21:07:09.322250  258418 start.go:316] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0630 21:07:09.322300  258418 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0630 21:07:09.322345  258418 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:07:09.357615  258418 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49427 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:07:09.448779  258418 ssh_runner.go:195] Run: cat /etc/os-release
	I0630 21:07:09.451635  258418 main.go:134] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0630 21:07:09.451662  258418 main.go:134] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0630 21:07:09.451677  258418 main.go:134] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0630 21:07:09.451685  258418 info.go:137] Remote host: Ubuntu 20.04.4 LTS
	I0630 21:07:09.451696  258418 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/addons for local assets ...
	I0630 21:07:09.451763  258418 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files for local assets ...
	I0630 21:07:09.451845  258418 filesync.go:149] local asset: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem -> 99502.pem in /etc/ssl/certs
	I0630 21:07:09.451951  258418 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0630 21:07:09.458665  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem --> /etc/ssl/certs/99502.pem (1708 bytes)
	I0630 21:07:09.476026  258418 start.go:309] post-start completed in 153.769797ms
	I0630 21:07:09.476430  258418 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-20220630210659-9950
	I0630 21:07:09.510898  258418 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/config.json ...
	I0630 21:07:09.511146  258418 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0630 21:07:09.511187  258418 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:07:09.545651  258418 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49427 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:07:09.637501  258418 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0630 21:07:09.641506  258418 start.go:134] duration metric: createHost completed in 9.575373132s
	I0630 21:07:09.641531  258418 start.go:81] releasing machines lock for "embed-certs-20220630210659-9950", held for 9.57549992s
	I0630 21:07:09.641602  258418 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-20220630210659-9950
	I0630 21:07:09.677201  258418 ssh_runner.go:195] Run: systemctl --version
	I0630 21:07:09.677250  258418 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/
	I0630 21:07:09.677265  258418 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:07:09.677309  258418 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:07:09.713480  258418 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49427 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:07:09.713482  258418 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49427 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:07:06.559671  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:08.560388  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:09.797176  258418 ssh_runner.go:195] Run: sudo systemctl stop -f crio
	I0630 21:07:09.827436  258418 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0630 21:07:09.837837  258418 docker.go:179] disabling docker service ...
	I0630 21:07:09.837887  258418 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0630 21:07:09.854330  258418 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0630 21:07:09.864433  258418 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0630 21:07:09.947141  258418 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0630 21:07:10.021015  258418 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0630 21:07:10.030498  258418 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
	image-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0630 21:07:10.043126  258418 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*sandbox_image = .*$|sandbox_image = "k8s.gcr.io/pause:3.7"|' -i /etc/containerd/config.toml"
	I0630 21:07:10.051201  258418 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*restrict_oom_score_adj = .*$|restrict_oom_score_adj = false|' -i /etc/containerd/config.toml"
	I0630 21:07:10.060149  258418 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*SystemdCgroup = .*$|SystemdCgroup = false|' -i /etc/containerd/config.toml"
	I0630 21:07:10.068522  258418 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*conf_dir = .*$|conf_dir = "/etc/cni/net.mk"|' -i /etc/containerd/config.toml"
	I0630 21:07:10.077416  258418 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^# imports|imports = ["/etc/containerd/containerd.conf.d/02-containerd.conf"]|' -i /etc/containerd/config.toml"
	I0630 21:07:10.085718  258418 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc/containerd/containerd.conf.d && printf %!s(MISSING) "dmVyc2lvbiA9IDIK" | base64 -d | sudo tee /etc/containerd/containerd.conf.d/02-containerd.conf"
	I0630 21:07:10.100377  258418 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0630 21:07:10.107211  258418 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0630 21:07:10.114109  258418 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0630 21:07:10.199996  258418 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0630 21:07:10.275745  258418 start.go:447] Will wait 60s for socket path /run/containerd/containerd.sock
	I0630 21:07:10.275834  258418 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
	I0630 21:07:10.279416  258418 start.go:468] Will wait 60s for crictl version
	I0630 21:07:10.279463  258418 ssh_runner.go:195] Run: sudo crictl version
	I0630 21:07:10.306037  258418 start.go:477] Version:  0.1.0
	RuntimeName:  containerd
	RuntimeVersion:  1.6.6
	RuntimeApiVersion:  v1alpha2
	I0630 21:07:10.306097  258418 ssh_runner.go:195] Run: containerd --version
	I0630 21:07:10.336955  258418 ssh_runner.go:195] Run: containerd --version
	I0630 21:07:10.369264  258418 out.go:177] * Preparing Kubernetes v1.24.2 on containerd 1.6.6 ...
	I0630 21:07:06.322142  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:08.323262  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:10.323523  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:10.370707  258418 cli_runner.go:164] Run: docker network inspect embed-certs-20220630210659-9950 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0630 21:07:10.404290  258418 ssh_runner.go:195] Run: grep 192.168.94.1	host.minikube.internal$ /etc/hosts
	I0630 21:07:10.407606  258418 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.94.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0630 21:07:10.417141  258418 preload.go:132] Checking if preload exists for k8s version v1.24.2 and runtime containerd
	I0630 21:07:10.417195  258418 ssh_runner.go:195] Run: sudo crictl images --output json
	I0630 21:07:10.442185  258418 containerd.go:547] all images are preloaded for containerd runtime.
	I0630 21:07:10.442210  258418 containerd.go:461] Images already preloaded, skipping extraction
	I0630 21:07:10.442264  258418 ssh_runner.go:195] Run: sudo crictl images --output json
	I0630 21:07:10.466454  258418 containerd.go:547] all images are preloaded for containerd runtime.
	I0630 21:07:10.466477  258418 cache_images.go:84] Images are preloaded, skipping loading
	I0630 21:07:10.466518  258418 ssh_runner.go:195] Run: sudo crictl info
	I0630 21:07:10.490761  258418 cni.go:95] Creating CNI manager for ""
	I0630 21:07:10.490782  258418 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:07:10.490794  258418 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
	I0630 21:07:10.490806  258418 kubeadm.go:158] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.94.2 APIServerPort:8443 KubernetesVersion:v1.24.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:embed-certs-20220630210659-9950 NodeName:embed-certs-20220630210659-9950 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.94.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.94.2 CgroupDriver:cgroupfs ClientC
AFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}
	I0630 21:07:10.490930  258418 kubeadm.go:162] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.94.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: /run/containerd/containerd.sock
	  name: "embed-certs-20220630210659-9950"
	  kubeletExtraArgs:
	    node-ip: 192.168.94.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.94.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.24.2
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%!"(MISSING)
	  nodefs.inodesFree: "0%!"(MISSING)
	  imagefs.available: "0%!"(MISSING)
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0630 21:07:10.491006  258418 kubeadm.go:961] kubelet [Unit]
	Wants=containerd.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.24.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=embed-certs-20220630210659-9950 --image-service-endpoint=unix:///run/containerd/containerd.sock --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.94.2 --runtime-request-timeout=15m
	
	[Install]
	 config:
	{KubernetesVersion:v1.24.2 ClusterName:embed-certs-20220630210659-9950 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
	I0630 21:07:10.491052  258418 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.24.2
	I0630 21:07:10.498227  258418 binaries.go:44] Found k8s binaries, skipping transfer
	I0630 21:07:10.498292  258418 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0630 21:07:10.505224  258418 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (524 bytes)
	I0630 21:07:10.518421  258418 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0630 21:07:10.531076  258418 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2060 bytes)
	I0630 21:07:10.543943  258418 ssh_runner.go:195] Run: grep 192.168.94.2	control-plane.minikube.internal$ /etc/hosts
	I0630 21:07:10.547038  258418 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.94.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0630 21:07:10.556545  258418 certs.go:54] Setting up /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950 for IP: 192.168.94.2
	I0630 21:07:10.556652  258418 certs.go:182] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.key
	I0630 21:07:10.556714  258418 certs.go:182] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.key
	I0630 21:07:10.556769  258418 certs.go:302] generating minikube-user signed cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/client.key
	I0630 21:07:10.556787  258418 crypto.go:68] Generating cert /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/client.crt with IP's: []
	I0630 21:07:10.765363  258418 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/client.crt ...
	I0630 21:07:10.765395  258418 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/client.crt: {Name:mk2189a82adcc765dfa2510a823d0440782737cd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:07:10.765620  258418 crypto.go:164] Writing key to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/client.key ...
	I0630 21:07:10.765636  258418 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/client.key: {Name:mkdeb0e682321ff945ca41fa64d1e608453c6f36 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:07:10.765773  258418 certs.go:302] generating minikube signed cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.key.ad8e880a
	I0630 21:07:10.765794  258418 crypto.go:68] Generating cert /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.crt.ad8e880a with IP's: [192.168.94.2 10.96.0.1 127.0.0.1 10.0.0.1]
	I0630 21:07:10.910596  258418 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.crt.ad8e880a ...
	I0630 21:07:10.910627  258418 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.crt.ad8e880a: {Name:mkc69164c3a143b379c0f4996d5e2da27861b5ff Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:07:10.910832  258418 crypto.go:164] Writing key to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.key.ad8e880a ...
	I0630 21:07:10.910846  258418 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.key.ad8e880a: {Name:mk8e2527beae912aa15913d6f348638ece4c494e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:07:10.910935  258418 certs.go:320] copying /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.crt.ad8e880a -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.crt
	I0630 21:07:10.910996  258418 certs.go:324] copying /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.key.ad8e880a -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.key
	I0630 21:07:10.911041  258418 certs.go:302] generating aggregator signed cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.key
	I0630 21:07:10.911054  258418 crypto.go:68] Generating cert /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.crt with IP's: []
	I0630 21:07:11.469066  258418 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.crt ...
	I0630 21:07:11.469461  258418 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.crt: {Name:mk9657fa57381458a8b172f509e4d3599add736c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:07:11.469782  258418 crypto.go:164] Writing key to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.key ...
	I0630 21:07:11.469807  258418 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.key: {Name:mkd9e4d5545bdb7302e99bfbbe9d07417abbdc89 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:07:11.470115  258418 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950.pem (1338 bytes)
	W0630 21:07:11.470166  258418 certs.go:384] ignoring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950_empty.pem, impossibly tiny 0 bytes
	I0630 21:07:11.470180  258418 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem (1679 bytes)
	I0630 21:07:11.470222  258418 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem (1082 bytes)
	I0630 21:07:11.470260  258418 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem (1123 bytes)
	I0630 21:07:11.470301  258418 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/key.pem (1679 bytes)
	I0630 21:07:11.470362  258418 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem (1708 bytes)
	I0630 21:07:11.471511  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
	I0630 21:07:11.490653  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I0630 21:07:11.508628  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0630 21:07:11.527379  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
	I0630 21:07:11.545789  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0630 21:07:11.564535  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
	I0630 21:07:11.582438  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0630 21:07:11.600444  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
	I0630 21:07:11.620977  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem --> /usr/share/ca-certificates/99502.pem (1708 bytes)
	I0630 21:07:11.639639  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0630 21:07:11.658178  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950.pem --> /usr/share/ca-certificates/9950.pem (1338 bytes)
	I0630 21:07:11.677694  258418 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0630 21:07:11.690755  258418 ssh_runner.go:195] Run: openssl version
	I0630 21:07:11.695688  258418 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/99502.pem && ln -fs /usr/share/ca-certificates/99502.pem /etc/ssl/certs/99502.pem"
	I0630 21:07:11.703347  258418 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/99502.pem
	I0630 21:07:11.706626  258418 certs.go:431] hashing: -rw-r--r-- 1 root root 1708 Jun 30 20:26 /usr/share/ca-certificates/99502.pem
	I0630 21:07:11.706684  258418 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/99502.pem
	I0630 21:07:11.711429  258418 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/99502.pem /etc/ssl/certs/3ec20f2e.0"
	I0630 21:07:11.719285  258418 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0630 21:07:11.726650  258418 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:07:11.729726  258418 certs.go:431] hashing: -rw-r--r-- 1 root root 1111 Jun 30 20:22 /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:07:11.729781  258418 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:07:11.734559  258418 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0630 21:07:11.741992  258418 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/9950.pem && ln -fs /usr/share/ca-certificates/9950.pem /etc/ssl/certs/9950.pem"
	I0630 21:07:11.752166  258418 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/9950.pem
	I0630 21:07:11.755639  258418 certs.go:431] hashing: -rw-r--r-- 1 root root 1338 Jun 30 20:26 /usr/share/ca-certificates/9950.pem
	I0630 21:07:11.755700  258418 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/9950.pem
	I0630 21:07:11.760725  258418 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/9950.pem /etc/ssl/certs/51391683.0"
	I0630 21:07:11.768543  258418 kubeadm.go:395] StartCluster: {Name:embed-certs-20220630210659-9950 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:embed-certs-20220630210659-9950 Namespace:default APIServerName
:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirr
or: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 21:07:11.768636  258418 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
	I0630 21:07:11.768692  258418 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0630 21:07:11.793825  258418 cri.go:87] found id: ""
	I0630 21:07:11.793907  258418 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0630 21:07:11.801886  258418 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0630 21:07:11.809295  258418 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver
	I0630 21:07:11.809360  258418 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0630 21:07:11.816601  258418 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0630 21:07:11.816642  258418 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0630 21:07:11.060021  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:13.559886  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:12.823802  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:15.322092  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:15.560115  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:18.060545  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:17.322180  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:19.322480  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:22.533924  258418 out.go:204]   - Generating certificates and keys ...
	I0630 21:07:22.537123  258418 out.go:204]   - Booting up control plane ...
	I0630 21:07:22.539540  258418 out.go:204]   - Configuring RBAC rules ...
	I0630 21:07:22.542068  258418 cni.go:95] Creating CNI manager for ""
	I0630 21:07:22.542090  258418 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:07:22.543871  258418 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0630 21:07:22.545247  258418 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0630 21:07:22.549022  258418 cni.go:189] applying CNI manifest using /var/lib/minikube/binaries/v1.24.2/kubectl ...
	I0630 21:07:22.549039  258418 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2429 bytes)
	I0630 21:07:22.563394  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0630 21:07:23.507644  258418 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0630 21:07:23.507717  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:23.507738  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl label nodes minikube.k8s.io/version=v1.26.0 minikube.k8s.io/commit=251ffcec0e4c997cd7732864187747cc579943c9 minikube.k8s.io/name=embed-certs-20220630210659-9950 minikube.k8s.io/updated_at=2022_06_30T21_07_23_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:23.514525  258418 ops.go:34] apiserver oom_adj: -16
	I0630 21:07:23.575212  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:24.170884  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:24.670874  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:20.560389  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:23.059986  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:25.060230  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:21.821348  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:23.821974  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:25.170894  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:25.670569  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:26.170948  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:26.670289  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:27.171214  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:27.670384  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:28.171262  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:28.671014  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:29.170342  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:29.671154  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:27.560295  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:30.060032  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:25.822336  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:28.321275  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:30.322133  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:30.170498  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:30.670666  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:31.170390  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:31.671212  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:32.170367  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:32.670667  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:33.170348  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:33.670265  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:34.170960  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:34.670712  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:32.559626  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:34.559784  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:34.845605  258418 kubeadm.go:1045] duration metric: took 11.337946322s to wait for elevateKubeSystemPrivileges.
	I0630 21:07:34.845642  258418 kubeadm.go:397] StartCluster complete in 23.077108776s
	I0630 21:07:34.845658  258418 settings.go:142] acquiring lock: {Name:mkcbd229caa05b60d3551ef0b47eea08424c9b5d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:07:34.845753  258418 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:07:34.847459  258418 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig: {Name:mk34e4a4e7b04f624b9adbda4f77ee20b38308ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:07:35.362178  258418 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "embed-certs-20220630210659-9950" rescaled to 1
	I0630 21:07:35.362241  258418 start.go:208] Will wait 6m0s for node &{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0630 21:07:35.365698  258418 out.go:177] * Verifying Kubernetes components...
	I0630 21:07:35.362298  258418 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0630 21:07:35.362308  258418 addons.go:412] enableAddons start: toEnable=map[], additional=[]
	I0630 21:07:35.365824  258418 addons.go:65] Setting storage-provisioner=true in profile "embed-certs-20220630210659-9950"
	I0630 21:07:35.362522  258418 config.go:178] Loaded profile config "embed-certs-20220630210659-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:07:35.365855  258418 addons.go:153] Setting addon storage-provisioner=true in "embed-certs-20220630210659-9950"
	W0630 21:07:35.365867  258418 addons.go:162] addon storage-provisioner should already be in state true
	I0630 21:07:35.365909  258418 host.go:66] Checking if "embed-certs-20220630210659-9950" exists ...
	I0630 21:07:35.365837  258418 addons.go:65] Setting default-storageclass=true in profile "embed-certs-20220630210659-9950"
	I0630 21:07:35.367597  258418 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 21:07:35.367617  258418 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "embed-certs-20220630210659-9950"
	I0630 21:07:35.366441  258418 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:07:35.367981  258418 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:07:35.413326  258418 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0630 21:07:32.322459  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:34.821349  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:35.413605  258418 addons.go:153] Setting addon default-storageclass=true in "embed-certs-20220630210659-9950"
	W0630 21:07:35.414779  258418 addons.go:162] addon default-storageclass should already be in state true
	I0630 21:07:35.414788  258418 addons.go:345] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 21:07:35.414799  258418 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0630 21:07:35.414802  258418 host.go:66] Checking if "embed-certs-20220630210659-9950" exists ...
	I0630 21:07:35.414839  258418 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:07:35.415175  258418 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:07:35.457376  258418 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.94.1 host.minikube.internal\n           fallthrough\n        }' | sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0630 21:07:35.458873  258418 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49427 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:07:35.458979  258418 node_ready.go:35] waiting up to 6m0s for node "embed-certs-20220630210659-9950" to be "Ready" ...
	I0630 21:07:35.461992  258418 addons.go:345] installing /etc/kubernetes/addons/storageclass.yaml
	I0630 21:07:35.462008  258418 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0630 21:07:35.462054  258418 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:07:35.501119  258418 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49427 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:07:35.644457  258418 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 21:07:35.747687  258418 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0630 21:07:36.026997  258418 start.go:806] {"host.minikube.internal": 192.168.94.1} host record injected into CoreDNS
	I0630 21:07:36.263877  258418 out.go:177] * Enabled addons: storage-provisioner, default-storageclass
	I0630 21:07:36.265439  258418 addons.go:414] enableAddons completed in 903.132951ms
	I0630 21:07:37.465314  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:07:37.059624  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:39.059792  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:36.821414  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:38.822111  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:39.965997  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:07:41.966144  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:07:44.466024  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:07:41.060328  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:43.060458  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:41.321999  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:43.821239  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:46.965627  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:07:48.966028  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:07:45.560281  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:48.059772  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:50.059801  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:45.821375  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:47.821892  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:49.822095  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:51.466128  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:07:53.965949  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:07:52.060088  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:54.559829  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:51.822570  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:54.322283  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:55.966446  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:07:57.966572  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:07:56.560117  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:59.060638  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:56.822512  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:59.322047  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:00.465385  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:02.466107  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:01.559922  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:08:03.560005  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:08:01.821701  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:03.822251  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:04.966016  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:07.465504  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:09.465988  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:06.059907  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:08:08.060375  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:08:06.322082  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:08.322154  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:10.322487  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:11.965618  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:13.966333  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:10.559488  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:08:12.560562  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:08:15.060921  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:08:12.821974  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:14.822566  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:15.966399  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:17.967088  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:17.559310  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:08:19.560222  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:08:17.322397  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:19.322675  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:22.059940  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:08:23.062928  242039 node_ready.go:38] duration metric: took 4m0.010106635s waiting for node "default-k8s-different-port-20220630210335-9950" to be "Ready" ...
	I0630 21:08:23.064921  242039 out.go:177] 
	W0630 21:08:23.066357  242039 out.go:239] X Exiting due to GUEST_START: wait 6m0s for node: waiting for node to be ready: waitNodeCondition: timed out waiting for the condition
	W0630 21:08:23.066374  242039 out.go:239] * 
	W0630 21:08:23.067132  242039 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0630 21:08:23.069099  242039 out.go:177] 
	
	* 
	* ==> container status <==
	* CONTAINER           IMAGE               CREATED              STATE               NAME                      ATTEMPT             POD ID
	584280e8bde0e       6fb66cd78abfe       About a minute ago   Running             kindnet-cni               1                   0823b9897612c
	8102f84d94828       6fb66cd78abfe       4 minutes ago        Exited              kindnet-cni               0                   0823b9897612c
	aa0dfccd9a7c9       a634548d10b03       4 minutes ago        Running             kube-proxy                0                   c479a4792f00e
	b2e2e7466122c       5d725196c1f47       4 minutes ago        Running             kube-scheduler            0                   406a4d9e4a4e0
	56c1c7bc165ac       34cdf99b1bb3b       4 minutes ago        Running             kube-controller-manager   0                   5eece610e7575
	f0093895eba10       d3377ffb7177c       4 minutes ago        Running             kube-apiserver            0                   07624118b1109
	a126cf77f563c       aebe758cef4cd       4 minutes ago        Running             etcd                      0                   795cd8784cf1c
	
	* 
	* ==> containerd <==
	* -- Logs begin at Thu 2022-06-30 21:03:44 UTC, end at Thu 2022-06-30 21:08:24 UTC. --
	Jun 30 21:04:22 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:04:22.273546398Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
	Jun 30 21:04:22 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:04:22.273556231Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
	Jun 30 21:04:22 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:04:22.273727958Z" level=info msg="starting signal loop" namespace=k8s.io path=/run/containerd/io.containerd.runtime.v2.task/k8s.io/0823b9897612c7f5b860b2b0d00ed072c571f9d7f024a97a59f9ccd688f6dee7 pid=1716 runtime=io.containerd.runc.v2
	Jun 30 21:04:22 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:04:22.275405707Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1
	Jun 30 21:04:22 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:04:22.275479110Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
	Jun 30 21:04:22 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:04:22.275488915Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
	Jun 30 21:04:22 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:04:22.275670217Z" level=info msg="starting signal loop" namespace=k8s.io path=/run/containerd/io.containerd.runtime.v2.task/k8s.io/c479a4792f00ed62aa74a3546e3152b03654ca0c6a659f041c27a9784e0ba43d pid=1725 runtime=io.containerd.runc.v2
	Jun 30 21:04:22 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:04:22.365898570Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kube-proxy-jb4cj,Uid:f292d396-44fc-483d-953b-c68f7b577b9b,Namespace:kube-system,Attempt:0,} returns sandbox id \"c479a4792f00ed62aa74a3546e3152b03654ca0c6a659f041c27a9784e0ba43d\""
	Jun 30 21:04:22 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:04:22.369290038Z" level=info msg="CreateContainer within sandbox \"c479a4792f00ed62aa74a3546e3152b03654ca0c6a659f041c27a9784e0ba43d\" for container &ContainerMetadata{Name:kube-proxy,Attempt:0,}"
	Jun 30 21:04:22 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:04:22.385894701Z" level=info msg="CreateContainer within sandbox \"c479a4792f00ed62aa74a3546e3152b03654ca0c6a659f041c27a9784e0ba43d\" for &ContainerMetadata{Name:kube-proxy,Attempt:0,} returns container id \"aa0dfccd9a7c940761ea2c4805338d040616ef5e513c23001d346fe07a7c5eff\""
	Jun 30 21:04:22 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:04:22.387032000Z" level=info msg="StartContainer for \"aa0dfccd9a7c940761ea2c4805338d040616ef5e513c23001d346fe07a7c5eff\""
	Jun 30 21:04:22 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:04:22.527754654Z" level=info msg="StartContainer for \"aa0dfccd9a7c940761ea2c4805338d040616ef5e513c23001d346fe07a7c5eff\" returns successfully"
	Jun 30 21:04:22 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:04:22.561707985Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kindnet-jgsc8,Uid:a63f0d82-ce2a-4e93-8747-604386ef8614,Namespace:kube-system,Attempt:0,} returns sandbox id \"0823b9897612c7f5b860b2b0d00ed072c571f9d7f024a97a59f9ccd688f6dee7\""
	Jun 30 21:04:22 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:04:22.564895377Z" level=info msg="CreateContainer within sandbox \"0823b9897612c7f5b860b2b0d00ed072c571f9d7f024a97a59f9ccd688f6dee7\" for container &ContainerMetadata{Name:kindnet-cni,Attempt:0,}"
	Jun 30 21:04:22 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:04:22.628069414Z" level=info msg="CreateContainer within sandbox \"0823b9897612c7f5b860b2b0d00ed072c571f9d7f024a97a59f9ccd688f6dee7\" for &ContainerMetadata{Name:kindnet-cni,Attempt:0,} returns container id \"8102f84d94828ce8eeaa9af1d8a6fc6e04b5f6af2c880836155b0488af953431\""
	Jun 30 21:04:22 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:04:22.628843828Z" level=info msg="StartContainer for \"8102f84d94828ce8eeaa9af1d8a6fc6e04b5f6af2c880836155b0488af953431\""
	Jun 30 21:04:22 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:04:22.741896204Z" level=info msg="StartContainer for \"8102f84d94828ce8eeaa9af1d8a6fc6e04b5f6af2c880836155b0488af953431\" returns successfully"
	Jun 30 21:07:07 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:07:07.383004791Z" level=info msg="shim disconnected" id=8102f84d94828ce8eeaa9af1d8a6fc6e04b5f6af2c880836155b0488af953431
	Jun 30 21:07:07 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:07:07.383080416Z" level=warning msg="cleaning up after shim disconnected" id=8102f84d94828ce8eeaa9af1d8a6fc6e04b5f6af2c880836155b0488af953431 namespace=k8s.io
	Jun 30 21:07:07 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:07:07.383098375Z" level=info msg="cleaning up dead shim"
	Jun 30 21:07:07 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:07:07.394131200Z" level=warning msg="cleanup warnings time=\"2022-06-30T21:07:07Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=2116 runtime=io.containerd.runc.v2\n"
	Jun 30 21:07:08 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:07:08.072070812Z" level=info msg="CreateContainer within sandbox \"0823b9897612c7f5b860b2b0d00ed072c571f9d7f024a97a59f9ccd688f6dee7\" for container &ContainerMetadata{Name:kindnet-cni,Attempt:1,}"
	Jun 30 21:07:08 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:07:08.088865141Z" level=info msg="CreateContainer within sandbox \"0823b9897612c7f5b860b2b0d00ed072c571f9d7f024a97a59f9ccd688f6dee7\" for &ContainerMetadata{Name:kindnet-cni,Attempt:1,} returns container id \"584280e8bde0ef7bf80df61cbb48a357cfdc1ad65b8de1fea8b6945ea020a7da\""
	Jun 30 21:07:08 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:07:08.090137996Z" level=info msg="StartContainer for \"584280e8bde0ef7bf80df61cbb48a357cfdc1ad65b8de1fea8b6945ea020a7da\""
	Jun 30 21:07:08 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:07:08.242829335Z" level=info msg="StartContainer for \"584280e8bde0ef7bf80df61cbb48a357cfdc1ad65b8de1fea8b6945ea020a7da\" returns successfully"
	
	* 
	* ==> describe nodes <==
	* Name:               default-k8s-different-port-20220630210335-9950
	Roles:              control-plane
	Labels:             beta.kubernetes.io/arch=amd64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=amd64
	                    kubernetes.io/hostname=default-k8s-different-port-20220630210335-9950
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=251ffcec0e4c997cd7732864187747cc579943c9
	                    minikube.k8s.io/name=default-k8s-different-port-20220630210335-9950
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2022_06_30T21_04_10_0700
	                    minikube.k8s.io/version=v1.26.0
	                    node-role.kubernetes.io/control-plane=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///run/containerd/containerd.sock
	                    node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Thu, 30 Jun 2022 21:04:06 +0000
	Taints:             node.kubernetes.io/not-ready:NoSchedule
	Unschedulable:      false
	Lease:
	  HolderIdentity:  default-k8s-different-port-20220630210335-9950
	  AcquireTime:     <unset>
	  RenewTime:       Thu, 30 Jun 2022 21:08:15 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Thu, 30 Jun 2022 21:04:19 +0000   Thu, 30 Jun 2022 21:04:03 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Thu, 30 Jun 2022 21:04:19 +0000   Thu, 30 Jun 2022 21:04:03 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Thu, 30 Jun 2022 21:04:19 +0000   Thu, 30 Jun 2022 21:04:03 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            False   Thu, 30 Jun 2022 21:04:19 +0000   Thu, 30 Jun 2022 21:04:03 +0000   KubeletNotReady              container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Addresses:
	  InternalIP:  192.168.85.2
	  Hostname:    default-k8s-different-port-20220630210335-9950
	Capacity:
	  cpu:                8
	  ephemeral-storage:  304695084Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32873488Ki
	  pods:               110
	Allocatable:
	  cpu:                8
	  ephemeral-storage:  304695084Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32873488Ki
	  pods:               110
	System Info:
	  Machine ID:                 bbe1e1cef6e940328962dca52b3c5731
	  System UUID:                f0807fcb-4145-441b-8a5a-5dbf32733249
	  Boot ID:                    471c4729-f046-4a15-bc49-46f3ad561708
	  Kernel Version:             5.15.0-1012-gcp
	  OS Image:                   Ubuntu 20.04.4 LTS
	  Operating System:           linux
	  Architecture:               amd64
	  Container Runtime Version:  containerd://1.6.6
	  Kubelet Version:            v1.24.2
	  Kube-Proxy Version:         v1.24.2
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (6 in total)
	  Namespace                   Name                                                                      CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                                                      ------------  ----------  ---------------  -------------  ---
	  kube-system                 etcd-default-k8s-different-port-20220630210335-9950                       100m (1%!)(MISSING)     0 (0%!)(MISSING)      100Mi (0%!)(MISSING)       0 (0%!)(MISSING)         4m14s
	  kube-system                 kindnet-jgsc8                                                             100m (1%!)(MISSING)     100m (1%!)(MISSING)   50Mi (0%!)(MISSING)        50Mi (0%!)(MISSING)      4m3s
	  kube-system                 kube-apiserver-default-k8s-different-port-20220630210335-9950             250m (3%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m15s
	  kube-system                 kube-controller-manager-default-k8s-different-port-20220630210335-9950    200m (2%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m16s
	  kube-system                 kube-proxy-jb4cj                                                          0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m3s
	  kube-system                 kube-scheduler-default-k8s-different-port-20220630210335-9950             100m (1%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m15s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                750m (9%!)(MISSING)   100m (1%!)(MISSING)
	  memory             150Mi (0%!)(MISSING)  50Mi (0%!)(MISSING)
	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	Events:
	  Type    Reason                   Age                    From             Message
	  ----    ------                   ----                   ----             -------
	  Normal  Starting                 4m1s                   kube-proxy       
	  Normal  NodeHasSufficientMemory  4m23s (x5 over 4m23s)  kubelet          Node default-k8s-different-port-20220630210335-9950 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    4m23s (x5 over 4m23s)  kubelet          Node default-k8s-different-port-20220630210335-9950 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     4m23s (x4 over 4m23s)  kubelet          Node default-k8s-different-port-20220630210335-9950 status is now: NodeHasSufficientPID
	  Normal  NodeHasNoDiskPressure    4m15s                  kubelet          Node default-k8s-different-port-20220630210335-9950 status is now: NodeHasNoDiskPressure
	  Normal  Starting                 4m15s                  kubelet          Starting kubelet.
	  Normal  NodeHasSufficientMemory  4m15s                  kubelet          Node default-k8s-different-port-20220630210335-9950 status is now: NodeHasSufficientMemory
	  Normal  NodeHasSufficientPID     4m15s                  kubelet          Node default-k8s-different-port-20220630210335-9950 status is now: NodeHasSufficientPID
	  Normal  NodeAllocatableEnforced  4m15s                  kubelet          Updated Node Allocatable limit across pods
	  Normal  RegisteredNode           4m3s                   node-controller  Node default-k8s-different-port-20220630210335-9950 event: Registered Node default-k8s-different-port-20220630210335-9950 in Controller
	
	* 
	* ==> dmesg <==
	* [  +2.939825] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000011] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.027789] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.019913] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[ +21.968090] IPv4: martian destination 127.0.0.11 from 10.244.0.3, dev veth8071d138
	[ +25.445872] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.029436] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.023957] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +2.947695] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[Jun30 21:05] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.023879] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +2.955783] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.011828] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000005] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.027896] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	
	* 
	* ==> etcd [a126cf77f563c9a045eb277d6616e24e487ddda0de594854165897f596aaacb9] <==
	* {"level":"info","ts":"2022-06-30T21:04:02.744Z","caller":"embed/etcd.go:688","msg":"starting with client TLS","tls-info":"cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, client-cert=, client-key=, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = ","cipher-suites":[]}
	{"level":"info","ts":"2022-06-30T21:04:02.744Z","caller":"embed/etcd.go:277","msg":"now serving peer/client/metrics","local-member-id":"9f0758e1c58a86ed","initial-advertise-peer-urls":["https://192.168.85.2:2380"],"listen-peer-urls":["https://192.168.85.2:2380"],"advertise-client-urls":["https://192.168.85.2:2379"],"listen-client-urls":["https://127.0.0.1:2379","https://192.168.85.2:2379"],"listen-metrics-urls":["http://127.0.0.1:2381"]}
	{"level":"info","ts":"2022-06-30T21:04:02.744Z","caller":"embed/etcd.go:763","msg":"serving metrics","address":"http://127.0.0.1:2381"}
	{"level":"info","ts":"2022-06-30T21:04:02.744Z","caller":"embed/etcd.go:581","msg":"serving peer traffic","address":"192.168.85.2:2380"}
	{"level":"info","ts":"2022-06-30T21:04:02.744Z","caller":"embed/etcd.go:553","msg":"cmux::serve","address":"192.168.85.2:2380"}
	{"level":"info","ts":"2022-06-30T21:04:03.633Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"9f0758e1c58a86ed is starting a new election at term 1"}
	{"level":"info","ts":"2022-06-30T21:04:03.633Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"9f0758e1c58a86ed became pre-candidate at term 1"}
	{"level":"info","ts":"2022-06-30T21:04:03.633Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"9f0758e1c58a86ed received MsgPreVoteResp from 9f0758e1c58a86ed at term 1"}
	{"level":"info","ts":"2022-06-30T21:04:03.633Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"9f0758e1c58a86ed became candidate at term 2"}
	{"level":"info","ts":"2022-06-30T21:04:03.633Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"9f0758e1c58a86ed received MsgVoteResp from 9f0758e1c58a86ed at term 2"}
	{"level":"info","ts":"2022-06-30T21:04:03.633Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"9f0758e1c58a86ed became leader at term 2"}
	{"level":"info","ts":"2022-06-30T21:04:03.633Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: 9f0758e1c58a86ed elected leader 9f0758e1c58a86ed at term 2"}
	{"level":"info","ts":"2022-06-30T21:04:03.633Z","caller":"etcdserver/server.go:2042","msg":"published local member to cluster through raft","local-member-id":"9f0758e1c58a86ed","local-member-attributes":"{Name:default-k8s-different-port-20220630210335-9950 ClientURLs:[https://192.168.85.2:2379]}","request-path":"/0/members/9f0758e1c58a86ed/attributes","cluster-id":"68eaea490fab4e05","publish-timeout":"7s"}
	{"level":"info","ts":"2022-06-30T21:04:03.633Z","caller":"embed/serve.go:98","msg":"ready to serve client requests"}
	{"level":"info","ts":"2022-06-30T21:04:03.633Z","caller":"etcdserver/server.go:2507","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}
	{"level":"info","ts":"2022-06-30T21:04:03.633Z","caller":"embed/serve.go:98","msg":"ready to serve client requests"}
	{"level":"info","ts":"2022-06-30T21:04:03.634Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
	{"level":"info","ts":"2022-06-30T21:04:03.634Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
	{"level":"info","ts":"2022-06-30T21:04:03.634Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"68eaea490fab4e05","local-member-id":"9f0758e1c58a86ed","cluster-version":"3.5"}
	{"level":"info","ts":"2022-06-30T21:04:03.634Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
	{"level":"info","ts":"2022-06-30T21:04:03.634Z","caller":"etcdserver/server.go:2531","msg":"cluster version is updated","cluster-version":"3.5"}
	{"level":"info","ts":"2022-06-30T21:04:03.635Z","caller":"embed/serve.go:188","msg":"serving client traffic securely","address":"127.0.0.1:2379"}
	{"level":"info","ts":"2022-06-30T21:04:03.635Z","caller":"embed/serve.go:188","msg":"serving client traffic securely","address":"192.168.85.2:2379"}
	{"level":"warn","ts":"2022-06-30T21:07:03.828Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"140.683358ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/\" range_end:\"/registry/pods0\" count_only:true ","response":"range_response_count:0 size:7"}
	{"level":"info","ts":"2022-06-30T21:07:03.828Z","caller":"traceutil/trace.go:171","msg":"trace[45868920] range","detail":"{range_begin:/registry/pods/; range_end:/registry/pods0; response_count:0; response_revision:421; }","duration":"140.817273ms","start":"2022-06-30T21:07:03.687Z","end":"2022-06-30T21:07:03.828Z","steps":["trace[45868920] 'count revisions from in-memory index tree'  (duration: 140.576636ms)"],"step_count":1}
	
	* 
	* ==> kernel <==
	*  21:08:24 up 50 min,  0 users,  load average: 0.61, 1.44, 1.87
	Linux default-k8s-different-port-20220630210335-9950 5.15.0-1012-gcp #17~20.04.1-Ubuntu SMP Thu Jun 23 16:10:34 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
	PRETTY_NAME="Ubuntu 20.04.4 LTS"
	
	* 
	* ==> kube-apiserver [f0093895eba1080a2212532b5c34b83dc16abf6e2eccfb1bdf732d5e70875609] <==
	* I0630 21:04:06.434171       1 shared_informer.go:262] Caches are synced for cluster_authentication_trust_controller
	I0630 21:04:06.439202       1 controller.go:611] quota admission added evaluator for: namespaces
	I0630 21:04:06.523292       1 apf_controller.go:322] Running API Priority and Fairness config worker
	I0630 21:04:06.523335       1 cache.go:39] Caches are synced for APIServiceRegistrationController controller
	I0630 21:04:06.523484       1 shared_informer.go:262] Caches are synced for node_authorizer
	I0630 21:04:06.523520       1 cache.go:39] Caches are synced for autoregister controller
	I0630 21:04:06.528129       1 shared_informer.go:262] Caches are synced for crd-autoregister
	I0630 21:04:06.987992       1 controller.go:132] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).
	I0630 21:04:07.306964       1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000
	I0630 21:04:07.310021       1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000
	I0630 21:04:07.310040       1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.
	I0630 21:04:07.688455       1 controller.go:611] quota admission added evaluator for: roles.rbac.authorization.k8s.io
	I0630 21:04:07.735835       1 controller.go:611] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
	I0630 21:04:07.854938       1 alloc.go:327] "allocated clusterIPs" service="default/kubernetes" clusterIPs=map[IPv4:10.96.0.1]
	W0630 21:04:07.860197       1 lease.go:234] Resetting endpoints for master service "kubernetes" to [192.168.85.2]
	I0630 21:04:07.861189       1 controller.go:611] quota admission added evaluator for: endpoints
	I0630 21:04:07.864940       1 controller.go:611] quota admission added evaluator for: endpointslices.discovery.k8s.io
	I0630 21:04:08.456765       1 controller.go:611] quota admission added evaluator for: serviceaccounts
	I0630 21:04:09.445974       1 controller.go:611] quota admission added evaluator for: deployments.apps
	I0630 21:04:09.455771       1 alloc.go:327] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs=map[IPv4:10.96.0.10]
	I0630 21:04:09.466333       1 controller.go:611] quota admission added evaluator for: daemonsets.apps
	I0630 21:04:09.563553       1 controller.go:611] quota admission added evaluator for: leases.coordination.k8s.io
	I0630 21:04:21.314803       1 controller.go:611] quota admission added evaluator for: controllerrevisions.apps
	I0630 21:04:22.114650       1 controller.go:611] quota admission added evaluator for: replicasets.apps
	I0630 21:04:22.652116       1 controller.go:611] quota admission added evaluator for: events.events.k8s.io
	
	* 
	* ==> kube-controller-manager [56c1c7bc165ac17cdfb803f71cd26ff02ab6261448f17c5c4ac7f531a632c67b] <==
	* I0630 21:04:21.320479       1 shared_informer.go:262] Caches are synced for namespace
	I0630 21:04:21.320896       1 event.go:294] "Event occurred" object="kube-system/kube-proxy" fieldPath="" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-jb4cj"
	I0630 21:04:21.324363       1 event.go:294] "Event occurred" object="kube-system/kindnet" fieldPath="" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kindnet-jgsc8"
	I0630 21:04:21.355651       1 shared_informer.go:262] Caches are synced for deployment
	I0630 21:04:21.359253       1 shared_informer.go:262] Caches are synced for service account
	I0630 21:04:21.366778       1 shared_informer.go:262] Caches are synced for disruption
	I0630 21:04:21.366798       1 disruption.go:371] Sending events to api server.
	I0630 21:04:21.487997       1 shared_informer.go:262] Caches are synced for endpoint_slice_mirroring
	I0630 21:04:21.490195       1 shared_informer.go:262] Caches are synced for endpoint
	I0630 21:04:21.503596       1 shared_informer.go:262] Caches are synced for expand
	I0630 21:04:21.504800       1 shared_informer.go:262] Caches are synced for stateful set
	I0630 21:04:21.512633       1 shared_informer.go:262] Caches are synced for persistent volume
	I0630 21:04:21.523832       1 shared_informer.go:262] Caches are synced for resource quota
	I0630 21:04:21.524971       1 shared_informer.go:262] Caches are synced for PVC protection
	I0630 21:04:21.556715       1 shared_informer.go:262] Caches are synced for ephemeral
	I0630 21:04:21.561878       1 shared_informer.go:262] Caches are synced for attach detach
	I0630 21:04:21.568100       1 shared_informer.go:262] Caches are synced for resource quota
	I0630 21:04:21.927657       1 shared_informer.go:262] Caches are synced for garbage collector
	I0630 21:04:21.927689       1 garbagecollector.go:158] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
	I0630 21:04:21.943923       1 shared_informer.go:262] Caches are synced for garbage collector
	I0630 21:04:22.116902       1 event.go:294] "Event occurred" object="kube-system/coredns" fieldPath="" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-6d4b75cb6d to 2"
	I0630 21:04:22.317548       1 event.go:294] "Event occurred" object="kube-system/coredns-6d4b75cb6d" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-6d4b75cb6d-cnt2b"
	I0630 21:04:22.323524       1 event.go:294] "Event occurred" object="kube-system/coredns-6d4b75cb6d" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-6d4b75cb6d-rp7g9"
	I0630 21:04:22.469674       1 event.go:294] "Event occurred" object="kube-system/coredns" fieldPath="" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-6d4b75cb6d to 1"
	I0630 21:04:22.523588       1 event.go:294] "Event occurred" object="kube-system/coredns-6d4b75cb6d" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-6d4b75cb6d-rp7g9"
	
	* 
	* ==> kube-proxy [aa0dfccd9a7c940761ea2c4805338d040616ef5e513c23001d346fe07a7c5eff] <==
	* I0630 21:04:22.576102       1 node.go:163] Successfully retrieved node IP: 192.168.85.2
	I0630 21:04:22.576176       1 server_others.go:138] "Detected node IP" address="192.168.85.2"
	I0630 21:04:22.576216       1 server_others.go:578] "Unknown proxy mode, assuming iptables proxy" proxyMode=""
	I0630 21:04:22.648411       1 server_others.go:206] "Using iptables Proxier"
	I0630 21:04:22.648445       1 server_others.go:213] "kube-proxy running in dual-stack mode" ipFamily=IPv4
	I0630 21:04:22.648457       1 server_others.go:214] "Creating dualStackProxier for iptables"
	I0630 21:04:22.648483       1 server_others.go:501] "Detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, , defaulting to no-op detect-local for IPv6"
	I0630 21:04:22.648518       1 proxier.go:259] "Setting route_localnet=1, use nodePortAddresses to filter loopback addresses for NodePorts to skip it https://issues.k8s.io/90259"
	I0630 21:04:22.648694       1 proxier.go:259] "Setting route_localnet=1, use nodePortAddresses to filter loopback addresses for NodePorts to skip it https://issues.k8s.io/90259"
	I0630 21:04:22.648965       1 server.go:661] "Version info" version="v1.24.2"
	I0630 21:04:22.648989       1 server.go:663] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
	I0630 21:04:22.649821       1 config.go:226] "Starting endpoint slice config controller"
	I0630 21:04:22.649843       1 shared_informer.go:255] Waiting for caches to sync for endpoint slice config
	I0630 21:04:22.649889       1 config.go:317] "Starting service config controller"
	I0630 21:04:22.649900       1 shared_informer.go:255] Waiting for caches to sync for service config
	I0630 21:04:22.649946       1 config.go:444] "Starting node config controller"
	I0630 21:04:22.649970       1 shared_informer.go:255] Waiting for caches to sync for node config
	I0630 21:04:22.749993       1 shared_informer.go:262] Caches are synced for service config
	I0630 21:04:22.750048       1 shared_informer.go:262] Caches are synced for node config
	I0630 21:04:22.750021       1 shared_informer.go:262] Caches are synced for endpoint slice config
	
	* 
	* ==> kube-scheduler [b2e2e7466122cde98a4cb1eba9d3f61be1dc7eb41a6935e6c16b3334125a3df7] <==
	* W0630 21:04:06.439138       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E0630 21:04:06.439258       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	W0630 21:04:06.439213       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E0630 21:04:06.439487       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	W0630 21:04:06.439530       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
	W0630 21:04:06.439635       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	E0630 21:04:06.439746       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	E0630 21:04:06.439668       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
	W0630 21:04:06.438273       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	E0630 21:04:06.440521       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	W0630 21:04:06.439545       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0630 21:04:06.440544       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	W0630 21:04:07.244869       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	E0630 21:04:07.244905       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	W0630 21:04:07.276194       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E0630 21:04:07.276227       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	W0630 21:04:07.289458       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	E0630 21:04:07.289489       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	W0630 21:04:07.295610       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E0630 21:04:07.295643       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	W0630 21:04:07.404412       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	E0630 21:04:07.404447       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	W0630 21:04:07.645230       1 reflector.go:324] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	E0630 21:04:07.645267       1 reflector.go:138] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	I0630 21:04:10.336041       1 shared_informer.go:262] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	
	* 
	* ==> kubelet <==
	* -- Logs begin at Thu 2022-06-30 21:03:44 UTC, end at Thu 2022-06-30 21:08:24 UTC. --
	Jun 30 21:06:24 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:06:24.899425    1349 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:06:29 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:06:29.900363    1349 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:06:34 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:06:34.901645    1349 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:06:39 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:06:39.903220    1349 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:06:44 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:06:44.904029    1349 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:06:49 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:06:49.905850    1349 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:06:54 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:06:54.906753    1349 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:06:59 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:06:59.908151    1349 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:07:04 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:07:04.909237    1349 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:07:08 default-k8s-different-port-20220630210335-9950 kubelet[1349]: I0630 21:07:08.065985    1349 scope.go:110] "RemoveContainer" containerID="8102f84d94828ce8eeaa9af1d8a6fc6e04b5f6af2c880836155b0488af953431"
	Jun 30 21:07:09 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:07:09.910192    1349 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:07:14 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:07:14.911909    1349 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:07:19 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:07:19.913685    1349 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:07:24 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:07:24.915419    1349 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:07:29 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:07:29.916493    1349 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:07:34 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:07:34.917945    1349 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:07:39 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:07:39.919618    1349 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:07:44 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:07:44.921044    1349 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:07:49 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:07:49.922886    1349 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:07:54 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:07:54.924547    1349 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:07:59 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:07:59.925700    1349 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:08:04 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:08:04.927325    1349 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:08:09 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:08:09.929153    1349 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:08:14 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:08:14.930293    1349 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:08:19 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:08:19.931481    1349 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	

                                                
                                                
-- /stdout --
helpers_test.go:254: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p default-k8s-different-port-20220630210335-9950 -n default-k8s-different-port-20220630210335-9950
helpers_test.go:261: (dbg) Run:  kubectl --context default-k8s-different-port-20220630210335-9950 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:270: non-running pods: coredns-6d4b75cb6d-cnt2b storage-provisioner
helpers_test.go:272: ======> post-mortem[TestStartStop/group/default-k8s-different-port/serial/FirstStart]: describe non-running pods <======
helpers_test.go:275: (dbg) Run:  kubectl --context default-k8s-different-port-20220630210335-9950 describe pod coredns-6d4b75cb6d-cnt2b storage-provisioner
helpers_test.go:275: (dbg) Non-zero exit: kubectl --context default-k8s-different-port-20220630210335-9950 describe pod coredns-6d4b75cb6d-cnt2b storage-provisioner: exit status 1 (53.672256ms)

                                                
                                                
** stderr ** 
	Error from server (NotFound): pods "coredns-6d4b75cb6d-cnt2b" not found
	Error from server (NotFound): pods "storage-provisioner" not found

                                                
                                                
** /stderr **
helpers_test.go:277: kubectl --context default-k8s-different-port-20220630210335-9950 describe pod coredns-6d4b75cb6d-cnt2b storage-provisioner: exit status 1
--- FAIL: TestStartStop/group/default-k8s-different-port/serial/FirstStart (290.16s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/DeployApp (484.85s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context old-k8s-version-20220630210005-9950 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/old-k8s-version/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:342: "busybox" [904813a4-e37b-48a1-970f-af1d62faca5b] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.)

                                                
                                                
=== CONT  TestStartStop/group/old-k8s-version/serial/DeployApp
start_stop_delete_test.go:196: ***** TestStartStop/group/old-k8s-version/serial/DeployApp: pod "integration-test=busybox" failed to start within 8m0s: timed out waiting for the condition ****
start_stop_delete_test.go:196: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p old-k8s-version-20220630210005-9950 -n old-k8s-version-20220630210005-9950
start_stop_delete_test.go:196: TestStartStop/group/old-k8s-version/serial/DeployApp: showing logs for failed pods as of 2022-06-30 21:12:47.99636542 +0000 UTC m=+3116.235503676
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context old-k8s-version-20220630210005-9950 describe po busybox -n default
start_stop_delete_test.go:196: (dbg) kubectl --context old-k8s-version-20220630210005-9950 describe po busybox -n default:
Name:         busybox
Namespace:    default
Priority:     0
Node:         <none>
Labels:       integration-test=busybox
Annotations:  <none>
Status:       Pending
IP:           
IPs:          <none>
Containers:
busybox:
Image:      gcr.io/k8s-minikube/busybox:1.28.4-glibc
Port:       <none>
Host Port:  <none>
Command:
sleep
3600
Environment:  <none>
Mounts:
/var/run/secrets/kubernetes.io/serviceaccount from default-token-mvrxf (ro)
Conditions:
Type           Status
PodScheduled   False 
Volumes:
default-token-mvrxf:
Type:        Secret (a volume populated by a Secret)
SecretName:  default-token-mvrxf
Optional:    false
QoS Class:       BestEffort
Node-Selectors:  <none>
Tolerations:     node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type     Reason            Age                    From               Message
----     ------            ----                   ----               -------
Warning  FailedScheduling  8m                     default-scheduler  0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.
Warning  FailedScheduling  5m23s (x1 over 6m53s)  default-scheduler  0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context old-k8s-version-20220630210005-9950 logs busybox -n default
start_stop_delete_test.go:196: (dbg) kubectl --context old-k8s-version-20220630210005-9950 logs busybox -n default:
start_stop_delete_test.go:196: wait: integration-test=busybox within 8m0s: timed out waiting for the condition
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestStartStop/group/old-k8s-version/serial/DeployApp]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect old-k8s-version-20220630210005-9950
helpers_test.go:235: (dbg) docker inspect old-k8s-version-20220630210005-9950:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "1b84433fb68bbf2bd151038738e402e5c525e45c0c466b954c0a2fc61a335d66",
	        "Created": "2022-06-30T21:00:13.927977074Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 229888,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2022-06-30T21:00:14.354950284Z",
	            "FinishedAt": "0001-01-01T00:00:00Z"
	        },
	        "Image": "sha256:573e7be5768273a7845baee1ae90fa2e33b83b10a7fbb0f0f41efbf29b53d1f1",
	        "ResolvConfPath": "/var/lib/docker/containers/1b84433fb68bbf2bd151038738e402e5c525e45c0c466b954c0a2fc61a335d66/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/1b84433fb68bbf2bd151038738e402e5c525e45c0c466b954c0a2fc61a335d66/hostname",
	        "HostsPath": "/var/lib/docker/containers/1b84433fb68bbf2bd151038738e402e5c525e45c0c466b954c0a2fc61a335d66/hosts",
	        "LogPath": "/var/lib/docker/containers/1b84433fb68bbf2bd151038738e402e5c525e45c0c466b954c0a2fc61a335d66/1b84433fb68bbf2bd151038738e402e5c525e45c0c466b954c0a2fc61a335d66-json.log",
	        "Name": "/old-k8s-version-20220630210005-9950",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "old-k8s-version-20220630210005-9950:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "old-k8s-version-20220630210005-9950",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 2306867200,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": null,
	            "BlkioDeviceWriteBps": null,
	            "BlkioDeviceReadIOps": null,
	            "BlkioDeviceWriteIOps": null,
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "KernelMemory": 0,
	            "KernelMemoryTCP": 0,
	            "MemoryReservation": 0,
	            "MemorySwap": 4613734400,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": null,
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/d94571e47e569545ea7c101defd143650d23877c940361aa1535ed742bae26c1-init/diff:/var/lib/docker/overlay2/8b88d9f6f12c48be642a133456203e58549a93f1da67d0349744bd0f78917fba/diff:/var/lib/docker/overlay2/2bcbb3b4718a64188802301a25d7f413bb307cb16d077e7e5af799f9152a2970/diff:/var/lib/docker/overlay2/70b0888bf22fcef1c004704b71288ac581cf26a3b3b19fbca3da296ba10d6978/diff:/var/lib/docker/overlay2/7c5332f38fe652f379ef9b6d23e795158e9994317cfb547b581dd2b1fdf1303b/diff:/var/lib/docker/overlay2/0ddb5a3abf433b644a8bfa124e3c87878eed67878faa35493f2befc2b392e9cb/diff:/var/lib/docker/overlay2/3b7cda5fb0232fdeecbec0531ac704a59eb38fe57664c25777193b07e2df0077/diff:/var/lib/docker/overlay2/a14687ada786c65465b9924ae2d77ba27afc07942851cafaade28e80dfe9da16/diff:/var/lib/docker/overlay2/c49a9b7157aa6e8714e192b2849866d035b59e18de462c0ee9b72f898cc5a485/diff:/var/lib/docker/overlay2/efd71a50e3a1044a6d1c4c1a7d4d91d9f070c066e03e51c6c73a5764b778ad72/diff:/var/lib/docker/overlay2/55476a
1c0a20aa4238a0bb0e43c6402c33dcad312938ad48ee81be0160e12a49/diff:/var/lib/docker/overlay2/c48c4a348a797b9a38f01568a6adbcb4b05b4f56f7b986a4bf1b509d8cb00732/diff:/var/lib/docker/overlay2/568e3f354ab0428de5cf82d1fdfb780c3377f5cc55d9f524731c53e39e0ecae7/diff:/var/lib/docker/overlay2/2857943e320cdcdae9af3d8c2acda1fb61e2f142a88b8b902908071cea67816e/diff:/var/lib/docker/overlay2/bdd9a57f0b65e65c5a16395f239425e794c678b0e8db2f4a368e0a9427fe5116/diff:/var/lib/docker/overlay2/b150183f1b73e8c13c751911bcee09fed8ef973478f4dc3cfdb9e509118bf1ea/diff:/var/lib/docker/overlay2/0a053e7c29417cd6feafb351c7944e81342a52898871bc779f7bf61868c78ec4/diff:/var/lib/docker/overlay2/d3c0de3a44d75d0a05acb7843d53deba5ce0457649d6ed757da9b4c532a81e4f/diff:/var/lib/docker/overlay2/53f6170132880e1697dd802b8577382b31c6f1ba144256f8cc62542998842a6b/diff:/var/lib/docker/overlay2/b5c0be6d8efdb1fcb12e73b8f72853f77baa4bc014ac2c1e28b7b972b07f3325/diff:/var/lib/docker/overlay2/36c908f082a1e5388bb25277f1c957eaecf70fcd958080422fa85a3105724fb2/diff:/var/lib/d
ocker/overlay2/b147fe9dce365cfaf9bfeca2e370829e4d87e2671c133a9836ecb02a85422cc7/diff:/var/lib/docker/overlay2/65f488eb9181a721f01b333f5fa0cb91d216abd7842a9ae193bd95316f378721/diff:/var/lib/docker/overlay2/b04269aa247b68912ddc5b1c98ad55d67af4103f576a900eef4069c196b8a263/diff:/var/lib/docker/overlay2/b714c37e15257ae9d0e15d271dd18a330c38ad765901d9b7e7e3feb73e1b03e4/diff:/var/lib/docker/overlay2/3c253b721193edeaade7bba7ce25ff687c889b8fa86e9489c7ee20d5624e6c5b/diff:/var/lib/docker/overlay2/7f67b74e101fa21dd320393c10576eefa4ce1cec2e210bff405784fa45b360f3/diff:/var/lib/docker/overlay2/c3b2adaa63a06a5e6ed966d7b6f20a757aeadd3f25eb09ef3c7e9a66a8904143/diff:/var/lib/docker/overlay2/ddb5d653d19e8cafc4625a8fe9597667d98b277a7f679e532ad84caa2c6da636/diff:/var/lib/docker/overlay2/03eb172b20323ebeee7cb09025726a6e10de6c3dd8661f4f6bbc5a3a3778bad4/diff:/var/lib/docker/overlay2/80ea9bf34d028e95a8a418b3aeb634be72ab3336448946d7855c51ffdf8258d7/diff:/var/lib/docker/overlay2/e28987ea3fb4d431dee111f38cc76814b85f73e86434be3c463c01fdd59
9ad46/diff:/var/lib/docker/overlay2/6f9a46c7c6cf4fd30ce32a1eb08ed9b1e8dd61cb0e42ce54f0f736f06558c306/diff:/var/lib/docker/overlay2/6fc942eb9ccfc09898edc9a5ef3b3d305a6fcb22e8cefb1a9f9c344d10b59b25/diff:/var/lib/docker/overlay2/f6b8c57540e798dc1dfd51fd29c020193c02a4362f31c6d07aa220327bb07b90/diff:/var/lib/docker/overlay2/85d0aa01a3fab8c77262c59d8a7b0809a72673a3da7d33e4e19c04a66db44a11/diff:/var/lib/docker/overlay2/58dcd81a1605641f785ced5aeb38657eec1f02a31b7adfaf4f6fdd49f4bab1d6/diff:/var/lib/docker/overlay2/9d537e0a65325e4bf85b26da9828002339f5c442ca85f931b340457a80ec8c94/diff:/var/lib/docker/overlay2/a6f73707ee6a74e948a02d03c4a3f12b57c2eb408dc67da3c39961bb3cefcc97/diff:/var/lib/docker/overlay2/922526c310b066dbb73b9a106eef8bf0064ad7907a8d7d7b353f5307a17a4901/diff:/var/lib/docker/overlay2/a4185854870ebf8d34a4c7e1827dbe3bc461559839301ffb23c5efff5e3c9f14/diff:/var/lib/docker/overlay2/8c02b1fcb9d79f5d7b2ee4d44f6625a692c44a0d18df0a5c01cac0cca0fdf3f3/diff",
	                "MergedDir": "/var/lib/docker/overlay2/d94571e47e569545ea7c101defd143650d23877c940361aa1535ed742bae26c1/merged",
	                "UpperDir": "/var/lib/docker/overlay2/d94571e47e569545ea7c101defd143650d23877c940361aa1535ed742bae26c1/diff",
	                "WorkDir": "/var/lib/docker/overlay2/d94571e47e569545ea7c101defd143650d23877c940361aa1535ed742bae26c1/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "old-k8s-version-20220630210005-9950",
	                "Source": "/var/lib/docker/volumes/old-k8s-version-20220630210005-9950/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "old-k8s-version-20220630210005-9950",
	            "Domainname": "",
	            "User": "root",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e",
	            "Volumes": null,
	            "WorkingDir": "",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "old-k8s-version-20220630210005-9950",
	                "name.minikube.sigs.k8s.io": "old-k8s-version-20220630210005-9950",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "ec7fc0e156b0aa4af84fc726351cbb9f7e2ff99be8702d21728abb4b2e5727a3",
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49397"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49396"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49393"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49395"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49394"
	                    }
	                ]
	            },
	            "SandboxKey": "/var/run/docker/netns/ec7fc0e156b0",
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "old-k8s-version-20220630210005-9950": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.67.2"
	                    },
	                    "Links": null,
	                    "Aliases": [
	                        "1b84433fb68b",
	                        "old-k8s-version-20220630210005-9950"
	                    ],
	                    "NetworkID": "2a33e496d49b578848c27ed72b0172cf6807dc7dbeec46561e901ef8145b93e7",
	                    "EndpointID": "3e37099b34556312803f62e1d2ae2bcf3204c44287b61d98bcdde49b6700ecc8",
	                    "Gateway": "192.168.67.1",
	                    "IPAddress": "192.168.67.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "MacAddress": "02:42:c0:a8:43:02",
	                    "DriverOpts": null
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-20220630210005-9950 -n old-k8s-version-20220630210005-9950
helpers_test.go:244: <<< TestStartStop/group/old-k8s-version/serial/DeployApp FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======>  post-mortem[TestStartStop/group/old-k8s-version/serial/DeployApp]: minikube logs <======
helpers_test.go:247: (dbg) Run:  out/minikube-linux-amd64 -p old-k8s-version-20220630210005-9950 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-amd64 -p old-k8s-version-20220630210005-9950 logs -n 25: (1.044608405s)
helpers_test.go:252: TestStartStop/group/old-k8s-version/serial/DeployApp logs: 
-- stdout --
	* 
	* ==> Audit <==
	* |---------|------------------------------------------------------------|----------|---------|---------|---------------------|---------------------|
	| Command |                            Args                            | Profile  |  User   | Version |     Start Time      |      End Time       |
	|---------|------------------------------------------------------------|----------|---------|---------|---------------------|---------------------|
	| start   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:02 UTC | 30 Jun 22 21:03 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|         | --memory=2200                                              |          |         |         |                     |                     |
	|         | --alsologtostderr                                          |          |         |         |                     |                     |
	|         | --wait=true --preload=false                                |          |         |         |                     |                     |
	|         | --driver=docker                                            |          |         |         |                     |                     |
	|         | --container-runtime=containerd                             |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                               |          |         |         |                     |                     |
	| delete  | -p calico-20220630204859-9950                              | minikube | jenkins | v1.26.0 | 30 Jun 22 21:03 UTC | 30 Jun 22 21:03 UTC |
	| start   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:03 UTC |                     |
	|         | default-k8s-different-port-20220630210335-9950             |          |         |         |                     |                     |
	|         | --memory=2200 --alsologtostderr --wait=true                |          |         |         |                     |                     |
	|         | --apiserver-port=8444 --driver=docker                      |          |         |         |                     |                     |
	|         |  --container-runtime=containerd                            |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                               |          |         |         |                     |                     |
	| addons  | enable metrics-server -p                                   | minikube | jenkins | v1.26.0 | 30 Jun 22 21:03 UTC | 30 Jun 22 21:03 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|         | --images=MetricsServer=k8s.gcr.io/echoserver:1.4           |          |         |         |                     |                     |
	|         | --registries=MetricsServer=fake.domain                     |          |         |         |                     |                     |
	| stop    | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:03 UTC | 30 Jun 22 21:04 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=3                                     |          |         |         |                     |                     |
	| addons  | enable dashboard -p                                        | minikube | jenkins | v1.26.0 | 30 Jun 22 21:04 UTC | 30 Jun 22 21:04 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|         | --images=MetricsScraper=k8s.gcr.io/echoserver:1.4          |          |         |         |                     |                     |
	| start   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:04 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|         | --memory=2200                                              |          |         |         |                     |                     |
	|         | --alsologtostderr                                          |          |         |         |                     |                     |
	|         | --wait=true --preload=false                                |          |         |         |                     |                     |
	|         | --driver=docker                                            |          |         |         |                     |                     |
	|         | --container-runtime=containerd                             |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                               |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:05 UTC | 30 Jun 22 21:05 UTC |
	|         | enable-default-cni-20220630204858-9950                     |          |         |         |                     |                     |
	| start   | -p newest-cni-20220630210514-9950 --memory=2200            | minikube | jenkins | v1.26.0 | 30 Jun 22 21:05 UTC | 30 Jun 22 21:06 UTC |
	|         | --alsologtostderr --wait=apiserver,system_pods,default_sa  |          |         |         |                     |                     |
	|         | --feature-gates ServerSideApply=true --network-plugin=cni  |          |         |         |                     |                     |
	|         | --extra-config=kubeadm.pod-network-cidr=192.168.111.111/16 |          |         |         |                     |                     |
	|         | --driver=docker  --container-runtime=containerd            |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                               |          |         |         |                     |                     |
	| addons  | enable metrics-server -p                                   | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | --images=MetricsServer=k8s.gcr.io/echoserver:1.4           |          |         |         |                     |                     |
	|         | --registries=MetricsServer=fake.domain                     |          |         |         |                     |                     |
	| stop    | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=3                                     |          |         |         |                     |                     |
	| addons  | enable dashboard -p                                        | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | --images=MetricsScraper=k8s.gcr.io/echoserver:1.4          |          |         |         |                     |                     |
	| start   | -p newest-cni-20220630210514-9950 --memory=2200            | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | --alsologtostderr --wait=apiserver,system_pods,default_sa  |          |         |         |                     |                     |
	|         | --feature-gates ServerSideApply=true --network-plugin=cni  |          |         |         |                     |                     |
	|         | --extra-config=kubeadm.pod-network-cidr=192.168.111.111/16 |          |         |         |                     |                     |
	|         | --driver=docker  --container-runtime=containerd            |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                               |          |         |         |                     |                     |
	| ssh     | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | sudo crictl images -o json                                 |          |         |         |                     |                     |
	| pause   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                     |          |         |         |                     |                     |
	| unpause | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                     |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | disable-driver-mounts-20220630210659-9950                  |          |         |         |                     |                     |
	| start   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC |                     |
	|         | embed-certs-20220630210659-9950                            |          |         |         |                     |                     |
	|         | --memory=2200 --alsologtostderr                            |          |         |         |                     |                     |
	|         | --wait=true --embed-certs                                  |          |         |         |                     |                     |
	|         | --driver=docker                                            |          |         |         |                     |                     |
	|         | --container-runtime=containerd                             |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                               |          |         |         |                     |                     |
	| ssh     | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|         | sudo crictl images -o json                                 |          |         |         |                     |                     |
	| pause   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                     |          |         |         |                     |                     |
	| unpause | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                     |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|---------|------------------------------------------------------------|----------|---------|---------|---------------------|---------------------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2022/06/30 21:06:59
	Running on machine: ubuntu-20-agent-8
	Binary: Built with gc go1.18.3 for linux/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0630 21:06:59.738083  258418 out.go:296] Setting OutFile to fd 1 ...
	I0630 21:06:59.738291  258418 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 21:06:59.738303  258418 out.go:309] Setting ErrFile to fd 2...
	I0630 21:06:59.738308  258418 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 21:06:59.738724  258418 root.go:329] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/bin
	I0630 21:06:59.739016  258418 out.go:303] Setting JSON to false
	I0630 21:06:59.740481  258418 start.go:115] hostinfo: {"hostname":"ubuntu-20-agent-8","uptime":2972,"bootTime":1656620248,"procs":586,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1012-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0630 21:06:59.740554  258418 start.go:125] virtualization: kvm guest
	I0630 21:06:59.743370  258418 out.go:177] * [embed-certs-20220630210659-9950] minikube v1.26.0 on Ubuntu 20.04 (kvm/amd64)
	I0630 21:06:59.744868  258418 out.go:177]   - MINIKUBE_LOCATION=14420
	I0630 21:06:59.744862  258418 notify.go:193] Checking for updates...
	I0630 21:06:59.746487  258418 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0630 21:06:59.747925  258418 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:06:59.749264  258418 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube
	I0630 21:06:59.750647  258418 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0630 21:06:59.752427  258418 config.go:178] Loaded profile config "default-k8s-different-port-20220630210335-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:06:59.752560  258418 config.go:178] Loaded profile config "no-preload-20220630210237-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:06:59.752664  258418 config.go:178] Loaded profile config "old-k8s-version-20220630210005-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.16.0
	I0630 21:06:59.752733  258418 driver.go:360] Setting default libvirt URI to qemu:///system
	I0630 21:06:59.793157  258418 docker.go:137] docker version: linux-20.10.17
	I0630 21:06:59.793329  258418 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0630 21:06:59.904539  258418 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:3 ContainersPaused:0 ContainersStopped:0 Images:8 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:50 OomKillDisable:true NGoroutines:49 SystemTime:2022-06-30 21:06:59.825756368 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1012-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexServ
erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662451712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-8 Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Client
Info:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
	I0630 21:06:59.904699  258418 docker.go:254] overlay module found
	I0630 21:06:59.908463  258418 out.go:177] * Using the docker driver based on user configuration
	I0630 21:06:59.909872  258418 start.go:284] selected driver: docker
	I0630 21:06:59.909886  258418 start.go:808] validating driver "docker" against <nil>
	I0630 21:06:59.909904  258418 start.go:819] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0630 21:06:59.910758  258418 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0630 21:07:00.020059  258418 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:3 ContainersPaused:0 ContainersStopped:0 Images:8 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:50 OomKillDisable:true NGoroutines:49 SystemTime:2022-06-30 21:06:59.94317636 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1012-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexServe
rAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662451712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-8 Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] ClientI
nfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
	I0630 21:07:00.020196  258418 start_flags.go:296] no existing cluster config was found, will generate one from the flags 
	I0630 21:07:00.020755  258418 start_flags.go:853] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0630 21:07:00.022859  258418 out.go:177] * Using Docker driver with root privileges
	I0630 21:07:00.024184  258418 cni.go:95] Creating CNI manager for ""
	I0630 21:07:00.024208  258418 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:07:00.024223  258418 start_flags.go:305] Found "CNI" CNI - setting NetworkPlugin=cni
	I0630 21:07:00.024246  258418 start_flags.go:310] config:
	{Name:embed-certs-20220630210659-9950 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:embed-certs-20220630210659-9950 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:clus
ter.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 21:07:00.025866  258418 out.go:177] * Starting control plane node embed-certs-20220630210659-9950 in cluster embed-certs-20220630210659-9950
	I0630 21:07:00.027139  258418 cache.go:120] Beginning downloading kic base image for docker with containerd
	I0630 21:07:00.028673  258418 out.go:177] * Pulling base image ...
	I0630 21:07:00.029951  258418 preload.go:132] Checking if preload exists for k8s version v1.24.2 and runtime containerd
	I0630 21:07:00.029992  258418 preload.go:148] Found local preload: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-containerd-overlay2-amd64.tar.lz4
	I0630 21:07:00.030001  258418 cache.go:57] Caching tarball of preloaded images
	I0630 21:07:00.030041  258418 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e in local docker daemon
	I0630 21:07:00.030250  258418 preload.go:174] Found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-containerd-overlay2-amd64.tar.lz4 in cache, skipping download
	I0630 21:07:00.030266  258418 cache.go:60] Finished verifying existence of preloaded tar for  v1.24.2 on containerd
	I0630 21:07:00.030363  258418 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/config.json ...
	I0630 21:07:00.030388  258418 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/config.json: {Name:mk3d06fce107c3c107ba91de67a3c2827092ffff Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:07:00.065813  258418 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e in local docker daemon, skipping pull
	I0630 21:07:00.065840  258418 cache.go:142] gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e exists in daemon, skipping load
	I0630 21:07:00.065850  258418 cache.go:208] Successfully downloaded all kic artifacts
	I0630 21:07:00.065886  258418 start.go:352] acquiring machines lock for embed-certs-20220630210659-9950: {Name:mk6619dbb09b46cdd2b244e5bf2112b3274a30ef Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0630 21:07:00.066018  258418 start.go:356] acquired machines lock for "embed-certs-20220630210659-9950" in 103.406µs
	I0630 21:07:00.066043  258418 start.go:91] Provisioning new machine with config: &{Name:embed-certs-20220630210659-9950 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:embed-certs-20220630210659-9950 Namespace
:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker
BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:} &{Name: IP: Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0630 21:07:00.066120  258418 start.go:131] createHost starting for "" (driver="docker")
	I0630 21:06:57.559842  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:06:59.560333  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:06:57.322367  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:06:59.322499  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:00.068356  258418 out.go:204] * Creating docker container (CPUs=2, Memory=2200MB) ...
	I0630 21:07:00.068557  258418 start.go:165] libmachine.API.Create for "embed-certs-20220630210659-9950" (driver="docker")
	I0630 21:07:00.068584  258418 client.go:168] LocalClient.Create starting
	I0630 21:07:00.068653  258418 main.go:134] libmachine: Reading certificate data from /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem
	I0630 21:07:00.068682  258418 main.go:134] libmachine: Decoding PEM data...
	I0630 21:07:00.068698  258418 main.go:134] libmachine: Parsing certificate...
	I0630 21:07:00.068753  258418 main.go:134] libmachine: Reading certificate data from /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem
	I0630 21:07:00.068774  258418 main.go:134] libmachine: Decoding PEM data...
	I0630 21:07:00.068784  258418 main.go:134] libmachine: Parsing certificate...
	I0630 21:07:00.069116  258418 cli_runner.go:164] Run: docker network inspect embed-certs-20220630210659-9950 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	W0630 21:07:00.108024  258418 cli_runner.go:211] docker network inspect embed-certs-20220630210659-9950 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
	I0630 21:07:00.108116  258418 network_create.go:272] running [docker network inspect embed-certs-20220630210659-9950] to gather additional debugging logs...
	I0630 21:07:00.108144  258418 cli_runner.go:164] Run: docker network inspect embed-certs-20220630210659-9950
	W0630 21:07:00.141588  258418 cli_runner.go:211] docker network inspect embed-certs-20220630210659-9950 returned with exit code 1
	I0630 21:07:00.141617  258418 network_create.go:275] error running [docker network inspect embed-certs-20220630210659-9950]: docker network inspect embed-certs-20220630210659-9950: exit status 1
	stdout:
	[]
	
	stderr:
	Error: No such network: embed-certs-20220630210659-9950
	I0630 21:07:00.141631  258418 network_create.go:277] output of [docker network inspect embed-certs-20220630210659-9950]: -- stdout --
	[]
	
	-- /stdout --
	** stderr ** 
	Error: No such network: embed-certs-20220630210659-9950
	
	** /stderr **
	I0630 21:07:00.141686  258418 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0630 21:07:00.178261  258418 network.go:240] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName:br-c7ee26fec5a3 IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:02:42:cc:d0:4a:9e}}
	I0630 21:07:00.179334  258418 network.go:240] skipping subnet 192.168.58.0/24 that is taken: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 Interface:{IfaceName:br-3e97afadef02 IfaceIPv4:192.168.58.1 IfaceMTU:1500 IfaceMAC:02:42:9e:e7:fd:62}}
	I0630 21:07:00.179967  258418 network.go:240] skipping subnet 192.168.67.0/24 that is taken: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 Interface:{IfaceName:br-2a33e496d49b IfaceIPv4:192.168.67.1 IfaceMTU:1500 IfaceMAC:02:42:21:56:17:cb}}
	I0630 21:07:00.180760  258418 network.go:240] skipping subnet 192.168.76.0/24 that is taken: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 Interface:{IfaceName:br-5e7b405f6aaf IfaceIPv4:192.168.76.1 IfaceMTU:1500 IfaceMAC:02:42:7b:eb:36:d4}}
	I0630 21:07:00.181503  258418 network.go:240] skipping subnet 192.168.85.0/24 that is taken: &{IP:192.168.85.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.85.0/24 Gateway:192.168.85.1 ClientMin:192.168.85.2 ClientMax:192.168.85.254 Broadcast:192.168.85.255 Interface:{IfaceName:br-88cfda28f438 IfaceIPv4:192.168.85.1 IfaceMTU:1500 IfaceMAC:02:42:12:4c:db:ca}}
	I0630 21:07:00.182506  258418 network.go:288] reserving subnet 192.168.94.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[] amended:true}} dirty:map[192.168.94.0:0xc000790098] misses:0}
	I0630 21:07:00.182557  258418 network.go:235] using free private subnet 192.168.94.0/24: &{IP:192.168.94.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.94.0/24 Gateway:192.168.94.1 ClientMin:192.168.94.2 ClientMax:192.168.94.254 Broadcast:192.168.94.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
	I0630 21:07:00.182573  258418 network_create.go:115] attempt to create docker network embed-certs-20220630210659-9950 192.168.94.0/24 with gateway 192.168.94.1 and MTU of 1500 ...
	I0630 21:07:00.182643  258418 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.94.0/24 --gateway=192.168.94.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=embed-certs-20220630210659-9950 embed-certs-20220630210659-9950
	I0630 21:07:00.257759  258418 network_create.go:99] docker network embed-certs-20220630210659-9950 192.168.94.0/24 created
	I0630 21:07:00.257800  258418 kic.go:106] calculated static IP "192.168.94.2" for the "embed-certs-20220630210659-9950" container
	I0630 21:07:00.257889  258418 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I0630 21:07:00.297023  258418 cli_runner.go:164] Run: docker volume create embed-certs-20220630210659-9950 --label name.minikube.sigs.k8s.io=embed-certs-20220630210659-9950 --label created_by.minikube.sigs.k8s.io=true
	I0630 21:07:00.333425  258418 oci.go:103] Successfully created a docker volume embed-certs-20220630210659-9950
	I0630 21:07:00.333505  258418 cli_runner.go:164] Run: docker run --rm --name embed-certs-20220630210659-9950-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=embed-certs-20220630210659-9950 --entrypoint /usr/bin/test -v embed-certs-20220630210659-9950:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e -d /var/lib
	I0630 21:07:00.910665  258418 oci.go:107] Successfully prepared a docker volume embed-certs-20220630210659-9950
	I0630 21:07:00.910711  258418 preload.go:132] Checking if preload exists for k8s version v1.24.2 and runtime containerd
	I0630 21:07:00.910729  258418 kic.go:179] Starting extracting preloaded images to volume ...
	I0630 21:07:00.910788  258418 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-containerd-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v embed-certs-20220630210659-9950:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e -I lz4 -xf /preloaded.tar -C /extractDir
	I0630 21:07:02.060819  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:04.559635  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:01.822187  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:04.321625  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:07.402589  258418 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-containerd-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v embed-certs-20220630210659-9950:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e -I lz4 -xf /preloaded.tar -C /extractDir: (6.49174022s)
	I0630 21:07:07.402619  258418 kic.go:188] duration metric: took 6.491886 seconds to extract preloaded images to volume
	W0630 21:07:07.402757  258418 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	I0630 21:07:07.402858  258418 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0630 21:07:07.511838  258418 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname embed-certs-20220630210659-9950 --name embed-certs-20220630210659-9950 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=embed-certs-20220630210659-9950 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=embed-certs-20220630210659-9950 --network embed-certs-20220630210659-9950 --ip 192.168.94.2 --volume embed-certs-20220630210659-9950:/var --security-opt apparmor=unconfined --memory=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e
	I0630 21:07:07.934143  258418 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Running}}
	I0630 21:07:07.973385  258418 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:07:08.010245  258418 cli_runner.go:164] Run: docker exec embed-certs-20220630210659-9950 stat /var/lib/dpkg/alternatives/iptables
	I0630 21:07:08.090553  258418 oci.go:144] the created container "embed-certs-20220630210659-9950" has a running status.
	I0630 21:07:08.090607  258418 kic.go:210] Creating ssh key for kic: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa...
	I0630 21:07:08.314972  258418 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0630 21:07:08.427784  258418 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:07:08.468895  258418 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0630 21:07:08.468925  258418 kic_runner.go:114] Args: [docker exec --privileged embed-certs-20220630210659-9950 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0630 21:07:08.566253  258418 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:07:08.600997  258418 machine.go:88] provisioning docker machine ...
	I0630 21:07:08.601037  258418 ubuntu.go:169] provisioning hostname "embed-certs-20220630210659-9950"
	I0630 21:07:08.601149  258418 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:07:08.636297  258418 main.go:134] libmachine: Using SSH client type: native
	I0630 21:07:08.636495  258418 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil>  [] 0s} 127.0.0.1 49427 <nil> <nil>}
	I0630 21:07:08.636521  258418 main.go:134] libmachine: About to run SSH command:
	sudo hostname embed-certs-20220630210659-9950 && echo "embed-certs-20220630210659-9950" | sudo tee /etc/hostname
	I0630 21:07:08.771633  258418 main.go:134] libmachine: SSH cmd err, output: <nil>: embed-certs-20220630210659-9950
	
	I0630 21:07:08.771709  258418 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:07:08.807559  258418 main.go:134] libmachine: Using SSH client type: native
	I0630 21:07:08.807748  258418 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil>  [] 0s} 127.0.0.1 49427 <nil> <nil>}
	I0630 21:07:08.807776  258418 main.go:134] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sembed-certs-20220630210659-9950' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 embed-certs-20220630210659-9950/g' /etc/hosts;
				else 
					echo '127.0.1.1 embed-certs-20220630210659-9950' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0630 21:07:08.925119  258418 main.go:134] libmachine: SSH cmd err, output: <nil>: 
	I0630 21:07:08.925147  258418 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube CaCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/c
erts/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube}
	I0630 21:07:08.925201  258418 ubuntu.go:177] setting up certificates
	I0630 21:07:08.925214  258418 provision.go:83] configureAuth start
	I0630 21:07:08.925265  258418 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-20220630210659-9950
	I0630 21:07:08.960061  258418 provision.go:138] copyHostCerts
	I0630 21:07:08.960154  258418 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem, removing ...
	I0630 21:07:08.960170  258418 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem
	I0630 21:07:08.960258  258418 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem (1082 bytes)
	I0630 21:07:08.960358  258418 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem, removing ...
	I0630 21:07:08.960373  258418 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem
	I0630 21:07:08.960415  258418 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem (1123 bytes)
	I0630 21:07:08.960487  258418 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem, removing ...
	I0630 21:07:08.960500  258418 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem
	I0630 21:07:08.960537  258418 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem (1679 bytes)
	I0630 21:07:08.960643  258418 provision.go:112] generating server cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem org=jenkins.embed-certs-20220630210659-9950 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-20220630210659-9950]
	I0630 21:07:09.146367  258418 provision.go:172] copyRemoteCerts
	I0630 21:07:09.146434  258418 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0630 21:07:09.146467  258418 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:07:09.181391  258418 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49427 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:07:09.268359  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
	I0630 21:07:09.286430  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem --> /etc/docker/server.pem (1265 bytes)
	I0630 21:07:09.303887  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
	I0630 21:07:09.321968  258418 provision.go:86] duration metric: configureAuth took 396.737856ms
	I0630 21:07:09.321996  258418 ubuntu.go:193] setting minikube options for container-runtime
	I0630 21:07:09.322190  258418 config.go:178] Loaded profile config "embed-certs-20220630210659-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:07:09.322207  258418 machine.go:91] provisioned docker machine in 721.186892ms
	I0630 21:07:09.322214  258418 client.go:171] LocalClient.Create took 9.253625617s
	I0630 21:07:09.322232  258418 start.go:173] duration metric: libmachine.API.Create for "embed-certs-20220630210659-9950" took 9.253674873s
	I0630 21:07:09.322245  258418 start.go:306] post-start starting for "embed-certs-20220630210659-9950" (driver="docker")
	I0630 21:07:09.322250  258418 start.go:316] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0630 21:07:09.322300  258418 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0630 21:07:09.322345  258418 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:07:09.357615  258418 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49427 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:07:09.448779  258418 ssh_runner.go:195] Run: cat /etc/os-release
	I0630 21:07:09.451635  258418 main.go:134] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0630 21:07:09.451662  258418 main.go:134] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0630 21:07:09.451677  258418 main.go:134] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0630 21:07:09.451685  258418 info.go:137] Remote host: Ubuntu 20.04.4 LTS
	I0630 21:07:09.451696  258418 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/addons for local assets ...
	I0630 21:07:09.451763  258418 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files for local assets ...
	I0630 21:07:09.451845  258418 filesync.go:149] local asset: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem -> 99502.pem in /etc/ssl/certs
	I0630 21:07:09.451951  258418 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0630 21:07:09.458665  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem --> /etc/ssl/certs/99502.pem (1708 bytes)
	I0630 21:07:09.476026  258418 start.go:309] post-start completed in 153.769797ms
	I0630 21:07:09.476430  258418 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-20220630210659-9950
	I0630 21:07:09.510898  258418 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/config.json ...
	I0630 21:07:09.511146  258418 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0630 21:07:09.511187  258418 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:07:09.545651  258418 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49427 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:07:09.637501  258418 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0630 21:07:09.641506  258418 start.go:134] duration metric: createHost completed in 9.575373132s
	I0630 21:07:09.641531  258418 start.go:81] releasing machines lock for "embed-certs-20220630210659-9950", held for 9.57549992s
	I0630 21:07:09.641602  258418 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-20220630210659-9950
	I0630 21:07:09.677201  258418 ssh_runner.go:195] Run: systemctl --version
	I0630 21:07:09.677250  258418 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/
	I0630 21:07:09.677265  258418 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:07:09.677309  258418 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:07:09.713480  258418 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49427 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:07:09.713482  258418 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49427 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:07:06.559671  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:08.560388  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:09.797176  258418 ssh_runner.go:195] Run: sudo systemctl stop -f crio
	I0630 21:07:09.827436  258418 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0630 21:07:09.837837  258418 docker.go:179] disabling docker service ...
	I0630 21:07:09.837887  258418 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0630 21:07:09.854330  258418 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0630 21:07:09.864433  258418 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0630 21:07:09.947141  258418 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0630 21:07:10.021015  258418 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0630 21:07:10.030498  258418 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
	image-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0630 21:07:10.043126  258418 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*sandbox_image = .*$|sandbox_image = "k8s.gcr.io/pause:3.7"|' -i /etc/containerd/config.toml"
	I0630 21:07:10.051201  258418 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*restrict_oom_score_adj = .*$|restrict_oom_score_adj = false|' -i /etc/containerd/config.toml"
	I0630 21:07:10.060149  258418 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*SystemdCgroup = .*$|SystemdCgroup = false|' -i /etc/containerd/config.toml"
	I0630 21:07:10.068522  258418 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*conf_dir = .*$|conf_dir = "/etc/cni/net.mk"|' -i /etc/containerd/config.toml"
	I0630 21:07:10.077416  258418 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^# imports|imports = ["/etc/containerd/containerd.conf.d/02-containerd.conf"]|' -i /etc/containerd/config.toml"
	I0630 21:07:10.085718  258418 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc/containerd/containerd.conf.d && printf %!s(MISSING) "dmVyc2lvbiA9IDIK" | base64 -d | sudo tee /etc/containerd/containerd.conf.d/02-containerd.conf"
	I0630 21:07:10.100377  258418 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0630 21:07:10.107211  258418 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0630 21:07:10.114109  258418 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0630 21:07:10.199996  258418 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0630 21:07:10.275745  258418 start.go:447] Will wait 60s for socket path /run/containerd/containerd.sock
	I0630 21:07:10.275834  258418 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
	I0630 21:07:10.279416  258418 start.go:468] Will wait 60s for crictl version
	I0630 21:07:10.279463  258418 ssh_runner.go:195] Run: sudo crictl version
	I0630 21:07:10.306037  258418 start.go:477] Version:  0.1.0
	RuntimeName:  containerd
	RuntimeVersion:  1.6.6
	RuntimeApiVersion:  v1alpha2
	I0630 21:07:10.306097  258418 ssh_runner.go:195] Run: containerd --version
	I0630 21:07:10.336955  258418 ssh_runner.go:195] Run: containerd --version
	I0630 21:07:10.369264  258418 out.go:177] * Preparing Kubernetes v1.24.2 on containerd 1.6.6 ...
	I0630 21:07:06.322142  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:08.323262  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:10.323523  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:10.370707  258418 cli_runner.go:164] Run: docker network inspect embed-certs-20220630210659-9950 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0630 21:07:10.404290  258418 ssh_runner.go:195] Run: grep 192.168.94.1	host.minikube.internal$ /etc/hosts
	I0630 21:07:10.407606  258418 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.94.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0630 21:07:10.417141  258418 preload.go:132] Checking if preload exists for k8s version v1.24.2 and runtime containerd
	I0630 21:07:10.417195  258418 ssh_runner.go:195] Run: sudo crictl images --output json
	I0630 21:07:10.442185  258418 containerd.go:547] all images are preloaded for containerd runtime.
	I0630 21:07:10.442210  258418 containerd.go:461] Images already preloaded, skipping extraction
	I0630 21:07:10.442264  258418 ssh_runner.go:195] Run: sudo crictl images --output json
	I0630 21:07:10.466454  258418 containerd.go:547] all images are preloaded for containerd runtime.
	I0630 21:07:10.466477  258418 cache_images.go:84] Images are preloaded, skipping loading
	I0630 21:07:10.466518  258418 ssh_runner.go:195] Run: sudo crictl info
	I0630 21:07:10.490761  258418 cni.go:95] Creating CNI manager for ""
	I0630 21:07:10.490782  258418 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:07:10.490794  258418 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
	I0630 21:07:10.490806  258418 kubeadm.go:158] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.94.2 APIServerPort:8443 KubernetesVersion:v1.24.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:embed-certs-20220630210659-9950 NodeName:embed-certs-20220630210659-9950 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.94.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.94.2 CgroupDriver:cgroupfs ClientC
AFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}
	I0630 21:07:10.490930  258418 kubeadm.go:162] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.94.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: /run/containerd/containerd.sock
	  name: "embed-certs-20220630210659-9950"
	  kubeletExtraArgs:
	    node-ip: 192.168.94.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.94.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.24.2
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%!"(MISSING)
	  nodefs.inodesFree: "0%!"(MISSING)
	  imagefs.available: "0%!"(MISSING)
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0630 21:07:10.491006  258418 kubeadm.go:961] kubelet [Unit]
	Wants=containerd.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.24.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=embed-certs-20220630210659-9950 --image-service-endpoint=unix:///run/containerd/containerd.sock --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.94.2 --runtime-request-timeout=15m
	
	[Install]
	 config:
	{KubernetesVersion:v1.24.2 ClusterName:embed-certs-20220630210659-9950 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
	I0630 21:07:10.491052  258418 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.24.2
	I0630 21:07:10.498227  258418 binaries.go:44] Found k8s binaries, skipping transfer
	I0630 21:07:10.498292  258418 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0630 21:07:10.505224  258418 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (524 bytes)
	I0630 21:07:10.518421  258418 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0630 21:07:10.531076  258418 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2060 bytes)
	I0630 21:07:10.543943  258418 ssh_runner.go:195] Run: grep 192.168.94.2	control-plane.minikube.internal$ /etc/hosts
	I0630 21:07:10.547038  258418 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.94.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0630 21:07:10.556545  258418 certs.go:54] Setting up /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950 for IP: 192.168.94.2
	I0630 21:07:10.556652  258418 certs.go:182] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.key
	I0630 21:07:10.556714  258418 certs.go:182] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.key
	I0630 21:07:10.556769  258418 certs.go:302] generating minikube-user signed cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/client.key
	I0630 21:07:10.556787  258418 crypto.go:68] Generating cert /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/client.crt with IP's: []
	I0630 21:07:10.765363  258418 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/client.crt ...
	I0630 21:07:10.765395  258418 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/client.crt: {Name:mk2189a82adcc765dfa2510a823d0440782737cd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:07:10.765620  258418 crypto.go:164] Writing key to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/client.key ...
	I0630 21:07:10.765636  258418 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/client.key: {Name:mkdeb0e682321ff945ca41fa64d1e608453c6f36 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:07:10.765773  258418 certs.go:302] generating minikube signed cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.key.ad8e880a
	I0630 21:07:10.765794  258418 crypto.go:68] Generating cert /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.crt.ad8e880a with IP's: [192.168.94.2 10.96.0.1 127.0.0.1 10.0.0.1]
	I0630 21:07:10.910596  258418 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.crt.ad8e880a ...
	I0630 21:07:10.910627  258418 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.crt.ad8e880a: {Name:mkc69164c3a143b379c0f4996d5e2da27861b5ff Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:07:10.910832  258418 crypto.go:164] Writing key to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.key.ad8e880a ...
	I0630 21:07:10.910846  258418 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.key.ad8e880a: {Name:mk8e2527beae912aa15913d6f348638ece4c494e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:07:10.910935  258418 certs.go:320] copying /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.crt.ad8e880a -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.crt
	I0630 21:07:10.910996  258418 certs.go:324] copying /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.key.ad8e880a -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.key
	I0630 21:07:10.911041  258418 certs.go:302] generating aggregator signed cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.key
	I0630 21:07:10.911054  258418 crypto.go:68] Generating cert /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.crt with IP's: []
	I0630 21:07:11.469066  258418 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.crt ...
	I0630 21:07:11.469461  258418 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.crt: {Name:mk9657fa57381458a8b172f509e4d3599add736c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:07:11.469782  258418 crypto.go:164] Writing key to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.key ...
	I0630 21:07:11.469807  258418 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.key: {Name:mkd9e4d5545bdb7302e99bfbbe9d07417abbdc89 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:07:11.470115  258418 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950.pem (1338 bytes)
	W0630 21:07:11.470166  258418 certs.go:384] ignoring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950_empty.pem, impossibly tiny 0 bytes
	I0630 21:07:11.470180  258418 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem (1679 bytes)
	I0630 21:07:11.470222  258418 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem (1082 bytes)
	I0630 21:07:11.470260  258418 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem (1123 bytes)
	I0630 21:07:11.470301  258418 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/key.pem (1679 bytes)
	I0630 21:07:11.470362  258418 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem (1708 bytes)
	I0630 21:07:11.471511  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
	I0630 21:07:11.490653  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I0630 21:07:11.508628  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0630 21:07:11.527379  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
	I0630 21:07:11.545789  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0630 21:07:11.564535  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
	I0630 21:07:11.582438  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0630 21:07:11.600444  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
	I0630 21:07:11.620977  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem --> /usr/share/ca-certificates/99502.pem (1708 bytes)
	I0630 21:07:11.639639  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0630 21:07:11.658178  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950.pem --> /usr/share/ca-certificates/9950.pem (1338 bytes)
	I0630 21:07:11.677694  258418 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0630 21:07:11.690755  258418 ssh_runner.go:195] Run: openssl version
	I0630 21:07:11.695688  258418 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/99502.pem && ln -fs /usr/share/ca-certificates/99502.pem /etc/ssl/certs/99502.pem"
	I0630 21:07:11.703347  258418 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/99502.pem
	I0630 21:07:11.706626  258418 certs.go:431] hashing: -rw-r--r-- 1 root root 1708 Jun 30 20:26 /usr/share/ca-certificates/99502.pem
	I0630 21:07:11.706684  258418 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/99502.pem
	I0630 21:07:11.711429  258418 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/99502.pem /etc/ssl/certs/3ec20f2e.0"
	I0630 21:07:11.719285  258418 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0630 21:07:11.726650  258418 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:07:11.729726  258418 certs.go:431] hashing: -rw-r--r-- 1 root root 1111 Jun 30 20:22 /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:07:11.729781  258418 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:07:11.734559  258418 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0630 21:07:11.741992  258418 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/9950.pem && ln -fs /usr/share/ca-certificates/9950.pem /etc/ssl/certs/9950.pem"
	I0630 21:07:11.752166  258418 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/9950.pem
	I0630 21:07:11.755639  258418 certs.go:431] hashing: -rw-r--r-- 1 root root 1338 Jun 30 20:26 /usr/share/ca-certificates/9950.pem
	I0630 21:07:11.755700  258418 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/9950.pem
	I0630 21:07:11.760725  258418 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/9950.pem /etc/ssl/certs/51391683.0"
	I0630 21:07:11.768543  258418 kubeadm.go:395] StartCluster: {Name:embed-certs-20220630210659-9950 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:embed-certs-20220630210659-9950 Namespace:default APIServerName
:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirr
or: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 21:07:11.768636  258418 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
	I0630 21:07:11.768692  258418 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0630 21:07:11.793825  258418 cri.go:87] found id: ""
	I0630 21:07:11.793907  258418 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0630 21:07:11.801886  258418 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0630 21:07:11.809295  258418 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver
	I0630 21:07:11.809360  258418 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0630 21:07:11.816601  258418 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0630 21:07:11.816642  258418 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0630 21:07:11.060021  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:13.559886  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:12.823802  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:15.322092  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:15.560115  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:18.060545  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:17.322180  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:19.322480  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:22.533924  258418 out.go:204]   - Generating certificates and keys ...
	I0630 21:07:22.537123  258418 out.go:204]   - Booting up control plane ...
	I0630 21:07:22.539540  258418 out.go:204]   - Configuring RBAC rules ...
	I0630 21:07:22.542068  258418 cni.go:95] Creating CNI manager for ""
	I0630 21:07:22.542090  258418 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:07:22.543871  258418 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0630 21:07:22.545247  258418 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0630 21:07:22.549022  258418 cni.go:189] applying CNI manifest using /var/lib/minikube/binaries/v1.24.2/kubectl ...
	I0630 21:07:22.549039  258418 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2429 bytes)
	I0630 21:07:22.563394  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0630 21:07:23.507644  258418 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0630 21:07:23.507717  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:23.507738  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl label nodes minikube.k8s.io/version=v1.26.0 minikube.k8s.io/commit=251ffcec0e4c997cd7732864187747cc579943c9 minikube.k8s.io/name=embed-certs-20220630210659-9950 minikube.k8s.io/updated_at=2022_06_30T21_07_23_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:23.514525  258418 ops.go:34] apiserver oom_adj: -16
	I0630 21:07:23.575212  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:24.170884  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:24.670874  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:20.560389  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:23.059986  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:25.060230  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:21.821348  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:23.821974  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:25.170894  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:25.670569  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:26.170948  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:26.670289  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:27.171214  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:27.670384  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:28.171262  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:28.671014  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:29.170342  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:29.671154  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:27.560295  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:30.060032  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:25.822336  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:28.321275  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:30.322133  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:30.170498  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:30.670666  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:31.170390  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:31.671212  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:32.170367  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:32.670667  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:33.170348  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:33.670265  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:34.170960  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:34.670712  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:32.559626  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:34.559784  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:34.845605  258418 kubeadm.go:1045] duration metric: took 11.337946322s to wait for elevateKubeSystemPrivileges.
	I0630 21:07:34.845642  258418 kubeadm.go:397] StartCluster complete in 23.077108776s
	I0630 21:07:34.845658  258418 settings.go:142] acquiring lock: {Name:mkcbd229caa05b60d3551ef0b47eea08424c9b5d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:07:34.845753  258418 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:07:34.847459  258418 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig: {Name:mk34e4a4e7b04f624b9adbda4f77ee20b38308ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:07:35.362178  258418 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "embed-certs-20220630210659-9950" rescaled to 1
	I0630 21:07:35.362241  258418 start.go:208] Will wait 6m0s for node &{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0630 21:07:35.365698  258418 out.go:177] * Verifying Kubernetes components...
	I0630 21:07:35.362298  258418 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0630 21:07:35.362308  258418 addons.go:412] enableAddons start: toEnable=map[], additional=[]
	I0630 21:07:35.365824  258418 addons.go:65] Setting storage-provisioner=true in profile "embed-certs-20220630210659-9950"
	I0630 21:07:35.362522  258418 config.go:178] Loaded profile config "embed-certs-20220630210659-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:07:35.365855  258418 addons.go:153] Setting addon storage-provisioner=true in "embed-certs-20220630210659-9950"
	W0630 21:07:35.365867  258418 addons.go:162] addon storage-provisioner should already be in state true
	I0630 21:07:35.365909  258418 host.go:66] Checking if "embed-certs-20220630210659-9950" exists ...
	I0630 21:07:35.365837  258418 addons.go:65] Setting default-storageclass=true in profile "embed-certs-20220630210659-9950"
	I0630 21:07:35.367597  258418 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 21:07:35.367617  258418 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "embed-certs-20220630210659-9950"
	I0630 21:07:35.366441  258418 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:07:35.367981  258418 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:07:35.413326  258418 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0630 21:07:32.322459  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:34.821349  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:35.413605  258418 addons.go:153] Setting addon default-storageclass=true in "embed-certs-20220630210659-9950"
	W0630 21:07:35.414779  258418 addons.go:162] addon default-storageclass should already be in state true
	I0630 21:07:35.414788  258418 addons.go:345] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 21:07:35.414799  258418 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0630 21:07:35.414802  258418 host.go:66] Checking if "embed-certs-20220630210659-9950" exists ...
	I0630 21:07:35.414839  258418 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:07:35.415175  258418 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:07:35.457376  258418 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.94.1 host.minikube.internal\n           fallthrough\n        }' | sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0630 21:07:35.458873  258418 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49427 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:07:35.458979  258418 node_ready.go:35] waiting up to 6m0s for node "embed-certs-20220630210659-9950" to be "Ready" ...
	I0630 21:07:35.461992  258418 addons.go:345] installing /etc/kubernetes/addons/storageclass.yaml
	I0630 21:07:35.462008  258418 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0630 21:07:35.462054  258418 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:07:35.501119  258418 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49427 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:07:35.644457  258418 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 21:07:35.747687  258418 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0630 21:07:36.026997  258418 start.go:806] {"host.minikube.internal": 192.168.94.1} host record injected into CoreDNS
	I0630 21:07:36.263877  258418 out.go:177] * Enabled addons: storage-provisioner, default-storageclass
	I0630 21:07:36.265439  258418 addons.go:414] enableAddons completed in 903.132951ms
	I0630 21:07:37.465314  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:07:37.059624  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:39.059792  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:36.821414  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:38.822111  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:39.965997  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:07:41.966144  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:07:44.466024  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:07:41.060328  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:43.060458  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:41.321999  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:43.821239  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:46.965627  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:07:48.966028  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:07:45.560281  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:48.059772  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:50.059801  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:45.821375  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:47.821892  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:49.822095  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:51.466128  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:07:53.965949  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:07:52.060088  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:54.559829  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:51.822570  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:54.322283  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:55.966446  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:07:57.966572  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:07:56.560117  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:59.060638  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:56.822512  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:59.322047  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:00.465385  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:02.466107  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:01.559922  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:08:03.560005  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:08:01.821701  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:03.822251  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:04.966016  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:07.465504  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:09.465988  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:06.059907  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:08:08.060375  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:08:06.322082  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:08.322154  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:10.322487  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:11.965618  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:13.966333  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:10.559488  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:08:12.560562  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:08:15.060921  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:08:12.821974  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:14.822566  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:15.966399  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:17.967088  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:17.559310  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:08:19.560222  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:08:17.322397  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:19.322675  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:22.059940  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:08:23.062928  242039 node_ready.go:38] duration metric: took 4m0.010106635s waiting for node "default-k8s-different-port-20220630210335-9950" to be "Ready" ...
	I0630 21:08:23.064921  242039 out.go:177] 
	W0630 21:08:23.066357  242039 out.go:239] X Exiting due to GUEST_START: wait 6m0s for node: waiting for node to be ready: waitNodeCondition: timed out waiting for the condition
	W0630 21:08:23.066374  242039 out.go:239] * 
	W0630 21:08:23.067132  242039 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0630 21:08:23.069099  242039 out.go:177] 
	I0630 21:08:20.465710  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:22.966006  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:21.821882  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:24.322587  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:24.966588  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:27.466076  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:29.466452  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:26.821575  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:29.321907  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:31.965739  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:34.465951  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:31.822708  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:34.321850  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:36.965728  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:39.465956  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:36.822442  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:38.816177  244832 pod_ready.go:81] duration metric: took 4m0.004378904s waiting for pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace to be "Ready" ...
	E0630 21:08:38.816215  244832 pod_ready.go:66] WaitExtra: waitPodCondition: timed out waiting 4m0s for pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace to be "Ready" (will not retry!)
	I0630 21:08:38.816238  244832 pod_ready.go:38] duration metric: took 4m9.046787153s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0630 21:08:38.816268  244832 kubeadm.go:630] restartCluster took 4m21.001155245s
	W0630 21:08:38.816400  244832 out.go:239] ! Unable to restart cluster, will reset it: extra: timed out waiting 4m0s for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready"
	I0630 21:08:38.816438  244832 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm reset --cri-socket /run/containerd/containerd.sock --force"
	I0630 21:08:41.415334  244832 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm reset --cri-socket /run/containerd/containerd.sock --force": (2.598874111s)
	I0630 21:08:41.415392  244832 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 21:08:41.426149  244832 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0630 21:08:41.433368  244832 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver
	I0630 21:08:41.433434  244832 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0630 21:08:41.440582  244832 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0630 21:08:41.440622  244832 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0630 21:08:41.703563  244832 out.go:204]   - Generating certificates and keys ...
	I0630 21:08:41.466144  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:43.466290  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:42.552119  244832 out.go:204]   - Booting up control plane ...
	I0630 21:08:45.965932  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:47.966089  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:50.095638  244832 out.go:204]   - Configuring RBAC rules ...
	I0630 21:08:50.533360  244832 cni.go:95] Creating CNI manager for ""
	I0630 21:08:50.533390  244832 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:08:50.535069  244832 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0630 21:08:49.966441  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:51.966501  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:53.967111  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:50.536580  244832 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0630 21:08:50.540911  244832 cni.go:189] applying CNI manifest using /var/lib/minikube/binaries/v1.24.2/kubectl ...
	I0630 21:08:50.540936  244832 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2429 bytes)
	I0630 21:08:50.556120  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0630 21:08:51.389198  244832 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0630 21:08:51.389281  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:08:51.389289  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl label nodes minikube.k8s.io/version=v1.26.0 minikube.k8s.io/commit=251ffcec0e4c997cd7732864187747cc579943c9 minikube.k8s.io/name=no-preload-20220630210237-9950 minikube.k8s.io/updated_at=2022_06_30T21_08_51_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:08:51.465379  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:08:51.473789  244832 ops.go:34] apiserver oom_adj: -16
	I0630 21:08:52.054266  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:08:52.554346  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:08:53.054915  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:08:53.554970  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:08:54.054244  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:08:54.553935  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:08:55.054105  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:08:56.465679  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:58.466102  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:55.554577  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:08:56.054094  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:08:56.554285  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:08:57.054273  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:08:57.554271  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:08:58.054647  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:08:58.554140  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:08:59.054835  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:08:59.553990  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:09:00.054934  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:09:00.554758  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:09:01.054048  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:09:01.554228  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:09:02.054048  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:09:02.554569  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:09:03.054628  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:09:03.134111  244832 kubeadm.go:1045] duration metric: took 11.744889966s to wait for elevateKubeSystemPrivileges.
	I0630 21:09:03.134158  244832 kubeadm.go:397] StartCluster complete in 4m45.363383803s
	I0630 21:09:03.134182  244832 settings.go:142] acquiring lock: {Name:mkcbd229caa05b60d3551ef0b47eea08424c9b5d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:09:03.134326  244832 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:09:03.136509  244832 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig: {Name:mk34e4a4e7b04f624b9adbda4f77ee20b38308ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:09:03.652245  244832 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "no-preload-20220630210237-9950" rescaled to 1
	I0630 21:09:03.652307  244832 start.go:208] Will wait 6m0s for node &{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0630 21:09:03.654230  244832 out.go:177] * Verifying Kubernetes components...
	I0630 21:09:03.652361  244832 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0630 21:09:03.652377  244832 addons.go:412] enableAddons start: toEnable=map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true], additional=[]
	I0630 21:09:03.652560  244832 config.go:178] Loaded profile config "no-preload-20220630210237-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:09:03.656333  244832 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 21:09:03.656394  244832 addons.go:65] Setting storage-provisioner=true in profile "no-preload-20220630210237-9950"
	I0630 21:09:03.656420  244832 addons.go:153] Setting addon storage-provisioner=true in "no-preload-20220630210237-9950"
	I0630 21:09:03.656431  244832 addons.go:65] Setting dashboard=true in profile "no-preload-20220630210237-9950"
	W0630 21:09:03.656444  244832 addons.go:162] addon storage-provisioner should already be in state true
	I0630 21:09:03.656447  244832 addons.go:153] Setting addon dashboard=true in "no-preload-20220630210237-9950"
	W0630 21:09:03.656460  244832 addons.go:162] addon dashboard should already be in state true
	I0630 21:09:03.656494  244832 host.go:66] Checking if "no-preload-20220630210237-9950" exists ...
	I0630 21:09:03.656500  244832 host.go:66] Checking if "no-preload-20220630210237-9950" exists ...
	I0630 21:09:03.656813  244832 addons.go:65] Setting metrics-server=true in profile "no-preload-20220630210237-9950"
	I0630 21:09:03.656833  244832 addons.go:153] Setting addon metrics-server=true in "no-preload-20220630210237-9950"
	W0630 21:09:03.656841  244832 addons.go:162] addon metrics-server should already be in state true
	I0630 21:09:03.656879  244832 host.go:66] Checking if "no-preload-20220630210237-9950" exists ...
	I0630 21:09:03.657021  244832 cli_runner.go:164] Run: docker container inspect no-preload-20220630210237-9950 --format={{.State.Status}}
	I0630 21:09:03.657027  244832 cli_runner.go:164] Run: docker container inspect no-preload-20220630210237-9950 --format={{.State.Status}}
	I0630 21:09:03.656419  244832 addons.go:65] Setting default-storageclass=true in profile "no-preload-20220630210237-9950"
	I0630 21:09:03.657181  244832 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "no-preload-20220630210237-9950"
	I0630 21:09:03.657358  244832 cli_runner.go:164] Run: docker container inspect no-preload-20220630210237-9950 --format={{.State.Status}}
	I0630 21:09:03.657461  244832 cli_runner.go:164] Run: docker container inspect no-preload-20220630210237-9950 --format={{.State.Status}}
	I0630 21:09:03.710739  244832 out.go:177]   - Using image kubernetesui/dashboard:v2.6.0
	I0630 21:09:03.712433  244832 out.go:177]   - Using image fake.domain/k8s.gcr.io/echoserver:1.4
	I0630 21:09:03.713954  244832 addons.go:345] installing /etc/kubernetes/addons/metrics-apiservice.yaml
	I0630 21:09:03.713971  244832 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
	I0630 21:09:03.714019  244832 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-20220630210237-9950
	I0630 21:09:03.712413  244832 out.go:177]   - Using image k8s.gcr.io/echoserver:1.4
	I0630 21:09:03.715477  244832 addons.go:345] installing /etc/kubernetes/addons/dashboard-ns.yaml
	I0630 21:09:03.715500  244832 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
	I0630 21:09:03.715544  244832 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-20220630210237-9950
	I0630 21:09:03.721335  244832 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0630 21:09:00.965954  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:03.466641  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:03.722819  244832 addons.go:345] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 21:09:03.722838  244832 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0630 21:09:03.722890  244832 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-20220630210237-9950
	I0630 21:09:03.727454  244832 addons.go:153] Setting addon default-storageclass=true in "no-preload-20220630210237-9950"
	W0630 21:09:03.727483  244832 addons.go:162] addon default-storageclass should already be in state true
	I0630 21:09:03.727515  244832 host.go:66] Checking if "no-preload-20220630210237-9950" exists ...
	I0630 21:09:03.728100  244832 cli_runner.go:164] Run: docker container inspect no-preload-20220630210237-9950 --format={{.State.Status}}
	I0630 21:09:03.763933  244832 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49412 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/no-preload-20220630210237-9950/id_rsa Username:docker}
	I0630 21:09:03.768185  244832 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49412 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/no-preload-20220630210237-9950/id_rsa Username:docker}
	I0630 21:09:03.773250  244832 node_ready.go:35] waiting up to 6m0s for node "no-preload-20220630210237-9950" to be "Ready" ...
	I0630 21:09:03.773577  244832 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.76.1 host.minikube.internal\n           fallthrough\n        }' | sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0630 21:09:03.783470  244832 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49412 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/no-preload-20220630210237-9950/id_rsa Username:docker}
	I0630 21:09:03.784449  244832 node_ready.go:49] node "no-preload-20220630210237-9950" has status "Ready":"True"
	I0630 21:09:03.784473  244832 node_ready.go:38] duration metric: took 11.192291ms waiting for node "no-preload-20220630210237-9950" to be "Ready" ...
	I0630 21:09:03.784486  244832 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0630 21:09:03.791364  244832 addons.go:345] installing /etc/kubernetes/addons/storageclass.yaml
	I0630 21:09:03.791386  244832 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0630 21:09:03.791427  244832 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-20220630210237-9950
	I0630 21:09:03.830036  244832 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49412 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/no-preload-20220630210237-9950/id_rsa Username:docker}
	I0630 21:09:03.831021  244832 pod_ready.go:78] waiting up to 6m0s for pod "coredns-6d4b75cb6d-5qlzp" in "kube-system" namespace to be "Ready" ...
	I0630 21:09:03.938059  244832 addons.go:345] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
	I0630 21:09:03.938089  244832 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
	I0630 21:09:03.954468  244832 addons.go:345] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
	I0630 21:09:03.954500  244832 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
	I0630 21:09:04.045307  244832 addons.go:345] installing /etc/kubernetes/addons/dashboard-configmap.yaml
	I0630 21:09:04.045333  244832 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
	I0630 21:09:04.127108  244832 addons.go:345] installing /etc/kubernetes/addons/dashboard-dp.yaml
	I0630 21:09:04.127136  244832 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4196 bytes)
	I0630 21:09:04.149860  244832 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0630 21:09:04.150583  244832 addons.go:345] installing /etc/kubernetes/addons/dashboard-role.yaml
	I0630 21:09:04.150608  244832 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
	I0630 21:09:04.150939  244832 addons.go:345] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
	I0630 21:09:04.150956  244832 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1820 bytes)
	I0630 21:09:04.150956  244832 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 21:09:04.243546  244832 addons.go:345] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
	I0630 21:09:04.243634  244832 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
	I0630 21:09:04.247904  244832 addons.go:345] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
	I0630 21:09:04.247931  244832 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
	I0630 21:09:04.338186  244832 addons.go:345] installing /etc/kubernetes/addons/dashboard-sa.yaml
	I0630 21:09:04.338213  244832 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
	I0630 21:09:04.340356  244832 addons.go:345] installing /etc/kubernetes/addons/metrics-server-service.yaml
	I0630 21:09:04.340381  244832 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
	I0630 21:09:04.430136  244832 addons.go:345] installing /etc/kubernetes/addons/dashboard-secret.yaml
	I0630 21:09:04.430168  244832 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
	I0630 21:09:04.444956  244832 start.go:806] {"host.minikube.internal": 192.168.76.1} host record injected into CoreDNS
	I0630 21:09:04.455189  244832 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I0630 21:09:04.524569  244832 addons.go:345] installing /etc/kubernetes/addons/dashboard-svc.yaml
	I0630 21:09:04.524597  244832 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
	I0630 21:09:04.545502  244832 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	I0630 21:09:05.357803  244832 addons.go:383] Verifying addon metrics-server=true in "no-preload-20220630210237-9950"
	I0630 21:09:05.658440  244832 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (1.112884128s)
	I0630 21:09:05.660683  244832 out.go:177] * Enabled addons: default-storageclass, storage-provisioner, metrics-server, dashboard
	I0630 21:09:05.467925  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:07.966731  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:05.662129  244832 addons.go:414] enableAddons completed in 2.009750951s
	I0630 21:09:05.844463  244832 pod_ready.go:92] pod "coredns-6d4b75cb6d-5qlzp" in "kube-system" namespace has status "Ready":"True"
	I0630 21:09:05.844495  244832 pod_ready.go:81] duration metric: took 2.013440652s waiting for pod "coredns-6d4b75cb6d-5qlzp" in "kube-system" namespace to be "Ready" ...
	I0630 21:09:05.844506  244832 pod_ready.go:78] waiting up to 6m0s for pod "coredns-6d4b75cb6d-x4f86" in "kube-system" namespace to be "Ready" ...
	I0630 21:09:07.855520  244832 pod_ready.go:102] pod "coredns-6d4b75cb6d-x4f86" in "kube-system" namespace has status "Ready":"False"
	I0630 21:09:09.856096  244832 pod_ready.go:102] pod "coredns-6d4b75cb6d-x4f86" in "kube-system" namespace has status "Ready":"False"
	I0630 21:09:11.852406  244832 pod_ready.go:97] error getting pod "coredns-6d4b75cb6d-x4f86" in "kube-system" namespace (skipping!): pods "coredns-6d4b75cb6d-x4f86" not found
	I0630 21:09:11.852452  244832 pod_ready.go:81] duration metric: took 6.007939247s waiting for pod "coredns-6d4b75cb6d-x4f86" in "kube-system" namespace to be "Ready" ...
	E0630 21:09:11.852466  244832 pod_ready.go:66] WaitExtra: waitPodCondition: error getting pod "coredns-6d4b75cb6d-x4f86" in "kube-system" namespace (skipping!): pods "coredns-6d4b75cb6d-x4f86" not found
	I0630 21:09:11.852476  244832 pod_ready.go:78] waiting up to 6m0s for pod "etcd-no-preload-20220630210237-9950" in "kube-system" namespace to be "Ready" ...
	I0630 21:09:11.857931  244832 pod_ready.go:92] pod "etcd-no-preload-20220630210237-9950" in "kube-system" namespace has status "Ready":"True"
	I0630 21:09:11.857958  244832 pod_ready.go:81] duration metric: took 5.467697ms waiting for pod "etcd-no-preload-20220630210237-9950" in "kube-system" namespace to be "Ready" ...
	I0630 21:09:11.857974  244832 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-no-preload-20220630210237-9950" in "kube-system" namespace to be "Ready" ...
	I0630 21:09:11.863228  244832 pod_ready.go:92] pod "kube-apiserver-no-preload-20220630210237-9950" in "kube-system" namespace has status "Ready":"True"
	I0630 21:09:11.863249  244832 pod_ready.go:81] duration metric: took 5.267601ms waiting for pod "kube-apiserver-no-preload-20220630210237-9950" in "kube-system" namespace to be "Ready" ...
	I0630 21:09:11.863258  244832 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-no-preload-20220630210237-9950" in "kube-system" namespace to be "Ready" ...
	I0630 21:09:11.867810  244832 pod_ready.go:92] pod "kube-controller-manager-no-preload-20220630210237-9950" in "kube-system" namespace has status "Ready":"True"
	I0630 21:09:11.867829  244832 pod_ready.go:81] duration metric: took 4.564864ms waiting for pod "kube-controller-manager-no-preload-20220630210237-9950" in "kube-system" namespace to be "Ready" ...
	I0630 21:09:11.867838  244832 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-tvrsr" in "kube-system" namespace to be "Ready" ...
	I0630 21:09:11.872281  244832 pod_ready.go:92] pod "kube-proxy-tvrsr" in "kube-system" namespace has status "Ready":"True"
	I0630 21:09:11.872301  244832 pod_ready.go:81] duration metric: took 4.457626ms waiting for pod "kube-proxy-tvrsr" in "kube-system" namespace to be "Ready" ...
	I0630 21:09:11.872310  244832 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-no-preload-20220630210237-9950" in "kube-system" namespace to be "Ready" ...
	I0630 21:09:12.053039  244832 pod_ready.go:92] pod "kube-scheduler-no-preload-20220630210237-9950" in "kube-system" namespace has status "Ready":"True"
	I0630 21:09:12.053102  244832 pod_ready.go:81] duration metric: took 180.784597ms waiting for pod "kube-scheduler-no-preload-20220630210237-9950" in "kube-system" namespace to be "Ready" ...
	I0630 21:09:12.053114  244832 pod_ready.go:38] duration metric: took 8.268615647s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0630 21:09:12.053135  244832 api_server.go:51] waiting for apiserver process to appear ...
	I0630 21:09:12.053178  244832 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 21:09:12.063633  244832 api_server.go:71] duration metric: took 8.411278704s to wait for apiserver process to appear ...
	I0630 21:09:12.063665  244832 api_server.go:87] waiting for apiserver healthz status ...
	I0630 21:09:12.063679  244832 api_server.go:240] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
	I0630 21:09:12.068387  244832 api_server.go:266] https://192.168.76.2:8443/healthz returned 200:
	ok
	I0630 21:09:12.069257  244832 api_server.go:140] control plane version: v1.24.2
	I0630 21:09:12.069276  244832 api_server.go:130] duration metric: took 5.604247ms to wait for apiserver health ...
	I0630 21:09:12.069284  244832 system_pods.go:43] waiting for kube-system pods to appear ...
	I0630 21:09:12.256558  244832 system_pods.go:59] 9 kube-system pods found
	I0630 21:09:12.256591  244832 system_pods.go:61] "coredns-6d4b75cb6d-5qlzp" [8ba0dd4a-8ebf-4939-b707-1da4b243c067] Running
	I0630 21:09:12.256598  244832 system_pods.go:61] "etcd-no-preload-20220630210237-9950" [e63230b7-21b4-4a85-8582-07dc0a355237] Running
	I0630 21:09:12.256604  244832 system_pods.go:61] "kindnet-tcclk" [582c4926-4000-4d83-b1fe-59ff22076a33] Running
	I0630 21:09:12.256610  244832 system_pods.go:61] "kube-apiserver-no-preload-20220630210237-9950" [1cd86f63-3fb2-4e66-89b8-1216d397911b] Running
	I0630 21:09:12.256617  244832 system_pods.go:61] "kube-controller-manager-no-preload-20220630210237-9950" [84d2b5fb-12d4-47f8-b32b-fe7016eeefc0] Running
	I0630 21:09:12.256623  244832 system_pods.go:61] "kube-proxy-tvrsr" [5386550e-2fb7-4652-ab2b-4bcc71110442] Running
	I0630 21:09:12.256630  244832 system_pods.go:61] "kube-scheduler-no-preload-20220630210237-9950" [d03950fd-8252-480b-8eaf-0811287b74f0] Running
	I0630 21:09:12.256641  244832 system_pods.go:61] "metrics-server-5c6f97fb75-9mmw6" [7abb4bac-623a-494d-89c1-45f0fecc5034] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
	I0630 21:09:12.256657  244832 system_pods.go:61] "storage-provisioner" [7d5959da-fbe6-4605-ba9c-c06ea97b06fc] Running
	I0630 21:09:12.256665  244832 system_pods.go:74] duration metric: took 187.374212ms to wait for pod list to return data ...
	I0630 21:09:12.256679  244832 default_sa.go:34] waiting for default service account to be created ...
	I0630 21:09:12.452542  244832 default_sa.go:45] found service account: "default"
	I0630 21:09:12.452565  244832 default_sa.go:55] duration metric: took 195.876726ms for default service account to be created ...
	I0630 21:09:12.452572  244832 system_pods.go:116] waiting for k8s-apps to be running ...
	I0630 21:09:12.656499  244832 system_pods.go:86] 9 kube-system pods found
	I0630 21:09:12.656527  244832 system_pods.go:89] "coredns-6d4b75cb6d-5qlzp" [8ba0dd4a-8ebf-4939-b707-1da4b243c067] Running
	I0630 21:09:12.656535  244832 system_pods.go:89] "etcd-no-preload-20220630210237-9950" [e63230b7-21b4-4a85-8582-07dc0a355237] Running
	I0630 21:09:12.656539  244832 system_pods.go:89] "kindnet-tcclk" [582c4926-4000-4d83-b1fe-59ff22076a33] Running
	I0630 21:09:12.656544  244832 system_pods.go:89] "kube-apiserver-no-preload-20220630210237-9950" [1cd86f63-3fb2-4e66-89b8-1216d397911b] Running
	I0630 21:09:12.656549  244832 system_pods.go:89] "kube-controller-manager-no-preload-20220630210237-9950" [84d2b5fb-12d4-47f8-b32b-fe7016eeefc0] Running
	I0630 21:09:12.656553  244832 system_pods.go:89] "kube-proxy-tvrsr" [5386550e-2fb7-4652-ab2b-4bcc71110442] Running
	I0630 21:09:12.656557  244832 system_pods.go:89] "kube-scheduler-no-preload-20220630210237-9950" [d03950fd-8252-480b-8eaf-0811287b74f0] Running
	I0630 21:09:12.656564  244832 system_pods.go:89] "metrics-server-5c6f97fb75-9mmw6" [7abb4bac-623a-494d-89c1-45f0fecc5034] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
	I0630 21:09:12.656574  244832 system_pods.go:89] "storage-provisioner" [7d5959da-fbe6-4605-ba9c-c06ea97b06fc] Running
	I0630 21:09:12.656584  244832 system_pods.go:126] duration metric: took 204.007805ms to wait for k8s-apps to be running ...
	I0630 21:09:12.656590  244832 system_svc.go:44] waiting for kubelet service to be running ....
	I0630 21:09:12.656635  244832 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 21:09:12.666895  244832 system_svc.go:56] duration metric: took 10.297711ms WaitForService to wait for kubelet.
	I0630 21:09:12.666924  244832 kubeadm.go:572] duration metric: took 9.014585325s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...
	I0630 21:09:12.666953  244832 node_conditions.go:102] verifying NodePressure condition ...
	I0630 21:09:12.853845  244832 node_conditions.go:122] node storage ephemeral capacity is 304695084Ki
	I0630 21:09:12.853871  244832 node_conditions.go:123] node cpu capacity is 8
	I0630 21:09:12.853885  244832 node_conditions.go:105] duration metric: took 186.925675ms to run NodePressure ...
	I0630 21:09:12.853896  244832 start.go:213] waiting for startup goroutines ...
	I0630 21:09:12.893905  244832 start.go:506] kubectl: 1.24.2, cluster: 1.24.2 (minor skew: 0)
	I0630 21:09:12.896835  244832 out.go:177] * Done! kubectl is now configured to use "no-preload-20220630210237-9950" cluster and "default" namespace by default
	I0630 21:09:09.967028  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:12.465824  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:14.466500  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:16.965412  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:18.966550  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:21.466374  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:23.966485  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:26.465447  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:28.466230  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:30.965905  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:33.466059  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:35.966260  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:38.465665  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:40.965367  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:42.966136  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:45.465020  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:47.466000  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:49.966235  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:52.465731  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:54.466083  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:56.966015  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:59.465658  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:01.465723  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:03.966642  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:06.466307  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:08.966212  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:11.465475  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:13.966074  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:15.966429  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:18.465535  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:20.465595  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:22.965577  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:24.965831  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:26.966289  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:29.466080  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:31.965740  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:34.465640  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:36.965286  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:39.465425  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:41.965521  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:43.966398  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:46.465344  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:48.965232  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:50.966164  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:53.465622  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:55.965628  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:58.465311  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:00.465929  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:02.465978  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:04.965401  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:06.965666  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:08.965779  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:10.966125  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:13.465399  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:15.465878  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:17.466180  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:19.966091  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:22.465421  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:24.465623  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:26.466188  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:28.965893  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:31.465563  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:33.966393  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:35.467568  258418 node_ready.go:38] duration metric: took 4m0.008553357s waiting for node "embed-certs-20220630210659-9950" to be "Ready" ...
	I0630 21:11:35.469705  258418 out.go:177] 
	W0630 21:11:35.471092  258418 out.go:239] X Exiting due to GUEST_START: wait 6m0s for node: waiting for node to be ready: waitNodeCondition: timed out waiting for the condition
	W0630 21:11:35.471111  258418 out.go:239] * 
	W0630 21:11:35.471814  258418 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0630 21:11:35.473349  258418 out.go:177] 
	
	* 
	* ==> container status <==
	* CONTAINER           IMAGE               CREATED             STATE               NAME                      ATTEMPT             POD ID
	c435aa6fdf138       6fb66cd78abfe       3 minutes ago       Exited              kindnet-cni               3                   b15f9ad19c2f6
	27b91b4e15954       c21b0c7400f98       12 minutes ago      Running             kube-proxy                0                   29779e553ffd2
	998b774f4f284       b305571ca60a5       12 minutes ago      Running             kube-apiserver            0                   6697c3421bd89
	b8604fd1030fa       06a629a7e51cd       12 minutes ago      Running             kube-controller-manager   0                   acea3993dd031
	fa267cd65f4ee       301ddc62b80b1       12 minutes ago      Running             kube-scheduler            0                   fe605286ea071
	f60b30d7e822c       b2756210eeabf       12 minutes ago      Running             etcd                      0                   b94b9bf357242
	
	* 
	* ==> containerd <==
	* -- Logs begin at Thu 2022-06-30 21:00:14 UTC, end at Thu 2022-06-30 21:12:49 UTC. --
	Jun 30 21:06:11 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:06:11.079281879Z" level=warning msg="cleaning up after shim disconnected" id=5dc3e41a57454c30adbf0679811124e6cc2011e688038f983b2fe03abac5041e namespace=k8s.io
	Jun 30 21:06:11 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:06:11.079299156Z" level=info msg="cleaning up dead shim"
	Jun 30 21:06:11 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:06:11.089274024Z" level=warning msg="cleanup warnings time=\"2022-06-30T21:06:11Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=3141 runtime=io.containerd.runc.v2\n"
	Jun 30 21:06:11 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:06:11.765795913Z" level=info msg="RemoveContainer for \"f3c9296d1934a714fc6e1f5c8f9667857513425cd1b3879bf4e33ddc11939aff\""
	Jun 30 21:06:11 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:06:11.772612009Z" level=info msg="RemoveContainer for \"f3c9296d1934a714fc6e1f5c8f9667857513425cd1b3879bf4e33ddc11939aff\" returns successfully"
	Jun 30 21:06:27 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:06:27.090657660Z" level=info msg="CreateContainer within sandbox \"b15f9ad19c2f6c96abd88ffd829a0f93c6e061772e32718825b5b3d3af616046\" for container &ContainerMetadata{Name:kindnet-cni,Attempt:2,}"
	Jun 30 21:06:27 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:06:27.104681661Z" level=info msg="CreateContainer within sandbox \"b15f9ad19c2f6c96abd88ffd829a0f93c6e061772e32718825b5b3d3af616046\" for &ContainerMetadata{Name:kindnet-cni,Attempt:2,} returns container id \"568d539319bef11ca6af8ad1791b75831190807f15d5234afa71d198e66f17eb\""
	Jun 30 21:06:27 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:06:27.105415565Z" level=info msg="StartContainer for \"568d539319bef11ca6af8ad1791b75831190807f15d5234afa71d198e66f17eb\""
	Jun 30 21:06:27 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:06:27.328624838Z" level=info msg="StartContainer for \"568d539319bef11ca6af8ad1791b75831190807f15d5234afa71d198e66f17eb\" returns successfully"
	Jun 30 21:09:07 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:09:07.827353949Z" level=info msg="shim disconnected" id=568d539319bef11ca6af8ad1791b75831190807f15d5234afa71d198e66f17eb
	Jun 30 21:09:07 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:09:07.827944284Z" level=warning msg="cleaning up after shim disconnected" id=568d539319bef11ca6af8ad1791b75831190807f15d5234afa71d198e66f17eb namespace=k8s.io
	Jun 30 21:09:07 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:09:07.827979415Z" level=info msg="cleaning up dead shim"
	Jun 30 21:09:07 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:09:07.840398403Z" level=warning msg="cleanup warnings time=\"2022-06-30T21:09:07Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=3595 runtime=io.containerd.runc.v2\n"
	Jun 30 21:09:08 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:09:08.047155189Z" level=info msg="RemoveContainer for \"5dc3e41a57454c30adbf0679811124e6cc2011e688038f983b2fe03abac5041e\""
	Jun 30 21:09:08 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:09:08.056419287Z" level=info msg="RemoveContainer for \"5dc3e41a57454c30adbf0679811124e6cc2011e688038f983b2fe03abac5041e\" returns successfully"
	Jun 30 21:09:31 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:09:31.089955786Z" level=info msg="CreateContainer within sandbox \"b15f9ad19c2f6c96abd88ffd829a0f93c6e061772e32718825b5b3d3af616046\" for container &ContainerMetadata{Name:kindnet-cni,Attempt:3,}"
	Jun 30 21:09:31 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:09:31.108751840Z" level=info msg="CreateContainer within sandbox \"b15f9ad19c2f6c96abd88ffd829a0f93c6e061772e32718825b5b3d3af616046\" for &ContainerMetadata{Name:kindnet-cni,Attempt:3,} returns container id \"c435aa6fdf138d684f721a5f1fb855163b020feb07c989254589c7e901b37b36\""
	Jun 30 21:09:31 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:09:31.109470441Z" level=info msg="StartContainer for \"c435aa6fdf138d684f721a5f1fb855163b020feb07c989254589c7e901b37b36\""
	Jun 30 21:09:31 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:09:31.330335393Z" level=info msg="StartContainer for \"c435aa6fdf138d684f721a5f1fb855163b020feb07c989254589c7e901b37b36\" returns successfully"
	Jun 30 21:12:11 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:12:11.774513396Z" level=info msg="shim disconnected" id=c435aa6fdf138d684f721a5f1fb855163b020feb07c989254589c7e901b37b36
	Jun 30 21:12:11 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:12:11.774568777Z" level=warning msg="cleaning up after shim disconnected" id=c435aa6fdf138d684f721a5f1fb855163b020feb07c989254589c7e901b37b36 namespace=k8s.io
	Jun 30 21:12:11 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:12:11.774584835Z" level=info msg="cleaning up dead shim"
	Jun 30 21:12:11 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:12:11.784103491Z" level=warning msg="cleanup warnings time=\"2022-06-30T21:12:11Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=4052 runtime=io.containerd.runc.v2\n"
	Jun 30 21:12:12 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:12:12.333554099Z" level=info msg="RemoveContainer for \"568d539319bef11ca6af8ad1791b75831190807f15d5234afa71d198e66f17eb\""
	Jun 30 21:12:12 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:12:12.338784434Z" level=info msg="RemoveContainer for \"568d539319bef11ca6af8ad1791b75831190807f15d5234afa71d198e66f17eb\" returns successfully"
	
	* 
	* ==> describe nodes <==
	* Name:               old-k8s-version-20220630210005-9950
	Roles:              master
	Labels:             beta.kubernetes.io/arch=amd64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=amd64
	                    kubernetes.io/hostname=old-k8s-version-20220630210005-9950
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=251ffcec0e4c997cd7732864187747cc579943c9
	                    minikube.k8s.io/name=old-k8s-version-20220630210005-9950
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2022_06_30T21_00_30_0700
	                    minikube.k8s.io/version=v1.26.0
	                    node-role.kubernetes.io/master=
	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: /run/containerd/containerd.sock
	                    node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Thu, 30 Jun 2022 21:00:25 +0000
	Taints:             node.kubernetes.io/not-ready:NoSchedule
	Unschedulable:      false
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Thu, 30 Jun 2022 21:11:55 +0000   Thu, 30 Jun 2022 21:00:21 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Thu, 30 Jun 2022 21:11:55 +0000   Thu, 30 Jun 2022 21:00:21 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Thu, 30 Jun 2022 21:11:55 +0000   Thu, 30 Jun 2022 21:00:21 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            False   Thu, 30 Jun 2022 21:11:55 +0000   Thu, 30 Jun 2022 21:00:21 +0000   KubeletNotReady              runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Addresses:
	  InternalIP:  192.168.67.2
	  Hostname:    old-k8s-version-20220630210005-9950
	Capacity:
	 cpu:                8
	 ephemeral-storage:  304695084Ki
	 hugepages-1Gi:      0
	 hugepages-2Mi:      0
	 memory:             32873488Ki
	 pods:               110
	Allocatable:
	 cpu:                8
	 ephemeral-storage:  304695084Ki
	 hugepages-1Gi:      0
	 hugepages-2Mi:      0
	 memory:             32873488Ki
	 pods:               110
	System Info:
	 Machine ID:                 bbe1e1cef6e940328962dca52b3c5731
	 System UUID:                2ca00556-ba1f-4dc3-b97e-bb738f788e2a
	 Boot ID:                    471c4729-f046-4a15-bc49-46f3ad561708
	 Kernel Version:             5.15.0-1012-gcp
	 OS Image:                   Ubuntu 20.04.4 LTS
	 Operating System:           linux
	 Architecture:               amd64
	 Container Runtime Version:  containerd://1.6.6
	 Kubelet Version:            v1.16.0
	 Kube-Proxy Version:         v1.16.0
	PodCIDR:                     10.244.0.0/24
	PodCIDRs:                    10.244.0.0/24
	Non-terminated Pods:         (6 in total)
	  Namespace                  Name                                                           CPU Requests  CPU Limits  Memory Requests  Memory Limits  AGE
	  ---------                  ----                                                           ------------  ----------  ---------------  -------------  ---
	  kube-system                etcd-old-k8s-version-20220630210005-9950                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         11m
	  kube-system                kindnet-4gs84                                                  100m (1%!)(MISSING)     100m (1%!)(MISSING)   50Mi (0%!)(MISSING)        50Mi (0%!)(MISSING)      12m
	  kube-system                kube-apiserver-old-k8s-version-20220630210005-9950             250m (3%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         11m
	  kube-system                kube-controller-manager-old-k8s-version-20220630210005-9950    200m (2%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         11m
	  kube-system                kube-proxy-twls5                                               0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         12m
	  kube-system                kube-scheduler-old-k8s-version-20220630210005-9950             100m (1%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         11m
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests   Limits
	  --------           --------   ------
	  cpu                650m (8%!)(MISSING)  100m (1%!)(MISSING)
	  memory             50Mi (0%!)(MISSING)  50Mi (0%!)(MISSING)
	  ephemeral-storage  0 (0%!)(MISSING)     0 (0%!)(MISSING)
	Events:
	  Type    Reason                   Age                From                                             Message
	  ----    ------                   ----               ----                                             -------
	  Normal  Starting                 12m                kubelet, old-k8s-version-20220630210005-9950     Starting kubelet.
	  Normal  NodeHasSufficientMemory  12m (x8 over 12m)  kubelet, old-k8s-version-20220630210005-9950     Node old-k8s-version-20220630210005-9950 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    12m (x8 over 12m)  kubelet, old-k8s-version-20220630210005-9950     Node old-k8s-version-20220630210005-9950 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     12m (x7 over 12m)  kubelet, old-k8s-version-20220630210005-9950     Node old-k8s-version-20220630210005-9950 status is now: NodeHasSufficientPID
	  Normal  NodeAllocatableEnforced  12m                kubelet, old-k8s-version-20220630210005-9950     Updated Node Allocatable limit across pods
	  Normal  Starting                 12m                kube-proxy, old-k8s-version-20220630210005-9950  Starting kube-proxy.
	
	* 
	* ==> dmesg <==
	* [  +2.939825] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000011] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.027789] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.019913] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[ +21.968090] IPv4: martian destination 127.0.0.11 from 10.244.0.3, dev veth8071d138
	[ +25.445872] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.029436] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.023957] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +2.947695] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[Jun30 21:05] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.023879] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +2.955783] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.011828] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000005] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.027896] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	
	* 
	* ==> etcd [f60b30d7e822cbe35e12b31f9d3517de2de1004b26577e8f27750257f416aae1] <==
	* 2022-06-30 21:00:21.137280 I | raft: newRaft 8688e899f7831fc7 [peers: [], term: 0, commit: 0, applied: 0, lastindex: 0, lastterm: 0]
	2022-06-30 21:00:21.137285 I | raft: 8688e899f7831fc7 became follower at term 1
	2022-06-30 21:00:21.142437 W | auth: simple token is not cryptographically signed
	2022-06-30 21:00:21.146144 I | etcdserver: starting server... [version: 3.3.15, cluster version: to_be_decided]
	2022-06-30 21:00:21.146596 I | etcdserver: 8688e899f7831fc7 as single-node; fast-forwarding 9 ticks (election ticks 10)
	2022-06-30 21:00:21.146824 I | etcdserver/membership: added member 8688e899f7831fc7 [https://192.168.67.2:2380] to cluster 9d8fdeb88b6def78
	2022-06-30 21:00:21.148068 I | embed: ClientTLS: cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, ca = , trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = 
	2022-06-30 21:00:21.148212 I | embed: listening for metrics on http://192.168.67.2:2381
	2022-06-30 21:00:21.148326 I | embed: listening for metrics on http://127.0.0.1:2381
	2022-06-30 21:00:22.037647 I | raft: 8688e899f7831fc7 is starting a new election at term 1
	2022-06-30 21:00:22.037692 I | raft: 8688e899f7831fc7 became candidate at term 2
	2022-06-30 21:00:22.037716 I | raft: 8688e899f7831fc7 received MsgVoteResp from 8688e899f7831fc7 at term 2
	2022-06-30 21:00:22.037741 I | raft: 8688e899f7831fc7 became leader at term 2
	2022-06-30 21:00:22.037750 I | raft: raft.node: 8688e899f7831fc7 elected leader 8688e899f7831fc7 at term 2
	2022-06-30 21:00:22.038107 I | etcdserver: published {Name:old-k8s-version-20220630210005-9950 ClientURLs:[https://192.168.67.2:2379]} to cluster 9d8fdeb88b6def78
	2022-06-30 21:00:22.038200 I | embed: ready to serve client requests
	2022-06-30 21:00:22.038309 I | embed: ready to serve client requests
	2022-06-30 21:00:22.039774 I | embed: serving client requests on 127.0.0.1:2379
	2022-06-30 21:00:22.040324 I | embed: serving client requests on 192.168.67.2:2379
	2022-06-30 21:00:22.065264 I | etcdserver: setting up the initial cluster version to 3.3
	2022-06-30 21:00:22.075609 N | etcdserver/membership: set the initial cluster version to 3.3
	2022-06-30 21:00:22.075977 I | etcdserver/api: enabled capabilities for version 3.3
	2022-06-30 21:05:18.599878 W | etcdserver: read-only range request "key:\"/registry/services/endpoints/default/kubernetes\" " with result "range_response_count:1 size:215" took too long (187.176398ms) to execute
	2022-06-30 21:10:22.085482 I | mvcc: store.index: compact 470
	2022-06-30 21:10:22.086313 I | mvcc: finished scheduled compaction at 470 (took 522.004µs)
	
	* 
	* ==> kernel <==
	*  21:12:49 up 55 min,  0 users,  load average: 0.32, 0.92, 1.55
	Linux old-k8s-version-20220630210005-9950 5.15.0-1012-gcp #17~20.04.1-Ubuntu SMP Thu Jun 23 16:10:34 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
	PRETTY_NAME="Ubuntu 20.04.4 LTS"
	
	* 
	* ==> kube-apiserver [998b774f4f284a1fcf3dbd179faaa8c69e39ab084d30662575ac04f0146604f3] <==
	* I0630 21:00:24.949248       1 nonstructuralschema_controller.go:191] Starting NonStructuralSchemaConditionController
	I0630 21:00:24.949265       1 apiapproval_controller.go:185] Starting KubernetesAPIApprovalPolicyConformantConditionController
	I0630 21:00:24.948849       1 controller.go:81] Starting OpenAPI AggregationController
	E0630 21:00:24.950202       1 controller.go:154] Unable to remove old endpoints from kubernetes service: StorageError: key not found, Code: 1, Key: /registry/masterleases/192.168.67.2, ResourceVersion: 0, AdditionalErrorMsg: 
	I0630 21:00:25.049002       1 cache.go:39] Caches are synced for AvailableConditionController controller
	I0630 21:00:25.049043       1 cache.go:39] Caches are synced for APIServiceRegistrationController controller
	I0630 21:00:25.049119       1 shared_informer.go:204] Caches are synced for crd-autoregister 
	I0630 21:00:25.049016       1 cache.go:39] Caches are synced for autoregister controller
	I0630 21:00:25.948863       1 controller.go:107] OpenAPI AggregationController: Processing item 
	I0630 21:00:25.948905       1 controller.go:130] OpenAPI AggregationController: action for item : Nothing (removed from the queue).
	I0630 21:00:25.948917       1 controller.go:130] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).
	I0630 21:00:25.952956       1 storage_scheduling.go:139] created PriorityClass system-node-critical with value 2000001000
	I0630 21:00:25.956204       1 storage_scheduling.go:139] created PriorityClass system-cluster-critical with value 2000000000
	I0630 21:00:25.956228       1 storage_scheduling.go:148] all system priority classes are created successfully or already exist.
	I0630 21:00:26.733262       1 controller.go:606] quota admission added evaluator for: leases.coordination.k8s.io
	I0630 21:00:27.730109       1 controller.go:606] quota admission added evaluator for: roles.rbac.authorization.k8s.io
	I0630 21:00:28.010061       1 controller.go:606] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
	W0630 21:00:28.355670       1 lease.go:222] Resetting endpoints for master service "kubernetes" to [192.168.67.2]
	I0630 21:00:28.356311       1 controller.go:606] quota admission added evaluator for: endpoints
	I0630 21:00:29.247950       1 controller.go:606] quota admission added evaluator for: serviceaccounts
	I0630 21:00:29.559245       1 controller.go:606] quota admission added evaluator for: deployments.apps
	I0630 21:00:29.917364       1 controller.go:606] quota admission added evaluator for: daemonsets.apps
	I0630 21:00:44.554471       1 controller.go:606] quota admission added evaluator for: controllerrevisions.apps
	I0630 21:00:44.569493       1 controller.go:606] quota admission added evaluator for: events.events.k8s.io
	I0630 21:00:44.669578       1 controller.go:606] quota admission added evaluator for: replicasets.apps
	
	* 
	* ==> kube-controller-manager [b8604fd1030fac170f4591063a20f1abfb86602e188695c1be545614d1b4e8a0] <==
	* I0630 21:00:44.503669       1 shared_informer.go:197] Waiting for caches to sync for cidrallocator
	I0630 21:00:44.505172       1 shared_informer.go:204] Caches are synced for TTL 
	I0630 21:00:44.522066       1 shared_informer.go:204] Caches are synced for persistent volume 
	I0630 21:00:44.527506       1 shared_informer.go:204] Caches are synced for attach detach 
	I0630 21:00:44.546533       1 shared_informer.go:204] Caches are synced for daemon sets 
	I0630 21:00:44.563035       1 event.go:255] Event(v1.ObjectReference{Kind:"DaemonSet", Namespace:"kube-system", Name:"kube-proxy", UID:"4dfe461e-1e01-4e37-b387-4caf9b091e6e", APIVersion:"apps/v1", ResourceVersion:"204", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: kube-proxy-twls5
	I0630 21:00:44.565383       1 event.go:255] Event(v1.ObjectReference{Kind:"DaemonSet", Namespace:"kube-system", Name:"kindnet", UID:"4d27e7c9-7dc6-4d5f-bacf-6fc3835a67e6", APIVersion:"apps/v1", ResourceVersion:"212", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: kindnet-4gs84
	I0630 21:00:44.623202       1 shared_informer.go:204] Caches are synced for cidrallocator 
	I0630 21:00:44.629310       1 range_allocator.go:359] Set node old-k8s-version-20220630210005-9950 PodCIDR to [10.244.0.0/24]
	I0630 21:00:44.667272       1 shared_informer.go:204] Caches are synced for deployment 
	I0630 21:00:44.672031       1 event.go:255] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"kube-system", Name:"coredns", UID:"4670cf8e-481a-421e-a11d-7ec907e8c283", APIVersion:"apps/v1", ResourceVersion:"348", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled up replica set coredns-5644d7b6d9 to 1
	I0630 21:00:44.676702       1 event.go:255] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kube-system", Name:"coredns-5644d7b6d9", UID:"40553f62-8c8a-4503-b0fb-c4c0a693baf1", APIVersion:"apps/v1", ResourceVersion:"351", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: coredns-5644d7b6d9-dw8lr
	I0630 21:00:44.680500       1 shared_informer.go:204] Caches are synced for taint 
	I0630 21:00:44.680614       1 node_lifecycle_controller.go:1208] Initializing eviction metric for zone: 
	W0630 21:00:44.680718       1 node_lifecycle_controller.go:903] Missing timestamp for Node old-k8s-version-20220630210005-9950. Assuming now as a timestamp.
	I0630 21:00:44.680771       1 node_lifecycle_controller.go:1058] Controller detected that all Nodes are not-Ready. Entering master disruption mode.
	I0630 21:00:44.680817       1 event.go:255] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"old-k8s-version-20220630210005-9950", UID:"4800bcdf-0e4c-4b5c-b919-e996b18087ab", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'RegisteredNode' Node old-k8s-version-20220630210005-9950 event: Registered Node old-k8s-version-20220630210005-9950 in Controller
	I0630 21:00:44.680849       1 taint_manager.go:186] Starting NoExecuteTaintManager
	I0630 21:00:44.755613       1 shared_informer.go:204] Caches are synced for disruption 
	I0630 21:00:44.755650       1 disruption.go:341] Sending events to api server.
	I0630 21:00:44.955933       1 shared_informer.go:204] Caches are synced for resource quota 
	I0630 21:00:44.957188       1 shared_informer.go:204] Caches are synced for garbage collector 
	I0630 21:00:44.960086       1 shared_informer.go:204] Caches are synced for resource quota 
	I0630 21:00:44.960086       1 shared_informer.go:204] Caches are synced for garbage collector 
	I0630 21:00:44.960164       1 garbagecollector.go:139] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
	
	* 
	* ==> kube-proxy [27b91b4e1595400f52e6c0fd5fb8e3732c524b9757a79a5a9108333797eb3788] <==
	* W0630 21:00:45.177711       1 server_others.go:329] Flag proxy-mode="" unknown, assuming iptables proxy
	I0630 21:00:45.186039       1 node.go:135] Successfully retrieved node IP: 192.168.67.2
	I0630 21:00:45.186134       1 server_others.go:149] Using iptables Proxier.
	I0630 21:00:45.188027       1 server.go:529] Version: v1.16.0
	I0630 21:00:45.188832       1 config.go:131] Starting endpoints config controller
	I0630 21:00:45.188867       1 shared_informer.go:197] Waiting for caches to sync for endpoints config
	I0630 21:00:45.188954       1 config.go:313] Starting service config controller
	I0630 21:00:45.188977       1 shared_informer.go:197] Waiting for caches to sync for service config
	I0630 21:00:45.323127       1 shared_informer.go:204] Caches are synced for endpoints config 
	I0630 21:00:45.323142       1 shared_informer.go:204] Caches are synced for service config 
	
	* 
	* ==> kube-scheduler [fa267cd65f4eefef8993b275f8625ee5daf30304f18337e27a9944d1b5f03a02] <==
	* W0630 21:00:25.044088       1 authentication.go:79] Authentication is disabled
	I0630 21:00:25.044103       1 deprecated_insecure_serving.go:51] Serving healthz insecurely on [::]:10251
	I0630 21:00:25.045554       1 secure_serving.go:123] Serving securely on 127.0.0.1:10259
	E0630 21:00:25.131167       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E0630 21:00:25.132503       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E0630 21:00:25.133014       1 reflector.go:123] k8s.io/kubernetes/cmd/kube-scheduler/app/server.go:236: Failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E0630 21:00:25.134979       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E0630 21:00:25.135062       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	E0630 21:00:25.135104       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	E0630 21:00:25.135146       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0630 21:00:25.135256       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	E0630 21:00:25.135513       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	E0630 21:00:25.137975       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1beta1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E0630 21:00:25.225117       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	E0630 21:00:26.132387       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E0630 21:00:26.133463       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E0630 21:00:26.135507       1 reflector.go:123] k8s.io/kubernetes/cmd/kube-scheduler/app/server.go:236: Failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E0630 21:00:26.136422       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E0630 21:00:26.139047       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	E0630 21:00:26.141958       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1beta1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E0630 21:00:26.142771       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	E0630 21:00:26.144164       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0630 21:00:26.145881       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	E0630 21:00:26.146811       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	E0630 21:00:26.226419       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	
	* 
	* ==> kubelet <==
	* -- Logs begin at Thu 2022-06-30 21:00:14 UTC, end at Thu 2022-06-30 21:12:49 UTC. --
	Jun 30 21:11:00 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:11:00.334622     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:11:05 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:11:05.335521     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:11:10 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:11:10.336330     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:11:15 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:11:15.337202     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:11:20 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:11:20.337978     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:11:25 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:11:25.338834     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:11:30 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:11:30.339554     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:11:35 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:11:35.340352     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:11:40 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:11:40.341367     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:11:45 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:11:45.342142     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:11:50 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:11:50.342943     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:11:55 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:11:55.343770     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:12:00 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:12:00.344643     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:12:05 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:12:05.345525     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:12:10 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:12:10.346282     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:12:12 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:12:12.333666     918 pod_workers.go:191] Error syncing pod 0eb5f5b6-6c40-401a-95c4-bef42040561c ("kindnet-4gs84_kube-system(0eb5f5b6-6c40-401a-95c4-bef42040561c)"), skipping: failed to "StartContainer" for "kindnet-cni" with CrashLoopBackOff: "back-off 40s restarting failed container=kindnet-cni pod=kindnet-4gs84_kube-system(0eb5f5b6-6c40-401a-95c4-bef42040561c)"
	Jun 30 21:12:15 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:12:15.346991     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:12:20 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:12:20.347603     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:12:25 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:12:25.348426     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:12:28 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:12:28.088049     918 pod_workers.go:191] Error syncing pod 0eb5f5b6-6c40-401a-95c4-bef42040561c ("kindnet-4gs84_kube-system(0eb5f5b6-6c40-401a-95c4-bef42040561c)"), skipping: failed to "StartContainer" for "kindnet-cni" with CrashLoopBackOff: "back-off 40s restarting failed container=kindnet-cni pod=kindnet-4gs84_kube-system(0eb5f5b6-6c40-401a-95c4-bef42040561c)"
	Jun 30 21:12:30 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:12:30.349355     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:12:35 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:12:35.350183     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:12:39 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:12:39.087841     918 pod_workers.go:191] Error syncing pod 0eb5f5b6-6c40-401a-95c4-bef42040561c ("kindnet-4gs84_kube-system(0eb5f5b6-6c40-401a-95c4-bef42040561c)"), skipping: failed to "StartContainer" for "kindnet-cni" with CrashLoopBackOff: "back-off 40s restarting failed container=kindnet-cni pod=kindnet-4gs84_kube-system(0eb5f5b6-6c40-401a-95c4-bef42040561c)"
	Jun 30 21:12:40 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:12:40.350982     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:12:45 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:12:45.351900     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	

                                                
                                                
-- /stdout --
helpers_test.go:254: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p old-k8s-version-20220630210005-9950 -n old-k8s-version-20220630210005-9950
helpers_test.go:261: (dbg) Run:  kubectl --context old-k8s-version-20220630210005-9950 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:270: non-running pods: busybox coredns-5644d7b6d9-dw8lr storage-provisioner
helpers_test.go:272: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/DeployApp]: describe non-running pods <======
helpers_test.go:275: (dbg) Run:  kubectl --context old-k8s-version-20220630210005-9950 describe pod busybox coredns-5644d7b6d9-dw8lr storage-provisioner
helpers_test.go:275: (dbg) Non-zero exit: kubectl --context old-k8s-version-20220630210005-9950 describe pod busybox coredns-5644d7b6d9-dw8lr storage-provisioner: exit status 1 (65.603185ms)

                                                
                                                
-- stdout --
	Name:         busybox
	Namespace:    default
	Priority:     0
	Node:         <none>
	Labels:       integration-test=busybox
	Annotations:  <none>
	Status:       Pending
	IP:           
	IPs:          <none>
	Containers:
	  busybox:
	    Image:      gcr.io/k8s-minikube/busybox:1.28.4-glibc
	    Port:       <none>
	    Host Port:  <none>
	    Command:
	      sleep
	      3600
	    Environment:  <none>
	    Mounts:
	      /var/run/secrets/kubernetes.io/serviceaccount from default-token-mvrxf (ro)
	Conditions:
	  Type           Status
	  PodScheduled   False 
	Volumes:
	  default-token-mvrxf:
	    Type:        Secret (a volume populated by a Secret)
	    SecretName:  default-token-mvrxf
	    Optional:    false
	QoS Class:       BestEffort
	Node-Selectors:  <none>
	Tolerations:     node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
	                 node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
	Events:
	  Type     Reason            Age                    From               Message
	  ----     ------            ----                   ----               -------
	  Warning  FailedScheduling  8m2s                   default-scheduler  0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.
	  Warning  FailedScheduling  5m25s (x1 over 6m55s)  default-scheduler  0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.

                                                
                                                
-- /stdout --
** stderr ** 
	Error from server (NotFound): pods "coredns-5644d7b6d9-dw8lr" not found
	Error from server (NotFound): pods "storage-provisioner" not found

                                                
                                                
** /stderr **
helpers_test.go:277: kubectl --context old-k8s-version-20220630210005-9950 describe pod busybox coredns-5644d7b6d9-dw8lr storage-provisioner: exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestStartStop/group/old-k8s-version/serial/DeployApp]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect old-k8s-version-20220630210005-9950
helpers_test.go:235: (dbg) docker inspect old-k8s-version-20220630210005-9950:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "1b84433fb68bbf2bd151038738e402e5c525e45c0c466b954c0a2fc61a335d66",
	        "Created": "2022-06-30T21:00:13.927977074Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 229888,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2022-06-30T21:00:14.354950284Z",
	            "FinishedAt": "0001-01-01T00:00:00Z"
	        },
	        "Image": "sha256:573e7be5768273a7845baee1ae90fa2e33b83b10a7fbb0f0f41efbf29b53d1f1",
	        "ResolvConfPath": "/var/lib/docker/containers/1b84433fb68bbf2bd151038738e402e5c525e45c0c466b954c0a2fc61a335d66/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/1b84433fb68bbf2bd151038738e402e5c525e45c0c466b954c0a2fc61a335d66/hostname",
	        "HostsPath": "/var/lib/docker/containers/1b84433fb68bbf2bd151038738e402e5c525e45c0c466b954c0a2fc61a335d66/hosts",
	        "LogPath": "/var/lib/docker/containers/1b84433fb68bbf2bd151038738e402e5c525e45c0c466b954c0a2fc61a335d66/1b84433fb68bbf2bd151038738e402e5c525e45c0c466b954c0a2fc61a335d66-json.log",
	        "Name": "/old-k8s-version-20220630210005-9950",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "old-k8s-version-20220630210005-9950:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "old-k8s-version-20220630210005-9950",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 2306867200,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": null,
	            "BlkioDeviceWriteBps": null,
	            "BlkioDeviceReadIOps": null,
	            "BlkioDeviceWriteIOps": null,
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "KernelMemory": 0,
	            "KernelMemoryTCP": 0,
	            "MemoryReservation": 0,
	            "MemorySwap": 4613734400,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": null,
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/d94571e47e569545ea7c101defd143650d23877c940361aa1535ed742bae26c1-init/diff:/var/lib/docker/overlay2/8b88d9f6f12c48be642a133456203e58549a93f1da67d0349744bd0f78917fba/diff:/var/lib/docker/overlay2/2bcbb3b4718a64188802301a25d7f413bb307cb16d077e7e5af799f9152a2970/diff:/var/lib/docker/overlay2/70b0888bf22fcef1c004704b71288ac581cf26a3b3b19fbca3da296ba10d6978/diff:/var/lib/docker/overlay2/7c5332f38fe652f379ef9b6d23e795158e9994317cfb547b581dd2b1fdf1303b/diff:/var/lib/docker/overlay2/0ddb5a3abf433b644a8bfa124e3c87878eed67878faa35493f2befc2b392e9cb/diff:/var/lib/docker/overlay2/3b7cda5fb0232fdeecbec0531ac704a59eb38fe57664c25777193b07e2df0077/diff:/var/lib/docker/overlay2/a14687ada786c65465b9924ae2d77ba27afc07942851cafaade28e80dfe9da16/diff:/var/lib/docker/overlay2/c49a9b7157aa6e8714e192b2849866d035b59e18de462c0ee9b72f898cc5a485/diff:/var/lib/docker/overlay2/efd71a50e3a1044a6d1c4c1a7d4d91d9f070c066e03e51c6c73a5764b778ad72/diff:/var/lib/docker/overlay2/55476a
1c0a20aa4238a0bb0e43c6402c33dcad312938ad48ee81be0160e12a49/diff:/var/lib/docker/overlay2/c48c4a348a797b9a38f01568a6adbcb4b05b4f56f7b986a4bf1b509d8cb00732/diff:/var/lib/docker/overlay2/568e3f354ab0428de5cf82d1fdfb780c3377f5cc55d9f524731c53e39e0ecae7/diff:/var/lib/docker/overlay2/2857943e320cdcdae9af3d8c2acda1fb61e2f142a88b8b902908071cea67816e/diff:/var/lib/docker/overlay2/bdd9a57f0b65e65c5a16395f239425e794c678b0e8db2f4a368e0a9427fe5116/diff:/var/lib/docker/overlay2/b150183f1b73e8c13c751911bcee09fed8ef973478f4dc3cfdb9e509118bf1ea/diff:/var/lib/docker/overlay2/0a053e7c29417cd6feafb351c7944e81342a52898871bc779f7bf61868c78ec4/diff:/var/lib/docker/overlay2/d3c0de3a44d75d0a05acb7843d53deba5ce0457649d6ed757da9b4c532a81e4f/diff:/var/lib/docker/overlay2/53f6170132880e1697dd802b8577382b31c6f1ba144256f8cc62542998842a6b/diff:/var/lib/docker/overlay2/b5c0be6d8efdb1fcb12e73b8f72853f77baa4bc014ac2c1e28b7b972b07f3325/diff:/var/lib/docker/overlay2/36c908f082a1e5388bb25277f1c957eaecf70fcd958080422fa85a3105724fb2/diff:/var/lib/d
ocker/overlay2/b147fe9dce365cfaf9bfeca2e370829e4d87e2671c133a9836ecb02a85422cc7/diff:/var/lib/docker/overlay2/65f488eb9181a721f01b333f5fa0cb91d216abd7842a9ae193bd95316f378721/diff:/var/lib/docker/overlay2/b04269aa247b68912ddc5b1c98ad55d67af4103f576a900eef4069c196b8a263/diff:/var/lib/docker/overlay2/b714c37e15257ae9d0e15d271dd18a330c38ad765901d9b7e7e3feb73e1b03e4/diff:/var/lib/docker/overlay2/3c253b721193edeaade7bba7ce25ff687c889b8fa86e9489c7ee20d5624e6c5b/diff:/var/lib/docker/overlay2/7f67b74e101fa21dd320393c10576eefa4ce1cec2e210bff405784fa45b360f3/diff:/var/lib/docker/overlay2/c3b2adaa63a06a5e6ed966d7b6f20a757aeadd3f25eb09ef3c7e9a66a8904143/diff:/var/lib/docker/overlay2/ddb5d653d19e8cafc4625a8fe9597667d98b277a7f679e532ad84caa2c6da636/diff:/var/lib/docker/overlay2/03eb172b20323ebeee7cb09025726a6e10de6c3dd8661f4f6bbc5a3a3778bad4/diff:/var/lib/docker/overlay2/80ea9bf34d028e95a8a418b3aeb634be72ab3336448946d7855c51ffdf8258d7/diff:/var/lib/docker/overlay2/e28987ea3fb4d431dee111f38cc76814b85f73e86434be3c463c01fdd59
9ad46/diff:/var/lib/docker/overlay2/6f9a46c7c6cf4fd30ce32a1eb08ed9b1e8dd61cb0e42ce54f0f736f06558c306/diff:/var/lib/docker/overlay2/6fc942eb9ccfc09898edc9a5ef3b3d305a6fcb22e8cefb1a9f9c344d10b59b25/diff:/var/lib/docker/overlay2/f6b8c57540e798dc1dfd51fd29c020193c02a4362f31c6d07aa220327bb07b90/diff:/var/lib/docker/overlay2/85d0aa01a3fab8c77262c59d8a7b0809a72673a3da7d33e4e19c04a66db44a11/diff:/var/lib/docker/overlay2/58dcd81a1605641f785ced5aeb38657eec1f02a31b7adfaf4f6fdd49f4bab1d6/diff:/var/lib/docker/overlay2/9d537e0a65325e4bf85b26da9828002339f5c442ca85f931b340457a80ec8c94/diff:/var/lib/docker/overlay2/a6f73707ee6a74e948a02d03c4a3f12b57c2eb408dc67da3c39961bb3cefcc97/diff:/var/lib/docker/overlay2/922526c310b066dbb73b9a106eef8bf0064ad7907a8d7d7b353f5307a17a4901/diff:/var/lib/docker/overlay2/a4185854870ebf8d34a4c7e1827dbe3bc461559839301ffb23c5efff5e3c9f14/diff:/var/lib/docker/overlay2/8c02b1fcb9d79f5d7b2ee4d44f6625a692c44a0d18df0a5c01cac0cca0fdf3f3/diff",
	                "MergedDir": "/var/lib/docker/overlay2/d94571e47e569545ea7c101defd143650d23877c940361aa1535ed742bae26c1/merged",
	                "UpperDir": "/var/lib/docker/overlay2/d94571e47e569545ea7c101defd143650d23877c940361aa1535ed742bae26c1/diff",
	                "WorkDir": "/var/lib/docker/overlay2/d94571e47e569545ea7c101defd143650d23877c940361aa1535ed742bae26c1/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "old-k8s-version-20220630210005-9950",
	                "Source": "/var/lib/docker/volumes/old-k8s-version-20220630210005-9950/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "old-k8s-version-20220630210005-9950",
	            "Domainname": "",
	            "User": "root",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e",
	            "Volumes": null,
	            "WorkingDir": "",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "old-k8s-version-20220630210005-9950",
	                "name.minikube.sigs.k8s.io": "old-k8s-version-20220630210005-9950",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "ec7fc0e156b0aa4af84fc726351cbb9f7e2ff99be8702d21728abb4b2e5727a3",
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49397"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49396"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49393"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49395"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49394"
	                    }
	                ]
	            },
	            "SandboxKey": "/var/run/docker/netns/ec7fc0e156b0",
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "old-k8s-version-20220630210005-9950": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.67.2"
	                    },
	                    "Links": null,
	                    "Aliases": [
	                        "1b84433fb68b",
	                        "old-k8s-version-20220630210005-9950"
	                    ],
	                    "NetworkID": "2a33e496d49b578848c27ed72b0172cf6807dc7dbeec46561e901ef8145b93e7",
	                    "EndpointID": "3e37099b34556312803f62e1d2ae2bcf3204c44287b61d98bcdde49b6700ecc8",
	                    "Gateway": "192.168.67.1",
	                    "IPAddress": "192.168.67.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "MacAddress": "02:42:c0:a8:43:02",
	                    "DriverOpts": null
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-20220630210005-9950 -n old-k8s-version-20220630210005-9950
helpers_test.go:244: <<< TestStartStop/group/old-k8s-version/serial/DeployApp FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======>  post-mortem[TestStartStop/group/old-k8s-version/serial/DeployApp]: minikube logs <======
helpers_test.go:247: (dbg) Run:  out/minikube-linux-amd64 -p old-k8s-version-20220630210005-9950 logs -n 25
helpers_test.go:252: TestStartStop/group/old-k8s-version/serial/DeployApp logs: 
-- stdout --
	* 
	* ==> Audit <==
	* |---------|------------------------------------------------------------|----------|---------|---------|---------------------|---------------------|
	| Command |                            Args                            | Profile  |  User   | Version |     Start Time      |      End Time       |
	|---------|------------------------------------------------------------|----------|---------|---------|---------------------|---------------------|
	| start   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:02 UTC | 30 Jun 22 21:03 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|         | --memory=2200                                              |          |         |         |                     |                     |
	|         | --alsologtostderr                                          |          |         |         |                     |                     |
	|         | --wait=true --preload=false                                |          |         |         |                     |                     |
	|         | --driver=docker                                            |          |         |         |                     |                     |
	|         | --container-runtime=containerd                             |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                               |          |         |         |                     |                     |
	| delete  | -p calico-20220630204859-9950                              | minikube | jenkins | v1.26.0 | 30 Jun 22 21:03 UTC | 30 Jun 22 21:03 UTC |
	| start   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:03 UTC |                     |
	|         | default-k8s-different-port-20220630210335-9950             |          |         |         |                     |                     |
	|         | --memory=2200 --alsologtostderr --wait=true                |          |         |         |                     |                     |
	|         | --apiserver-port=8444 --driver=docker                      |          |         |         |                     |                     |
	|         |  --container-runtime=containerd                            |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                               |          |         |         |                     |                     |
	| addons  | enable metrics-server -p                                   | minikube | jenkins | v1.26.0 | 30 Jun 22 21:03 UTC | 30 Jun 22 21:03 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|         | --images=MetricsServer=k8s.gcr.io/echoserver:1.4           |          |         |         |                     |                     |
	|         | --registries=MetricsServer=fake.domain                     |          |         |         |                     |                     |
	| stop    | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:03 UTC | 30 Jun 22 21:04 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=3                                     |          |         |         |                     |                     |
	| addons  | enable dashboard -p                                        | minikube | jenkins | v1.26.0 | 30 Jun 22 21:04 UTC | 30 Jun 22 21:04 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|         | --images=MetricsScraper=k8s.gcr.io/echoserver:1.4          |          |         |         |                     |                     |
	| start   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:04 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|         | --memory=2200                                              |          |         |         |                     |                     |
	|         | --alsologtostderr                                          |          |         |         |                     |                     |
	|         | --wait=true --preload=false                                |          |         |         |                     |                     |
	|         | --driver=docker                                            |          |         |         |                     |                     |
	|         | --container-runtime=containerd                             |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                               |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:05 UTC | 30 Jun 22 21:05 UTC |
	|         | enable-default-cni-20220630204858-9950                     |          |         |         |                     |                     |
	| start   | -p newest-cni-20220630210514-9950 --memory=2200            | minikube | jenkins | v1.26.0 | 30 Jun 22 21:05 UTC | 30 Jun 22 21:06 UTC |
	|         | --alsologtostderr --wait=apiserver,system_pods,default_sa  |          |         |         |                     |                     |
	|         | --feature-gates ServerSideApply=true --network-plugin=cni  |          |         |         |                     |                     |
	|         | --extra-config=kubeadm.pod-network-cidr=192.168.111.111/16 |          |         |         |                     |                     |
	|         | --driver=docker  --container-runtime=containerd            |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                               |          |         |         |                     |                     |
	| addons  | enable metrics-server -p                                   | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | --images=MetricsServer=k8s.gcr.io/echoserver:1.4           |          |         |         |                     |                     |
	|         | --registries=MetricsServer=fake.domain                     |          |         |         |                     |                     |
	| stop    | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=3                                     |          |         |         |                     |                     |
	| addons  | enable dashboard -p                                        | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | --images=MetricsScraper=k8s.gcr.io/echoserver:1.4          |          |         |         |                     |                     |
	| start   | -p newest-cni-20220630210514-9950 --memory=2200            | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | --alsologtostderr --wait=apiserver,system_pods,default_sa  |          |         |         |                     |                     |
	|         | --feature-gates ServerSideApply=true --network-plugin=cni  |          |         |         |                     |                     |
	|         | --extra-config=kubeadm.pod-network-cidr=192.168.111.111/16 |          |         |         |                     |                     |
	|         | --driver=docker  --container-runtime=containerd            |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                               |          |         |         |                     |                     |
	| ssh     | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | sudo crictl images -o json                                 |          |         |         |                     |                     |
	| pause   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                     |          |         |         |                     |                     |
	| unpause | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                     |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | disable-driver-mounts-20220630210659-9950                  |          |         |         |                     |                     |
	| start   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC |                     |
	|         | embed-certs-20220630210659-9950                            |          |         |         |                     |                     |
	|         | --memory=2200 --alsologtostderr                            |          |         |         |                     |                     |
	|         | --wait=true --embed-certs                                  |          |         |         |                     |                     |
	|         | --driver=docker                                            |          |         |         |                     |                     |
	|         | --container-runtime=containerd                             |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                               |          |         |         |                     |                     |
	| ssh     | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|         | sudo crictl images -o json                                 |          |         |         |                     |                     |
	| pause   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                     |          |         |         |                     |                     |
	| unpause | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                     |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|---------|------------------------------------------------------------|----------|---------|---------|---------------------|---------------------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2022/06/30 21:06:59
	Running on machine: ubuntu-20-agent-8
	Binary: Built with gc go1.18.3 for linux/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0630 21:06:59.738083  258418 out.go:296] Setting OutFile to fd 1 ...
	I0630 21:06:59.738291  258418 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 21:06:59.738303  258418 out.go:309] Setting ErrFile to fd 2...
	I0630 21:06:59.738308  258418 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 21:06:59.738724  258418 root.go:329] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/bin
	I0630 21:06:59.739016  258418 out.go:303] Setting JSON to false
	I0630 21:06:59.740481  258418 start.go:115] hostinfo: {"hostname":"ubuntu-20-agent-8","uptime":2972,"bootTime":1656620248,"procs":586,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1012-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0630 21:06:59.740554  258418 start.go:125] virtualization: kvm guest
	I0630 21:06:59.743370  258418 out.go:177] * [embed-certs-20220630210659-9950] minikube v1.26.0 on Ubuntu 20.04 (kvm/amd64)
	I0630 21:06:59.744868  258418 out.go:177]   - MINIKUBE_LOCATION=14420
	I0630 21:06:59.744862  258418 notify.go:193] Checking for updates...
	I0630 21:06:59.746487  258418 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0630 21:06:59.747925  258418 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:06:59.749264  258418 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube
	I0630 21:06:59.750647  258418 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0630 21:06:59.752427  258418 config.go:178] Loaded profile config "default-k8s-different-port-20220630210335-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:06:59.752560  258418 config.go:178] Loaded profile config "no-preload-20220630210237-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:06:59.752664  258418 config.go:178] Loaded profile config "old-k8s-version-20220630210005-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.16.0
	I0630 21:06:59.752733  258418 driver.go:360] Setting default libvirt URI to qemu:///system
	I0630 21:06:59.793157  258418 docker.go:137] docker version: linux-20.10.17
	I0630 21:06:59.793329  258418 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0630 21:06:59.904539  258418 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:3 ContainersPaused:0 ContainersStopped:0 Images:8 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:50 OomKillDisable:true NGoroutines:49 SystemTime:2022-06-30 21:06:59.825756368 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1012-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexServ
erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662451712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-8 Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Client
Info:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
	I0630 21:06:59.904699  258418 docker.go:254] overlay module found
	I0630 21:06:59.908463  258418 out.go:177] * Using the docker driver based on user configuration
	I0630 21:06:59.909872  258418 start.go:284] selected driver: docker
	I0630 21:06:59.909886  258418 start.go:808] validating driver "docker" against <nil>
	I0630 21:06:59.909904  258418 start.go:819] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0630 21:06:59.910758  258418 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0630 21:07:00.020059  258418 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:3 ContainersPaused:0 ContainersStopped:0 Images:8 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:50 OomKillDisable:true NGoroutines:49 SystemTime:2022-06-30 21:06:59.94317636 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1012-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexServe
rAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662451712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-8 Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] ClientI
nfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
	I0630 21:07:00.020196  258418 start_flags.go:296] no existing cluster config was found, will generate one from the flags 
	I0630 21:07:00.020755  258418 start_flags.go:853] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0630 21:07:00.022859  258418 out.go:177] * Using Docker driver with root privileges
	I0630 21:07:00.024184  258418 cni.go:95] Creating CNI manager for ""
	I0630 21:07:00.024208  258418 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:07:00.024223  258418 start_flags.go:305] Found "CNI" CNI - setting NetworkPlugin=cni
	I0630 21:07:00.024246  258418 start_flags.go:310] config:
	{Name:embed-certs-20220630210659-9950 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:embed-certs-20220630210659-9950 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:clus
ter.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 21:07:00.025866  258418 out.go:177] * Starting control plane node embed-certs-20220630210659-9950 in cluster embed-certs-20220630210659-9950
	I0630 21:07:00.027139  258418 cache.go:120] Beginning downloading kic base image for docker with containerd
	I0630 21:07:00.028673  258418 out.go:177] * Pulling base image ...
	I0630 21:07:00.029951  258418 preload.go:132] Checking if preload exists for k8s version v1.24.2 and runtime containerd
	I0630 21:07:00.029992  258418 preload.go:148] Found local preload: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-containerd-overlay2-amd64.tar.lz4
	I0630 21:07:00.030001  258418 cache.go:57] Caching tarball of preloaded images
	I0630 21:07:00.030041  258418 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e in local docker daemon
	I0630 21:07:00.030250  258418 preload.go:174] Found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-containerd-overlay2-amd64.tar.lz4 in cache, skipping download
	I0630 21:07:00.030266  258418 cache.go:60] Finished verifying existence of preloaded tar for  v1.24.2 on containerd
	I0630 21:07:00.030363  258418 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/config.json ...
	I0630 21:07:00.030388  258418 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/config.json: {Name:mk3d06fce107c3c107ba91de67a3c2827092ffff Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:07:00.065813  258418 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e in local docker daemon, skipping pull
	I0630 21:07:00.065840  258418 cache.go:142] gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e exists in daemon, skipping load
	I0630 21:07:00.065850  258418 cache.go:208] Successfully downloaded all kic artifacts
	I0630 21:07:00.065886  258418 start.go:352] acquiring machines lock for embed-certs-20220630210659-9950: {Name:mk6619dbb09b46cdd2b244e5bf2112b3274a30ef Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0630 21:07:00.066018  258418 start.go:356] acquired machines lock for "embed-certs-20220630210659-9950" in 103.406µs
	I0630 21:07:00.066043  258418 start.go:91] Provisioning new machine with config: &{Name:embed-certs-20220630210659-9950 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:embed-certs-20220630210659-9950 Namespace
:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker
BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:} &{Name: IP: Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0630 21:07:00.066120  258418 start.go:131] createHost starting for "" (driver="docker")
	I0630 21:06:57.559842  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:06:59.560333  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:06:57.322367  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:06:59.322499  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:00.068356  258418 out.go:204] * Creating docker container (CPUs=2, Memory=2200MB) ...
	I0630 21:07:00.068557  258418 start.go:165] libmachine.API.Create for "embed-certs-20220630210659-9950" (driver="docker")
	I0630 21:07:00.068584  258418 client.go:168] LocalClient.Create starting
	I0630 21:07:00.068653  258418 main.go:134] libmachine: Reading certificate data from /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem
	I0630 21:07:00.068682  258418 main.go:134] libmachine: Decoding PEM data...
	I0630 21:07:00.068698  258418 main.go:134] libmachine: Parsing certificate...
	I0630 21:07:00.068753  258418 main.go:134] libmachine: Reading certificate data from /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem
	I0630 21:07:00.068774  258418 main.go:134] libmachine: Decoding PEM data...
	I0630 21:07:00.068784  258418 main.go:134] libmachine: Parsing certificate...
	I0630 21:07:00.069116  258418 cli_runner.go:164] Run: docker network inspect embed-certs-20220630210659-9950 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	W0630 21:07:00.108024  258418 cli_runner.go:211] docker network inspect embed-certs-20220630210659-9950 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
	I0630 21:07:00.108116  258418 network_create.go:272] running [docker network inspect embed-certs-20220630210659-9950] to gather additional debugging logs...
	I0630 21:07:00.108144  258418 cli_runner.go:164] Run: docker network inspect embed-certs-20220630210659-9950
	W0630 21:07:00.141588  258418 cli_runner.go:211] docker network inspect embed-certs-20220630210659-9950 returned with exit code 1
	I0630 21:07:00.141617  258418 network_create.go:275] error running [docker network inspect embed-certs-20220630210659-9950]: docker network inspect embed-certs-20220630210659-9950: exit status 1
	stdout:
	[]
	
	stderr:
	Error: No such network: embed-certs-20220630210659-9950
	I0630 21:07:00.141631  258418 network_create.go:277] output of [docker network inspect embed-certs-20220630210659-9950]: -- stdout --
	[]
	
	-- /stdout --
	** stderr ** 
	Error: No such network: embed-certs-20220630210659-9950
	
	** /stderr **
	I0630 21:07:00.141686  258418 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0630 21:07:00.178261  258418 network.go:240] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName:br-c7ee26fec5a3 IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:02:42:cc:d0:4a:9e}}
	I0630 21:07:00.179334  258418 network.go:240] skipping subnet 192.168.58.0/24 that is taken: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 Interface:{IfaceName:br-3e97afadef02 IfaceIPv4:192.168.58.1 IfaceMTU:1500 IfaceMAC:02:42:9e:e7:fd:62}}
	I0630 21:07:00.179967  258418 network.go:240] skipping subnet 192.168.67.0/24 that is taken: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 Interface:{IfaceName:br-2a33e496d49b IfaceIPv4:192.168.67.1 IfaceMTU:1500 IfaceMAC:02:42:21:56:17:cb}}
	I0630 21:07:00.180760  258418 network.go:240] skipping subnet 192.168.76.0/24 that is taken: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 Interface:{IfaceName:br-5e7b405f6aaf IfaceIPv4:192.168.76.1 IfaceMTU:1500 IfaceMAC:02:42:7b:eb:36:d4}}
	I0630 21:07:00.181503  258418 network.go:240] skipping subnet 192.168.85.0/24 that is taken: &{IP:192.168.85.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.85.0/24 Gateway:192.168.85.1 ClientMin:192.168.85.2 ClientMax:192.168.85.254 Broadcast:192.168.85.255 Interface:{IfaceName:br-88cfda28f438 IfaceIPv4:192.168.85.1 IfaceMTU:1500 IfaceMAC:02:42:12:4c:db:ca}}
	I0630 21:07:00.182506  258418 network.go:288] reserving subnet 192.168.94.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[] amended:true}} dirty:map[192.168.94.0:0xc000790098] misses:0}
	I0630 21:07:00.182557  258418 network.go:235] using free private subnet 192.168.94.0/24: &{IP:192.168.94.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.94.0/24 Gateway:192.168.94.1 ClientMin:192.168.94.2 ClientMax:192.168.94.254 Broadcast:192.168.94.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
	I0630 21:07:00.182573  258418 network_create.go:115] attempt to create docker network embed-certs-20220630210659-9950 192.168.94.0/24 with gateway 192.168.94.1 and MTU of 1500 ...
	I0630 21:07:00.182643  258418 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.94.0/24 --gateway=192.168.94.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=embed-certs-20220630210659-9950 embed-certs-20220630210659-9950
	I0630 21:07:00.257759  258418 network_create.go:99] docker network embed-certs-20220630210659-9950 192.168.94.0/24 created
	I0630 21:07:00.257800  258418 kic.go:106] calculated static IP "192.168.94.2" for the "embed-certs-20220630210659-9950" container
	I0630 21:07:00.257889  258418 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I0630 21:07:00.297023  258418 cli_runner.go:164] Run: docker volume create embed-certs-20220630210659-9950 --label name.minikube.sigs.k8s.io=embed-certs-20220630210659-9950 --label created_by.minikube.sigs.k8s.io=true
	I0630 21:07:00.333425  258418 oci.go:103] Successfully created a docker volume embed-certs-20220630210659-9950
	I0630 21:07:00.333505  258418 cli_runner.go:164] Run: docker run --rm --name embed-certs-20220630210659-9950-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=embed-certs-20220630210659-9950 --entrypoint /usr/bin/test -v embed-certs-20220630210659-9950:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e -d /var/lib
	I0630 21:07:00.910665  258418 oci.go:107] Successfully prepared a docker volume embed-certs-20220630210659-9950
	I0630 21:07:00.910711  258418 preload.go:132] Checking if preload exists for k8s version v1.24.2 and runtime containerd
	I0630 21:07:00.910729  258418 kic.go:179] Starting extracting preloaded images to volume ...
	I0630 21:07:00.910788  258418 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-containerd-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v embed-certs-20220630210659-9950:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e -I lz4 -xf /preloaded.tar -C /extractDir
	I0630 21:07:02.060819  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:04.559635  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:01.822187  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:04.321625  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:07.402589  258418 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-containerd-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v embed-certs-20220630210659-9950:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e -I lz4 -xf /preloaded.tar -C /extractDir: (6.49174022s)
	I0630 21:07:07.402619  258418 kic.go:188] duration metric: took 6.491886 seconds to extract preloaded images to volume
	W0630 21:07:07.402757  258418 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	I0630 21:07:07.402858  258418 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0630 21:07:07.511838  258418 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname embed-certs-20220630210659-9950 --name embed-certs-20220630210659-9950 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=embed-certs-20220630210659-9950 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=embed-certs-20220630210659-9950 --network embed-certs-20220630210659-9950 --ip 192.168.94.2 --volume embed-certs-20220630210659-9950:/var --security-opt apparmor=unconfined --memory=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e
	I0630 21:07:07.934143  258418 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Running}}
	I0630 21:07:07.973385  258418 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:07:08.010245  258418 cli_runner.go:164] Run: docker exec embed-certs-20220630210659-9950 stat /var/lib/dpkg/alternatives/iptables
	I0630 21:07:08.090553  258418 oci.go:144] the created container "embed-certs-20220630210659-9950" has a running status.
	I0630 21:07:08.090607  258418 kic.go:210] Creating ssh key for kic: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa...
	I0630 21:07:08.314972  258418 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0630 21:07:08.427784  258418 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:07:08.468895  258418 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0630 21:07:08.468925  258418 kic_runner.go:114] Args: [docker exec --privileged embed-certs-20220630210659-9950 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0630 21:07:08.566253  258418 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:07:08.600997  258418 machine.go:88] provisioning docker machine ...
	I0630 21:07:08.601037  258418 ubuntu.go:169] provisioning hostname "embed-certs-20220630210659-9950"
	I0630 21:07:08.601149  258418 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:07:08.636297  258418 main.go:134] libmachine: Using SSH client type: native
	I0630 21:07:08.636495  258418 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil>  [] 0s} 127.0.0.1 49427 <nil> <nil>}
	I0630 21:07:08.636521  258418 main.go:134] libmachine: About to run SSH command:
	sudo hostname embed-certs-20220630210659-9950 && echo "embed-certs-20220630210659-9950" | sudo tee /etc/hostname
	I0630 21:07:08.771633  258418 main.go:134] libmachine: SSH cmd err, output: <nil>: embed-certs-20220630210659-9950
	
	I0630 21:07:08.771709  258418 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:07:08.807559  258418 main.go:134] libmachine: Using SSH client type: native
	I0630 21:07:08.807748  258418 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil>  [] 0s} 127.0.0.1 49427 <nil> <nil>}
	I0630 21:07:08.807776  258418 main.go:134] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sembed-certs-20220630210659-9950' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 embed-certs-20220630210659-9950/g' /etc/hosts;
				else 
					echo '127.0.1.1 embed-certs-20220630210659-9950' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0630 21:07:08.925119  258418 main.go:134] libmachine: SSH cmd err, output: <nil>: 
	I0630 21:07:08.925147  258418 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube CaCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/c
erts/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube}
	I0630 21:07:08.925201  258418 ubuntu.go:177] setting up certificates
	I0630 21:07:08.925214  258418 provision.go:83] configureAuth start
	I0630 21:07:08.925265  258418 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-20220630210659-9950
	I0630 21:07:08.960061  258418 provision.go:138] copyHostCerts
	I0630 21:07:08.960154  258418 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem, removing ...
	I0630 21:07:08.960170  258418 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem
	I0630 21:07:08.960258  258418 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem (1082 bytes)
	I0630 21:07:08.960358  258418 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem, removing ...
	I0630 21:07:08.960373  258418 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem
	I0630 21:07:08.960415  258418 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem (1123 bytes)
	I0630 21:07:08.960487  258418 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem, removing ...
	I0630 21:07:08.960500  258418 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem
	I0630 21:07:08.960537  258418 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem (1679 bytes)
	I0630 21:07:08.960643  258418 provision.go:112] generating server cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem org=jenkins.embed-certs-20220630210659-9950 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-20220630210659-9950]
	I0630 21:07:09.146367  258418 provision.go:172] copyRemoteCerts
	I0630 21:07:09.146434  258418 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0630 21:07:09.146467  258418 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:07:09.181391  258418 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49427 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:07:09.268359  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
	I0630 21:07:09.286430  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem --> /etc/docker/server.pem (1265 bytes)
	I0630 21:07:09.303887  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
	I0630 21:07:09.321968  258418 provision.go:86] duration metric: configureAuth took 396.737856ms
	I0630 21:07:09.321996  258418 ubuntu.go:193] setting minikube options for container-runtime
	I0630 21:07:09.322190  258418 config.go:178] Loaded profile config "embed-certs-20220630210659-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:07:09.322207  258418 machine.go:91] provisioned docker machine in 721.186892ms
	I0630 21:07:09.322214  258418 client.go:171] LocalClient.Create took 9.253625617s
	I0630 21:07:09.322232  258418 start.go:173] duration metric: libmachine.API.Create for "embed-certs-20220630210659-9950" took 9.253674873s
	I0630 21:07:09.322245  258418 start.go:306] post-start starting for "embed-certs-20220630210659-9950" (driver="docker")
	I0630 21:07:09.322250  258418 start.go:316] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0630 21:07:09.322300  258418 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0630 21:07:09.322345  258418 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:07:09.357615  258418 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49427 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:07:09.448779  258418 ssh_runner.go:195] Run: cat /etc/os-release
	I0630 21:07:09.451635  258418 main.go:134] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0630 21:07:09.451662  258418 main.go:134] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0630 21:07:09.451677  258418 main.go:134] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0630 21:07:09.451685  258418 info.go:137] Remote host: Ubuntu 20.04.4 LTS
	I0630 21:07:09.451696  258418 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/addons for local assets ...
	I0630 21:07:09.451763  258418 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files for local assets ...
	I0630 21:07:09.451845  258418 filesync.go:149] local asset: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem -> 99502.pem in /etc/ssl/certs
	I0630 21:07:09.451951  258418 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0630 21:07:09.458665  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem --> /etc/ssl/certs/99502.pem (1708 bytes)
	I0630 21:07:09.476026  258418 start.go:309] post-start completed in 153.769797ms
	I0630 21:07:09.476430  258418 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-20220630210659-9950
	I0630 21:07:09.510898  258418 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/config.json ...
	I0630 21:07:09.511146  258418 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0630 21:07:09.511187  258418 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:07:09.545651  258418 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49427 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:07:09.637501  258418 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0630 21:07:09.641506  258418 start.go:134] duration metric: createHost completed in 9.575373132s
	I0630 21:07:09.641531  258418 start.go:81] releasing machines lock for "embed-certs-20220630210659-9950", held for 9.57549992s
	I0630 21:07:09.641602  258418 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-20220630210659-9950
	I0630 21:07:09.677201  258418 ssh_runner.go:195] Run: systemctl --version
	I0630 21:07:09.677250  258418 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/
	I0630 21:07:09.677265  258418 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:07:09.677309  258418 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:07:09.713480  258418 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49427 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:07:09.713482  258418 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49427 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:07:06.559671  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:08.560388  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:09.797176  258418 ssh_runner.go:195] Run: sudo systemctl stop -f crio
	I0630 21:07:09.827436  258418 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0630 21:07:09.837837  258418 docker.go:179] disabling docker service ...
	I0630 21:07:09.837887  258418 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0630 21:07:09.854330  258418 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0630 21:07:09.864433  258418 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0630 21:07:09.947141  258418 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0630 21:07:10.021015  258418 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0630 21:07:10.030498  258418 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
	image-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0630 21:07:10.043126  258418 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*sandbox_image = .*$|sandbox_image = "k8s.gcr.io/pause:3.7"|' -i /etc/containerd/config.toml"
	I0630 21:07:10.051201  258418 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*restrict_oom_score_adj = .*$|restrict_oom_score_adj = false|' -i /etc/containerd/config.toml"
	I0630 21:07:10.060149  258418 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*SystemdCgroup = .*$|SystemdCgroup = false|' -i /etc/containerd/config.toml"
	I0630 21:07:10.068522  258418 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*conf_dir = .*$|conf_dir = "/etc/cni/net.mk"|' -i /etc/containerd/config.toml"
	I0630 21:07:10.077416  258418 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^# imports|imports = ["/etc/containerd/containerd.conf.d/02-containerd.conf"]|' -i /etc/containerd/config.toml"
	I0630 21:07:10.085718  258418 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc/containerd/containerd.conf.d && printf %!s(MISSING) "dmVyc2lvbiA9IDIK" | base64 -d | sudo tee /etc/containerd/containerd.conf.d/02-containerd.conf"
	I0630 21:07:10.100377  258418 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0630 21:07:10.107211  258418 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0630 21:07:10.114109  258418 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0630 21:07:10.199996  258418 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0630 21:07:10.275745  258418 start.go:447] Will wait 60s for socket path /run/containerd/containerd.sock
	I0630 21:07:10.275834  258418 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
	I0630 21:07:10.279416  258418 start.go:468] Will wait 60s for crictl version
	I0630 21:07:10.279463  258418 ssh_runner.go:195] Run: sudo crictl version
	I0630 21:07:10.306037  258418 start.go:477] Version:  0.1.0
	RuntimeName:  containerd
	RuntimeVersion:  1.6.6
	RuntimeApiVersion:  v1alpha2
	I0630 21:07:10.306097  258418 ssh_runner.go:195] Run: containerd --version
	I0630 21:07:10.336955  258418 ssh_runner.go:195] Run: containerd --version
	I0630 21:07:10.369264  258418 out.go:177] * Preparing Kubernetes v1.24.2 on containerd 1.6.6 ...
	I0630 21:07:06.322142  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:08.323262  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:10.323523  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:10.370707  258418 cli_runner.go:164] Run: docker network inspect embed-certs-20220630210659-9950 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0630 21:07:10.404290  258418 ssh_runner.go:195] Run: grep 192.168.94.1	host.minikube.internal$ /etc/hosts
	I0630 21:07:10.407606  258418 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.94.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0630 21:07:10.417141  258418 preload.go:132] Checking if preload exists for k8s version v1.24.2 and runtime containerd
	I0630 21:07:10.417195  258418 ssh_runner.go:195] Run: sudo crictl images --output json
	I0630 21:07:10.442185  258418 containerd.go:547] all images are preloaded for containerd runtime.
	I0630 21:07:10.442210  258418 containerd.go:461] Images already preloaded, skipping extraction
	I0630 21:07:10.442264  258418 ssh_runner.go:195] Run: sudo crictl images --output json
	I0630 21:07:10.466454  258418 containerd.go:547] all images are preloaded for containerd runtime.
	I0630 21:07:10.466477  258418 cache_images.go:84] Images are preloaded, skipping loading
	I0630 21:07:10.466518  258418 ssh_runner.go:195] Run: sudo crictl info
	I0630 21:07:10.490761  258418 cni.go:95] Creating CNI manager for ""
	I0630 21:07:10.490782  258418 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:07:10.490794  258418 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
	I0630 21:07:10.490806  258418 kubeadm.go:158] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.94.2 APIServerPort:8443 KubernetesVersion:v1.24.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:embed-certs-20220630210659-9950 NodeName:embed-certs-20220630210659-9950 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.94.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.94.2 CgroupDriver:cgroupfs ClientC
AFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}
	I0630 21:07:10.490930  258418 kubeadm.go:162] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.94.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: /run/containerd/containerd.sock
	  name: "embed-certs-20220630210659-9950"
	  kubeletExtraArgs:
	    node-ip: 192.168.94.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.94.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.24.2
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%!"(MISSING)
	  nodefs.inodesFree: "0%!"(MISSING)
	  imagefs.available: "0%!"(MISSING)
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0630 21:07:10.491006  258418 kubeadm.go:961] kubelet [Unit]
	Wants=containerd.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.24.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=embed-certs-20220630210659-9950 --image-service-endpoint=unix:///run/containerd/containerd.sock --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.94.2 --runtime-request-timeout=15m
	
	[Install]
	 config:
	{KubernetesVersion:v1.24.2 ClusterName:embed-certs-20220630210659-9950 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
	I0630 21:07:10.491052  258418 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.24.2
	I0630 21:07:10.498227  258418 binaries.go:44] Found k8s binaries, skipping transfer
	I0630 21:07:10.498292  258418 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0630 21:07:10.505224  258418 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (524 bytes)
	I0630 21:07:10.518421  258418 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0630 21:07:10.531076  258418 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2060 bytes)
	I0630 21:07:10.543943  258418 ssh_runner.go:195] Run: grep 192.168.94.2	control-plane.minikube.internal$ /etc/hosts
	I0630 21:07:10.547038  258418 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.94.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0630 21:07:10.556545  258418 certs.go:54] Setting up /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950 for IP: 192.168.94.2
	I0630 21:07:10.556652  258418 certs.go:182] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.key
	I0630 21:07:10.556714  258418 certs.go:182] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.key
	I0630 21:07:10.556769  258418 certs.go:302] generating minikube-user signed cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/client.key
	I0630 21:07:10.556787  258418 crypto.go:68] Generating cert /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/client.crt with IP's: []
	I0630 21:07:10.765363  258418 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/client.crt ...
	I0630 21:07:10.765395  258418 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/client.crt: {Name:mk2189a82adcc765dfa2510a823d0440782737cd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:07:10.765620  258418 crypto.go:164] Writing key to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/client.key ...
	I0630 21:07:10.765636  258418 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/client.key: {Name:mkdeb0e682321ff945ca41fa64d1e608453c6f36 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:07:10.765773  258418 certs.go:302] generating minikube signed cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.key.ad8e880a
	I0630 21:07:10.765794  258418 crypto.go:68] Generating cert /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.crt.ad8e880a with IP's: [192.168.94.2 10.96.0.1 127.0.0.1 10.0.0.1]
	I0630 21:07:10.910596  258418 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.crt.ad8e880a ...
	I0630 21:07:10.910627  258418 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.crt.ad8e880a: {Name:mkc69164c3a143b379c0f4996d5e2da27861b5ff Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:07:10.910832  258418 crypto.go:164] Writing key to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.key.ad8e880a ...
	I0630 21:07:10.910846  258418 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.key.ad8e880a: {Name:mk8e2527beae912aa15913d6f348638ece4c494e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:07:10.910935  258418 certs.go:320] copying /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.crt.ad8e880a -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.crt
	I0630 21:07:10.910996  258418 certs.go:324] copying /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.key.ad8e880a -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.key
	I0630 21:07:10.911041  258418 certs.go:302] generating aggregator signed cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.key
	I0630 21:07:10.911054  258418 crypto.go:68] Generating cert /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.crt with IP's: []
	I0630 21:07:11.469066  258418 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.crt ...
	I0630 21:07:11.469461  258418 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.crt: {Name:mk9657fa57381458a8b172f509e4d3599add736c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:07:11.469782  258418 crypto.go:164] Writing key to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.key ...
	I0630 21:07:11.469807  258418 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.key: {Name:mkd9e4d5545bdb7302e99bfbbe9d07417abbdc89 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:07:11.470115  258418 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950.pem (1338 bytes)
	W0630 21:07:11.470166  258418 certs.go:384] ignoring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950_empty.pem, impossibly tiny 0 bytes
	I0630 21:07:11.470180  258418 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem (1679 bytes)
	I0630 21:07:11.470222  258418 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem (1082 bytes)
	I0630 21:07:11.470260  258418 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem (1123 bytes)
	I0630 21:07:11.470301  258418 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/key.pem (1679 bytes)
	I0630 21:07:11.470362  258418 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem (1708 bytes)
	I0630 21:07:11.471511  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
	I0630 21:07:11.490653  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I0630 21:07:11.508628  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0630 21:07:11.527379  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
	I0630 21:07:11.545789  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0630 21:07:11.564535  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
	I0630 21:07:11.582438  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0630 21:07:11.600444  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
	I0630 21:07:11.620977  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem --> /usr/share/ca-certificates/99502.pem (1708 bytes)
	I0630 21:07:11.639639  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0630 21:07:11.658178  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950.pem --> /usr/share/ca-certificates/9950.pem (1338 bytes)
	I0630 21:07:11.677694  258418 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0630 21:07:11.690755  258418 ssh_runner.go:195] Run: openssl version
	I0630 21:07:11.695688  258418 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/99502.pem && ln -fs /usr/share/ca-certificates/99502.pem /etc/ssl/certs/99502.pem"
	I0630 21:07:11.703347  258418 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/99502.pem
	I0630 21:07:11.706626  258418 certs.go:431] hashing: -rw-r--r-- 1 root root 1708 Jun 30 20:26 /usr/share/ca-certificates/99502.pem
	I0630 21:07:11.706684  258418 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/99502.pem
	I0630 21:07:11.711429  258418 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/99502.pem /etc/ssl/certs/3ec20f2e.0"
	I0630 21:07:11.719285  258418 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0630 21:07:11.726650  258418 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:07:11.729726  258418 certs.go:431] hashing: -rw-r--r-- 1 root root 1111 Jun 30 20:22 /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:07:11.729781  258418 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:07:11.734559  258418 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0630 21:07:11.741992  258418 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/9950.pem && ln -fs /usr/share/ca-certificates/9950.pem /etc/ssl/certs/9950.pem"
	I0630 21:07:11.752166  258418 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/9950.pem
	I0630 21:07:11.755639  258418 certs.go:431] hashing: -rw-r--r-- 1 root root 1338 Jun 30 20:26 /usr/share/ca-certificates/9950.pem
	I0630 21:07:11.755700  258418 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/9950.pem
	I0630 21:07:11.760725  258418 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/9950.pem /etc/ssl/certs/51391683.0"
	I0630 21:07:11.768543  258418 kubeadm.go:395] StartCluster: {Name:embed-certs-20220630210659-9950 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:embed-certs-20220630210659-9950 Namespace:default APIServerName
:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirr
or: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 21:07:11.768636  258418 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
	I0630 21:07:11.768692  258418 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0630 21:07:11.793825  258418 cri.go:87] found id: ""
	I0630 21:07:11.793907  258418 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0630 21:07:11.801886  258418 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0630 21:07:11.809295  258418 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver
	I0630 21:07:11.809360  258418 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0630 21:07:11.816601  258418 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0630 21:07:11.816642  258418 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0630 21:07:11.060021  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:13.559886  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:12.823802  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:15.322092  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:15.560115  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:18.060545  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:17.322180  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:19.322480  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:22.533924  258418 out.go:204]   - Generating certificates and keys ...
	I0630 21:07:22.537123  258418 out.go:204]   - Booting up control plane ...
	I0630 21:07:22.539540  258418 out.go:204]   - Configuring RBAC rules ...
	I0630 21:07:22.542068  258418 cni.go:95] Creating CNI manager for ""
	I0630 21:07:22.542090  258418 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:07:22.543871  258418 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0630 21:07:22.545247  258418 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0630 21:07:22.549022  258418 cni.go:189] applying CNI manifest using /var/lib/minikube/binaries/v1.24.2/kubectl ...
	I0630 21:07:22.549039  258418 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2429 bytes)
	I0630 21:07:22.563394  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0630 21:07:23.507644  258418 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0630 21:07:23.507717  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:23.507738  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl label nodes minikube.k8s.io/version=v1.26.0 minikube.k8s.io/commit=251ffcec0e4c997cd7732864187747cc579943c9 minikube.k8s.io/name=embed-certs-20220630210659-9950 minikube.k8s.io/updated_at=2022_06_30T21_07_23_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:23.514525  258418 ops.go:34] apiserver oom_adj: -16
	I0630 21:07:23.575212  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:24.170884  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:24.670874  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:20.560389  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:23.059986  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:25.060230  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:21.821348  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:23.821974  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:25.170894  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:25.670569  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:26.170948  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:26.670289  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:27.171214  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:27.670384  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:28.171262  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:28.671014  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:29.170342  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:29.671154  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:27.560295  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:30.060032  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:25.822336  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:28.321275  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:30.322133  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:30.170498  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:30.670666  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:31.170390  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:31.671212  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:32.170367  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:32.670667  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:33.170348  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:33.670265  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:34.170960  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:34.670712  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:32.559626  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:34.559784  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:34.845605  258418 kubeadm.go:1045] duration metric: took 11.337946322s to wait for elevateKubeSystemPrivileges.
	I0630 21:07:34.845642  258418 kubeadm.go:397] StartCluster complete in 23.077108776s
	I0630 21:07:34.845658  258418 settings.go:142] acquiring lock: {Name:mkcbd229caa05b60d3551ef0b47eea08424c9b5d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:07:34.845753  258418 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:07:34.847459  258418 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig: {Name:mk34e4a4e7b04f624b9adbda4f77ee20b38308ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:07:35.362178  258418 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "embed-certs-20220630210659-9950" rescaled to 1
	I0630 21:07:35.362241  258418 start.go:208] Will wait 6m0s for node &{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0630 21:07:35.365698  258418 out.go:177] * Verifying Kubernetes components...
	I0630 21:07:35.362298  258418 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0630 21:07:35.362308  258418 addons.go:412] enableAddons start: toEnable=map[], additional=[]
	I0630 21:07:35.365824  258418 addons.go:65] Setting storage-provisioner=true in profile "embed-certs-20220630210659-9950"
	I0630 21:07:35.362522  258418 config.go:178] Loaded profile config "embed-certs-20220630210659-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:07:35.365855  258418 addons.go:153] Setting addon storage-provisioner=true in "embed-certs-20220630210659-9950"
	W0630 21:07:35.365867  258418 addons.go:162] addon storage-provisioner should already be in state true
	I0630 21:07:35.365909  258418 host.go:66] Checking if "embed-certs-20220630210659-9950" exists ...
	I0630 21:07:35.365837  258418 addons.go:65] Setting default-storageclass=true in profile "embed-certs-20220630210659-9950"
	I0630 21:07:35.367597  258418 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 21:07:35.367617  258418 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "embed-certs-20220630210659-9950"
	I0630 21:07:35.366441  258418 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:07:35.367981  258418 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:07:35.413326  258418 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0630 21:07:32.322459  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:34.821349  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:35.413605  258418 addons.go:153] Setting addon default-storageclass=true in "embed-certs-20220630210659-9950"
	W0630 21:07:35.414779  258418 addons.go:162] addon default-storageclass should already be in state true
	I0630 21:07:35.414788  258418 addons.go:345] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 21:07:35.414799  258418 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0630 21:07:35.414802  258418 host.go:66] Checking if "embed-certs-20220630210659-9950" exists ...
	I0630 21:07:35.414839  258418 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:07:35.415175  258418 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:07:35.457376  258418 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.94.1 host.minikube.internal\n           fallthrough\n        }' | sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0630 21:07:35.458873  258418 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49427 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:07:35.458979  258418 node_ready.go:35] waiting up to 6m0s for node "embed-certs-20220630210659-9950" to be "Ready" ...
	I0630 21:07:35.461992  258418 addons.go:345] installing /etc/kubernetes/addons/storageclass.yaml
	I0630 21:07:35.462008  258418 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0630 21:07:35.462054  258418 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:07:35.501119  258418 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49427 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:07:35.644457  258418 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 21:07:35.747687  258418 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0630 21:07:36.026997  258418 start.go:806] {"host.minikube.internal": 192.168.94.1} host record injected into CoreDNS
	I0630 21:07:36.263877  258418 out.go:177] * Enabled addons: storage-provisioner, default-storageclass
	I0630 21:07:36.265439  258418 addons.go:414] enableAddons completed in 903.132951ms
	I0630 21:07:37.465314  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:07:37.059624  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:39.059792  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:36.821414  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:38.822111  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:39.965997  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:07:41.966144  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:07:44.466024  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:07:41.060328  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:43.060458  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:41.321999  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:43.821239  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:46.965627  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:07:48.966028  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:07:45.560281  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:48.059772  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:50.059801  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:45.821375  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:47.821892  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:49.822095  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:51.466128  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:07:53.965949  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:07:52.060088  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:54.559829  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:51.822570  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:54.322283  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:55.966446  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:07:57.966572  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:07:56.560117  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:59.060638  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:56.822512  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:59.322047  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:00.465385  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:02.466107  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:01.559922  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:08:03.560005  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:08:01.821701  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:03.822251  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:04.966016  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:07.465504  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:09.465988  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:06.059907  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:08:08.060375  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:08:06.322082  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:08.322154  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:10.322487  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:11.965618  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:13.966333  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:10.559488  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:08:12.560562  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:08:15.060921  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:08:12.821974  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:14.822566  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:15.966399  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:17.967088  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:17.559310  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:08:19.560222  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:08:17.322397  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:19.322675  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:22.059940  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:08:23.062928  242039 node_ready.go:38] duration metric: took 4m0.010106635s waiting for node "default-k8s-different-port-20220630210335-9950" to be "Ready" ...
	I0630 21:08:23.064921  242039 out.go:177] 
	W0630 21:08:23.066357  242039 out.go:239] X Exiting due to GUEST_START: wait 6m0s for node: waiting for node to be ready: waitNodeCondition: timed out waiting for the condition
	W0630 21:08:23.066374  242039 out.go:239] * 
	W0630 21:08:23.067132  242039 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0630 21:08:23.069099  242039 out.go:177] 
	I0630 21:08:20.465710  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:22.966006  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:21.821882  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:24.322587  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:24.966588  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:27.466076  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:29.466452  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:26.821575  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:29.321907  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:31.965739  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:34.465951  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:31.822708  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:34.321850  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:36.965728  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:39.465956  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:36.822442  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:38.816177  244832 pod_ready.go:81] duration metric: took 4m0.004378904s waiting for pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace to be "Ready" ...
	E0630 21:08:38.816215  244832 pod_ready.go:66] WaitExtra: waitPodCondition: timed out waiting 4m0s for pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace to be "Ready" (will not retry!)
	I0630 21:08:38.816238  244832 pod_ready.go:38] duration metric: took 4m9.046787153s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0630 21:08:38.816268  244832 kubeadm.go:630] restartCluster took 4m21.001155245s
	W0630 21:08:38.816400  244832 out.go:239] ! Unable to restart cluster, will reset it: extra: timed out waiting 4m0s for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready"
	I0630 21:08:38.816438  244832 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm reset --cri-socket /run/containerd/containerd.sock --force"
	I0630 21:08:41.415334  244832 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm reset --cri-socket /run/containerd/containerd.sock --force": (2.598874111s)
	I0630 21:08:41.415392  244832 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 21:08:41.426149  244832 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0630 21:08:41.433368  244832 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver
	I0630 21:08:41.433434  244832 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0630 21:08:41.440582  244832 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0630 21:08:41.440622  244832 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0630 21:08:41.703563  244832 out.go:204]   - Generating certificates and keys ...
	I0630 21:08:41.466144  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:43.466290  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:42.552119  244832 out.go:204]   - Booting up control plane ...
	I0630 21:08:45.965932  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:47.966089  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:50.095638  244832 out.go:204]   - Configuring RBAC rules ...
	I0630 21:08:50.533360  244832 cni.go:95] Creating CNI manager for ""
	I0630 21:08:50.533390  244832 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:08:50.535069  244832 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0630 21:08:49.966441  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:51.966501  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:53.967111  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:50.536580  244832 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0630 21:08:50.540911  244832 cni.go:189] applying CNI manifest using /var/lib/minikube/binaries/v1.24.2/kubectl ...
	I0630 21:08:50.540936  244832 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2429 bytes)
	I0630 21:08:50.556120  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0630 21:08:51.389198  244832 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0630 21:08:51.389281  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:08:51.389289  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl label nodes minikube.k8s.io/version=v1.26.0 minikube.k8s.io/commit=251ffcec0e4c997cd7732864187747cc579943c9 minikube.k8s.io/name=no-preload-20220630210237-9950 minikube.k8s.io/updated_at=2022_06_30T21_08_51_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:08:51.465379  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:08:51.473789  244832 ops.go:34] apiserver oom_adj: -16
	I0630 21:08:52.054266  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:08:52.554346  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:08:53.054915  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:08:53.554970  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:08:54.054244  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:08:54.553935  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:08:55.054105  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:08:56.465679  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:58.466102  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:55.554577  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:08:56.054094  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:08:56.554285  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:08:57.054273  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:08:57.554271  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:08:58.054647  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:08:58.554140  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:08:59.054835  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:08:59.553990  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:09:00.054934  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:09:00.554758  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:09:01.054048  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:09:01.554228  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:09:02.054048  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:09:02.554569  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:09:03.054628  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:09:03.134111  244832 kubeadm.go:1045] duration metric: took 11.744889966s to wait for elevateKubeSystemPrivileges.
	I0630 21:09:03.134158  244832 kubeadm.go:397] StartCluster complete in 4m45.363383803s
	I0630 21:09:03.134182  244832 settings.go:142] acquiring lock: {Name:mkcbd229caa05b60d3551ef0b47eea08424c9b5d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:09:03.134326  244832 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:09:03.136509  244832 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig: {Name:mk34e4a4e7b04f624b9adbda4f77ee20b38308ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:09:03.652245  244832 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "no-preload-20220630210237-9950" rescaled to 1
	I0630 21:09:03.652307  244832 start.go:208] Will wait 6m0s for node &{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0630 21:09:03.654230  244832 out.go:177] * Verifying Kubernetes components...
	I0630 21:09:03.652361  244832 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0630 21:09:03.652377  244832 addons.go:412] enableAddons start: toEnable=map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true], additional=[]
	I0630 21:09:03.652560  244832 config.go:178] Loaded profile config "no-preload-20220630210237-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:09:03.656333  244832 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 21:09:03.656394  244832 addons.go:65] Setting storage-provisioner=true in profile "no-preload-20220630210237-9950"
	I0630 21:09:03.656420  244832 addons.go:153] Setting addon storage-provisioner=true in "no-preload-20220630210237-9950"
	I0630 21:09:03.656431  244832 addons.go:65] Setting dashboard=true in profile "no-preload-20220630210237-9950"
	W0630 21:09:03.656444  244832 addons.go:162] addon storage-provisioner should already be in state true
	I0630 21:09:03.656447  244832 addons.go:153] Setting addon dashboard=true in "no-preload-20220630210237-9950"
	W0630 21:09:03.656460  244832 addons.go:162] addon dashboard should already be in state true
	I0630 21:09:03.656494  244832 host.go:66] Checking if "no-preload-20220630210237-9950" exists ...
	I0630 21:09:03.656500  244832 host.go:66] Checking if "no-preload-20220630210237-9950" exists ...
	I0630 21:09:03.656813  244832 addons.go:65] Setting metrics-server=true in profile "no-preload-20220630210237-9950"
	I0630 21:09:03.656833  244832 addons.go:153] Setting addon metrics-server=true in "no-preload-20220630210237-9950"
	W0630 21:09:03.656841  244832 addons.go:162] addon metrics-server should already be in state true
	I0630 21:09:03.656879  244832 host.go:66] Checking if "no-preload-20220630210237-9950" exists ...
	I0630 21:09:03.657021  244832 cli_runner.go:164] Run: docker container inspect no-preload-20220630210237-9950 --format={{.State.Status}}
	I0630 21:09:03.657027  244832 cli_runner.go:164] Run: docker container inspect no-preload-20220630210237-9950 --format={{.State.Status}}
	I0630 21:09:03.656419  244832 addons.go:65] Setting default-storageclass=true in profile "no-preload-20220630210237-9950"
	I0630 21:09:03.657181  244832 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "no-preload-20220630210237-9950"
	I0630 21:09:03.657358  244832 cli_runner.go:164] Run: docker container inspect no-preload-20220630210237-9950 --format={{.State.Status}}
	I0630 21:09:03.657461  244832 cli_runner.go:164] Run: docker container inspect no-preload-20220630210237-9950 --format={{.State.Status}}
	I0630 21:09:03.710739  244832 out.go:177]   - Using image kubernetesui/dashboard:v2.6.0
	I0630 21:09:03.712433  244832 out.go:177]   - Using image fake.domain/k8s.gcr.io/echoserver:1.4
	I0630 21:09:03.713954  244832 addons.go:345] installing /etc/kubernetes/addons/metrics-apiservice.yaml
	I0630 21:09:03.713971  244832 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
	I0630 21:09:03.714019  244832 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-20220630210237-9950
	I0630 21:09:03.712413  244832 out.go:177]   - Using image k8s.gcr.io/echoserver:1.4
	I0630 21:09:03.715477  244832 addons.go:345] installing /etc/kubernetes/addons/dashboard-ns.yaml
	I0630 21:09:03.715500  244832 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
	I0630 21:09:03.715544  244832 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-20220630210237-9950
	I0630 21:09:03.721335  244832 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0630 21:09:00.965954  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:03.466641  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:03.722819  244832 addons.go:345] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 21:09:03.722838  244832 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0630 21:09:03.722890  244832 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-20220630210237-9950
	I0630 21:09:03.727454  244832 addons.go:153] Setting addon default-storageclass=true in "no-preload-20220630210237-9950"
	W0630 21:09:03.727483  244832 addons.go:162] addon default-storageclass should already be in state true
	I0630 21:09:03.727515  244832 host.go:66] Checking if "no-preload-20220630210237-9950" exists ...
	I0630 21:09:03.728100  244832 cli_runner.go:164] Run: docker container inspect no-preload-20220630210237-9950 --format={{.State.Status}}
	I0630 21:09:03.763933  244832 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49412 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/no-preload-20220630210237-9950/id_rsa Username:docker}
	I0630 21:09:03.768185  244832 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49412 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/no-preload-20220630210237-9950/id_rsa Username:docker}
	I0630 21:09:03.773250  244832 node_ready.go:35] waiting up to 6m0s for node "no-preload-20220630210237-9950" to be "Ready" ...
	I0630 21:09:03.773577  244832 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.76.1 host.minikube.internal\n           fallthrough\n        }' | sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0630 21:09:03.783470  244832 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49412 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/no-preload-20220630210237-9950/id_rsa Username:docker}
	I0630 21:09:03.784449  244832 node_ready.go:49] node "no-preload-20220630210237-9950" has status "Ready":"True"
	I0630 21:09:03.784473  244832 node_ready.go:38] duration metric: took 11.192291ms waiting for node "no-preload-20220630210237-9950" to be "Ready" ...
	I0630 21:09:03.784486  244832 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0630 21:09:03.791364  244832 addons.go:345] installing /etc/kubernetes/addons/storageclass.yaml
	I0630 21:09:03.791386  244832 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0630 21:09:03.791427  244832 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-20220630210237-9950
	I0630 21:09:03.830036  244832 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49412 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/no-preload-20220630210237-9950/id_rsa Username:docker}
	I0630 21:09:03.831021  244832 pod_ready.go:78] waiting up to 6m0s for pod "coredns-6d4b75cb6d-5qlzp" in "kube-system" namespace to be "Ready" ...
	I0630 21:09:03.938059  244832 addons.go:345] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
	I0630 21:09:03.938089  244832 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
	I0630 21:09:03.954468  244832 addons.go:345] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
	I0630 21:09:03.954500  244832 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
	I0630 21:09:04.045307  244832 addons.go:345] installing /etc/kubernetes/addons/dashboard-configmap.yaml
	I0630 21:09:04.045333  244832 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
	I0630 21:09:04.127108  244832 addons.go:345] installing /etc/kubernetes/addons/dashboard-dp.yaml
	I0630 21:09:04.127136  244832 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4196 bytes)
	I0630 21:09:04.149860  244832 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0630 21:09:04.150583  244832 addons.go:345] installing /etc/kubernetes/addons/dashboard-role.yaml
	I0630 21:09:04.150608  244832 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
	I0630 21:09:04.150939  244832 addons.go:345] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
	I0630 21:09:04.150956  244832 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1820 bytes)
	I0630 21:09:04.150956  244832 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 21:09:04.243546  244832 addons.go:345] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
	I0630 21:09:04.243634  244832 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
	I0630 21:09:04.247904  244832 addons.go:345] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
	I0630 21:09:04.247931  244832 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
	I0630 21:09:04.338186  244832 addons.go:345] installing /etc/kubernetes/addons/dashboard-sa.yaml
	I0630 21:09:04.338213  244832 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
	I0630 21:09:04.340356  244832 addons.go:345] installing /etc/kubernetes/addons/metrics-server-service.yaml
	I0630 21:09:04.340381  244832 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
	I0630 21:09:04.430136  244832 addons.go:345] installing /etc/kubernetes/addons/dashboard-secret.yaml
	I0630 21:09:04.430168  244832 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
	I0630 21:09:04.444956  244832 start.go:806] {"host.minikube.internal": 192.168.76.1} host record injected into CoreDNS
	I0630 21:09:04.455189  244832 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I0630 21:09:04.524569  244832 addons.go:345] installing /etc/kubernetes/addons/dashboard-svc.yaml
	I0630 21:09:04.524597  244832 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
	I0630 21:09:04.545502  244832 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	I0630 21:09:05.357803  244832 addons.go:383] Verifying addon metrics-server=true in "no-preload-20220630210237-9950"
	I0630 21:09:05.658440  244832 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (1.112884128s)
	I0630 21:09:05.660683  244832 out.go:177] * Enabled addons: default-storageclass, storage-provisioner, metrics-server, dashboard
	I0630 21:09:05.467925  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:07.966731  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:05.662129  244832 addons.go:414] enableAddons completed in 2.009750951s
	I0630 21:09:05.844463  244832 pod_ready.go:92] pod "coredns-6d4b75cb6d-5qlzp" in "kube-system" namespace has status "Ready":"True"
	I0630 21:09:05.844495  244832 pod_ready.go:81] duration metric: took 2.013440652s waiting for pod "coredns-6d4b75cb6d-5qlzp" in "kube-system" namespace to be "Ready" ...
	I0630 21:09:05.844506  244832 pod_ready.go:78] waiting up to 6m0s for pod "coredns-6d4b75cb6d-x4f86" in "kube-system" namespace to be "Ready" ...
	I0630 21:09:07.855520  244832 pod_ready.go:102] pod "coredns-6d4b75cb6d-x4f86" in "kube-system" namespace has status "Ready":"False"
	I0630 21:09:09.856096  244832 pod_ready.go:102] pod "coredns-6d4b75cb6d-x4f86" in "kube-system" namespace has status "Ready":"False"
	I0630 21:09:11.852406  244832 pod_ready.go:97] error getting pod "coredns-6d4b75cb6d-x4f86" in "kube-system" namespace (skipping!): pods "coredns-6d4b75cb6d-x4f86" not found
	I0630 21:09:11.852452  244832 pod_ready.go:81] duration metric: took 6.007939247s waiting for pod "coredns-6d4b75cb6d-x4f86" in "kube-system" namespace to be "Ready" ...
	E0630 21:09:11.852466  244832 pod_ready.go:66] WaitExtra: waitPodCondition: error getting pod "coredns-6d4b75cb6d-x4f86" in "kube-system" namespace (skipping!): pods "coredns-6d4b75cb6d-x4f86" not found
	I0630 21:09:11.852476  244832 pod_ready.go:78] waiting up to 6m0s for pod "etcd-no-preload-20220630210237-9950" in "kube-system" namespace to be "Ready" ...
	I0630 21:09:11.857931  244832 pod_ready.go:92] pod "etcd-no-preload-20220630210237-9950" in "kube-system" namespace has status "Ready":"True"
	I0630 21:09:11.857958  244832 pod_ready.go:81] duration metric: took 5.467697ms waiting for pod "etcd-no-preload-20220630210237-9950" in "kube-system" namespace to be "Ready" ...
	I0630 21:09:11.857974  244832 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-no-preload-20220630210237-9950" in "kube-system" namespace to be "Ready" ...
	I0630 21:09:11.863228  244832 pod_ready.go:92] pod "kube-apiserver-no-preload-20220630210237-9950" in "kube-system" namespace has status "Ready":"True"
	I0630 21:09:11.863249  244832 pod_ready.go:81] duration metric: took 5.267601ms waiting for pod "kube-apiserver-no-preload-20220630210237-9950" in "kube-system" namespace to be "Ready" ...
	I0630 21:09:11.863258  244832 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-no-preload-20220630210237-9950" in "kube-system" namespace to be "Ready" ...
	I0630 21:09:11.867810  244832 pod_ready.go:92] pod "kube-controller-manager-no-preload-20220630210237-9950" in "kube-system" namespace has status "Ready":"True"
	I0630 21:09:11.867829  244832 pod_ready.go:81] duration metric: took 4.564864ms waiting for pod "kube-controller-manager-no-preload-20220630210237-9950" in "kube-system" namespace to be "Ready" ...
	I0630 21:09:11.867838  244832 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-tvrsr" in "kube-system" namespace to be "Ready" ...
	I0630 21:09:11.872281  244832 pod_ready.go:92] pod "kube-proxy-tvrsr" in "kube-system" namespace has status "Ready":"True"
	I0630 21:09:11.872301  244832 pod_ready.go:81] duration metric: took 4.457626ms waiting for pod "kube-proxy-tvrsr" in "kube-system" namespace to be "Ready" ...
	I0630 21:09:11.872310  244832 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-no-preload-20220630210237-9950" in "kube-system" namespace to be "Ready" ...
	I0630 21:09:12.053039  244832 pod_ready.go:92] pod "kube-scheduler-no-preload-20220630210237-9950" in "kube-system" namespace has status "Ready":"True"
	I0630 21:09:12.053102  244832 pod_ready.go:81] duration metric: took 180.784597ms waiting for pod "kube-scheduler-no-preload-20220630210237-9950" in "kube-system" namespace to be "Ready" ...
	I0630 21:09:12.053114  244832 pod_ready.go:38] duration metric: took 8.268615647s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0630 21:09:12.053135  244832 api_server.go:51] waiting for apiserver process to appear ...
	I0630 21:09:12.053178  244832 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 21:09:12.063633  244832 api_server.go:71] duration metric: took 8.411278704s to wait for apiserver process to appear ...
	I0630 21:09:12.063665  244832 api_server.go:87] waiting for apiserver healthz status ...
	I0630 21:09:12.063679  244832 api_server.go:240] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
	I0630 21:09:12.068387  244832 api_server.go:266] https://192.168.76.2:8443/healthz returned 200:
	ok
	I0630 21:09:12.069257  244832 api_server.go:140] control plane version: v1.24.2
	I0630 21:09:12.069276  244832 api_server.go:130] duration metric: took 5.604247ms to wait for apiserver health ...
	I0630 21:09:12.069284  244832 system_pods.go:43] waiting for kube-system pods to appear ...
	I0630 21:09:12.256558  244832 system_pods.go:59] 9 kube-system pods found
	I0630 21:09:12.256591  244832 system_pods.go:61] "coredns-6d4b75cb6d-5qlzp" [8ba0dd4a-8ebf-4939-b707-1da4b243c067] Running
	I0630 21:09:12.256598  244832 system_pods.go:61] "etcd-no-preload-20220630210237-9950" [e63230b7-21b4-4a85-8582-07dc0a355237] Running
	I0630 21:09:12.256604  244832 system_pods.go:61] "kindnet-tcclk" [582c4926-4000-4d83-b1fe-59ff22076a33] Running
	I0630 21:09:12.256610  244832 system_pods.go:61] "kube-apiserver-no-preload-20220630210237-9950" [1cd86f63-3fb2-4e66-89b8-1216d397911b] Running
	I0630 21:09:12.256617  244832 system_pods.go:61] "kube-controller-manager-no-preload-20220630210237-9950" [84d2b5fb-12d4-47f8-b32b-fe7016eeefc0] Running
	I0630 21:09:12.256623  244832 system_pods.go:61] "kube-proxy-tvrsr" [5386550e-2fb7-4652-ab2b-4bcc71110442] Running
	I0630 21:09:12.256630  244832 system_pods.go:61] "kube-scheduler-no-preload-20220630210237-9950" [d03950fd-8252-480b-8eaf-0811287b74f0] Running
	I0630 21:09:12.256641  244832 system_pods.go:61] "metrics-server-5c6f97fb75-9mmw6" [7abb4bac-623a-494d-89c1-45f0fecc5034] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
	I0630 21:09:12.256657  244832 system_pods.go:61] "storage-provisioner" [7d5959da-fbe6-4605-ba9c-c06ea97b06fc] Running
	I0630 21:09:12.256665  244832 system_pods.go:74] duration metric: took 187.374212ms to wait for pod list to return data ...
	I0630 21:09:12.256679  244832 default_sa.go:34] waiting for default service account to be created ...
	I0630 21:09:12.452542  244832 default_sa.go:45] found service account: "default"
	I0630 21:09:12.452565  244832 default_sa.go:55] duration metric: took 195.876726ms for default service account to be created ...
	I0630 21:09:12.452572  244832 system_pods.go:116] waiting for k8s-apps to be running ...
	I0630 21:09:12.656499  244832 system_pods.go:86] 9 kube-system pods found
	I0630 21:09:12.656527  244832 system_pods.go:89] "coredns-6d4b75cb6d-5qlzp" [8ba0dd4a-8ebf-4939-b707-1da4b243c067] Running
	I0630 21:09:12.656535  244832 system_pods.go:89] "etcd-no-preload-20220630210237-9950" [e63230b7-21b4-4a85-8582-07dc0a355237] Running
	I0630 21:09:12.656539  244832 system_pods.go:89] "kindnet-tcclk" [582c4926-4000-4d83-b1fe-59ff22076a33] Running
	I0630 21:09:12.656544  244832 system_pods.go:89] "kube-apiserver-no-preload-20220630210237-9950" [1cd86f63-3fb2-4e66-89b8-1216d397911b] Running
	I0630 21:09:12.656549  244832 system_pods.go:89] "kube-controller-manager-no-preload-20220630210237-9950" [84d2b5fb-12d4-47f8-b32b-fe7016eeefc0] Running
	I0630 21:09:12.656553  244832 system_pods.go:89] "kube-proxy-tvrsr" [5386550e-2fb7-4652-ab2b-4bcc71110442] Running
	I0630 21:09:12.656557  244832 system_pods.go:89] "kube-scheduler-no-preload-20220630210237-9950" [d03950fd-8252-480b-8eaf-0811287b74f0] Running
	I0630 21:09:12.656564  244832 system_pods.go:89] "metrics-server-5c6f97fb75-9mmw6" [7abb4bac-623a-494d-89c1-45f0fecc5034] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
	I0630 21:09:12.656574  244832 system_pods.go:89] "storage-provisioner" [7d5959da-fbe6-4605-ba9c-c06ea97b06fc] Running
	I0630 21:09:12.656584  244832 system_pods.go:126] duration metric: took 204.007805ms to wait for k8s-apps to be running ...
	I0630 21:09:12.656590  244832 system_svc.go:44] waiting for kubelet service to be running ....
	I0630 21:09:12.656635  244832 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 21:09:12.666895  244832 system_svc.go:56] duration metric: took 10.297711ms WaitForService to wait for kubelet.
	I0630 21:09:12.666924  244832 kubeadm.go:572] duration metric: took 9.014585325s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...
	I0630 21:09:12.666953  244832 node_conditions.go:102] verifying NodePressure condition ...
	I0630 21:09:12.853845  244832 node_conditions.go:122] node storage ephemeral capacity is 304695084Ki
	I0630 21:09:12.853871  244832 node_conditions.go:123] node cpu capacity is 8
	I0630 21:09:12.853885  244832 node_conditions.go:105] duration metric: took 186.925675ms to run NodePressure ...
	I0630 21:09:12.853896  244832 start.go:213] waiting for startup goroutines ...
	I0630 21:09:12.893905  244832 start.go:506] kubectl: 1.24.2, cluster: 1.24.2 (minor skew: 0)
	I0630 21:09:12.896835  244832 out.go:177] * Done! kubectl is now configured to use "no-preload-20220630210237-9950" cluster and "default" namespace by default
	I0630 21:09:09.967028  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:12.465824  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:14.466500  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:16.965412  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:18.966550  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:21.466374  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:23.966485  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:26.465447  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:28.466230  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:30.965905  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:33.466059  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:35.966260  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:38.465665  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:40.965367  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:42.966136  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:45.465020  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:47.466000  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:49.966235  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:52.465731  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:54.466083  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:56.966015  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:59.465658  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:01.465723  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:03.966642  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:06.466307  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:08.966212  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:11.465475  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:13.966074  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:15.966429  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:18.465535  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:20.465595  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:22.965577  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:24.965831  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:26.966289  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:29.466080  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:31.965740  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:34.465640  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:36.965286  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:39.465425  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:41.965521  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:43.966398  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:46.465344  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:48.965232  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:50.966164  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:53.465622  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:55.965628  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:58.465311  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:00.465929  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:02.465978  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:04.965401  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:06.965666  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:08.965779  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:10.966125  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:13.465399  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:15.465878  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:17.466180  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:19.966091  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:22.465421  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:24.465623  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:26.466188  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:28.965893  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:31.465563  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:33.966393  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:35.467568  258418 node_ready.go:38] duration metric: took 4m0.008553357s waiting for node "embed-certs-20220630210659-9950" to be "Ready" ...
	I0630 21:11:35.469705  258418 out.go:177] 
	W0630 21:11:35.471092  258418 out.go:239] X Exiting due to GUEST_START: wait 6m0s for node: waiting for node to be ready: waitNodeCondition: timed out waiting for the condition
	W0630 21:11:35.471111  258418 out.go:239] * 
	W0630 21:11:35.471814  258418 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0630 21:11:35.473349  258418 out.go:177] 
	
	* 
	* ==> container status <==
	* CONTAINER           IMAGE               CREATED             STATE               NAME                      ATTEMPT             POD ID
	c435aa6fdf138       6fb66cd78abfe       3 minutes ago       Exited              kindnet-cni               3                   b15f9ad19c2f6
	27b91b4e15954       c21b0c7400f98       12 minutes ago      Running             kube-proxy                0                   29779e553ffd2
	998b774f4f284       b305571ca60a5       12 minutes ago      Running             kube-apiserver            0                   6697c3421bd89
	b8604fd1030fa       06a629a7e51cd       12 minutes ago      Running             kube-controller-manager   0                   acea3993dd031
	fa267cd65f4ee       301ddc62b80b1       12 minutes ago      Running             kube-scheduler            0                   fe605286ea071
	f60b30d7e822c       b2756210eeabf       12 minutes ago      Running             etcd                      0                   b94b9bf357242
	
	* 
	* ==> containerd <==
	* -- Logs begin at Thu 2022-06-30 21:00:14 UTC, end at Thu 2022-06-30 21:12:51 UTC. --
	Jun 30 21:06:11 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:06:11.079281879Z" level=warning msg="cleaning up after shim disconnected" id=5dc3e41a57454c30adbf0679811124e6cc2011e688038f983b2fe03abac5041e namespace=k8s.io
	Jun 30 21:06:11 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:06:11.079299156Z" level=info msg="cleaning up dead shim"
	Jun 30 21:06:11 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:06:11.089274024Z" level=warning msg="cleanup warnings time=\"2022-06-30T21:06:11Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=3141 runtime=io.containerd.runc.v2\n"
	Jun 30 21:06:11 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:06:11.765795913Z" level=info msg="RemoveContainer for \"f3c9296d1934a714fc6e1f5c8f9667857513425cd1b3879bf4e33ddc11939aff\""
	Jun 30 21:06:11 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:06:11.772612009Z" level=info msg="RemoveContainer for \"f3c9296d1934a714fc6e1f5c8f9667857513425cd1b3879bf4e33ddc11939aff\" returns successfully"
	Jun 30 21:06:27 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:06:27.090657660Z" level=info msg="CreateContainer within sandbox \"b15f9ad19c2f6c96abd88ffd829a0f93c6e061772e32718825b5b3d3af616046\" for container &ContainerMetadata{Name:kindnet-cni,Attempt:2,}"
	Jun 30 21:06:27 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:06:27.104681661Z" level=info msg="CreateContainer within sandbox \"b15f9ad19c2f6c96abd88ffd829a0f93c6e061772e32718825b5b3d3af616046\" for &ContainerMetadata{Name:kindnet-cni,Attempt:2,} returns container id \"568d539319bef11ca6af8ad1791b75831190807f15d5234afa71d198e66f17eb\""
	Jun 30 21:06:27 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:06:27.105415565Z" level=info msg="StartContainer for \"568d539319bef11ca6af8ad1791b75831190807f15d5234afa71d198e66f17eb\""
	Jun 30 21:06:27 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:06:27.328624838Z" level=info msg="StartContainer for \"568d539319bef11ca6af8ad1791b75831190807f15d5234afa71d198e66f17eb\" returns successfully"
	Jun 30 21:09:07 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:09:07.827353949Z" level=info msg="shim disconnected" id=568d539319bef11ca6af8ad1791b75831190807f15d5234afa71d198e66f17eb
	Jun 30 21:09:07 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:09:07.827944284Z" level=warning msg="cleaning up after shim disconnected" id=568d539319bef11ca6af8ad1791b75831190807f15d5234afa71d198e66f17eb namespace=k8s.io
	Jun 30 21:09:07 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:09:07.827979415Z" level=info msg="cleaning up dead shim"
	Jun 30 21:09:07 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:09:07.840398403Z" level=warning msg="cleanup warnings time=\"2022-06-30T21:09:07Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=3595 runtime=io.containerd.runc.v2\n"
	Jun 30 21:09:08 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:09:08.047155189Z" level=info msg="RemoveContainer for \"5dc3e41a57454c30adbf0679811124e6cc2011e688038f983b2fe03abac5041e\""
	Jun 30 21:09:08 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:09:08.056419287Z" level=info msg="RemoveContainer for \"5dc3e41a57454c30adbf0679811124e6cc2011e688038f983b2fe03abac5041e\" returns successfully"
	Jun 30 21:09:31 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:09:31.089955786Z" level=info msg="CreateContainer within sandbox \"b15f9ad19c2f6c96abd88ffd829a0f93c6e061772e32718825b5b3d3af616046\" for container &ContainerMetadata{Name:kindnet-cni,Attempt:3,}"
	Jun 30 21:09:31 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:09:31.108751840Z" level=info msg="CreateContainer within sandbox \"b15f9ad19c2f6c96abd88ffd829a0f93c6e061772e32718825b5b3d3af616046\" for &ContainerMetadata{Name:kindnet-cni,Attempt:3,} returns container id \"c435aa6fdf138d684f721a5f1fb855163b020feb07c989254589c7e901b37b36\""
	Jun 30 21:09:31 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:09:31.109470441Z" level=info msg="StartContainer for \"c435aa6fdf138d684f721a5f1fb855163b020feb07c989254589c7e901b37b36\""
	Jun 30 21:09:31 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:09:31.330335393Z" level=info msg="StartContainer for \"c435aa6fdf138d684f721a5f1fb855163b020feb07c989254589c7e901b37b36\" returns successfully"
	Jun 30 21:12:11 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:12:11.774513396Z" level=info msg="shim disconnected" id=c435aa6fdf138d684f721a5f1fb855163b020feb07c989254589c7e901b37b36
	Jun 30 21:12:11 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:12:11.774568777Z" level=warning msg="cleaning up after shim disconnected" id=c435aa6fdf138d684f721a5f1fb855163b020feb07c989254589c7e901b37b36 namespace=k8s.io
	Jun 30 21:12:11 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:12:11.774584835Z" level=info msg="cleaning up dead shim"
	Jun 30 21:12:11 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:12:11.784103491Z" level=warning msg="cleanup warnings time=\"2022-06-30T21:12:11Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=4052 runtime=io.containerd.runc.v2\n"
	Jun 30 21:12:12 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:12:12.333554099Z" level=info msg="RemoveContainer for \"568d539319bef11ca6af8ad1791b75831190807f15d5234afa71d198e66f17eb\""
	Jun 30 21:12:12 old-k8s-version-20220630210005-9950 containerd[521]: time="2022-06-30T21:12:12.338784434Z" level=info msg="RemoveContainer for \"568d539319bef11ca6af8ad1791b75831190807f15d5234afa71d198e66f17eb\" returns successfully"
	
	* 
	* ==> describe nodes <==
	* Name:               old-k8s-version-20220630210005-9950
	Roles:              master
	Labels:             beta.kubernetes.io/arch=amd64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=amd64
	                    kubernetes.io/hostname=old-k8s-version-20220630210005-9950
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=251ffcec0e4c997cd7732864187747cc579943c9
	                    minikube.k8s.io/name=old-k8s-version-20220630210005-9950
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2022_06_30T21_00_30_0700
	                    minikube.k8s.io/version=v1.26.0
	                    node-role.kubernetes.io/master=
	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: /run/containerd/containerd.sock
	                    node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Thu, 30 Jun 2022 21:00:25 +0000
	Taints:             node.kubernetes.io/not-ready:NoSchedule
	Unschedulable:      false
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Thu, 30 Jun 2022 21:11:55 +0000   Thu, 30 Jun 2022 21:00:21 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Thu, 30 Jun 2022 21:11:55 +0000   Thu, 30 Jun 2022 21:00:21 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Thu, 30 Jun 2022 21:11:55 +0000   Thu, 30 Jun 2022 21:00:21 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            False   Thu, 30 Jun 2022 21:11:55 +0000   Thu, 30 Jun 2022 21:00:21 +0000   KubeletNotReady              runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Addresses:
	  InternalIP:  192.168.67.2
	  Hostname:    old-k8s-version-20220630210005-9950
	Capacity:
	 cpu:                8
	 ephemeral-storage:  304695084Ki
	 hugepages-1Gi:      0
	 hugepages-2Mi:      0
	 memory:             32873488Ki
	 pods:               110
	Allocatable:
	 cpu:                8
	 ephemeral-storage:  304695084Ki
	 hugepages-1Gi:      0
	 hugepages-2Mi:      0
	 memory:             32873488Ki
	 pods:               110
	System Info:
	 Machine ID:                 bbe1e1cef6e940328962dca52b3c5731
	 System UUID:                2ca00556-ba1f-4dc3-b97e-bb738f788e2a
	 Boot ID:                    471c4729-f046-4a15-bc49-46f3ad561708
	 Kernel Version:             5.15.0-1012-gcp
	 OS Image:                   Ubuntu 20.04.4 LTS
	 Operating System:           linux
	 Architecture:               amd64
	 Container Runtime Version:  containerd://1.6.6
	 Kubelet Version:            v1.16.0
	 Kube-Proxy Version:         v1.16.0
	PodCIDR:                     10.244.0.0/24
	PodCIDRs:                    10.244.0.0/24
	Non-terminated Pods:         (6 in total)
	  Namespace                  Name                                                           CPU Requests  CPU Limits  Memory Requests  Memory Limits  AGE
	  ---------                  ----                                                           ------------  ----------  ---------------  -------------  ---
	  kube-system                etcd-old-k8s-version-20220630210005-9950                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         11m
	  kube-system                kindnet-4gs84                                                  100m (1%!)(MISSING)     100m (1%!)(MISSING)   50Mi (0%!)(MISSING)        50Mi (0%!)(MISSING)      12m
	  kube-system                kube-apiserver-old-k8s-version-20220630210005-9950             250m (3%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         11m
	  kube-system                kube-controller-manager-old-k8s-version-20220630210005-9950    200m (2%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         11m
	  kube-system                kube-proxy-twls5                                               0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         12m
	  kube-system                kube-scheduler-old-k8s-version-20220630210005-9950             100m (1%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         11m
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests   Limits
	  --------           --------   ------
	  cpu                650m (8%!)(MISSING)  100m (1%!)(MISSING)
	  memory             50Mi (0%!)(MISSING)  50Mi (0%!)(MISSING)
	  ephemeral-storage  0 (0%!)(MISSING)     0 (0%!)(MISSING)
	Events:
	  Type    Reason                   Age                From                                             Message
	  ----    ------                   ----               ----                                             -------
	  Normal  Starting                 12m                kubelet, old-k8s-version-20220630210005-9950     Starting kubelet.
	  Normal  NodeHasSufficientMemory  12m (x8 over 12m)  kubelet, old-k8s-version-20220630210005-9950     Node old-k8s-version-20220630210005-9950 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    12m (x8 over 12m)  kubelet, old-k8s-version-20220630210005-9950     Node old-k8s-version-20220630210005-9950 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     12m (x7 over 12m)  kubelet, old-k8s-version-20220630210005-9950     Node old-k8s-version-20220630210005-9950 status is now: NodeHasSufficientPID
	  Normal  NodeAllocatableEnforced  12m                kubelet, old-k8s-version-20220630210005-9950     Updated Node Allocatable limit across pods
	  Normal  Starting                 12m                kube-proxy, old-k8s-version-20220630210005-9950  Starting kube-proxy.
	
	* 
	* ==> dmesg <==
	* [  +2.939825] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000011] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.027789] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.019913] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[ +21.968090] IPv4: martian destination 127.0.0.11 from 10.244.0.3, dev veth8071d138
	[ +25.445872] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.029436] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.023957] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +2.947695] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[Jun30 21:05] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.023879] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +2.955783] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.011828] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000005] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.027896] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	
	* 
	* ==> etcd [f60b30d7e822cbe35e12b31f9d3517de2de1004b26577e8f27750257f416aae1] <==
	* 2022-06-30 21:00:21.137280 I | raft: newRaft 8688e899f7831fc7 [peers: [], term: 0, commit: 0, applied: 0, lastindex: 0, lastterm: 0]
	2022-06-30 21:00:21.137285 I | raft: 8688e899f7831fc7 became follower at term 1
	2022-06-30 21:00:21.142437 W | auth: simple token is not cryptographically signed
	2022-06-30 21:00:21.146144 I | etcdserver: starting server... [version: 3.3.15, cluster version: to_be_decided]
	2022-06-30 21:00:21.146596 I | etcdserver: 8688e899f7831fc7 as single-node; fast-forwarding 9 ticks (election ticks 10)
	2022-06-30 21:00:21.146824 I | etcdserver/membership: added member 8688e899f7831fc7 [https://192.168.67.2:2380] to cluster 9d8fdeb88b6def78
	2022-06-30 21:00:21.148068 I | embed: ClientTLS: cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, ca = , trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = 
	2022-06-30 21:00:21.148212 I | embed: listening for metrics on http://192.168.67.2:2381
	2022-06-30 21:00:21.148326 I | embed: listening for metrics on http://127.0.0.1:2381
	2022-06-30 21:00:22.037647 I | raft: 8688e899f7831fc7 is starting a new election at term 1
	2022-06-30 21:00:22.037692 I | raft: 8688e899f7831fc7 became candidate at term 2
	2022-06-30 21:00:22.037716 I | raft: 8688e899f7831fc7 received MsgVoteResp from 8688e899f7831fc7 at term 2
	2022-06-30 21:00:22.037741 I | raft: 8688e899f7831fc7 became leader at term 2
	2022-06-30 21:00:22.037750 I | raft: raft.node: 8688e899f7831fc7 elected leader 8688e899f7831fc7 at term 2
	2022-06-30 21:00:22.038107 I | etcdserver: published {Name:old-k8s-version-20220630210005-9950 ClientURLs:[https://192.168.67.2:2379]} to cluster 9d8fdeb88b6def78
	2022-06-30 21:00:22.038200 I | embed: ready to serve client requests
	2022-06-30 21:00:22.038309 I | embed: ready to serve client requests
	2022-06-30 21:00:22.039774 I | embed: serving client requests on 127.0.0.1:2379
	2022-06-30 21:00:22.040324 I | embed: serving client requests on 192.168.67.2:2379
	2022-06-30 21:00:22.065264 I | etcdserver: setting up the initial cluster version to 3.3
	2022-06-30 21:00:22.075609 N | etcdserver/membership: set the initial cluster version to 3.3
	2022-06-30 21:00:22.075977 I | etcdserver/api: enabled capabilities for version 3.3
	2022-06-30 21:05:18.599878 W | etcdserver: read-only range request "key:\"/registry/services/endpoints/default/kubernetes\" " with result "range_response_count:1 size:215" took too long (187.176398ms) to execute
	2022-06-30 21:10:22.085482 I | mvcc: store.index: compact 470
	2022-06-30 21:10:22.086313 I | mvcc: finished scheduled compaction at 470 (took 522.004µs)
	
	* 
	* ==> kernel <==
	*  21:12:51 up 55 min,  0 users,  load average: 0.30, 0.90, 1.55
	Linux old-k8s-version-20220630210005-9950 5.15.0-1012-gcp #17~20.04.1-Ubuntu SMP Thu Jun 23 16:10:34 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
	PRETTY_NAME="Ubuntu 20.04.4 LTS"
	
	* 
	* ==> kube-apiserver [998b774f4f284a1fcf3dbd179faaa8c69e39ab084d30662575ac04f0146604f3] <==
	* I0630 21:00:24.949248       1 nonstructuralschema_controller.go:191] Starting NonStructuralSchemaConditionController
	I0630 21:00:24.949265       1 apiapproval_controller.go:185] Starting KubernetesAPIApprovalPolicyConformantConditionController
	I0630 21:00:24.948849       1 controller.go:81] Starting OpenAPI AggregationController
	E0630 21:00:24.950202       1 controller.go:154] Unable to remove old endpoints from kubernetes service: StorageError: key not found, Code: 1, Key: /registry/masterleases/192.168.67.2, ResourceVersion: 0, AdditionalErrorMsg: 
	I0630 21:00:25.049002       1 cache.go:39] Caches are synced for AvailableConditionController controller
	I0630 21:00:25.049043       1 cache.go:39] Caches are synced for APIServiceRegistrationController controller
	I0630 21:00:25.049119       1 shared_informer.go:204] Caches are synced for crd-autoregister 
	I0630 21:00:25.049016       1 cache.go:39] Caches are synced for autoregister controller
	I0630 21:00:25.948863       1 controller.go:107] OpenAPI AggregationController: Processing item 
	I0630 21:00:25.948905       1 controller.go:130] OpenAPI AggregationController: action for item : Nothing (removed from the queue).
	I0630 21:00:25.948917       1 controller.go:130] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).
	I0630 21:00:25.952956       1 storage_scheduling.go:139] created PriorityClass system-node-critical with value 2000001000
	I0630 21:00:25.956204       1 storage_scheduling.go:139] created PriorityClass system-cluster-critical with value 2000000000
	I0630 21:00:25.956228       1 storage_scheduling.go:148] all system priority classes are created successfully or already exist.
	I0630 21:00:26.733262       1 controller.go:606] quota admission added evaluator for: leases.coordination.k8s.io
	I0630 21:00:27.730109       1 controller.go:606] quota admission added evaluator for: roles.rbac.authorization.k8s.io
	I0630 21:00:28.010061       1 controller.go:606] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
	W0630 21:00:28.355670       1 lease.go:222] Resetting endpoints for master service "kubernetes" to [192.168.67.2]
	I0630 21:00:28.356311       1 controller.go:606] quota admission added evaluator for: endpoints
	I0630 21:00:29.247950       1 controller.go:606] quota admission added evaluator for: serviceaccounts
	I0630 21:00:29.559245       1 controller.go:606] quota admission added evaluator for: deployments.apps
	I0630 21:00:29.917364       1 controller.go:606] quota admission added evaluator for: daemonsets.apps
	I0630 21:00:44.554471       1 controller.go:606] quota admission added evaluator for: controllerrevisions.apps
	I0630 21:00:44.569493       1 controller.go:606] quota admission added evaluator for: events.events.k8s.io
	I0630 21:00:44.669578       1 controller.go:606] quota admission added evaluator for: replicasets.apps
	
	* 
	* ==> kube-controller-manager [b8604fd1030fac170f4591063a20f1abfb86602e188695c1be545614d1b4e8a0] <==
	* I0630 21:00:44.503669       1 shared_informer.go:197] Waiting for caches to sync for cidrallocator
	I0630 21:00:44.505172       1 shared_informer.go:204] Caches are synced for TTL 
	I0630 21:00:44.522066       1 shared_informer.go:204] Caches are synced for persistent volume 
	I0630 21:00:44.527506       1 shared_informer.go:204] Caches are synced for attach detach 
	I0630 21:00:44.546533       1 shared_informer.go:204] Caches are synced for daemon sets 
	I0630 21:00:44.563035       1 event.go:255] Event(v1.ObjectReference{Kind:"DaemonSet", Namespace:"kube-system", Name:"kube-proxy", UID:"4dfe461e-1e01-4e37-b387-4caf9b091e6e", APIVersion:"apps/v1", ResourceVersion:"204", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: kube-proxy-twls5
	I0630 21:00:44.565383       1 event.go:255] Event(v1.ObjectReference{Kind:"DaemonSet", Namespace:"kube-system", Name:"kindnet", UID:"4d27e7c9-7dc6-4d5f-bacf-6fc3835a67e6", APIVersion:"apps/v1", ResourceVersion:"212", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: kindnet-4gs84
	I0630 21:00:44.623202       1 shared_informer.go:204] Caches are synced for cidrallocator 
	I0630 21:00:44.629310       1 range_allocator.go:359] Set node old-k8s-version-20220630210005-9950 PodCIDR to [10.244.0.0/24]
	I0630 21:00:44.667272       1 shared_informer.go:204] Caches are synced for deployment 
	I0630 21:00:44.672031       1 event.go:255] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"kube-system", Name:"coredns", UID:"4670cf8e-481a-421e-a11d-7ec907e8c283", APIVersion:"apps/v1", ResourceVersion:"348", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled up replica set coredns-5644d7b6d9 to 1
	I0630 21:00:44.676702       1 event.go:255] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kube-system", Name:"coredns-5644d7b6d9", UID:"40553f62-8c8a-4503-b0fb-c4c0a693baf1", APIVersion:"apps/v1", ResourceVersion:"351", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: coredns-5644d7b6d9-dw8lr
	I0630 21:00:44.680500       1 shared_informer.go:204] Caches are synced for taint 
	I0630 21:00:44.680614       1 node_lifecycle_controller.go:1208] Initializing eviction metric for zone: 
	W0630 21:00:44.680718       1 node_lifecycle_controller.go:903] Missing timestamp for Node old-k8s-version-20220630210005-9950. Assuming now as a timestamp.
	I0630 21:00:44.680771       1 node_lifecycle_controller.go:1058] Controller detected that all Nodes are not-Ready. Entering master disruption mode.
	I0630 21:00:44.680817       1 event.go:255] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"old-k8s-version-20220630210005-9950", UID:"4800bcdf-0e4c-4b5c-b919-e996b18087ab", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'RegisteredNode' Node old-k8s-version-20220630210005-9950 event: Registered Node old-k8s-version-20220630210005-9950 in Controller
	I0630 21:00:44.680849       1 taint_manager.go:186] Starting NoExecuteTaintManager
	I0630 21:00:44.755613       1 shared_informer.go:204] Caches are synced for disruption 
	I0630 21:00:44.755650       1 disruption.go:341] Sending events to api server.
	I0630 21:00:44.955933       1 shared_informer.go:204] Caches are synced for resource quota 
	I0630 21:00:44.957188       1 shared_informer.go:204] Caches are synced for garbage collector 
	I0630 21:00:44.960086       1 shared_informer.go:204] Caches are synced for resource quota 
	I0630 21:00:44.960086       1 shared_informer.go:204] Caches are synced for garbage collector 
	I0630 21:00:44.960164       1 garbagecollector.go:139] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
	
	* 
	* ==> kube-proxy [27b91b4e1595400f52e6c0fd5fb8e3732c524b9757a79a5a9108333797eb3788] <==
	* W0630 21:00:45.177711       1 server_others.go:329] Flag proxy-mode="" unknown, assuming iptables proxy
	I0630 21:00:45.186039       1 node.go:135] Successfully retrieved node IP: 192.168.67.2
	I0630 21:00:45.186134       1 server_others.go:149] Using iptables Proxier.
	I0630 21:00:45.188027       1 server.go:529] Version: v1.16.0
	I0630 21:00:45.188832       1 config.go:131] Starting endpoints config controller
	I0630 21:00:45.188867       1 shared_informer.go:197] Waiting for caches to sync for endpoints config
	I0630 21:00:45.188954       1 config.go:313] Starting service config controller
	I0630 21:00:45.188977       1 shared_informer.go:197] Waiting for caches to sync for service config
	I0630 21:00:45.323127       1 shared_informer.go:204] Caches are synced for endpoints config 
	I0630 21:00:45.323142       1 shared_informer.go:204] Caches are synced for service config 
	
	* 
	* ==> kube-scheduler [fa267cd65f4eefef8993b275f8625ee5daf30304f18337e27a9944d1b5f03a02] <==
	* W0630 21:00:25.044088       1 authentication.go:79] Authentication is disabled
	I0630 21:00:25.044103       1 deprecated_insecure_serving.go:51] Serving healthz insecurely on [::]:10251
	I0630 21:00:25.045554       1 secure_serving.go:123] Serving securely on 127.0.0.1:10259
	E0630 21:00:25.131167       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E0630 21:00:25.132503       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E0630 21:00:25.133014       1 reflector.go:123] k8s.io/kubernetes/cmd/kube-scheduler/app/server.go:236: Failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E0630 21:00:25.134979       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E0630 21:00:25.135062       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	E0630 21:00:25.135104       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	E0630 21:00:25.135146       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0630 21:00:25.135256       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	E0630 21:00:25.135513       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	E0630 21:00:25.137975       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1beta1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E0630 21:00:25.225117       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	E0630 21:00:26.132387       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E0630 21:00:26.133463       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E0630 21:00:26.135507       1 reflector.go:123] k8s.io/kubernetes/cmd/kube-scheduler/app/server.go:236: Failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E0630 21:00:26.136422       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E0630 21:00:26.139047       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	E0630 21:00:26.141958       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1beta1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E0630 21:00:26.142771       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	E0630 21:00:26.144164       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0630 21:00:26.145881       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	E0630 21:00:26.146811       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	E0630 21:00:26.226419       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	
	* 
	* ==> kubelet <==
	* -- Logs begin at Thu 2022-06-30 21:00:14 UTC, end at Thu 2022-06-30 21:12:51 UTC. --
	Jun 30 21:11:05 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:11:05.335521     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:11:10 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:11:10.336330     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:11:15 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:11:15.337202     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:11:20 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:11:20.337978     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:11:25 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:11:25.338834     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:11:30 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:11:30.339554     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:11:35 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:11:35.340352     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:11:40 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:11:40.341367     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:11:45 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:11:45.342142     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:11:50 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:11:50.342943     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:11:55 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:11:55.343770     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:12:00 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:12:00.344643     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:12:05 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:12:05.345525     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:12:10 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:12:10.346282     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:12:12 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:12:12.333666     918 pod_workers.go:191] Error syncing pod 0eb5f5b6-6c40-401a-95c4-bef42040561c ("kindnet-4gs84_kube-system(0eb5f5b6-6c40-401a-95c4-bef42040561c)"), skipping: failed to "StartContainer" for "kindnet-cni" with CrashLoopBackOff: "back-off 40s restarting failed container=kindnet-cni pod=kindnet-4gs84_kube-system(0eb5f5b6-6c40-401a-95c4-bef42040561c)"
	Jun 30 21:12:15 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:12:15.346991     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:12:20 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:12:20.347603     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:12:25 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:12:25.348426     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:12:28 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:12:28.088049     918 pod_workers.go:191] Error syncing pod 0eb5f5b6-6c40-401a-95c4-bef42040561c ("kindnet-4gs84_kube-system(0eb5f5b6-6c40-401a-95c4-bef42040561c)"), skipping: failed to "StartContainer" for "kindnet-cni" with CrashLoopBackOff: "back-off 40s restarting failed container=kindnet-cni pod=kindnet-4gs84_kube-system(0eb5f5b6-6c40-401a-95c4-bef42040561c)"
	Jun 30 21:12:30 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:12:30.349355     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:12:35 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:12:35.350183     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:12:39 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:12:39.087841     918 pod_workers.go:191] Error syncing pod 0eb5f5b6-6c40-401a-95c4-bef42040561c ("kindnet-4gs84_kube-system(0eb5f5b6-6c40-401a-95c4-bef42040561c)"), skipping: failed to "StartContainer" for "kindnet-cni" with CrashLoopBackOff: "back-off 40s restarting failed container=kindnet-cni pod=kindnet-4gs84_kube-system(0eb5f5b6-6c40-401a-95c4-bef42040561c)"
	Jun 30 21:12:40 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:12:40.350982     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:12:45 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:12:45.351900     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:12:50 old-k8s-version-20220630210005-9950 kubelet[918]: E0630 21:12:50.352819     918 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	

                                                
                                                
-- /stdout --
helpers_test.go:254: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p old-k8s-version-20220630210005-9950 -n old-k8s-version-20220630210005-9950
helpers_test.go:261: (dbg) Run:  kubectl --context old-k8s-version-20220630210005-9950 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:270: non-running pods: busybox coredns-5644d7b6d9-dw8lr storage-provisioner
helpers_test.go:272: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/DeployApp]: describe non-running pods <======
helpers_test.go:275: (dbg) Run:  kubectl --context old-k8s-version-20220630210005-9950 describe pod busybox coredns-5644d7b6d9-dw8lr storage-provisioner
helpers_test.go:275: (dbg) Non-zero exit: kubectl --context old-k8s-version-20220630210005-9950 describe pod busybox coredns-5644d7b6d9-dw8lr storage-provisioner: exit status 1 (61.167107ms)

                                                
                                                
-- stdout --
	Name:         busybox
	Namespace:    default
	Priority:     0
	Node:         <none>
	Labels:       integration-test=busybox
	Annotations:  <none>
	Status:       Pending
	IP:           
	IPs:          <none>
	Containers:
	  busybox:
	    Image:      gcr.io/k8s-minikube/busybox:1.28.4-glibc
	    Port:       <none>
	    Host Port:  <none>
	    Command:
	      sleep
	      3600
	    Environment:  <none>
	    Mounts:
	      /var/run/secrets/kubernetes.io/serviceaccount from default-token-mvrxf (ro)
	Conditions:
	  Type           Status
	  PodScheduled   False 
	Volumes:
	  default-token-mvrxf:
	    Type:        Secret (a volume populated by a Secret)
	    SecretName:  default-token-mvrxf
	    Optional:    false
	QoS Class:       BestEffort
	Node-Selectors:  <none>
	Tolerations:     node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
	                 node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
	Events:
	  Type     Reason            Age                    From               Message
	  ----     ------            ----                   ----               -------
	  Warning  FailedScheduling  8m4s                   default-scheduler  0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.
	  Warning  FailedScheduling  5m27s (x1 over 6m57s)  default-scheduler  0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.

                                                
                                                
-- /stdout --
** stderr ** 
	Error from server (NotFound): pods "coredns-5644d7b6d9-dw8lr" not found
	Error from server (NotFound): pods "storage-provisioner" not found

                                                
                                                
** /stderr **
helpers_test.go:277: kubectl --context old-k8s-version-20220630210005-9950 describe pod busybox coredns-5644d7b6d9-dw8lr storage-provisioner: exit status 1
--- FAIL: TestStartStop/group/old-k8s-version/serial/DeployApp (484.85s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/FirstStart (277.77s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-amd64 start -p embed-certs-20220630210659-9950 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=containerd --kubernetes-version=v1.24.2
E0630 21:07:08.072228    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/bridge-20220630204858-9950/client.crt: no such file or directory
E0630 21:07:49.033412    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/bridge-20220630204858-9950/client.crt: no such file or directory

                                                
                                                
=== CONT  TestStartStop/group/embed-certs/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p embed-certs-20220630210659-9950 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=containerd --kubernetes-version=v1.24.2: exit status 80 (4m35.807234664s)

                                                
                                                
-- stdout --
	* [embed-certs-20220630210659-9950] minikube v1.26.0 on Ubuntu 20.04 (kvm/amd64)
	  - MINIKUBE_LOCATION=14420
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-amd64
	* Using the docker driver based on user configuration
	* Using Docker driver with root privileges
	* Starting control plane node embed-certs-20220630210659-9950 in cluster embed-certs-20220630210659-9950
	* Pulling base image ...
	* Creating docker container (CPUs=2, Memory=2200MB) ...
	* Preparing Kubernetes v1.24.2 on containerd 1.6.6 ...
	  - Generating certificates and keys ...
	  - Booting up control plane ...
	  - Configuring RBAC rules ...
	* Configuring CNI (Container Networking Interface) ...
	* Verifying Kubernetes components...
	  - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	* Enabled addons: storage-provisioner, default-storageclass
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0630 21:06:59.738083  258418 out.go:296] Setting OutFile to fd 1 ...
	I0630 21:06:59.738291  258418 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 21:06:59.738303  258418 out.go:309] Setting ErrFile to fd 2...
	I0630 21:06:59.738308  258418 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 21:06:59.738724  258418 root.go:329] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/bin
	I0630 21:06:59.739016  258418 out.go:303] Setting JSON to false
	I0630 21:06:59.740481  258418 start.go:115] hostinfo: {"hostname":"ubuntu-20-agent-8","uptime":2972,"bootTime":1656620248,"procs":586,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1012-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0630 21:06:59.740554  258418 start.go:125] virtualization: kvm guest
	I0630 21:06:59.743370  258418 out.go:177] * [embed-certs-20220630210659-9950] minikube v1.26.0 on Ubuntu 20.04 (kvm/amd64)
	I0630 21:06:59.744868  258418 out.go:177]   - MINIKUBE_LOCATION=14420
	I0630 21:06:59.744862  258418 notify.go:193] Checking for updates...
	I0630 21:06:59.746487  258418 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0630 21:06:59.747925  258418 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:06:59.749264  258418 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube
	I0630 21:06:59.750647  258418 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0630 21:06:59.752427  258418 config.go:178] Loaded profile config "default-k8s-different-port-20220630210335-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:06:59.752560  258418 config.go:178] Loaded profile config "no-preload-20220630210237-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:06:59.752664  258418 config.go:178] Loaded profile config "old-k8s-version-20220630210005-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.16.0
	I0630 21:06:59.752733  258418 driver.go:360] Setting default libvirt URI to qemu:///system
	I0630 21:06:59.793157  258418 docker.go:137] docker version: linux-20.10.17
	I0630 21:06:59.793329  258418 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0630 21:06:59.904539  258418 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:3 ContainersPaused:0 ContainersStopped:0 Images:8 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:50 OomKillDisable:true NGoroutines:49 SystemTime:2022-06-30 21:06:59.825756368 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1012-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexServ
erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662451712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-8 Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Client
Info:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
	I0630 21:06:59.904699  258418 docker.go:254] overlay module found
	I0630 21:06:59.908463  258418 out.go:177] * Using the docker driver based on user configuration
	I0630 21:06:59.909872  258418 start.go:284] selected driver: docker
	I0630 21:06:59.909886  258418 start.go:808] validating driver "docker" against <nil>
	I0630 21:06:59.909904  258418 start.go:819] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0630 21:06:59.910758  258418 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0630 21:07:00.020059  258418 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:3 ContainersPaused:0 ContainersStopped:0 Images:8 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:50 OomKillDisable:true NGoroutines:49 SystemTime:2022-06-30 21:06:59.94317636 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1012-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexServe
rAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662451712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-8 Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] ClientI
nfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
	I0630 21:07:00.020196  258418 start_flags.go:296] no existing cluster config was found, will generate one from the flags 
	I0630 21:07:00.020755  258418 start_flags.go:853] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0630 21:07:00.022859  258418 out.go:177] * Using Docker driver with root privileges
	I0630 21:07:00.024184  258418 cni.go:95] Creating CNI manager for ""
	I0630 21:07:00.024208  258418 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:07:00.024223  258418 start_flags.go:305] Found "CNI" CNI - setting NetworkPlugin=cni
	I0630 21:07:00.024246  258418 start_flags.go:310] config:
	{Name:embed-certs-20220630210659-9950 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:embed-certs-20220630210659-9950 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:clus
ter.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 21:07:00.025866  258418 out.go:177] * Starting control plane node embed-certs-20220630210659-9950 in cluster embed-certs-20220630210659-9950
	I0630 21:07:00.027139  258418 cache.go:120] Beginning downloading kic base image for docker with containerd
	I0630 21:07:00.028673  258418 out.go:177] * Pulling base image ...
	I0630 21:07:00.029951  258418 preload.go:132] Checking if preload exists for k8s version v1.24.2 and runtime containerd
	I0630 21:07:00.029992  258418 preload.go:148] Found local preload: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-containerd-overlay2-amd64.tar.lz4
	I0630 21:07:00.030001  258418 cache.go:57] Caching tarball of preloaded images
	I0630 21:07:00.030041  258418 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e in local docker daemon
	I0630 21:07:00.030250  258418 preload.go:174] Found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-containerd-overlay2-amd64.tar.lz4 in cache, skipping download
	I0630 21:07:00.030266  258418 cache.go:60] Finished verifying existence of preloaded tar for  v1.24.2 on containerd
	I0630 21:07:00.030363  258418 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/config.json ...
	I0630 21:07:00.030388  258418 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/config.json: {Name:mk3d06fce107c3c107ba91de67a3c2827092ffff Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:07:00.065813  258418 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e in local docker daemon, skipping pull
	I0630 21:07:00.065840  258418 cache.go:142] gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e exists in daemon, skipping load
	I0630 21:07:00.065850  258418 cache.go:208] Successfully downloaded all kic artifacts
	I0630 21:07:00.065886  258418 start.go:352] acquiring machines lock for embed-certs-20220630210659-9950: {Name:mk6619dbb09b46cdd2b244e5bf2112b3274a30ef Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0630 21:07:00.066018  258418 start.go:356] acquired machines lock for "embed-certs-20220630210659-9950" in 103.406µs
	I0630 21:07:00.066043  258418 start.go:91] Provisioning new machine with config: &{Name:embed-certs-20220630210659-9950 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:embed-certs-20220630210659-9950 Namespace
:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker
BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:} &{Name: IP: Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0630 21:07:00.066120  258418 start.go:131] createHost starting for "" (driver="docker")
	I0630 21:07:00.068356  258418 out.go:204] * Creating docker container (CPUs=2, Memory=2200MB) ...
	I0630 21:07:00.068557  258418 start.go:165] libmachine.API.Create for "embed-certs-20220630210659-9950" (driver="docker")
	I0630 21:07:00.068584  258418 client.go:168] LocalClient.Create starting
	I0630 21:07:00.068653  258418 main.go:134] libmachine: Reading certificate data from /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem
	I0630 21:07:00.068682  258418 main.go:134] libmachine: Decoding PEM data...
	I0630 21:07:00.068698  258418 main.go:134] libmachine: Parsing certificate...
	I0630 21:07:00.068753  258418 main.go:134] libmachine: Reading certificate data from /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem
	I0630 21:07:00.068774  258418 main.go:134] libmachine: Decoding PEM data...
	I0630 21:07:00.068784  258418 main.go:134] libmachine: Parsing certificate...
	I0630 21:07:00.069116  258418 cli_runner.go:164] Run: docker network inspect embed-certs-20220630210659-9950 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	W0630 21:07:00.108024  258418 cli_runner.go:211] docker network inspect embed-certs-20220630210659-9950 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
	I0630 21:07:00.108116  258418 network_create.go:272] running [docker network inspect embed-certs-20220630210659-9950] to gather additional debugging logs...
	I0630 21:07:00.108144  258418 cli_runner.go:164] Run: docker network inspect embed-certs-20220630210659-9950
	W0630 21:07:00.141588  258418 cli_runner.go:211] docker network inspect embed-certs-20220630210659-9950 returned with exit code 1
	I0630 21:07:00.141617  258418 network_create.go:275] error running [docker network inspect embed-certs-20220630210659-9950]: docker network inspect embed-certs-20220630210659-9950: exit status 1
	stdout:
	[]
	
	stderr:
	Error: No such network: embed-certs-20220630210659-9950
	I0630 21:07:00.141631  258418 network_create.go:277] output of [docker network inspect embed-certs-20220630210659-9950]: -- stdout --
	[]
	
	-- /stdout --
	** stderr ** 
	Error: No such network: embed-certs-20220630210659-9950
	
	** /stderr **
	I0630 21:07:00.141686  258418 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0630 21:07:00.178261  258418 network.go:240] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName:br-c7ee26fec5a3 IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:02:42:cc:d0:4a:9e}}
	I0630 21:07:00.179334  258418 network.go:240] skipping subnet 192.168.58.0/24 that is taken: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 Interface:{IfaceName:br-3e97afadef02 IfaceIPv4:192.168.58.1 IfaceMTU:1500 IfaceMAC:02:42:9e:e7:fd:62}}
	I0630 21:07:00.179967  258418 network.go:240] skipping subnet 192.168.67.0/24 that is taken: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 Interface:{IfaceName:br-2a33e496d49b IfaceIPv4:192.168.67.1 IfaceMTU:1500 IfaceMAC:02:42:21:56:17:cb}}
	I0630 21:07:00.180760  258418 network.go:240] skipping subnet 192.168.76.0/24 that is taken: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 Interface:{IfaceName:br-5e7b405f6aaf IfaceIPv4:192.168.76.1 IfaceMTU:1500 IfaceMAC:02:42:7b:eb:36:d4}}
	I0630 21:07:00.181503  258418 network.go:240] skipping subnet 192.168.85.0/24 that is taken: &{IP:192.168.85.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.85.0/24 Gateway:192.168.85.1 ClientMin:192.168.85.2 ClientMax:192.168.85.254 Broadcast:192.168.85.255 Interface:{IfaceName:br-88cfda28f438 IfaceIPv4:192.168.85.1 IfaceMTU:1500 IfaceMAC:02:42:12:4c:db:ca}}
	I0630 21:07:00.182506  258418 network.go:288] reserving subnet 192.168.94.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[] amended:true}} dirty:map[192.168.94.0:0xc000790098] misses:0}
	I0630 21:07:00.182557  258418 network.go:235] using free private subnet 192.168.94.0/24: &{IP:192.168.94.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.94.0/24 Gateway:192.168.94.1 ClientMin:192.168.94.2 ClientMax:192.168.94.254 Broadcast:192.168.94.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
	I0630 21:07:00.182573  258418 network_create.go:115] attempt to create docker network embed-certs-20220630210659-9950 192.168.94.0/24 with gateway 192.168.94.1 and MTU of 1500 ...
	I0630 21:07:00.182643  258418 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.94.0/24 --gateway=192.168.94.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=embed-certs-20220630210659-9950 embed-certs-20220630210659-9950
	I0630 21:07:00.257759  258418 network_create.go:99] docker network embed-certs-20220630210659-9950 192.168.94.0/24 created
	I0630 21:07:00.257800  258418 kic.go:106] calculated static IP "192.168.94.2" for the "embed-certs-20220630210659-9950" container
	I0630 21:07:00.257889  258418 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I0630 21:07:00.297023  258418 cli_runner.go:164] Run: docker volume create embed-certs-20220630210659-9950 --label name.minikube.sigs.k8s.io=embed-certs-20220630210659-9950 --label created_by.minikube.sigs.k8s.io=true
	I0630 21:07:00.333425  258418 oci.go:103] Successfully created a docker volume embed-certs-20220630210659-9950
	I0630 21:07:00.333505  258418 cli_runner.go:164] Run: docker run --rm --name embed-certs-20220630210659-9950-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=embed-certs-20220630210659-9950 --entrypoint /usr/bin/test -v embed-certs-20220630210659-9950:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e -d /var/lib
	I0630 21:07:00.910665  258418 oci.go:107] Successfully prepared a docker volume embed-certs-20220630210659-9950
	I0630 21:07:00.910711  258418 preload.go:132] Checking if preload exists for k8s version v1.24.2 and runtime containerd
	I0630 21:07:00.910729  258418 kic.go:179] Starting extracting preloaded images to volume ...
	I0630 21:07:00.910788  258418 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-containerd-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v embed-certs-20220630210659-9950:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e -I lz4 -xf /preloaded.tar -C /extractDir
	I0630 21:07:07.402589  258418 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-containerd-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v embed-certs-20220630210659-9950:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e -I lz4 -xf /preloaded.tar -C /extractDir: (6.49174022s)
	I0630 21:07:07.402619  258418 kic.go:188] duration metric: took 6.491886 seconds to extract preloaded images to volume
	W0630 21:07:07.402757  258418 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	I0630 21:07:07.402858  258418 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0630 21:07:07.511838  258418 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname embed-certs-20220630210659-9950 --name embed-certs-20220630210659-9950 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=embed-certs-20220630210659-9950 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=embed-certs-20220630210659-9950 --network embed-certs-20220630210659-9950 --ip 192.168.94.2 --volume embed-certs-20220630210659-9950:/var --security-opt apparmor=unconfined --memory=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e
	I0630 21:07:07.934143  258418 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Running}}
	I0630 21:07:07.973385  258418 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:07:08.010245  258418 cli_runner.go:164] Run: docker exec embed-certs-20220630210659-9950 stat /var/lib/dpkg/alternatives/iptables
	I0630 21:07:08.090553  258418 oci.go:144] the created container "embed-certs-20220630210659-9950" has a running status.
	I0630 21:07:08.090607  258418 kic.go:210] Creating ssh key for kic: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa...
	I0630 21:07:08.314972  258418 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0630 21:07:08.427784  258418 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:07:08.468895  258418 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0630 21:07:08.468925  258418 kic_runner.go:114] Args: [docker exec --privileged embed-certs-20220630210659-9950 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0630 21:07:08.566253  258418 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:07:08.600997  258418 machine.go:88] provisioning docker machine ...
	I0630 21:07:08.601037  258418 ubuntu.go:169] provisioning hostname "embed-certs-20220630210659-9950"
	I0630 21:07:08.601149  258418 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:07:08.636297  258418 main.go:134] libmachine: Using SSH client type: native
	I0630 21:07:08.636495  258418 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil>  [] 0s} 127.0.0.1 49427 <nil> <nil>}
	I0630 21:07:08.636521  258418 main.go:134] libmachine: About to run SSH command:
	sudo hostname embed-certs-20220630210659-9950 && echo "embed-certs-20220630210659-9950" | sudo tee /etc/hostname
	I0630 21:07:08.771633  258418 main.go:134] libmachine: SSH cmd err, output: <nil>: embed-certs-20220630210659-9950
	
	I0630 21:07:08.771709  258418 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:07:08.807559  258418 main.go:134] libmachine: Using SSH client type: native
	I0630 21:07:08.807748  258418 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil>  [] 0s} 127.0.0.1 49427 <nil> <nil>}
	I0630 21:07:08.807776  258418 main.go:134] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sembed-certs-20220630210659-9950' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 embed-certs-20220630210659-9950/g' /etc/hosts;
				else 
					echo '127.0.1.1 embed-certs-20220630210659-9950' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0630 21:07:08.925119  258418 main.go:134] libmachine: SSH cmd err, output: <nil>: 
	I0630 21:07:08.925147  258418 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube CaCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/c
erts/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube}
	I0630 21:07:08.925201  258418 ubuntu.go:177] setting up certificates
	I0630 21:07:08.925214  258418 provision.go:83] configureAuth start
	I0630 21:07:08.925265  258418 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-20220630210659-9950
	I0630 21:07:08.960061  258418 provision.go:138] copyHostCerts
	I0630 21:07:08.960154  258418 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem, removing ...
	I0630 21:07:08.960170  258418 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem
	I0630 21:07:08.960258  258418 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem (1082 bytes)
	I0630 21:07:08.960358  258418 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem, removing ...
	I0630 21:07:08.960373  258418 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem
	I0630 21:07:08.960415  258418 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem (1123 bytes)
	I0630 21:07:08.960487  258418 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem, removing ...
	I0630 21:07:08.960500  258418 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem
	I0630 21:07:08.960537  258418 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem (1679 bytes)
	I0630 21:07:08.960643  258418 provision.go:112] generating server cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem org=jenkins.embed-certs-20220630210659-9950 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-20220630210659-9950]
	I0630 21:07:09.146367  258418 provision.go:172] copyRemoteCerts
	I0630 21:07:09.146434  258418 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0630 21:07:09.146467  258418 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:07:09.181391  258418 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49427 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:07:09.268359  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
	I0630 21:07:09.286430  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem --> /etc/docker/server.pem (1265 bytes)
	I0630 21:07:09.303887  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
	I0630 21:07:09.321968  258418 provision.go:86] duration metric: configureAuth took 396.737856ms
	I0630 21:07:09.321996  258418 ubuntu.go:193] setting minikube options for container-runtime
	I0630 21:07:09.322190  258418 config.go:178] Loaded profile config "embed-certs-20220630210659-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:07:09.322207  258418 machine.go:91] provisioned docker machine in 721.186892ms
	I0630 21:07:09.322214  258418 client.go:171] LocalClient.Create took 9.253625617s
	I0630 21:07:09.322232  258418 start.go:173] duration metric: libmachine.API.Create for "embed-certs-20220630210659-9950" took 9.253674873s
	I0630 21:07:09.322245  258418 start.go:306] post-start starting for "embed-certs-20220630210659-9950" (driver="docker")
	I0630 21:07:09.322250  258418 start.go:316] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0630 21:07:09.322300  258418 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0630 21:07:09.322345  258418 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:07:09.357615  258418 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49427 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:07:09.448779  258418 ssh_runner.go:195] Run: cat /etc/os-release
	I0630 21:07:09.451635  258418 main.go:134] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0630 21:07:09.451662  258418 main.go:134] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0630 21:07:09.451677  258418 main.go:134] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0630 21:07:09.451685  258418 info.go:137] Remote host: Ubuntu 20.04.4 LTS
	I0630 21:07:09.451696  258418 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/addons for local assets ...
	I0630 21:07:09.451763  258418 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files for local assets ...
	I0630 21:07:09.451845  258418 filesync.go:149] local asset: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem -> 99502.pem in /etc/ssl/certs
	I0630 21:07:09.451951  258418 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0630 21:07:09.458665  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem --> /etc/ssl/certs/99502.pem (1708 bytes)
	I0630 21:07:09.476026  258418 start.go:309] post-start completed in 153.769797ms
	I0630 21:07:09.476430  258418 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-20220630210659-9950
	I0630 21:07:09.510898  258418 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/config.json ...
	I0630 21:07:09.511146  258418 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0630 21:07:09.511187  258418 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:07:09.545651  258418 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49427 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:07:09.637501  258418 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0630 21:07:09.641506  258418 start.go:134] duration metric: createHost completed in 9.575373132s
	I0630 21:07:09.641531  258418 start.go:81] releasing machines lock for "embed-certs-20220630210659-9950", held for 9.57549992s
	I0630 21:07:09.641602  258418 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-20220630210659-9950
	I0630 21:07:09.677201  258418 ssh_runner.go:195] Run: systemctl --version
	I0630 21:07:09.677250  258418 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/
	I0630 21:07:09.677265  258418 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:07:09.677309  258418 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:07:09.713480  258418 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49427 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:07:09.713482  258418 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49427 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:07:09.797176  258418 ssh_runner.go:195] Run: sudo systemctl stop -f crio
	I0630 21:07:09.827436  258418 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0630 21:07:09.837837  258418 docker.go:179] disabling docker service ...
	I0630 21:07:09.837887  258418 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0630 21:07:09.854330  258418 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0630 21:07:09.864433  258418 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0630 21:07:09.947141  258418 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0630 21:07:10.021015  258418 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0630 21:07:10.030498  258418 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
	image-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0630 21:07:10.043126  258418 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*sandbox_image = .*$|sandbox_image = "k8s.gcr.io/pause:3.7"|' -i /etc/containerd/config.toml"
	I0630 21:07:10.051201  258418 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*restrict_oom_score_adj = .*$|restrict_oom_score_adj = false|' -i /etc/containerd/config.toml"
	I0630 21:07:10.060149  258418 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*SystemdCgroup = .*$|SystemdCgroup = false|' -i /etc/containerd/config.toml"
	I0630 21:07:10.068522  258418 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*conf_dir = .*$|conf_dir = "/etc/cni/net.mk"|' -i /etc/containerd/config.toml"
	I0630 21:07:10.077416  258418 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^# imports|imports = ["/etc/containerd/containerd.conf.d/02-containerd.conf"]|' -i /etc/containerd/config.toml"
	I0630 21:07:10.085718  258418 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc/containerd/containerd.conf.d && printf %s "dmVyc2lvbiA9IDIK" | base64 -d | sudo tee /etc/containerd/containerd.conf.d/02-containerd.conf"
	I0630 21:07:10.100377  258418 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0630 21:07:10.107211  258418 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0630 21:07:10.114109  258418 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0630 21:07:10.199996  258418 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0630 21:07:10.275745  258418 start.go:447] Will wait 60s for socket path /run/containerd/containerd.sock
	I0630 21:07:10.275834  258418 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
	I0630 21:07:10.279416  258418 start.go:468] Will wait 60s for crictl version
	I0630 21:07:10.279463  258418 ssh_runner.go:195] Run: sudo crictl version
	I0630 21:07:10.306037  258418 start.go:477] Version:  0.1.0
	RuntimeName:  containerd
	RuntimeVersion:  1.6.6
	RuntimeApiVersion:  v1alpha2
	I0630 21:07:10.306097  258418 ssh_runner.go:195] Run: containerd --version
	I0630 21:07:10.336955  258418 ssh_runner.go:195] Run: containerd --version
	I0630 21:07:10.369264  258418 out.go:177] * Preparing Kubernetes v1.24.2 on containerd 1.6.6 ...
	I0630 21:07:10.370707  258418 cli_runner.go:164] Run: docker network inspect embed-certs-20220630210659-9950 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0630 21:07:10.404290  258418 ssh_runner.go:195] Run: grep 192.168.94.1	host.minikube.internal$ /etc/hosts
	I0630 21:07:10.407606  258418 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.94.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0630 21:07:10.417141  258418 preload.go:132] Checking if preload exists for k8s version v1.24.2 and runtime containerd
	I0630 21:07:10.417195  258418 ssh_runner.go:195] Run: sudo crictl images --output json
	I0630 21:07:10.442185  258418 containerd.go:547] all images are preloaded for containerd runtime.
	I0630 21:07:10.442210  258418 containerd.go:461] Images already preloaded, skipping extraction
	I0630 21:07:10.442264  258418 ssh_runner.go:195] Run: sudo crictl images --output json
	I0630 21:07:10.466454  258418 containerd.go:547] all images are preloaded for containerd runtime.
	I0630 21:07:10.466477  258418 cache_images.go:84] Images are preloaded, skipping loading
	I0630 21:07:10.466518  258418 ssh_runner.go:195] Run: sudo crictl info
	I0630 21:07:10.490761  258418 cni.go:95] Creating CNI manager for ""
	I0630 21:07:10.490782  258418 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:07:10.490794  258418 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
	I0630 21:07:10.490806  258418 kubeadm.go:158] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.94.2 APIServerPort:8443 KubernetesVersion:v1.24.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:embed-certs-20220630210659-9950 NodeName:embed-certs-20220630210659-9950 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.94.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.94.2 CgroupDriver:cgroupfs ClientC
AFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}
	I0630 21:07:10.490930  258418 kubeadm.go:162] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.94.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: /run/containerd/containerd.sock
	  name: "embed-certs-20220630210659-9950"
	  kubeletExtraArgs:
	    node-ip: 192.168.94.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.94.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.24.2
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%"
	  nodefs.inodesFree: "0%"
	  imagefs.available: "0%"
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0630 21:07:10.491006  258418 kubeadm.go:961] kubelet [Unit]
	Wants=containerd.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.24.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=embed-certs-20220630210659-9950 --image-service-endpoint=unix:///run/containerd/containerd.sock --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.94.2 --runtime-request-timeout=15m
	
	[Install]
	 config:
	{KubernetesVersion:v1.24.2 ClusterName:embed-certs-20220630210659-9950 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
	I0630 21:07:10.491052  258418 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.24.2
	I0630 21:07:10.498227  258418 binaries.go:44] Found k8s binaries, skipping transfer
	I0630 21:07:10.498292  258418 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0630 21:07:10.505224  258418 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (524 bytes)
	I0630 21:07:10.518421  258418 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0630 21:07:10.531076  258418 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2060 bytes)
	I0630 21:07:10.543943  258418 ssh_runner.go:195] Run: grep 192.168.94.2	control-plane.minikube.internal$ /etc/hosts
	I0630 21:07:10.547038  258418 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.94.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0630 21:07:10.556545  258418 certs.go:54] Setting up /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950 for IP: 192.168.94.2
	I0630 21:07:10.556652  258418 certs.go:182] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.key
	I0630 21:07:10.556714  258418 certs.go:182] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.key
	I0630 21:07:10.556769  258418 certs.go:302] generating minikube-user signed cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/client.key
	I0630 21:07:10.556787  258418 crypto.go:68] Generating cert /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/client.crt with IP's: []
	I0630 21:07:10.765363  258418 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/client.crt ...
	I0630 21:07:10.765395  258418 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/client.crt: {Name:mk2189a82adcc765dfa2510a823d0440782737cd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:07:10.765620  258418 crypto.go:164] Writing key to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/client.key ...
	I0630 21:07:10.765636  258418 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/client.key: {Name:mkdeb0e682321ff945ca41fa64d1e608453c6f36 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:07:10.765773  258418 certs.go:302] generating minikube signed cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.key.ad8e880a
	I0630 21:07:10.765794  258418 crypto.go:68] Generating cert /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.crt.ad8e880a with IP's: [192.168.94.2 10.96.0.1 127.0.0.1 10.0.0.1]
	I0630 21:07:10.910596  258418 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.crt.ad8e880a ...
	I0630 21:07:10.910627  258418 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.crt.ad8e880a: {Name:mkc69164c3a143b379c0f4996d5e2da27861b5ff Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:07:10.910832  258418 crypto.go:164] Writing key to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.key.ad8e880a ...
	I0630 21:07:10.910846  258418 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.key.ad8e880a: {Name:mk8e2527beae912aa15913d6f348638ece4c494e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:07:10.910935  258418 certs.go:320] copying /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.crt.ad8e880a -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.crt
	I0630 21:07:10.910996  258418 certs.go:324] copying /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.key.ad8e880a -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.key
	I0630 21:07:10.911041  258418 certs.go:302] generating aggregator signed cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.key
	I0630 21:07:10.911054  258418 crypto.go:68] Generating cert /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.crt with IP's: []
	I0630 21:07:11.469066  258418 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.crt ...
	I0630 21:07:11.469461  258418 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.crt: {Name:mk9657fa57381458a8b172f509e4d3599add736c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:07:11.469782  258418 crypto.go:164] Writing key to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.key ...
	I0630 21:07:11.469807  258418 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.key: {Name:mkd9e4d5545bdb7302e99bfbbe9d07417abbdc89 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:07:11.470115  258418 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950.pem (1338 bytes)
	W0630 21:07:11.470166  258418 certs.go:384] ignoring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950_empty.pem, impossibly tiny 0 bytes
	I0630 21:07:11.470180  258418 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem (1679 bytes)
	I0630 21:07:11.470222  258418 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem (1082 bytes)
	I0630 21:07:11.470260  258418 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem (1123 bytes)
	I0630 21:07:11.470301  258418 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/key.pem (1679 bytes)
	I0630 21:07:11.470362  258418 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem (1708 bytes)
	I0630 21:07:11.471511  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
	I0630 21:07:11.490653  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I0630 21:07:11.508628  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0630 21:07:11.527379  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
	I0630 21:07:11.545789  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0630 21:07:11.564535  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
	I0630 21:07:11.582438  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0630 21:07:11.600444  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
	I0630 21:07:11.620977  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem --> /usr/share/ca-certificates/99502.pem (1708 bytes)
	I0630 21:07:11.639639  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0630 21:07:11.658178  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950.pem --> /usr/share/ca-certificates/9950.pem (1338 bytes)
	I0630 21:07:11.677694  258418 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0630 21:07:11.690755  258418 ssh_runner.go:195] Run: openssl version
	I0630 21:07:11.695688  258418 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/99502.pem && ln -fs /usr/share/ca-certificates/99502.pem /etc/ssl/certs/99502.pem"
	I0630 21:07:11.703347  258418 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/99502.pem
	I0630 21:07:11.706626  258418 certs.go:431] hashing: -rw-r--r-- 1 root root 1708 Jun 30 20:26 /usr/share/ca-certificates/99502.pem
	I0630 21:07:11.706684  258418 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/99502.pem
	I0630 21:07:11.711429  258418 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/99502.pem /etc/ssl/certs/3ec20f2e.0"
	I0630 21:07:11.719285  258418 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0630 21:07:11.726650  258418 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:07:11.729726  258418 certs.go:431] hashing: -rw-r--r-- 1 root root 1111 Jun 30 20:22 /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:07:11.729781  258418 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:07:11.734559  258418 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0630 21:07:11.741992  258418 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/9950.pem && ln -fs /usr/share/ca-certificates/9950.pem /etc/ssl/certs/9950.pem"
	I0630 21:07:11.752166  258418 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/9950.pem
	I0630 21:07:11.755639  258418 certs.go:431] hashing: -rw-r--r-- 1 root root 1338 Jun 30 20:26 /usr/share/ca-certificates/9950.pem
	I0630 21:07:11.755700  258418 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/9950.pem
	I0630 21:07:11.760725  258418 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/9950.pem /etc/ssl/certs/51391683.0"
	I0630 21:07:11.768543  258418 kubeadm.go:395] StartCluster: {Name:embed-certs-20220630210659-9950 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:embed-certs-20220630210659-9950 Namespace:default APIServerName
:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirr
or: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 21:07:11.768636  258418 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
	I0630 21:07:11.768692  258418 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0630 21:07:11.793825  258418 cri.go:87] found id: ""
	I0630 21:07:11.793907  258418 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0630 21:07:11.801886  258418 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0630 21:07:11.809295  258418 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver
	I0630 21:07:11.809360  258418 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0630 21:07:11.816601  258418 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0630 21:07:11.816642  258418 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0630 21:07:22.533924  258418 out.go:204]   - Generating certificates and keys ...
	I0630 21:07:22.537123  258418 out.go:204]   - Booting up control plane ...
	I0630 21:07:22.539540  258418 out.go:204]   - Configuring RBAC rules ...
	I0630 21:07:22.542068  258418 cni.go:95] Creating CNI manager for ""
	I0630 21:07:22.542090  258418 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:07:22.543871  258418 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0630 21:07:22.545247  258418 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0630 21:07:22.549022  258418 cni.go:189] applying CNI manifest using /var/lib/minikube/binaries/v1.24.2/kubectl ...
	I0630 21:07:22.549039  258418 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2429 bytes)
	I0630 21:07:22.563394  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0630 21:07:23.507644  258418 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0630 21:07:23.507717  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:23.507738  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl label nodes minikube.k8s.io/version=v1.26.0 minikube.k8s.io/commit=251ffcec0e4c997cd7732864187747cc579943c9 minikube.k8s.io/name=embed-certs-20220630210659-9950 minikube.k8s.io/updated_at=2022_06_30T21_07_23_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:23.514525  258418 ops.go:34] apiserver oom_adj: -16
	I0630 21:07:23.575212  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:24.170884  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:24.670874  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:25.170894  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:25.670569  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:26.170948  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:26.670289  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:27.171214  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:27.670384  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:28.171262  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:28.671014  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:29.170342  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:29.671154  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:30.170498  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:30.670666  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:31.170390  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:31.671212  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:32.170367  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:32.670667  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:33.170348  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:33.670265  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:34.170960  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:34.670712  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:34.845605  258418 kubeadm.go:1045] duration metric: took 11.337946322s to wait for elevateKubeSystemPrivileges.
	I0630 21:07:34.845642  258418 kubeadm.go:397] StartCluster complete in 23.077108776s
	I0630 21:07:34.845658  258418 settings.go:142] acquiring lock: {Name:mkcbd229caa05b60d3551ef0b47eea08424c9b5d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:07:34.845753  258418 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:07:34.847459  258418 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig: {Name:mk34e4a4e7b04f624b9adbda4f77ee20b38308ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:07:35.362178  258418 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "embed-certs-20220630210659-9950" rescaled to 1
	I0630 21:07:35.362241  258418 start.go:208] Will wait 6m0s for node &{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0630 21:07:35.365698  258418 out.go:177] * Verifying Kubernetes components...
	I0630 21:07:35.362298  258418 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0630 21:07:35.362308  258418 addons.go:412] enableAddons start: toEnable=map[], additional=[]
	I0630 21:07:35.365824  258418 addons.go:65] Setting storage-provisioner=true in profile "embed-certs-20220630210659-9950"
	I0630 21:07:35.362522  258418 config.go:178] Loaded profile config "embed-certs-20220630210659-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:07:35.365855  258418 addons.go:153] Setting addon storage-provisioner=true in "embed-certs-20220630210659-9950"
	W0630 21:07:35.365867  258418 addons.go:162] addon storage-provisioner should already be in state true
	I0630 21:07:35.365909  258418 host.go:66] Checking if "embed-certs-20220630210659-9950" exists ...
	I0630 21:07:35.365837  258418 addons.go:65] Setting default-storageclass=true in profile "embed-certs-20220630210659-9950"
	I0630 21:07:35.367597  258418 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 21:07:35.367617  258418 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "embed-certs-20220630210659-9950"
	I0630 21:07:35.366441  258418 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:07:35.367981  258418 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:07:35.413326  258418 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0630 21:07:35.413605  258418 addons.go:153] Setting addon default-storageclass=true in "embed-certs-20220630210659-9950"
	W0630 21:07:35.414779  258418 addons.go:162] addon default-storageclass should already be in state true
	I0630 21:07:35.414788  258418 addons.go:345] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 21:07:35.414799  258418 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0630 21:07:35.414802  258418 host.go:66] Checking if "embed-certs-20220630210659-9950" exists ...
	I0630 21:07:35.414839  258418 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:07:35.415175  258418 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:07:35.457376  258418 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.94.1 host.minikube.internal\n           fallthrough\n        }' | sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0630 21:07:35.458873  258418 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49427 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:07:35.458979  258418 node_ready.go:35] waiting up to 6m0s for node "embed-certs-20220630210659-9950" to be "Ready" ...
	I0630 21:07:35.461992  258418 addons.go:345] installing /etc/kubernetes/addons/storageclass.yaml
	I0630 21:07:35.462008  258418 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0630 21:07:35.462054  258418 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:07:35.501119  258418 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49427 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:07:35.644457  258418 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 21:07:35.747687  258418 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0630 21:07:36.026997  258418 start.go:806] {"host.minikube.internal": 192.168.94.1} host record injected into CoreDNS
	I0630 21:07:36.263877  258418 out.go:177] * Enabled addons: storage-provisioner, default-storageclass
	I0630 21:07:36.265439  258418 addons.go:414] enableAddons completed in 903.132951ms
	I0630 21:07:37.465314  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:07:39.965997  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:07:41.966144  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:07:44.466024  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:07:46.965627  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:07:48.966028  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:07:51.466128  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:07:53.965949  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:07:55.966446  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:07:57.966572  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:00.465385  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:02.466107  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:04.966016  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:07.465504  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:09.465988  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:11.965618  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:13.966333  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:15.966399  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:17.967088  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:20.465710  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:22.966006  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:24.966588  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:27.466076  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:29.466452  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:31.965739  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:34.465951  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:36.965728  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:39.465956  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:41.466144  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:43.466290  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:45.965932  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:47.966089  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:49.966441  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:51.966501  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:53.967111  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:56.465679  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:58.466102  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:00.965954  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:03.466641  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:05.467925  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:07.966731  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:09.967028  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:12.465824  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:14.466500  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:16.965412  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:18.966550  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:21.466374  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:23.966485  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:26.465447  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:28.466230  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:30.965905  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:33.466059  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:35.966260  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:38.465665  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:40.965367  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:42.966136  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:45.465020  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:47.466000  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:49.966235  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:52.465731  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:54.466083  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:56.966015  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:59.465658  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:01.465723  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:03.966642  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:06.466307  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:08.966212  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:11.465475  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:13.966074  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:15.966429  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:18.465535  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:20.465595  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:22.965577  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:24.965831  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:26.966289  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:29.466080  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:31.965740  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:34.465640  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:36.965286  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:39.465425  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:41.965521  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:43.966398  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:46.465344  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:48.965232  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:50.966164  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:53.465622  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:55.965628  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:58.465311  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:00.465929  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:02.465978  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:04.965401  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:06.965666  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:08.965779  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:10.966125  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:13.465399  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:15.465878  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:17.466180  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:19.966091  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:22.465421  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:24.465623  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:26.466188  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:28.965893  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:31.465563  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:33.966393  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:35.467568  258418 node_ready.go:38] duration metric: took 4m0.008553357s waiting for node "embed-certs-20220630210659-9950" to be "Ready" ...
	I0630 21:11:35.469705  258418 out.go:177] 
	W0630 21:11:35.471092  258418 out.go:239] X Exiting due to GUEST_START: wait 6m0s for node: waiting for node to be ready: waitNodeCondition: timed out waiting for the condition
	X Exiting due to GUEST_START: wait 6m0s for node: waiting for node to be ready: waitNodeCondition: timed out waiting for the condition
	W0630 21:11:35.471111  258418 out.go:239] * 
	* 
	W0630 21:11:35.471814  258418 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0630 21:11:35.473349  258418 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p embed-certs-20220630210659-9950 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=containerd --kubernetes-version=v1.24.2": exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestStartStop/group/embed-certs/serial/FirstStart]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect embed-certs-20220630210659-9950
helpers_test.go:235: (dbg) docker inspect embed-certs-20220630210659-9950:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "8d43dca0a5ff56a08f5b0493d261e7c5d2aa00d085ae1a1182a97b5635cc1304",
	        "Created": "2022-06-30T21:07:07.545531471Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 259148,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2022-06-30T21:07:07.92350884Z",
	            "FinishedAt": "0001-01-01T00:00:00Z"
	        },
	        "Image": "sha256:573e7be5768273a7845baee1ae90fa2e33b83b10a7fbb0f0f41efbf29b53d1f1",
	        "ResolvConfPath": "/var/lib/docker/containers/8d43dca0a5ff56a08f5b0493d261e7c5d2aa00d085ae1a1182a97b5635cc1304/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/8d43dca0a5ff56a08f5b0493d261e7c5d2aa00d085ae1a1182a97b5635cc1304/hostname",
	        "HostsPath": "/var/lib/docker/containers/8d43dca0a5ff56a08f5b0493d261e7c5d2aa00d085ae1a1182a97b5635cc1304/hosts",
	        "LogPath": "/var/lib/docker/containers/8d43dca0a5ff56a08f5b0493d261e7c5d2aa00d085ae1a1182a97b5635cc1304/8d43dca0a5ff56a08f5b0493d261e7c5d2aa00d085ae1a1182a97b5635cc1304-json.log",
	        "Name": "/embed-certs-20220630210659-9950",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "embed-certs-20220630210659-9950:/var",
	                "/lib/modules:/lib/modules:ro"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "embed-certs-20220630210659-9950",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 2306867200,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": null,
	            "BlkioDeviceWriteBps": null,
	            "BlkioDeviceReadIOps": null,
	            "BlkioDeviceWriteIOps": null,
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "KernelMemory": 0,
	            "KernelMemoryTCP": 0,
	            "MemoryReservation": 0,
	            "MemorySwap": 4613734400,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": null,
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/9c28feead8af894b180999110a5cc0d8344ae5c74789cd8dc72d94ee221f8e10-init/diff:/var/lib/docker/overlay2/8b88d9f6f12c48be642a133456203e58549a93f1da67d0349744bd0f78917fba/diff:/var/lib/docker/overlay2/2bcbb3b4718a64188802301a25d7f413bb307cb16d077e7e5af799f9152a2970/diff:/var/lib/docker/overlay2/70b0888bf22fcef1c004704b71288ac581cf26a3b3b19fbca3da296ba10d6978/diff:/var/lib/docker/overlay2/7c5332f38fe652f379ef9b6d23e795158e9994317cfb547b581dd2b1fdf1303b/diff:/var/lib/docker/overlay2/0ddb5a3abf433b644a8bfa124e3c87878eed67878faa35493f2befc2b392e9cb/diff:/var/lib/docker/overlay2/3b7cda5fb0232fdeecbec0531ac704a59eb38fe57664c25777193b07e2df0077/diff:/var/lib/docker/overlay2/a14687ada786c65465b9924ae2d77ba27afc07942851cafaade28e80dfe9da16/diff:/var/lib/docker/overlay2/c49a9b7157aa6e8714e192b2849866d035b59e18de462c0ee9b72f898cc5a485/diff:/var/lib/docker/overlay2/efd71a50e3a1044a6d1c4c1a7d4d91d9f070c066e03e51c6c73a5764b778ad72/diff:/var/lib/docker/overlay2/55476a
1c0a20aa4238a0bb0e43c6402c33dcad312938ad48ee81be0160e12a49/diff:/var/lib/docker/overlay2/c48c4a348a797b9a38f01568a6adbcb4b05b4f56f7b986a4bf1b509d8cb00732/diff:/var/lib/docker/overlay2/568e3f354ab0428de5cf82d1fdfb780c3377f5cc55d9f524731c53e39e0ecae7/diff:/var/lib/docker/overlay2/2857943e320cdcdae9af3d8c2acda1fb61e2f142a88b8b902908071cea67816e/diff:/var/lib/docker/overlay2/bdd9a57f0b65e65c5a16395f239425e794c678b0e8db2f4a368e0a9427fe5116/diff:/var/lib/docker/overlay2/b150183f1b73e8c13c751911bcee09fed8ef973478f4dc3cfdb9e509118bf1ea/diff:/var/lib/docker/overlay2/0a053e7c29417cd6feafb351c7944e81342a52898871bc779f7bf61868c78ec4/diff:/var/lib/docker/overlay2/d3c0de3a44d75d0a05acb7843d53deba5ce0457649d6ed757da9b4c532a81e4f/diff:/var/lib/docker/overlay2/53f6170132880e1697dd802b8577382b31c6f1ba144256f8cc62542998842a6b/diff:/var/lib/docker/overlay2/b5c0be6d8efdb1fcb12e73b8f72853f77baa4bc014ac2c1e28b7b972b07f3325/diff:/var/lib/docker/overlay2/36c908f082a1e5388bb25277f1c957eaecf70fcd958080422fa85a3105724fb2/diff:/var/lib/d
ocker/overlay2/b147fe9dce365cfaf9bfeca2e370829e4d87e2671c133a9836ecb02a85422cc7/diff:/var/lib/docker/overlay2/65f488eb9181a721f01b333f5fa0cb91d216abd7842a9ae193bd95316f378721/diff:/var/lib/docker/overlay2/b04269aa247b68912ddc5b1c98ad55d67af4103f576a900eef4069c196b8a263/diff:/var/lib/docker/overlay2/b714c37e15257ae9d0e15d271dd18a330c38ad765901d9b7e7e3feb73e1b03e4/diff:/var/lib/docker/overlay2/3c253b721193edeaade7bba7ce25ff687c889b8fa86e9489c7ee20d5624e6c5b/diff:/var/lib/docker/overlay2/7f67b74e101fa21dd320393c10576eefa4ce1cec2e210bff405784fa45b360f3/diff:/var/lib/docker/overlay2/c3b2adaa63a06a5e6ed966d7b6f20a757aeadd3f25eb09ef3c7e9a66a8904143/diff:/var/lib/docker/overlay2/ddb5d653d19e8cafc4625a8fe9597667d98b277a7f679e532ad84caa2c6da636/diff:/var/lib/docker/overlay2/03eb172b20323ebeee7cb09025726a6e10de6c3dd8661f4f6bbc5a3a3778bad4/diff:/var/lib/docker/overlay2/80ea9bf34d028e95a8a418b3aeb634be72ab3336448946d7855c51ffdf8258d7/diff:/var/lib/docker/overlay2/e28987ea3fb4d431dee111f38cc76814b85f73e86434be3c463c01fdd59
9ad46/diff:/var/lib/docker/overlay2/6f9a46c7c6cf4fd30ce32a1eb08ed9b1e8dd61cb0e42ce54f0f736f06558c306/diff:/var/lib/docker/overlay2/6fc942eb9ccfc09898edc9a5ef3b3d305a6fcb22e8cefb1a9f9c344d10b59b25/diff:/var/lib/docker/overlay2/f6b8c57540e798dc1dfd51fd29c020193c02a4362f31c6d07aa220327bb07b90/diff:/var/lib/docker/overlay2/85d0aa01a3fab8c77262c59d8a7b0809a72673a3da7d33e4e19c04a66db44a11/diff:/var/lib/docker/overlay2/58dcd81a1605641f785ced5aeb38657eec1f02a31b7adfaf4f6fdd49f4bab1d6/diff:/var/lib/docker/overlay2/9d537e0a65325e4bf85b26da9828002339f5c442ca85f931b340457a80ec8c94/diff:/var/lib/docker/overlay2/a6f73707ee6a74e948a02d03c4a3f12b57c2eb408dc67da3c39961bb3cefcc97/diff:/var/lib/docker/overlay2/922526c310b066dbb73b9a106eef8bf0064ad7907a8d7d7b353f5307a17a4901/diff:/var/lib/docker/overlay2/a4185854870ebf8d34a4c7e1827dbe3bc461559839301ffb23c5efff5e3c9f14/diff:/var/lib/docker/overlay2/8c02b1fcb9d79f5d7b2ee4d44f6625a692c44a0d18df0a5c01cac0cca0fdf3f3/diff",
	                "MergedDir": "/var/lib/docker/overlay2/9c28feead8af894b180999110a5cc0d8344ae5c74789cd8dc72d94ee221f8e10/merged",
	                "UpperDir": "/var/lib/docker/overlay2/9c28feead8af894b180999110a5cc0d8344ae5c74789cd8dc72d94ee221f8e10/diff",
	                "WorkDir": "/var/lib/docker/overlay2/9c28feead8af894b180999110a5cc0d8344ae5c74789cd8dc72d94ee221f8e10/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "embed-certs-20220630210659-9950",
	                "Source": "/var/lib/docker/volumes/embed-certs-20220630210659-9950/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "embed-certs-20220630210659-9950",
	            "Domainname": "",
	            "User": "root",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e",
	            "Volumes": null,
	            "WorkingDir": "",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "embed-certs-20220630210659-9950",
	                "name.minikube.sigs.k8s.io": "embed-certs-20220630210659-9950",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "877fceadb9246afa76923272f42d13c3ffa0cb31def97b937ce1263fb518147c",
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49427"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49426"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49423"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49425"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49424"
	                    }
	                ]
	            },
	            "SandboxKey": "/var/run/docker/netns/877fceadb924",
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "embed-certs-20220630210659-9950": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.94.2"
	                    },
	                    "Links": null,
	                    "Aliases": [
	                        "8d43dca0a5ff",
	                        "embed-certs-20220630210659-9950"
	                    ],
	                    "NetworkID": "a762009b1f738e8867dc868c38a8f04b91d930fa90f85eb117025e337ab9ed89",
	                    "EndpointID": "0afa60894f5bfb34a238eac3163af9d64b401d43c8640e4b094e1040817564ec",
	                    "Gateway": "192.168.94.1",
	                    "IPAddress": "192.168.94.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "MacAddress": "02:42:c0:a8:5e:02",
	                    "DriverOpts": null
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-20220630210659-9950 -n embed-certs-20220630210659-9950
helpers_test.go:244: <<< TestStartStop/group/embed-certs/serial/FirstStart FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======>  post-mortem[TestStartStop/group/embed-certs/serial/FirstStart]: minikube logs <======
helpers_test.go:247: (dbg) Run:  out/minikube-linux-amd64 -p embed-certs-20220630210659-9950 logs -n 25
helpers_test.go:252: TestStartStop/group/embed-certs/serial/FirstStart logs: 
-- stdout --
	* 
	* ==> Audit <==
	* |---------|------------------------------------------------------------|----------|---------|---------|---------------------|---------------------|
	| Command |                            Args                            | Profile  |  User   | Version |     Start Time      |      End Time       |
	|---------|------------------------------------------------------------|----------|---------|---------|---------------------|---------------------|
	| start   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:02 UTC | 30 Jun 22 21:03 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|         | --memory=2200                                              |          |         |         |                     |                     |
	|         | --alsologtostderr                                          |          |         |         |                     |                     |
	|         | --wait=true --preload=false                                |          |         |         |                     |                     |
	|         | --driver=docker                                            |          |         |         |                     |                     |
	|         | --container-runtime=containerd                             |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                               |          |         |         |                     |                     |
	| delete  | -p calico-20220630204859-9950                              | minikube | jenkins | v1.26.0 | 30 Jun 22 21:03 UTC | 30 Jun 22 21:03 UTC |
	| start   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:03 UTC |                     |
	|         | default-k8s-different-port-20220630210335-9950             |          |         |         |                     |                     |
	|         | --memory=2200 --alsologtostderr --wait=true                |          |         |         |                     |                     |
	|         | --apiserver-port=8444 --driver=docker                      |          |         |         |                     |                     |
	|         |  --container-runtime=containerd                            |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                               |          |         |         |                     |                     |
	| addons  | enable metrics-server -p                                   | minikube | jenkins | v1.26.0 | 30 Jun 22 21:03 UTC | 30 Jun 22 21:03 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|         | --images=MetricsServer=k8s.gcr.io/echoserver:1.4           |          |         |         |                     |                     |
	|         | --registries=MetricsServer=fake.domain                     |          |         |         |                     |                     |
	| stop    | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:03 UTC | 30 Jun 22 21:04 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=3                                     |          |         |         |                     |                     |
	| addons  | enable dashboard -p                                        | minikube | jenkins | v1.26.0 | 30 Jun 22 21:04 UTC | 30 Jun 22 21:04 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|         | --images=MetricsScraper=k8s.gcr.io/echoserver:1.4          |          |         |         |                     |                     |
	| start   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:04 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|         | --memory=2200                                              |          |         |         |                     |                     |
	|         | --alsologtostderr                                          |          |         |         |                     |                     |
	|         | --wait=true --preload=false                                |          |         |         |                     |                     |
	|         | --driver=docker                                            |          |         |         |                     |                     |
	|         | --container-runtime=containerd                             |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                               |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:05 UTC | 30 Jun 22 21:05 UTC |
	|         | enable-default-cni-20220630204858-9950                     |          |         |         |                     |                     |
	| start   | -p newest-cni-20220630210514-9950 --memory=2200            | minikube | jenkins | v1.26.0 | 30 Jun 22 21:05 UTC | 30 Jun 22 21:06 UTC |
	|         | --alsologtostderr --wait=apiserver,system_pods,default_sa  |          |         |         |                     |                     |
	|         | --feature-gates ServerSideApply=true --network-plugin=cni  |          |         |         |                     |                     |
	|         | --extra-config=kubeadm.pod-network-cidr=192.168.111.111/16 |          |         |         |                     |                     |
	|         | --driver=docker  --container-runtime=containerd            |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                               |          |         |         |                     |                     |
	| addons  | enable metrics-server -p                                   | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | --images=MetricsServer=k8s.gcr.io/echoserver:1.4           |          |         |         |                     |                     |
	|         | --registries=MetricsServer=fake.domain                     |          |         |         |                     |                     |
	| stop    | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=3                                     |          |         |         |                     |                     |
	| addons  | enable dashboard -p                                        | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | --images=MetricsScraper=k8s.gcr.io/echoserver:1.4          |          |         |         |                     |                     |
	| start   | -p newest-cni-20220630210514-9950 --memory=2200            | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | --alsologtostderr --wait=apiserver,system_pods,default_sa  |          |         |         |                     |                     |
	|         | --feature-gates ServerSideApply=true --network-plugin=cni  |          |         |         |                     |                     |
	|         | --extra-config=kubeadm.pod-network-cidr=192.168.111.111/16 |          |         |         |                     |                     |
	|         | --driver=docker  --container-runtime=containerd            |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                               |          |         |         |                     |                     |
	| ssh     | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | sudo crictl images -o json                                 |          |         |         |                     |                     |
	| pause   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                     |          |         |         |                     |                     |
	| unpause | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                     |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | disable-driver-mounts-20220630210659-9950                  |          |         |         |                     |                     |
	| start   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC |                     |
	|         | embed-certs-20220630210659-9950                            |          |         |         |                     |                     |
	|         | --memory=2200 --alsologtostderr                            |          |         |         |                     |                     |
	|         | --wait=true --embed-certs                                  |          |         |         |                     |                     |
	|         | --driver=docker                                            |          |         |         |                     |                     |
	|         | --container-runtime=containerd                             |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                               |          |         |         |                     |                     |
	| ssh     | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|         | sudo crictl images -o json                                 |          |         |         |                     |                     |
	| pause   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                     |          |         |         |                     |                     |
	| unpause | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                     |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|---------|------------------------------------------------------------|----------|---------|---------|---------------------|---------------------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2022/06/30 21:06:59
	Running on machine: ubuntu-20-agent-8
	Binary: Built with gc go1.18.3 for linux/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0630 21:06:59.738083  258418 out.go:296] Setting OutFile to fd 1 ...
	I0630 21:06:59.738291  258418 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 21:06:59.738303  258418 out.go:309] Setting ErrFile to fd 2...
	I0630 21:06:59.738308  258418 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 21:06:59.738724  258418 root.go:329] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/bin
	I0630 21:06:59.739016  258418 out.go:303] Setting JSON to false
	I0630 21:06:59.740481  258418 start.go:115] hostinfo: {"hostname":"ubuntu-20-agent-8","uptime":2972,"bootTime":1656620248,"procs":586,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1012-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0630 21:06:59.740554  258418 start.go:125] virtualization: kvm guest
	I0630 21:06:59.743370  258418 out.go:177] * [embed-certs-20220630210659-9950] minikube v1.26.0 on Ubuntu 20.04 (kvm/amd64)
	I0630 21:06:59.744868  258418 out.go:177]   - MINIKUBE_LOCATION=14420
	I0630 21:06:59.744862  258418 notify.go:193] Checking for updates...
	I0630 21:06:59.746487  258418 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0630 21:06:59.747925  258418 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:06:59.749264  258418 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube
	I0630 21:06:59.750647  258418 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0630 21:06:59.752427  258418 config.go:178] Loaded profile config "default-k8s-different-port-20220630210335-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:06:59.752560  258418 config.go:178] Loaded profile config "no-preload-20220630210237-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:06:59.752664  258418 config.go:178] Loaded profile config "old-k8s-version-20220630210005-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.16.0
	I0630 21:06:59.752733  258418 driver.go:360] Setting default libvirt URI to qemu:///system
	I0630 21:06:59.793157  258418 docker.go:137] docker version: linux-20.10.17
	I0630 21:06:59.793329  258418 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0630 21:06:59.904539  258418 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:3 ContainersPaused:0 ContainersStopped:0 Images:8 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:50 OomKillDisable:true NGoroutines:49 SystemTime:2022-06-30 21:06:59.825756368 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1012-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexServ
erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662451712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-8 Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Client
Info:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
	I0630 21:06:59.904699  258418 docker.go:254] overlay module found
	I0630 21:06:59.908463  258418 out.go:177] * Using the docker driver based on user configuration
	I0630 21:06:59.909872  258418 start.go:284] selected driver: docker
	I0630 21:06:59.909886  258418 start.go:808] validating driver "docker" against <nil>
	I0630 21:06:59.909904  258418 start.go:819] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0630 21:06:59.910758  258418 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0630 21:07:00.020059  258418 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:3 ContainersPaused:0 ContainersStopped:0 Images:8 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:50 OomKillDisable:true NGoroutines:49 SystemTime:2022-06-30 21:06:59.94317636 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1012-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexServe
rAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662451712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-8 Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] ClientI
nfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
	I0630 21:07:00.020196  258418 start_flags.go:296] no existing cluster config was found, will generate one from the flags 
	I0630 21:07:00.020755  258418 start_flags.go:853] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0630 21:07:00.022859  258418 out.go:177] * Using Docker driver with root privileges
	I0630 21:07:00.024184  258418 cni.go:95] Creating CNI manager for ""
	I0630 21:07:00.024208  258418 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:07:00.024223  258418 start_flags.go:305] Found "CNI" CNI - setting NetworkPlugin=cni
	I0630 21:07:00.024246  258418 start_flags.go:310] config:
	{Name:embed-certs-20220630210659-9950 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:embed-certs-20220630210659-9950 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:clus
ter.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 21:07:00.025866  258418 out.go:177] * Starting control plane node embed-certs-20220630210659-9950 in cluster embed-certs-20220630210659-9950
	I0630 21:07:00.027139  258418 cache.go:120] Beginning downloading kic base image for docker with containerd
	I0630 21:07:00.028673  258418 out.go:177] * Pulling base image ...
	I0630 21:07:00.029951  258418 preload.go:132] Checking if preload exists for k8s version v1.24.2 and runtime containerd
	I0630 21:07:00.029992  258418 preload.go:148] Found local preload: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-containerd-overlay2-amd64.tar.lz4
	I0630 21:07:00.030001  258418 cache.go:57] Caching tarball of preloaded images
	I0630 21:07:00.030041  258418 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e in local docker daemon
	I0630 21:07:00.030250  258418 preload.go:174] Found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-containerd-overlay2-amd64.tar.lz4 in cache, skipping download
	I0630 21:07:00.030266  258418 cache.go:60] Finished verifying existence of preloaded tar for  v1.24.2 on containerd
	I0630 21:07:00.030363  258418 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/config.json ...
	I0630 21:07:00.030388  258418 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/config.json: {Name:mk3d06fce107c3c107ba91de67a3c2827092ffff Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:07:00.065813  258418 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e in local docker daemon, skipping pull
	I0630 21:07:00.065840  258418 cache.go:142] gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e exists in daemon, skipping load
	I0630 21:07:00.065850  258418 cache.go:208] Successfully downloaded all kic artifacts
	I0630 21:07:00.065886  258418 start.go:352] acquiring machines lock for embed-certs-20220630210659-9950: {Name:mk6619dbb09b46cdd2b244e5bf2112b3274a30ef Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0630 21:07:00.066018  258418 start.go:356] acquired machines lock for "embed-certs-20220630210659-9950" in 103.406µs
	I0630 21:07:00.066043  258418 start.go:91] Provisioning new machine with config: &{Name:embed-certs-20220630210659-9950 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:embed-certs-20220630210659-9950 Namespace
:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker
BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:} &{Name: IP: Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0630 21:07:00.066120  258418 start.go:131] createHost starting for "" (driver="docker")
	I0630 21:06:57.559842  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:06:59.560333  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:06:57.322367  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:06:59.322499  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:00.068356  258418 out.go:204] * Creating docker container (CPUs=2, Memory=2200MB) ...
	I0630 21:07:00.068557  258418 start.go:165] libmachine.API.Create for "embed-certs-20220630210659-9950" (driver="docker")
	I0630 21:07:00.068584  258418 client.go:168] LocalClient.Create starting
	I0630 21:07:00.068653  258418 main.go:134] libmachine: Reading certificate data from /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem
	I0630 21:07:00.068682  258418 main.go:134] libmachine: Decoding PEM data...
	I0630 21:07:00.068698  258418 main.go:134] libmachine: Parsing certificate...
	I0630 21:07:00.068753  258418 main.go:134] libmachine: Reading certificate data from /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem
	I0630 21:07:00.068774  258418 main.go:134] libmachine: Decoding PEM data...
	I0630 21:07:00.068784  258418 main.go:134] libmachine: Parsing certificate...
	I0630 21:07:00.069116  258418 cli_runner.go:164] Run: docker network inspect embed-certs-20220630210659-9950 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	W0630 21:07:00.108024  258418 cli_runner.go:211] docker network inspect embed-certs-20220630210659-9950 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
	I0630 21:07:00.108116  258418 network_create.go:272] running [docker network inspect embed-certs-20220630210659-9950] to gather additional debugging logs...
	I0630 21:07:00.108144  258418 cli_runner.go:164] Run: docker network inspect embed-certs-20220630210659-9950
	W0630 21:07:00.141588  258418 cli_runner.go:211] docker network inspect embed-certs-20220630210659-9950 returned with exit code 1
	I0630 21:07:00.141617  258418 network_create.go:275] error running [docker network inspect embed-certs-20220630210659-9950]: docker network inspect embed-certs-20220630210659-9950: exit status 1
	stdout:
	[]
	
	stderr:
	Error: No such network: embed-certs-20220630210659-9950
	I0630 21:07:00.141631  258418 network_create.go:277] output of [docker network inspect embed-certs-20220630210659-9950]: -- stdout --
	[]
	
	-- /stdout --
	** stderr ** 
	Error: No such network: embed-certs-20220630210659-9950
	
	** /stderr **
	I0630 21:07:00.141686  258418 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0630 21:07:00.178261  258418 network.go:240] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName:br-c7ee26fec5a3 IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:02:42:cc:d0:4a:9e}}
	I0630 21:07:00.179334  258418 network.go:240] skipping subnet 192.168.58.0/24 that is taken: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 Interface:{IfaceName:br-3e97afadef02 IfaceIPv4:192.168.58.1 IfaceMTU:1500 IfaceMAC:02:42:9e:e7:fd:62}}
	I0630 21:07:00.179967  258418 network.go:240] skipping subnet 192.168.67.0/24 that is taken: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 Interface:{IfaceName:br-2a33e496d49b IfaceIPv4:192.168.67.1 IfaceMTU:1500 IfaceMAC:02:42:21:56:17:cb}}
	I0630 21:07:00.180760  258418 network.go:240] skipping subnet 192.168.76.0/24 that is taken: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 Interface:{IfaceName:br-5e7b405f6aaf IfaceIPv4:192.168.76.1 IfaceMTU:1500 IfaceMAC:02:42:7b:eb:36:d4}}
	I0630 21:07:00.181503  258418 network.go:240] skipping subnet 192.168.85.0/24 that is taken: &{IP:192.168.85.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.85.0/24 Gateway:192.168.85.1 ClientMin:192.168.85.2 ClientMax:192.168.85.254 Broadcast:192.168.85.255 Interface:{IfaceName:br-88cfda28f438 IfaceIPv4:192.168.85.1 IfaceMTU:1500 IfaceMAC:02:42:12:4c:db:ca}}
	I0630 21:07:00.182506  258418 network.go:288] reserving subnet 192.168.94.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[] amended:true}} dirty:map[192.168.94.0:0xc000790098] misses:0}
	I0630 21:07:00.182557  258418 network.go:235] using free private subnet 192.168.94.0/24: &{IP:192.168.94.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.94.0/24 Gateway:192.168.94.1 ClientMin:192.168.94.2 ClientMax:192.168.94.254 Broadcast:192.168.94.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
	I0630 21:07:00.182573  258418 network_create.go:115] attempt to create docker network embed-certs-20220630210659-9950 192.168.94.0/24 with gateway 192.168.94.1 and MTU of 1500 ...
	I0630 21:07:00.182643  258418 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.94.0/24 --gateway=192.168.94.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=embed-certs-20220630210659-9950 embed-certs-20220630210659-9950
	I0630 21:07:00.257759  258418 network_create.go:99] docker network embed-certs-20220630210659-9950 192.168.94.0/24 created
	I0630 21:07:00.257800  258418 kic.go:106] calculated static IP "192.168.94.2" for the "embed-certs-20220630210659-9950" container
	I0630 21:07:00.257889  258418 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I0630 21:07:00.297023  258418 cli_runner.go:164] Run: docker volume create embed-certs-20220630210659-9950 --label name.minikube.sigs.k8s.io=embed-certs-20220630210659-9950 --label created_by.minikube.sigs.k8s.io=true
	I0630 21:07:00.333425  258418 oci.go:103] Successfully created a docker volume embed-certs-20220630210659-9950
	I0630 21:07:00.333505  258418 cli_runner.go:164] Run: docker run --rm --name embed-certs-20220630210659-9950-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=embed-certs-20220630210659-9950 --entrypoint /usr/bin/test -v embed-certs-20220630210659-9950:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e -d /var/lib
	I0630 21:07:00.910665  258418 oci.go:107] Successfully prepared a docker volume embed-certs-20220630210659-9950
	I0630 21:07:00.910711  258418 preload.go:132] Checking if preload exists for k8s version v1.24.2 and runtime containerd
	I0630 21:07:00.910729  258418 kic.go:179] Starting extracting preloaded images to volume ...
	I0630 21:07:00.910788  258418 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-containerd-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v embed-certs-20220630210659-9950:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e -I lz4 -xf /preloaded.tar -C /extractDir
	I0630 21:07:02.060819  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:04.559635  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:01.822187  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:04.321625  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:07.402589  258418 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-containerd-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v embed-certs-20220630210659-9950:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e -I lz4 -xf /preloaded.tar -C /extractDir: (6.49174022s)
	I0630 21:07:07.402619  258418 kic.go:188] duration metric: took 6.491886 seconds to extract preloaded images to volume
	W0630 21:07:07.402757  258418 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	I0630 21:07:07.402858  258418 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0630 21:07:07.511838  258418 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname embed-certs-20220630210659-9950 --name embed-certs-20220630210659-9950 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=embed-certs-20220630210659-9950 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=embed-certs-20220630210659-9950 --network embed-certs-20220630210659-9950 --ip 192.168.94.2 --volume embed-certs-20220630210659-9950:/var --security-opt apparmor=unconfined --memory=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e
	I0630 21:07:07.934143  258418 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Running}}
	I0630 21:07:07.973385  258418 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:07:08.010245  258418 cli_runner.go:164] Run: docker exec embed-certs-20220630210659-9950 stat /var/lib/dpkg/alternatives/iptables
	I0630 21:07:08.090553  258418 oci.go:144] the created container "embed-certs-20220630210659-9950" has a running status.
	I0630 21:07:08.090607  258418 kic.go:210] Creating ssh key for kic: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa...
	I0630 21:07:08.314972  258418 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0630 21:07:08.427784  258418 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:07:08.468895  258418 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0630 21:07:08.468925  258418 kic_runner.go:114] Args: [docker exec --privileged embed-certs-20220630210659-9950 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0630 21:07:08.566253  258418 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:07:08.600997  258418 machine.go:88] provisioning docker machine ...
	I0630 21:07:08.601037  258418 ubuntu.go:169] provisioning hostname "embed-certs-20220630210659-9950"
	I0630 21:07:08.601149  258418 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:07:08.636297  258418 main.go:134] libmachine: Using SSH client type: native
	I0630 21:07:08.636495  258418 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil>  [] 0s} 127.0.0.1 49427 <nil> <nil>}
	I0630 21:07:08.636521  258418 main.go:134] libmachine: About to run SSH command:
	sudo hostname embed-certs-20220630210659-9950 && echo "embed-certs-20220630210659-9950" | sudo tee /etc/hostname
	I0630 21:07:08.771633  258418 main.go:134] libmachine: SSH cmd err, output: <nil>: embed-certs-20220630210659-9950
	
	I0630 21:07:08.771709  258418 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:07:08.807559  258418 main.go:134] libmachine: Using SSH client type: native
	I0630 21:07:08.807748  258418 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil>  [] 0s} 127.0.0.1 49427 <nil> <nil>}
	I0630 21:07:08.807776  258418 main.go:134] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sembed-certs-20220630210659-9950' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 embed-certs-20220630210659-9950/g' /etc/hosts;
				else 
					echo '127.0.1.1 embed-certs-20220630210659-9950' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0630 21:07:08.925119  258418 main.go:134] libmachine: SSH cmd err, output: <nil>: 
	I0630 21:07:08.925147  258418 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube CaCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/c
erts/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube}
	I0630 21:07:08.925201  258418 ubuntu.go:177] setting up certificates
	I0630 21:07:08.925214  258418 provision.go:83] configureAuth start
	I0630 21:07:08.925265  258418 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-20220630210659-9950
	I0630 21:07:08.960061  258418 provision.go:138] copyHostCerts
	I0630 21:07:08.960154  258418 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem, removing ...
	I0630 21:07:08.960170  258418 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem
	I0630 21:07:08.960258  258418 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem (1082 bytes)
	I0630 21:07:08.960358  258418 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem, removing ...
	I0630 21:07:08.960373  258418 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem
	I0630 21:07:08.960415  258418 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem (1123 bytes)
	I0630 21:07:08.960487  258418 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem, removing ...
	I0630 21:07:08.960500  258418 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem
	I0630 21:07:08.960537  258418 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem (1679 bytes)
	I0630 21:07:08.960643  258418 provision.go:112] generating server cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem org=jenkins.embed-certs-20220630210659-9950 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-20220630210659-9950]
	I0630 21:07:09.146367  258418 provision.go:172] copyRemoteCerts
	I0630 21:07:09.146434  258418 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0630 21:07:09.146467  258418 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:07:09.181391  258418 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49427 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:07:09.268359  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
	I0630 21:07:09.286430  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem --> /etc/docker/server.pem (1265 bytes)
	I0630 21:07:09.303887  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
	I0630 21:07:09.321968  258418 provision.go:86] duration metric: configureAuth took 396.737856ms
	I0630 21:07:09.321996  258418 ubuntu.go:193] setting minikube options for container-runtime
	I0630 21:07:09.322190  258418 config.go:178] Loaded profile config "embed-certs-20220630210659-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:07:09.322207  258418 machine.go:91] provisioned docker machine in 721.186892ms
	I0630 21:07:09.322214  258418 client.go:171] LocalClient.Create took 9.253625617s
	I0630 21:07:09.322232  258418 start.go:173] duration metric: libmachine.API.Create for "embed-certs-20220630210659-9950" took 9.253674873s
	I0630 21:07:09.322245  258418 start.go:306] post-start starting for "embed-certs-20220630210659-9950" (driver="docker")
	I0630 21:07:09.322250  258418 start.go:316] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0630 21:07:09.322300  258418 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0630 21:07:09.322345  258418 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:07:09.357615  258418 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49427 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:07:09.448779  258418 ssh_runner.go:195] Run: cat /etc/os-release
	I0630 21:07:09.451635  258418 main.go:134] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0630 21:07:09.451662  258418 main.go:134] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0630 21:07:09.451677  258418 main.go:134] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0630 21:07:09.451685  258418 info.go:137] Remote host: Ubuntu 20.04.4 LTS
	I0630 21:07:09.451696  258418 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/addons for local assets ...
	I0630 21:07:09.451763  258418 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files for local assets ...
	I0630 21:07:09.451845  258418 filesync.go:149] local asset: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem -> 99502.pem in /etc/ssl/certs
	I0630 21:07:09.451951  258418 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0630 21:07:09.458665  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem --> /etc/ssl/certs/99502.pem (1708 bytes)
	I0630 21:07:09.476026  258418 start.go:309] post-start completed in 153.769797ms
	I0630 21:07:09.476430  258418 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-20220630210659-9950
	I0630 21:07:09.510898  258418 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/config.json ...
	I0630 21:07:09.511146  258418 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0630 21:07:09.511187  258418 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:07:09.545651  258418 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49427 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:07:09.637501  258418 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0630 21:07:09.641506  258418 start.go:134] duration metric: createHost completed in 9.575373132s
	I0630 21:07:09.641531  258418 start.go:81] releasing machines lock for "embed-certs-20220630210659-9950", held for 9.57549992s
	I0630 21:07:09.641602  258418 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-20220630210659-9950
	I0630 21:07:09.677201  258418 ssh_runner.go:195] Run: systemctl --version
	I0630 21:07:09.677250  258418 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/
	I0630 21:07:09.677265  258418 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:07:09.677309  258418 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:07:09.713480  258418 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49427 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:07:09.713482  258418 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49427 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:07:06.559671  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:08.560388  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:09.797176  258418 ssh_runner.go:195] Run: sudo systemctl stop -f crio
	I0630 21:07:09.827436  258418 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0630 21:07:09.837837  258418 docker.go:179] disabling docker service ...
	I0630 21:07:09.837887  258418 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0630 21:07:09.854330  258418 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0630 21:07:09.864433  258418 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0630 21:07:09.947141  258418 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0630 21:07:10.021015  258418 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0630 21:07:10.030498  258418 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
	image-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0630 21:07:10.043126  258418 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*sandbox_image = .*$|sandbox_image = "k8s.gcr.io/pause:3.7"|' -i /etc/containerd/config.toml"
	I0630 21:07:10.051201  258418 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*restrict_oom_score_adj = .*$|restrict_oom_score_adj = false|' -i /etc/containerd/config.toml"
	I0630 21:07:10.060149  258418 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*SystemdCgroup = .*$|SystemdCgroup = false|' -i /etc/containerd/config.toml"
	I0630 21:07:10.068522  258418 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*conf_dir = .*$|conf_dir = "/etc/cni/net.mk"|' -i /etc/containerd/config.toml"
	I0630 21:07:10.077416  258418 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^# imports|imports = ["/etc/containerd/containerd.conf.d/02-containerd.conf"]|' -i /etc/containerd/config.toml"
	I0630 21:07:10.085718  258418 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc/containerd/containerd.conf.d && printf %!s(MISSING) "dmVyc2lvbiA9IDIK" | base64 -d | sudo tee /etc/containerd/containerd.conf.d/02-containerd.conf"
	I0630 21:07:10.100377  258418 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0630 21:07:10.107211  258418 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0630 21:07:10.114109  258418 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0630 21:07:10.199996  258418 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0630 21:07:10.275745  258418 start.go:447] Will wait 60s for socket path /run/containerd/containerd.sock
	I0630 21:07:10.275834  258418 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
	I0630 21:07:10.279416  258418 start.go:468] Will wait 60s for crictl version
	I0630 21:07:10.279463  258418 ssh_runner.go:195] Run: sudo crictl version
	I0630 21:07:10.306037  258418 start.go:477] Version:  0.1.0
	RuntimeName:  containerd
	RuntimeVersion:  1.6.6
	RuntimeApiVersion:  v1alpha2
	I0630 21:07:10.306097  258418 ssh_runner.go:195] Run: containerd --version
	I0630 21:07:10.336955  258418 ssh_runner.go:195] Run: containerd --version
	I0630 21:07:10.369264  258418 out.go:177] * Preparing Kubernetes v1.24.2 on containerd 1.6.6 ...
	I0630 21:07:06.322142  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:08.323262  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:10.323523  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:10.370707  258418 cli_runner.go:164] Run: docker network inspect embed-certs-20220630210659-9950 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0630 21:07:10.404290  258418 ssh_runner.go:195] Run: grep 192.168.94.1	host.minikube.internal$ /etc/hosts
	I0630 21:07:10.407606  258418 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.94.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0630 21:07:10.417141  258418 preload.go:132] Checking if preload exists for k8s version v1.24.2 and runtime containerd
	I0630 21:07:10.417195  258418 ssh_runner.go:195] Run: sudo crictl images --output json
	I0630 21:07:10.442185  258418 containerd.go:547] all images are preloaded for containerd runtime.
	I0630 21:07:10.442210  258418 containerd.go:461] Images already preloaded, skipping extraction
	I0630 21:07:10.442264  258418 ssh_runner.go:195] Run: sudo crictl images --output json
	I0630 21:07:10.466454  258418 containerd.go:547] all images are preloaded for containerd runtime.
	I0630 21:07:10.466477  258418 cache_images.go:84] Images are preloaded, skipping loading
	I0630 21:07:10.466518  258418 ssh_runner.go:195] Run: sudo crictl info
	I0630 21:07:10.490761  258418 cni.go:95] Creating CNI manager for ""
	I0630 21:07:10.490782  258418 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:07:10.490794  258418 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
	I0630 21:07:10.490806  258418 kubeadm.go:158] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.94.2 APIServerPort:8443 KubernetesVersion:v1.24.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:embed-certs-20220630210659-9950 NodeName:embed-certs-20220630210659-9950 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.94.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.94.2 CgroupDriver:cgroupfs ClientC
AFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}
	I0630 21:07:10.490930  258418 kubeadm.go:162] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.94.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: /run/containerd/containerd.sock
	  name: "embed-certs-20220630210659-9950"
	  kubeletExtraArgs:
	    node-ip: 192.168.94.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.94.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.24.2
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%!"(MISSING)
	  nodefs.inodesFree: "0%!"(MISSING)
	  imagefs.available: "0%!"(MISSING)
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0630 21:07:10.491006  258418 kubeadm.go:961] kubelet [Unit]
	Wants=containerd.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.24.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=embed-certs-20220630210659-9950 --image-service-endpoint=unix:///run/containerd/containerd.sock --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.94.2 --runtime-request-timeout=15m
	
	[Install]
	 config:
	{KubernetesVersion:v1.24.2 ClusterName:embed-certs-20220630210659-9950 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
	I0630 21:07:10.491052  258418 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.24.2
	I0630 21:07:10.498227  258418 binaries.go:44] Found k8s binaries, skipping transfer
	I0630 21:07:10.498292  258418 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0630 21:07:10.505224  258418 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (524 bytes)
	I0630 21:07:10.518421  258418 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0630 21:07:10.531076  258418 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2060 bytes)
	I0630 21:07:10.543943  258418 ssh_runner.go:195] Run: grep 192.168.94.2	control-plane.minikube.internal$ /etc/hosts
	I0630 21:07:10.547038  258418 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.94.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0630 21:07:10.556545  258418 certs.go:54] Setting up /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950 for IP: 192.168.94.2
	I0630 21:07:10.556652  258418 certs.go:182] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.key
	I0630 21:07:10.556714  258418 certs.go:182] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.key
	I0630 21:07:10.556769  258418 certs.go:302] generating minikube-user signed cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/client.key
	I0630 21:07:10.556787  258418 crypto.go:68] Generating cert /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/client.crt with IP's: []
	I0630 21:07:10.765363  258418 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/client.crt ...
	I0630 21:07:10.765395  258418 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/client.crt: {Name:mk2189a82adcc765dfa2510a823d0440782737cd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:07:10.765620  258418 crypto.go:164] Writing key to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/client.key ...
	I0630 21:07:10.765636  258418 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/client.key: {Name:mkdeb0e682321ff945ca41fa64d1e608453c6f36 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:07:10.765773  258418 certs.go:302] generating minikube signed cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.key.ad8e880a
	I0630 21:07:10.765794  258418 crypto.go:68] Generating cert /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.crt.ad8e880a with IP's: [192.168.94.2 10.96.0.1 127.0.0.1 10.0.0.1]
	I0630 21:07:10.910596  258418 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.crt.ad8e880a ...
	I0630 21:07:10.910627  258418 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.crt.ad8e880a: {Name:mkc69164c3a143b379c0f4996d5e2da27861b5ff Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:07:10.910832  258418 crypto.go:164] Writing key to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.key.ad8e880a ...
	I0630 21:07:10.910846  258418 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.key.ad8e880a: {Name:mk8e2527beae912aa15913d6f348638ece4c494e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:07:10.910935  258418 certs.go:320] copying /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.crt.ad8e880a -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.crt
	I0630 21:07:10.910996  258418 certs.go:324] copying /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.key.ad8e880a -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.key
	I0630 21:07:10.911041  258418 certs.go:302] generating aggregator signed cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.key
	I0630 21:07:10.911054  258418 crypto.go:68] Generating cert /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.crt with IP's: []
	I0630 21:07:11.469066  258418 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.crt ...
	I0630 21:07:11.469461  258418 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.crt: {Name:mk9657fa57381458a8b172f509e4d3599add736c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:07:11.469782  258418 crypto.go:164] Writing key to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.key ...
	I0630 21:07:11.469807  258418 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.key: {Name:mkd9e4d5545bdb7302e99bfbbe9d07417abbdc89 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:07:11.470115  258418 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950.pem (1338 bytes)
	W0630 21:07:11.470166  258418 certs.go:384] ignoring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950_empty.pem, impossibly tiny 0 bytes
	I0630 21:07:11.470180  258418 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem (1679 bytes)
	I0630 21:07:11.470222  258418 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem (1082 bytes)
	I0630 21:07:11.470260  258418 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem (1123 bytes)
	I0630 21:07:11.470301  258418 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/key.pem (1679 bytes)
	I0630 21:07:11.470362  258418 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem (1708 bytes)
	I0630 21:07:11.471511  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
	I0630 21:07:11.490653  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I0630 21:07:11.508628  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0630 21:07:11.527379  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
	I0630 21:07:11.545789  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0630 21:07:11.564535  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
	I0630 21:07:11.582438  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0630 21:07:11.600444  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
	I0630 21:07:11.620977  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem --> /usr/share/ca-certificates/99502.pem (1708 bytes)
	I0630 21:07:11.639639  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0630 21:07:11.658178  258418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950.pem --> /usr/share/ca-certificates/9950.pem (1338 bytes)
	I0630 21:07:11.677694  258418 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0630 21:07:11.690755  258418 ssh_runner.go:195] Run: openssl version
	I0630 21:07:11.695688  258418 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/99502.pem && ln -fs /usr/share/ca-certificates/99502.pem /etc/ssl/certs/99502.pem"
	I0630 21:07:11.703347  258418 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/99502.pem
	I0630 21:07:11.706626  258418 certs.go:431] hashing: -rw-r--r-- 1 root root 1708 Jun 30 20:26 /usr/share/ca-certificates/99502.pem
	I0630 21:07:11.706684  258418 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/99502.pem
	I0630 21:07:11.711429  258418 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/99502.pem /etc/ssl/certs/3ec20f2e.0"
	I0630 21:07:11.719285  258418 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0630 21:07:11.726650  258418 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:07:11.729726  258418 certs.go:431] hashing: -rw-r--r-- 1 root root 1111 Jun 30 20:22 /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:07:11.729781  258418 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:07:11.734559  258418 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0630 21:07:11.741992  258418 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/9950.pem && ln -fs /usr/share/ca-certificates/9950.pem /etc/ssl/certs/9950.pem"
	I0630 21:07:11.752166  258418 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/9950.pem
	I0630 21:07:11.755639  258418 certs.go:431] hashing: -rw-r--r-- 1 root root 1338 Jun 30 20:26 /usr/share/ca-certificates/9950.pem
	I0630 21:07:11.755700  258418 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/9950.pem
	I0630 21:07:11.760725  258418 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/9950.pem /etc/ssl/certs/51391683.0"
	I0630 21:07:11.768543  258418 kubeadm.go:395] StartCluster: {Name:embed-certs-20220630210659-9950 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:embed-certs-20220630210659-9950 Namespace:default APIServerName
:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirr
or: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 21:07:11.768636  258418 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
	I0630 21:07:11.768692  258418 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0630 21:07:11.793825  258418 cri.go:87] found id: ""
	I0630 21:07:11.793907  258418 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0630 21:07:11.801886  258418 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0630 21:07:11.809295  258418 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver
	I0630 21:07:11.809360  258418 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0630 21:07:11.816601  258418 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0630 21:07:11.816642  258418 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0630 21:07:11.060021  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:13.559886  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:12.823802  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:15.322092  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:15.560115  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:18.060545  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:17.322180  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:19.322480  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:22.533924  258418 out.go:204]   - Generating certificates and keys ...
	I0630 21:07:22.537123  258418 out.go:204]   - Booting up control plane ...
	I0630 21:07:22.539540  258418 out.go:204]   - Configuring RBAC rules ...
	I0630 21:07:22.542068  258418 cni.go:95] Creating CNI manager for ""
	I0630 21:07:22.542090  258418 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:07:22.543871  258418 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0630 21:07:22.545247  258418 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0630 21:07:22.549022  258418 cni.go:189] applying CNI manifest using /var/lib/minikube/binaries/v1.24.2/kubectl ...
	I0630 21:07:22.549039  258418 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2429 bytes)
	I0630 21:07:22.563394  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0630 21:07:23.507644  258418 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0630 21:07:23.507717  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:23.507738  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl label nodes minikube.k8s.io/version=v1.26.0 minikube.k8s.io/commit=251ffcec0e4c997cd7732864187747cc579943c9 minikube.k8s.io/name=embed-certs-20220630210659-9950 minikube.k8s.io/updated_at=2022_06_30T21_07_23_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:23.514525  258418 ops.go:34] apiserver oom_adj: -16
	I0630 21:07:23.575212  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:24.170884  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:24.670874  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:20.560389  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:23.059986  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:25.060230  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:21.821348  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:23.821974  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:25.170894  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:25.670569  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:26.170948  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:26.670289  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:27.171214  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:27.670384  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:28.171262  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:28.671014  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:29.170342  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:29.671154  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:27.560295  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:30.060032  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:25.822336  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:28.321275  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:30.322133  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:30.170498  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:30.670666  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:31.170390  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:31.671212  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:32.170367  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:32.670667  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:33.170348  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:33.670265  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:34.170960  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:34.670712  258418 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:07:32.559626  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:34.559784  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:34.845605  258418 kubeadm.go:1045] duration metric: took 11.337946322s to wait for elevateKubeSystemPrivileges.
	I0630 21:07:34.845642  258418 kubeadm.go:397] StartCluster complete in 23.077108776s
	I0630 21:07:34.845658  258418 settings.go:142] acquiring lock: {Name:mkcbd229caa05b60d3551ef0b47eea08424c9b5d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:07:34.845753  258418 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:07:34.847459  258418 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig: {Name:mk34e4a4e7b04f624b9adbda4f77ee20b38308ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:07:35.362178  258418 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "embed-certs-20220630210659-9950" rescaled to 1
	I0630 21:07:35.362241  258418 start.go:208] Will wait 6m0s for node &{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0630 21:07:35.365698  258418 out.go:177] * Verifying Kubernetes components...
	I0630 21:07:35.362298  258418 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0630 21:07:35.362308  258418 addons.go:412] enableAddons start: toEnable=map[], additional=[]
	I0630 21:07:35.365824  258418 addons.go:65] Setting storage-provisioner=true in profile "embed-certs-20220630210659-9950"
	I0630 21:07:35.362522  258418 config.go:178] Loaded profile config "embed-certs-20220630210659-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:07:35.365855  258418 addons.go:153] Setting addon storage-provisioner=true in "embed-certs-20220630210659-9950"
	W0630 21:07:35.365867  258418 addons.go:162] addon storage-provisioner should already be in state true
	I0630 21:07:35.365909  258418 host.go:66] Checking if "embed-certs-20220630210659-9950" exists ...
	I0630 21:07:35.365837  258418 addons.go:65] Setting default-storageclass=true in profile "embed-certs-20220630210659-9950"
	I0630 21:07:35.367597  258418 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 21:07:35.367617  258418 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "embed-certs-20220630210659-9950"
	I0630 21:07:35.366441  258418 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:07:35.367981  258418 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:07:35.413326  258418 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0630 21:07:32.322459  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:34.821349  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:35.413605  258418 addons.go:153] Setting addon default-storageclass=true in "embed-certs-20220630210659-9950"
	W0630 21:07:35.414779  258418 addons.go:162] addon default-storageclass should already be in state true
	I0630 21:07:35.414788  258418 addons.go:345] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 21:07:35.414799  258418 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0630 21:07:35.414802  258418 host.go:66] Checking if "embed-certs-20220630210659-9950" exists ...
	I0630 21:07:35.414839  258418 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:07:35.415175  258418 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:07:35.457376  258418 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.94.1 host.minikube.internal\n           fallthrough\n        }' | sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0630 21:07:35.458873  258418 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49427 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:07:35.458979  258418 node_ready.go:35] waiting up to 6m0s for node "embed-certs-20220630210659-9950" to be "Ready" ...
	I0630 21:07:35.461992  258418 addons.go:345] installing /etc/kubernetes/addons/storageclass.yaml
	I0630 21:07:35.462008  258418 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0630 21:07:35.462054  258418 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:07:35.501119  258418 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49427 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:07:35.644457  258418 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 21:07:35.747687  258418 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0630 21:07:36.026997  258418 start.go:806] {"host.minikube.internal": 192.168.94.1} host record injected into CoreDNS
	I0630 21:07:36.263877  258418 out.go:177] * Enabled addons: storage-provisioner, default-storageclass
	I0630 21:07:36.265439  258418 addons.go:414] enableAddons completed in 903.132951ms
	I0630 21:07:37.465314  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:07:37.059624  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:39.059792  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:36.821414  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:38.822111  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:39.965997  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:07:41.966144  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:07:44.466024  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:07:41.060328  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:43.060458  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:41.321999  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:43.821239  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:46.965627  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:07:48.966028  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:07:45.560281  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:48.059772  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:50.059801  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:45.821375  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:47.821892  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:49.822095  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:51.466128  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:07:53.965949  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:07:52.060088  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:54.559829  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:51.822570  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:54.322283  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:55.966446  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:07:57.966572  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:07:56.560117  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:59.060638  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:07:56.822512  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:07:59.322047  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:00.465385  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:02.466107  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:01.559922  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:08:03.560005  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:08:01.821701  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:03.822251  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:04.966016  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:07.465504  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:09.465988  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:06.059907  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:08:08.060375  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:08:06.322082  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:08.322154  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:10.322487  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:11.965618  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:13.966333  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:10.559488  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:08:12.560562  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:08:15.060921  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:08:12.821974  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:14.822566  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:15.966399  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:17.967088  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:17.559310  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:08:19.560222  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:08:17.322397  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:19.322675  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:22.059940  242039 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:08:23.062928  242039 node_ready.go:38] duration metric: took 4m0.010106635s waiting for node "default-k8s-different-port-20220630210335-9950" to be "Ready" ...
	I0630 21:08:23.064921  242039 out.go:177] 
	W0630 21:08:23.066357  242039 out.go:239] X Exiting due to GUEST_START: wait 6m0s for node: waiting for node to be ready: waitNodeCondition: timed out waiting for the condition
	W0630 21:08:23.066374  242039 out.go:239] * 
	W0630 21:08:23.067132  242039 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0630 21:08:23.069099  242039 out.go:177] 
	I0630 21:08:20.465710  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:22.966006  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:21.821882  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:24.322587  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:24.966588  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:27.466076  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:29.466452  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:26.821575  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:29.321907  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:31.965739  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:34.465951  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:31.822708  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:34.321850  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:36.965728  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:39.465956  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:36.822442  244832 pod_ready.go:102] pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace has status "Ready":"False"
	I0630 21:08:38.816177  244832 pod_ready.go:81] duration metric: took 4m0.004378904s waiting for pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace to be "Ready" ...
	E0630 21:08:38.816215  244832 pod_ready.go:66] WaitExtra: waitPodCondition: timed out waiting 4m0s for pod "metrics-server-5c6f97fb75-n5f6r" in "kube-system" namespace to be "Ready" (will not retry!)
	I0630 21:08:38.816238  244832 pod_ready.go:38] duration metric: took 4m9.046787153s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0630 21:08:38.816268  244832 kubeadm.go:630] restartCluster took 4m21.001155245s
	W0630 21:08:38.816400  244832 out.go:239] ! Unable to restart cluster, will reset it: extra: timed out waiting 4m0s for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready"
	I0630 21:08:38.816438  244832 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm reset --cri-socket /run/containerd/containerd.sock --force"
	I0630 21:08:41.415334  244832 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm reset --cri-socket /run/containerd/containerd.sock --force": (2.598874111s)
	I0630 21:08:41.415392  244832 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 21:08:41.426149  244832 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0630 21:08:41.433368  244832 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver
	I0630 21:08:41.433434  244832 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0630 21:08:41.440582  244832 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0630 21:08:41.440622  244832 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0630 21:08:41.703563  244832 out.go:204]   - Generating certificates and keys ...
	I0630 21:08:41.466144  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:43.466290  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:42.552119  244832 out.go:204]   - Booting up control plane ...
	I0630 21:08:45.965932  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:47.966089  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:50.095638  244832 out.go:204]   - Configuring RBAC rules ...
	I0630 21:08:50.533360  244832 cni.go:95] Creating CNI manager for ""
	I0630 21:08:50.533390  244832 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:08:50.535069  244832 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0630 21:08:49.966441  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:51.966501  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:53.967111  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:50.536580  244832 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0630 21:08:50.540911  244832 cni.go:189] applying CNI manifest using /var/lib/minikube/binaries/v1.24.2/kubectl ...
	I0630 21:08:50.540936  244832 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2429 bytes)
	I0630 21:08:50.556120  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0630 21:08:51.389198  244832 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0630 21:08:51.389281  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:08:51.389289  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl label nodes minikube.k8s.io/version=v1.26.0 minikube.k8s.io/commit=251ffcec0e4c997cd7732864187747cc579943c9 minikube.k8s.io/name=no-preload-20220630210237-9950 minikube.k8s.io/updated_at=2022_06_30T21_08_51_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:08:51.465379  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:08:51.473789  244832 ops.go:34] apiserver oom_adj: -16
	I0630 21:08:52.054266  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:08:52.554346  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:08:53.054915  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:08:53.554970  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:08:54.054244  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:08:54.553935  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:08:55.054105  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:08:56.465679  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:58.466102  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:08:55.554577  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:08:56.054094  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:08:56.554285  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:08:57.054273  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:08:57.554271  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:08:58.054647  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:08:58.554140  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:08:59.054835  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:08:59.553990  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:09:00.054934  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:09:00.554758  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:09:01.054048  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:09:01.554228  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:09:02.054048  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:09:02.554569  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:09:03.054628  244832 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:09:03.134111  244832 kubeadm.go:1045] duration metric: took 11.744889966s to wait for elevateKubeSystemPrivileges.
	I0630 21:09:03.134158  244832 kubeadm.go:397] StartCluster complete in 4m45.363383803s
	I0630 21:09:03.134182  244832 settings.go:142] acquiring lock: {Name:mkcbd229caa05b60d3551ef0b47eea08424c9b5d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:09:03.134326  244832 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:09:03.136509  244832 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig: {Name:mk34e4a4e7b04f624b9adbda4f77ee20b38308ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:09:03.652245  244832 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "no-preload-20220630210237-9950" rescaled to 1
	I0630 21:09:03.652307  244832 start.go:208] Will wait 6m0s for node &{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0630 21:09:03.654230  244832 out.go:177] * Verifying Kubernetes components...
	I0630 21:09:03.652361  244832 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0630 21:09:03.652377  244832 addons.go:412] enableAddons start: toEnable=map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true], additional=[]
	I0630 21:09:03.652560  244832 config.go:178] Loaded profile config "no-preload-20220630210237-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:09:03.656333  244832 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 21:09:03.656394  244832 addons.go:65] Setting storage-provisioner=true in profile "no-preload-20220630210237-9950"
	I0630 21:09:03.656420  244832 addons.go:153] Setting addon storage-provisioner=true in "no-preload-20220630210237-9950"
	I0630 21:09:03.656431  244832 addons.go:65] Setting dashboard=true in profile "no-preload-20220630210237-9950"
	W0630 21:09:03.656444  244832 addons.go:162] addon storage-provisioner should already be in state true
	I0630 21:09:03.656447  244832 addons.go:153] Setting addon dashboard=true in "no-preload-20220630210237-9950"
	W0630 21:09:03.656460  244832 addons.go:162] addon dashboard should already be in state true
	I0630 21:09:03.656494  244832 host.go:66] Checking if "no-preload-20220630210237-9950" exists ...
	I0630 21:09:03.656500  244832 host.go:66] Checking if "no-preload-20220630210237-9950" exists ...
	I0630 21:09:03.656813  244832 addons.go:65] Setting metrics-server=true in profile "no-preload-20220630210237-9950"
	I0630 21:09:03.656833  244832 addons.go:153] Setting addon metrics-server=true in "no-preload-20220630210237-9950"
	W0630 21:09:03.656841  244832 addons.go:162] addon metrics-server should already be in state true
	I0630 21:09:03.656879  244832 host.go:66] Checking if "no-preload-20220630210237-9950" exists ...
	I0630 21:09:03.657021  244832 cli_runner.go:164] Run: docker container inspect no-preload-20220630210237-9950 --format={{.State.Status}}
	I0630 21:09:03.657027  244832 cli_runner.go:164] Run: docker container inspect no-preload-20220630210237-9950 --format={{.State.Status}}
	I0630 21:09:03.656419  244832 addons.go:65] Setting default-storageclass=true in profile "no-preload-20220630210237-9950"
	I0630 21:09:03.657181  244832 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "no-preload-20220630210237-9950"
	I0630 21:09:03.657358  244832 cli_runner.go:164] Run: docker container inspect no-preload-20220630210237-9950 --format={{.State.Status}}
	I0630 21:09:03.657461  244832 cli_runner.go:164] Run: docker container inspect no-preload-20220630210237-9950 --format={{.State.Status}}
	I0630 21:09:03.710739  244832 out.go:177]   - Using image kubernetesui/dashboard:v2.6.0
	I0630 21:09:03.712433  244832 out.go:177]   - Using image fake.domain/k8s.gcr.io/echoserver:1.4
	I0630 21:09:03.713954  244832 addons.go:345] installing /etc/kubernetes/addons/metrics-apiservice.yaml
	I0630 21:09:03.713971  244832 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
	I0630 21:09:03.714019  244832 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-20220630210237-9950
	I0630 21:09:03.712413  244832 out.go:177]   - Using image k8s.gcr.io/echoserver:1.4
	I0630 21:09:03.715477  244832 addons.go:345] installing /etc/kubernetes/addons/dashboard-ns.yaml
	I0630 21:09:03.715500  244832 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
	I0630 21:09:03.715544  244832 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-20220630210237-9950
	I0630 21:09:03.721335  244832 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0630 21:09:00.965954  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:03.466641  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:03.722819  244832 addons.go:345] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 21:09:03.722838  244832 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0630 21:09:03.722890  244832 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-20220630210237-9950
	I0630 21:09:03.727454  244832 addons.go:153] Setting addon default-storageclass=true in "no-preload-20220630210237-9950"
	W0630 21:09:03.727483  244832 addons.go:162] addon default-storageclass should already be in state true
	I0630 21:09:03.727515  244832 host.go:66] Checking if "no-preload-20220630210237-9950" exists ...
	I0630 21:09:03.728100  244832 cli_runner.go:164] Run: docker container inspect no-preload-20220630210237-9950 --format={{.State.Status}}
	I0630 21:09:03.763933  244832 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49412 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/no-preload-20220630210237-9950/id_rsa Username:docker}
	I0630 21:09:03.768185  244832 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49412 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/no-preload-20220630210237-9950/id_rsa Username:docker}
	I0630 21:09:03.773250  244832 node_ready.go:35] waiting up to 6m0s for node "no-preload-20220630210237-9950" to be "Ready" ...
	I0630 21:09:03.773577  244832 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.76.1 host.minikube.internal\n           fallthrough\n        }' | sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0630 21:09:03.783470  244832 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49412 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/no-preload-20220630210237-9950/id_rsa Username:docker}
	I0630 21:09:03.784449  244832 node_ready.go:49] node "no-preload-20220630210237-9950" has status "Ready":"True"
	I0630 21:09:03.784473  244832 node_ready.go:38] duration metric: took 11.192291ms waiting for node "no-preload-20220630210237-9950" to be "Ready" ...
	I0630 21:09:03.784486  244832 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0630 21:09:03.791364  244832 addons.go:345] installing /etc/kubernetes/addons/storageclass.yaml
	I0630 21:09:03.791386  244832 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0630 21:09:03.791427  244832 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-20220630210237-9950
	I0630 21:09:03.830036  244832 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49412 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/no-preload-20220630210237-9950/id_rsa Username:docker}
	I0630 21:09:03.831021  244832 pod_ready.go:78] waiting up to 6m0s for pod "coredns-6d4b75cb6d-5qlzp" in "kube-system" namespace to be "Ready" ...
	I0630 21:09:03.938059  244832 addons.go:345] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
	I0630 21:09:03.938089  244832 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
	I0630 21:09:03.954468  244832 addons.go:345] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
	I0630 21:09:03.954500  244832 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
	I0630 21:09:04.045307  244832 addons.go:345] installing /etc/kubernetes/addons/dashboard-configmap.yaml
	I0630 21:09:04.045333  244832 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
	I0630 21:09:04.127108  244832 addons.go:345] installing /etc/kubernetes/addons/dashboard-dp.yaml
	I0630 21:09:04.127136  244832 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4196 bytes)
	I0630 21:09:04.149860  244832 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0630 21:09:04.150583  244832 addons.go:345] installing /etc/kubernetes/addons/dashboard-role.yaml
	I0630 21:09:04.150608  244832 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
	I0630 21:09:04.150939  244832 addons.go:345] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
	I0630 21:09:04.150956  244832 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1820 bytes)
	I0630 21:09:04.150956  244832 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 21:09:04.243546  244832 addons.go:345] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
	I0630 21:09:04.243634  244832 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
	I0630 21:09:04.247904  244832 addons.go:345] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
	I0630 21:09:04.247931  244832 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
	I0630 21:09:04.338186  244832 addons.go:345] installing /etc/kubernetes/addons/dashboard-sa.yaml
	I0630 21:09:04.338213  244832 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
	I0630 21:09:04.340356  244832 addons.go:345] installing /etc/kubernetes/addons/metrics-server-service.yaml
	I0630 21:09:04.340381  244832 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
	I0630 21:09:04.430136  244832 addons.go:345] installing /etc/kubernetes/addons/dashboard-secret.yaml
	I0630 21:09:04.430168  244832 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
	I0630 21:09:04.444956  244832 start.go:806] {"host.minikube.internal": 192.168.76.1} host record injected into CoreDNS
	I0630 21:09:04.455189  244832 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I0630 21:09:04.524569  244832 addons.go:345] installing /etc/kubernetes/addons/dashboard-svc.yaml
	I0630 21:09:04.524597  244832 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
	I0630 21:09:04.545502  244832 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	I0630 21:09:05.357803  244832 addons.go:383] Verifying addon metrics-server=true in "no-preload-20220630210237-9950"
	I0630 21:09:05.658440  244832 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (1.112884128s)
	I0630 21:09:05.660683  244832 out.go:177] * Enabled addons: default-storageclass, storage-provisioner, metrics-server, dashboard
	I0630 21:09:05.467925  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:07.966731  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:05.662129  244832 addons.go:414] enableAddons completed in 2.009750951s
	I0630 21:09:05.844463  244832 pod_ready.go:92] pod "coredns-6d4b75cb6d-5qlzp" in "kube-system" namespace has status "Ready":"True"
	I0630 21:09:05.844495  244832 pod_ready.go:81] duration metric: took 2.013440652s waiting for pod "coredns-6d4b75cb6d-5qlzp" in "kube-system" namespace to be "Ready" ...
	I0630 21:09:05.844506  244832 pod_ready.go:78] waiting up to 6m0s for pod "coredns-6d4b75cb6d-x4f86" in "kube-system" namespace to be "Ready" ...
	I0630 21:09:07.855520  244832 pod_ready.go:102] pod "coredns-6d4b75cb6d-x4f86" in "kube-system" namespace has status "Ready":"False"
	I0630 21:09:09.856096  244832 pod_ready.go:102] pod "coredns-6d4b75cb6d-x4f86" in "kube-system" namespace has status "Ready":"False"
	I0630 21:09:11.852406  244832 pod_ready.go:97] error getting pod "coredns-6d4b75cb6d-x4f86" in "kube-system" namespace (skipping!): pods "coredns-6d4b75cb6d-x4f86" not found
	I0630 21:09:11.852452  244832 pod_ready.go:81] duration metric: took 6.007939247s waiting for pod "coredns-6d4b75cb6d-x4f86" in "kube-system" namespace to be "Ready" ...
	E0630 21:09:11.852466  244832 pod_ready.go:66] WaitExtra: waitPodCondition: error getting pod "coredns-6d4b75cb6d-x4f86" in "kube-system" namespace (skipping!): pods "coredns-6d4b75cb6d-x4f86" not found
	I0630 21:09:11.852476  244832 pod_ready.go:78] waiting up to 6m0s for pod "etcd-no-preload-20220630210237-9950" in "kube-system" namespace to be "Ready" ...
	I0630 21:09:11.857931  244832 pod_ready.go:92] pod "etcd-no-preload-20220630210237-9950" in "kube-system" namespace has status "Ready":"True"
	I0630 21:09:11.857958  244832 pod_ready.go:81] duration metric: took 5.467697ms waiting for pod "etcd-no-preload-20220630210237-9950" in "kube-system" namespace to be "Ready" ...
	I0630 21:09:11.857974  244832 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-no-preload-20220630210237-9950" in "kube-system" namespace to be "Ready" ...
	I0630 21:09:11.863228  244832 pod_ready.go:92] pod "kube-apiserver-no-preload-20220630210237-9950" in "kube-system" namespace has status "Ready":"True"
	I0630 21:09:11.863249  244832 pod_ready.go:81] duration metric: took 5.267601ms waiting for pod "kube-apiserver-no-preload-20220630210237-9950" in "kube-system" namespace to be "Ready" ...
	I0630 21:09:11.863258  244832 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-no-preload-20220630210237-9950" in "kube-system" namespace to be "Ready" ...
	I0630 21:09:11.867810  244832 pod_ready.go:92] pod "kube-controller-manager-no-preload-20220630210237-9950" in "kube-system" namespace has status "Ready":"True"
	I0630 21:09:11.867829  244832 pod_ready.go:81] duration metric: took 4.564864ms waiting for pod "kube-controller-manager-no-preload-20220630210237-9950" in "kube-system" namespace to be "Ready" ...
	I0630 21:09:11.867838  244832 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-tvrsr" in "kube-system" namespace to be "Ready" ...
	I0630 21:09:11.872281  244832 pod_ready.go:92] pod "kube-proxy-tvrsr" in "kube-system" namespace has status "Ready":"True"
	I0630 21:09:11.872301  244832 pod_ready.go:81] duration metric: took 4.457626ms waiting for pod "kube-proxy-tvrsr" in "kube-system" namespace to be "Ready" ...
	I0630 21:09:11.872310  244832 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-no-preload-20220630210237-9950" in "kube-system" namespace to be "Ready" ...
	I0630 21:09:12.053039  244832 pod_ready.go:92] pod "kube-scheduler-no-preload-20220630210237-9950" in "kube-system" namespace has status "Ready":"True"
	I0630 21:09:12.053102  244832 pod_ready.go:81] duration metric: took 180.784597ms waiting for pod "kube-scheduler-no-preload-20220630210237-9950" in "kube-system" namespace to be "Ready" ...
	I0630 21:09:12.053114  244832 pod_ready.go:38] duration metric: took 8.268615647s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0630 21:09:12.053135  244832 api_server.go:51] waiting for apiserver process to appear ...
	I0630 21:09:12.053178  244832 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 21:09:12.063633  244832 api_server.go:71] duration metric: took 8.411278704s to wait for apiserver process to appear ...
	I0630 21:09:12.063665  244832 api_server.go:87] waiting for apiserver healthz status ...
	I0630 21:09:12.063679  244832 api_server.go:240] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
	I0630 21:09:12.068387  244832 api_server.go:266] https://192.168.76.2:8443/healthz returned 200:
	ok
	I0630 21:09:12.069257  244832 api_server.go:140] control plane version: v1.24.2
	I0630 21:09:12.069276  244832 api_server.go:130] duration metric: took 5.604247ms to wait for apiserver health ...
	I0630 21:09:12.069284  244832 system_pods.go:43] waiting for kube-system pods to appear ...
	I0630 21:09:12.256558  244832 system_pods.go:59] 9 kube-system pods found
	I0630 21:09:12.256591  244832 system_pods.go:61] "coredns-6d4b75cb6d-5qlzp" [8ba0dd4a-8ebf-4939-b707-1da4b243c067] Running
	I0630 21:09:12.256598  244832 system_pods.go:61] "etcd-no-preload-20220630210237-9950" [e63230b7-21b4-4a85-8582-07dc0a355237] Running
	I0630 21:09:12.256604  244832 system_pods.go:61] "kindnet-tcclk" [582c4926-4000-4d83-b1fe-59ff22076a33] Running
	I0630 21:09:12.256610  244832 system_pods.go:61] "kube-apiserver-no-preload-20220630210237-9950" [1cd86f63-3fb2-4e66-89b8-1216d397911b] Running
	I0630 21:09:12.256617  244832 system_pods.go:61] "kube-controller-manager-no-preload-20220630210237-9950" [84d2b5fb-12d4-47f8-b32b-fe7016eeefc0] Running
	I0630 21:09:12.256623  244832 system_pods.go:61] "kube-proxy-tvrsr" [5386550e-2fb7-4652-ab2b-4bcc71110442] Running
	I0630 21:09:12.256630  244832 system_pods.go:61] "kube-scheduler-no-preload-20220630210237-9950" [d03950fd-8252-480b-8eaf-0811287b74f0] Running
	I0630 21:09:12.256641  244832 system_pods.go:61] "metrics-server-5c6f97fb75-9mmw6" [7abb4bac-623a-494d-89c1-45f0fecc5034] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
	I0630 21:09:12.256657  244832 system_pods.go:61] "storage-provisioner" [7d5959da-fbe6-4605-ba9c-c06ea97b06fc] Running
	I0630 21:09:12.256665  244832 system_pods.go:74] duration metric: took 187.374212ms to wait for pod list to return data ...
	I0630 21:09:12.256679  244832 default_sa.go:34] waiting for default service account to be created ...
	I0630 21:09:12.452542  244832 default_sa.go:45] found service account: "default"
	I0630 21:09:12.452565  244832 default_sa.go:55] duration metric: took 195.876726ms for default service account to be created ...
	I0630 21:09:12.452572  244832 system_pods.go:116] waiting for k8s-apps to be running ...
	I0630 21:09:12.656499  244832 system_pods.go:86] 9 kube-system pods found
	I0630 21:09:12.656527  244832 system_pods.go:89] "coredns-6d4b75cb6d-5qlzp" [8ba0dd4a-8ebf-4939-b707-1da4b243c067] Running
	I0630 21:09:12.656535  244832 system_pods.go:89] "etcd-no-preload-20220630210237-9950" [e63230b7-21b4-4a85-8582-07dc0a355237] Running
	I0630 21:09:12.656539  244832 system_pods.go:89] "kindnet-tcclk" [582c4926-4000-4d83-b1fe-59ff22076a33] Running
	I0630 21:09:12.656544  244832 system_pods.go:89] "kube-apiserver-no-preload-20220630210237-9950" [1cd86f63-3fb2-4e66-89b8-1216d397911b] Running
	I0630 21:09:12.656549  244832 system_pods.go:89] "kube-controller-manager-no-preload-20220630210237-9950" [84d2b5fb-12d4-47f8-b32b-fe7016eeefc0] Running
	I0630 21:09:12.656553  244832 system_pods.go:89] "kube-proxy-tvrsr" [5386550e-2fb7-4652-ab2b-4bcc71110442] Running
	I0630 21:09:12.656557  244832 system_pods.go:89] "kube-scheduler-no-preload-20220630210237-9950" [d03950fd-8252-480b-8eaf-0811287b74f0] Running
	I0630 21:09:12.656564  244832 system_pods.go:89] "metrics-server-5c6f97fb75-9mmw6" [7abb4bac-623a-494d-89c1-45f0fecc5034] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
	I0630 21:09:12.656574  244832 system_pods.go:89] "storage-provisioner" [7d5959da-fbe6-4605-ba9c-c06ea97b06fc] Running
	I0630 21:09:12.656584  244832 system_pods.go:126] duration metric: took 204.007805ms to wait for k8s-apps to be running ...
	I0630 21:09:12.656590  244832 system_svc.go:44] waiting for kubelet service to be running ....
	I0630 21:09:12.656635  244832 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 21:09:12.666895  244832 system_svc.go:56] duration metric: took 10.297711ms WaitForService to wait for kubelet.
	I0630 21:09:12.666924  244832 kubeadm.go:572] duration metric: took 9.014585325s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...
	I0630 21:09:12.666953  244832 node_conditions.go:102] verifying NodePressure condition ...
	I0630 21:09:12.853845  244832 node_conditions.go:122] node storage ephemeral capacity is 304695084Ki
	I0630 21:09:12.853871  244832 node_conditions.go:123] node cpu capacity is 8
	I0630 21:09:12.853885  244832 node_conditions.go:105] duration metric: took 186.925675ms to run NodePressure ...
	I0630 21:09:12.853896  244832 start.go:213] waiting for startup goroutines ...
	I0630 21:09:12.893905  244832 start.go:506] kubectl: 1.24.2, cluster: 1.24.2 (minor skew: 0)
	I0630 21:09:12.896835  244832 out.go:177] * Done! kubectl is now configured to use "no-preload-20220630210237-9950" cluster and "default" namespace by default
	I0630 21:09:09.967028  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:12.465824  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:14.466500  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:16.965412  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:18.966550  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:21.466374  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:23.966485  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:26.465447  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:28.466230  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:30.965905  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:33.466059  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:35.966260  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:38.465665  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:40.965367  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:42.966136  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:45.465020  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:47.466000  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:49.966235  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:52.465731  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:54.466083  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:56.966015  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:09:59.465658  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:01.465723  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:03.966642  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:06.466307  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:08.966212  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:11.465475  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:13.966074  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:15.966429  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:18.465535  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:20.465595  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:22.965577  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:24.965831  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:26.966289  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:29.466080  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:31.965740  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:34.465640  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:36.965286  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:39.465425  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:41.965521  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:43.966398  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:46.465344  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:48.965232  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:50.966164  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:53.465622  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:55.965628  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:10:58.465311  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:00.465929  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:02.465978  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:04.965401  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:06.965666  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:08.965779  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:10.966125  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:13.465399  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:15.465878  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:17.466180  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:19.966091  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:22.465421  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:24.465623  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:26.466188  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:28.965893  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:31.465563  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:33.966393  258418 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:11:35.467568  258418 node_ready.go:38] duration metric: took 4m0.008553357s waiting for node "embed-certs-20220630210659-9950" to be "Ready" ...
	I0630 21:11:35.469705  258418 out.go:177] 
	W0630 21:11:35.471092  258418 out.go:239] X Exiting due to GUEST_START: wait 6m0s for node: waiting for node to be ready: waitNodeCondition: timed out waiting for the condition
	W0630 21:11:35.471111  258418 out.go:239] * 
	W0630 21:11:35.471814  258418 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0630 21:11:35.473349  258418 out.go:177] 
	
	* 
	* ==> container status <==
	* CONTAINER           IMAGE               CREATED              STATE               NAME                      ATTEMPT             POD ID
	ab6ea81818145       6fb66cd78abfe       About a minute ago   Running             kindnet-cni               1                   7fc20cc54e9dd
	abb09f5935beb       6fb66cd78abfe       4 minutes ago        Exited              kindnet-cni               0                   7fc20cc54e9dd
	8341041be1bdb       a634548d10b03       4 minutes ago        Running             kube-proxy                0                   3f9b2696c23cf
	157c2b0c199b6       d3377ffb7177c       4 minutes ago        Running             kube-apiserver            0                   529084b2bca78
	ccc3bef31fe3f       5d725196c1f47       4 minutes ago        Running             kube-scheduler            0                   1d1f80645e258
	d56e346d0980d       aebe758cef4cd       4 minutes ago        Running             etcd                      0                   db374d07bb628
	7734f08ca2670       34cdf99b1bb3b       4 minutes ago        Running             kube-controller-manager   0                   8db8d6937f223
	
	* 
	* ==> containerd <==
	* -- Logs begin at Thu 2022-06-30 21:07:08 UTC, end at Thu 2022-06-30 21:11:36 UTC. --
	Jun 30 21:07:35 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:07:35.352970401Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
	Jun 30 21:07:35 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:07:35.352984868Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
	Jun 30 21:07:35 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:07:35.353223191Z" level=info msg="starting signal loop" namespace=k8s.io path=/run/containerd/io.containerd.runtime.v2.task/k8s.io/7fc20cc54e9dd3e3e5cefee272490af70d0f9c8c9cd77f065c7a4450e9d1efab pid=1711 runtime=io.containerd.runc.v2
	Jun 30 21:07:35 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:07:35.353597858Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1
	Jun 30 21:07:35 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:07:35.353683326Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
	Jun 30 21:07:35 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:07:35.353698430Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
	Jun 30 21:07:35 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:07:35.353902991Z" level=info msg="starting signal loop" namespace=k8s.io path=/run/containerd/io.containerd.runtime.v2.task/k8s.io/3f9b2696c23cf643ce03cc7975b2aa93361d5268b6a955de2e974cf0dc70b4a6 pid=1712 runtime=io.containerd.runc.v2
	Jun 30 21:07:35 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:07:35.449744812Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kube-proxy-jhw4d,Uid:78ec1767-ed48-4f50-ab14-61149fad7e98,Namespace:kube-system,Attempt:0,} returns sandbox id \"3f9b2696c23cf643ce03cc7975b2aa93361d5268b6a955de2e974cf0dc70b4a6\""
	Jun 30 21:07:35 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:07:35.457038878Z" level=info msg="CreateContainer within sandbox \"3f9b2696c23cf643ce03cc7975b2aa93361d5268b6a955de2e974cf0dc70b4a6\" for container &ContainerMetadata{Name:kube-proxy,Attempt:0,}"
	Jun 30 21:07:35 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:07:35.475826418Z" level=info msg="CreateContainer within sandbox \"3f9b2696c23cf643ce03cc7975b2aa93361d5268b6a955de2e974cf0dc70b4a6\" for &ContainerMetadata{Name:kube-proxy,Attempt:0,} returns container id \"8341041be1bdbcf0e0425bd1832777e15b2ed89bf8696d0c78d14301820032c3\""
	Jun 30 21:07:35 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:07:35.476612663Z" level=info msg="StartContainer for \"8341041be1bdbcf0e0425bd1832777e15b2ed89bf8696d0c78d14301820032c3\""
	Jun 30 21:07:35 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:07:35.646046702Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kindnet-z7fgt,Uid:9d385a59-b071-48be-b547-db80254669bc,Namespace:kube-system,Attempt:0,} returns sandbox id \"7fc20cc54e9dd3e3e5cefee272490af70d0f9c8c9cd77f065c7a4450e9d1efab\""
	Jun 30 21:07:35 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:07:35.649331378Z" level=info msg="CreateContainer within sandbox \"7fc20cc54e9dd3e3e5cefee272490af70d0f9c8c9cd77f065c7a4450e9d1efab\" for container &ContainerMetadata{Name:kindnet-cni,Attempt:0,}"
	Jun 30 21:07:35 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:07:35.738160897Z" level=info msg="CreateContainer within sandbox \"7fc20cc54e9dd3e3e5cefee272490af70d0f9c8c9cd77f065c7a4450e9d1efab\" for &ContainerMetadata{Name:kindnet-cni,Attempt:0,} returns container id \"abb09f5935beb00881f3602ea9862dad633795ee2a89e31fd20cac6202fb8749\""
	Jun 30 21:07:35 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:07:35.738829113Z" level=info msg="StartContainer for \"abb09f5935beb00881f3602ea9862dad633795ee2a89e31fd20cac6202fb8749\""
	Jun 30 21:07:35 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:07:35.739174990Z" level=info msg="StartContainer for \"8341041be1bdbcf0e0425bd1832777e15b2ed89bf8696d0c78d14301820032c3\" returns successfully"
	Jun 30 21:07:36 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:07:36.050203324Z" level=info msg="StartContainer for \"abb09f5935beb00881f3602ea9862dad633795ee2a89e31fd20cac6202fb8749\" returns successfully"
	Jun 30 21:10:16 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:10:16.483475570Z" level=info msg="shim disconnected" id=abb09f5935beb00881f3602ea9862dad633795ee2a89e31fd20cac6202fb8749
	Jun 30 21:10:16 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:10:16.483540720Z" level=warning msg="cleaning up after shim disconnected" id=abb09f5935beb00881f3602ea9862dad633795ee2a89e31fd20cac6202fb8749 namespace=k8s.io
	Jun 30 21:10:16 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:10:16.483561263Z" level=info msg="cleaning up dead shim"
	Jun 30 21:10:16 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:10:16.493684645Z" level=warning msg="cleanup warnings time=\"2022-06-30T21:10:16Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=2102 runtime=io.containerd.runc.v2\n"
	Jun 30 21:10:16 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:10:16.852995702Z" level=info msg="CreateContainer within sandbox \"7fc20cc54e9dd3e3e5cefee272490af70d0f9c8c9cd77f065c7a4450e9d1efab\" for container &ContainerMetadata{Name:kindnet-cni,Attempt:1,}"
	Jun 30 21:10:16 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:10:16.867007542Z" level=info msg="CreateContainer within sandbox \"7fc20cc54e9dd3e3e5cefee272490af70d0f9c8c9cd77f065c7a4450e9d1efab\" for &ContainerMetadata{Name:kindnet-cni,Attempt:1,} returns container id \"ab6ea818181456a82b827f8508aa0a7fd54e93aafe963afa8bec216aa0475af1\""
	Jun 30 21:10:16 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:10:16.867682377Z" level=info msg="StartContainer for \"ab6ea818181456a82b827f8508aa0a7fd54e93aafe963afa8bec216aa0475af1\""
	Jun 30 21:10:16 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:10:16.944387233Z" level=info msg="StartContainer for \"ab6ea818181456a82b827f8508aa0a7fd54e93aafe963afa8bec216aa0475af1\" returns successfully"
	
	* 
	* ==> describe nodes <==
	* Name:               embed-certs-20220630210659-9950
	Roles:              control-plane
	Labels:             beta.kubernetes.io/arch=amd64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=amd64
	                    kubernetes.io/hostname=embed-certs-20220630210659-9950
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=251ffcec0e4c997cd7732864187747cc579943c9
	                    minikube.k8s.io/name=embed-certs-20220630210659-9950
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2022_06_30T21_07_23_0700
	                    minikube.k8s.io/version=v1.26.0
	                    node-role.kubernetes.io/control-plane=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///run/containerd/containerd.sock
	                    node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Thu, 30 Jun 2022 21:07:19 +0000
	Taints:             node.kubernetes.io/not-ready:NoSchedule
	Unschedulable:      false
	Lease:
	  HolderIdentity:  embed-certs-20220630210659-9950
	  AcquireTime:     <unset>
	  RenewTime:       Thu, 30 Jun 2022 21:11:27 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Thu, 30 Jun 2022 21:07:32 +0000   Thu, 30 Jun 2022 21:07:16 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Thu, 30 Jun 2022 21:07:32 +0000   Thu, 30 Jun 2022 21:07:16 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Thu, 30 Jun 2022 21:07:32 +0000   Thu, 30 Jun 2022 21:07:16 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            False   Thu, 30 Jun 2022 21:07:32 +0000   Thu, 30 Jun 2022 21:07:16 +0000   KubeletNotReady              container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Addresses:
	  InternalIP:  192.168.94.2
	  Hostname:    embed-certs-20220630210659-9950
	Capacity:
	  cpu:                8
	  ephemeral-storage:  304695084Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32873488Ki
	  pods:               110
	Allocatable:
	  cpu:                8
	  ephemeral-storage:  304695084Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32873488Ki
	  pods:               110
	System Info:
	  Machine ID:                 bbe1e1cef6e940328962dca52b3c5731
	  System UUID:                e149cbc8-bbc1-4888-b53f-97553d30d981
	  Boot ID:                    471c4729-f046-4a15-bc49-46f3ad561708
	  Kernel Version:             5.15.0-1012-gcp
	  OS Image:                   Ubuntu 20.04.4 LTS
	  Operating System:           linux
	  Architecture:               amd64
	  Container Runtime Version:  containerd://1.6.6
	  Kubelet Version:            v1.24.2
	  Kube-Proxy Version:         v1.24.2
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (6 in total)
	  Namespace                   Name                                                       CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                                       ------------  ----------  ---------------  -------------  ---
	  kube-system                 etcd-embed-certs-20220630210659-9950                       100m (1%!)(MISSING)     0 (0%!)(MISSING)      100Mi (0%!)(MISSING)       0 (0%!)(MISSING)         4m14s
	  kube-system                 kindnet-z7fgt                                              100m (1%!)(MISSING)     100m (1%!)(MISSING)   50Mi (0%!)(MISSING)        50Mi (0%!)(MISSING)      4m2s
	  kube-system                 kube-apiserver-embed-certs-20220630210659-9950             250m (3%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m14s
	  kube-system                 kube-controller-manager-embed-certs-20220630210659-9950    200m (2%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m14s
	  kube-system                 kube-proxy-jhw4d                                           0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m2s
	  kube-system                 kube-scheduler-embed-certs-20220630210659-9950             100m (1%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m14s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                750m (9%!)(MISSING)   100m (1%!)(MISSING)
	  memory             150Mi (0%!)(MISSING)  50Mi (0%!)(MISSING)
	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	Events:
	  Type    Reason                   Age                    From             Message
	  ----    ------                   ----                   ----             -------
	  Normal  Starting                 4m                     kube-proxy       
	  Normal  NodeHasSufficientMemory  4m21s (x5 over 4m22s)  kubelet          Node embed-certs-20220630210659-9950 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    4m21s (x5 over 4m22s)  kubelet          Node embed-certs-20220630210659-9950 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     4m21s (x4 over 4m22s)  kubelet          Node embed-certs-20220630210659-9950 status is now: NodeHasSufficientPID
	  Normal  NodeHasNoDiskPressure    4m14s                  kubelet          Node embed-certs-20220630210659-9950 status is now: NodeHasNoDiskPressure
	  Normal  Starting                 4m14s                  kubelet          Starting kubelet.
	  Normal  NodeHasSufficientMemory  4m14s                  kubelet          Node embed-certs-20220630210659-9950 status is now: NodeHasSufficientMemory
	  Normal  NodeHasSufficientPID     4m14s                  kubelet          Node embed-certs-20220630210659-9950 status is now: NodeHasSufficientPID
	  Normal  NodeAllocatableEnforced  4m14s                  kubelet          Updated Node Allocatable limit across pods
	  Normal  RegisteredNode           4m2s                   node-controller  Node embed-certs-20220630210659-9950 event: Registered Node embed-certs-20220630210659-9950 in Controller
	
	* 
	* ==> dmesg <==
	* [  +2.939825] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000011] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.027789] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.019913] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[ +21.968090] IPv4: martian destination 127.0.0.11 from 10.244.0.3, dev veth8071d138
	[ +25.445872] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.029436] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.023957] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +2.947695] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[Jun30 21:05] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.023879] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +2.955783] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.011828] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000005] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.027896] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	
	* 
	* ==> etcd [d56e346d0980d838b9cd42c94d9e084ef84bb0fdeb4316ae2dd5c8a25cc054a1] <==
	* {"level":"info","ts":"2022-06-30T21:07:15.945Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"dfc97eb0aae75b33 switched to configuration voters=(16125559238023404339)"}
	{"level":"info","ts":"2022-06-30T21:07:15.945Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"da400bbece288f5a","local-member-id":"dfc97eb0aae75b33","added-peer-id":"dfc97eb0aae75b33","added-peer-peer-urls":["https://192.168.94.2:2380"]}
	{"level":"info","ts":"2022-06-30T21:07:15.947Z","caller":"embed/etcd.go:688","msg":"starting with client TLS","tls-info":"cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, client-cert=, client-key=, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = ","cipher-suites":[]}
	{"level":"info","ts":"2022-06-30T21:07:15.948Z","caller":"embed/etcd.go:277","msg":"now serving peer/client/metrics","local-member-id":"dfc97eb0aae75b33","initial-advertise-peer-urls":["https://192.168.94.2:2380"],"listen-peer-urls":["https://192.168.94.2:2380"],"advertise-client-urls":["https://192.168.94.2:2379"],"listen-client-urls":["https://127.0.0.1:2379","https://192.168.94.2:2379"],"listen-metrics-urls":["http://127.0.0.1:2381"]}
	{"level":"info","ts":"2022-06-30T21:07:15.948Z","caller":"embed/etcd.go:581","msg":"serving peer traffic","address":"192.168.94.2:2380"}
	{"level":"info","ts":"2022-06-30T21:07:15.948Z","caller":"embed/etcd.go:763","msg":"serving metrics","address":"http://127.0.0.1:2381"}
	{"level":"info","ts":"2022-06-30T21:07:15.948Z","caller":"embed/etcd.go:553","msg":"cmux::serve","address":"192.168.94.2:2380"}
	{"level":"info","ts":"2022-06-30T21:07:16.036Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"dfc97eb0aae75b33 is starting a new election at term 1"}
	{"level":"info","ts":"2022-06-30T21:07:16.036Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"dfc97eb0aae75b33 became pre-candidate at term 1"}
	{"level":"info","ts":"2022-06-30T21:07:16.036Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"dfc97eb0aae75b33 received MsgPreVoteResp from dfc97eb0aae75b33 at term 1"}
	{"level":"info","ts":"2022-06-30T21:07:16.036Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"dfc97eb0aae75b33 became candidate at term 2"}
	{"level":"info","ts":"2022-06-30T21:07:16.036Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"dfc97eb0aae75b33 received MsgVoteResp from dfc97eb0aae75b33 at term 2"}
	{"level":"info","ts":"2022-06-30T21:07:16.036Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"dfc97eb0aae75b33 became leader at term 2"}
	{"level":"info","ts":"2022-06-30T21:07:16.036Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: dfc97eb0aae75b33 elected leader dfc97eb0aae75b33 at term 2"}
	{"level":"info","ts":"2022-06-30T21:07:16.036Z","caller":"etcdserver/server.go:2507","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}
	{"level":"info","ts":"2022-06-30T21:07:16.036Z","caller":"etcdserver/server.go:2042","msg":"published local member to cluster through raft","local-member-id":"dfc97eb0aae75b33","local-member-attributes":"{Name:embed-certs-20220630210659-9950 ClientURLs:[https://192.168.94.2:2379]}","request-path":"/0/members/dfc97eb0aae75b33/attributes","cluster-id":"da400bbece288f5a","publish-timeout":"7s"}
	{"level":"info","ts":"2022-06-30T21:07:16.036Z","caller":"embed/serve.go:98","msg":"ready to serve client requests"}
	{"level":"info","ts":"2022-06-30T21:07:16.036Z","caller":"embed/serve.go:98","msg":"ready to serve client requests"}
	{"level":"info","ts":"2022-06-30T21:07:16.037Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
	{"level":"info","ts":"2022-06-30T21:07:16.037Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
	{"level":"info","ts":"2022-06-30T21:07:16.037Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"da400bbece288f5a","local-member-id":"dfc97eb0aae75b33","cluster-version":"3.5"}
	{"level":"info","ts":"2022-06-30T21:07:16.037Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
	{"level":"info","ts":"2022-06-30T21:07:16.037Z","caller":"etcdserver/server.go:2531","msg":"cluster version is updated","cluster-version":"3.5"}
	{"level":"info","ts":"2022-06-30T21:07:16.038Z","caller":"embed/serve.go:188","msg":"serving client traffic securely","address":"127.0.0.1:2379"}
	{"level":"info","ts":"2022-06-30T21:07:16.038Z","caller":"embed/serve.go:188","msg":"serving client traffic securely","address":"192.168.94.2:2379"}
	
	* 
	* ==> kernel <==
	*  21:11:36 up 54 min,  0 users,  load average: 0.68, 1.12, 1.67
	Linux embed-certs-20220630210659-9950 5.15.0-1012-gcp #17~20.04.1-Ubuntu SMP Thu Jun 23 16:10:34 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
	PRETTY_NAME="Ubuntu 20.04.4 LTS"
	
	* 
	* ==> kube-apiserver [157c2b0c199b65e53b31cbc33bd298586d30106a66d587ee22f9c486df45d1ba] <==
	* I0630 21:07:19.225159       1 cache.go:39] Caches are synced for APIServiceRegistrationController controller
	I0630 21:07:19.225172       1 cache.go:39] Caches are synced for autoregister controller
	I0630 21:07:19.229589       1 controller.go:611] quota admission added evaluator for: namespaces
	I0630 21:07:19.267453       1 apf_controller.go:322] Running API Priority and Fairness config worker
	I0630 21:07:19.268797       1 cache.go:39] Caches are synced for AvailableConditionController controller
	I0630 21:07:19.272028       1 shared_informer.go:262] Caches are synced for crd-autoregister
	I0630 21:07:19.327812       1 shared_informer.go:262] Caches are synced for node_authorizer
	I0630 21:07:19.793196       1 controller.go:132] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).
	I0630 21:07:20.081878       1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000
	I0630 21:07:20.085097       1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000
	I0630 21:07:20.085124       1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.
	I0630 21:07:20.500795       1 controller.go:611] quota admission added evaluator for: roles.rbac.authorization.k8s.io
	I0630 21:07:20.554121       1 controller.go:611] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
	I0630 21:07:20.649489       1 alloc.go:327] "allocated clusterIPs" service="default/kubernetes" clusterIPs=map[IPv4:10.96.0.1]
	W0630 21:07:20.655776       1 lease.go:234] Resetting endpoints for master service "kubernetes" to [192.168.94.2]
	I0630 21:07:20.656777       1 controller.go:611] quota admission added evaluator for: endpoints
	I0630 21:07:20.660110       1 controller.go:611] quota admission added evaluator for: endpointslices.discovery.k8s.io
	I0630 21:07:21.241414       1 controller.go:611] quota admission added evaluator for: serviceaccounts
	I0630 21:07:22.286912       1 controller.go:611] quota admission added evaluator for: deployments.apps
	I0630 21:07:22.296519       1 alloc.go:327] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs=map[IPv4:10.96.0.10]
	I0630 21:07:22.305814       1 controller.go:611] quota admission added evaluator for: daemonsets.apps
	I0630 21:07:22.430261       1 controller.go:611] quota admission added evaluator for: leases.coordination.k8s.io
	I0630 21:07:34.975370       1 controller.go:611] quota admission added evaluator for: controllerrevisions.apps
	I0630 21:07:35.000925       1 controller.go:611] quota admission added evaluator for: replicasets.apps
	I0630 21:07:36.039694       1 controller.go:611] quota admission added evaluator for: events.events.k8s.io
	
	* 
	* ==> kube-controller-manager [7734f08ca26708ce34ae224077718432c05bc3133a11bb3d600a7d29c4df0045] <==
	* I0630 21:07:34.940748       1 shared_informer.go:262] Caches are synced for PVC protection
	I0630 21:07:34.940779       1 shared_informer.go:262] Caches are synced for endpoint
	I0630 21:07:34.940788       1 shared_informer.go:262] Caches are synced for attach detach
	I0630 21:07:34.940728       1 shared_informer.go:262] Caches are synced for stateful set
	I0630 21:07:34.940864       1 shared_informer.go:262] Caches are synced for GC
	I0630 21:07:34.942018       1 shared_informer.go:262] Caches are synced for persistent volume
	I0630 21:07:34.955637       1 shared_informer.go:262] Caches are synced for resource quota
	I0630 21:07:34.964899       1 shared_informer.go:262] Caches are synced for daemon sets
	I0630 21:07:34.969897       1 shared_informer.go:262] Caches are synced for job
	I0630 21:07:34.980424       1 event.go:294] "Event occurred" object="kube-system/kube-proxy" fieldPath="" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-jhw4d"
	I0630 21:07:34.982490       1 event.go:294] "Event occurred" object="kube-system/kindnet" fieldPath="" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kindnet-z7fgt"
	I0630 21:07:34.988369       1 shared_informer.go:262] Caches are synced for endpoint_slice
	I0630 21:07:34.990561       1 shared_informer.go:262] Caches are synced for ephemeral
	I0630 21:07:34.991707       1 shared_informer.go:262] Caches are synced for taint
	I0630 21:07:34.991768       1 shared_informer.go:262] Caches are synced for deployment
	I0630 21:07:34.991797       1 node_lifecycle_controller.go:1399] Initializing eviction metric for zone: 
	I0630 21:07:34.991839       1 taint_manager.go:187] "Starting NoExecuteTaintManager"
	W0630 21:07:34.991867       1 node_lifecycle_controller.go:1014] Missing timestamp for Node embed-certs-20220630210659-9950. Assuming now as a timestamp.
	I0630 21:07:34.991912       1 node_lifecycle_controller.go:1165] Controller detected that all Nodes are not-Ready. Entering master disruption mode.
	I0630 21:07:34.991954       1 event.go:294] "Event occurred" object="embed-certs-20220630210659-9950" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node embed-certs-20220630210659-9950 event: Registered Node embed-certs-20220630210659-9950 in Controller"
	I0630 21:07:35.002644       1 event.go:294] "Event occurred" object="kube-system/coredns" fieldPath="" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-6d4b75cb6d to 1"
	I0630 21:07:35.099654       1 event.go:294] "Event occurred" object="kube-system/coredns-6d4b75cb6d" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-6d4b75cb6d-87dwf"
	I0630 21:07:35.374123       1 shared_informer.go:262] Caches are synced for garbage collector
	I0630 21:07:35.396784       1 shared_informer.go:262] Caches are synced for garbage collector
	I0630 21:07:35.396818       1 garbagecollector.go:158] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
	
	* 
	* ==> kube-proxy [8341041be1bdbcf0e0425bd1832777e15b2ed89bf8696d0c78d14301820032c3] <==
	* I0630 21:07:35.930193       1 node.go:163] Successfully retrieved node IP: 192.168.94.2
	I0630 21:07:35.930280       1 server_others.go:138] "Detected node IP" address="192.168.94.2"
	I0630 21:07:35.930318       1 server_others.go:578] "Unknown proxy mode, assuming iptables proxy" proxyMode=""
	I0630 21:07:36.035407       1 server_others.go:206] "Using iptables Proxier"
	I0630 21:07:36.035471       1 server_others.go:213] "kube-proxy running in dual-stack mode" ipFamily=IPv4
	I0630 21:07:36.035484       1 server_others.go:214] "Creating dualStackProxier for iptables"
	I0630 21:07:36.035502       1 server_others.go:501] "Detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, , defaulting to no-op detect-local for IPv6"
	I0630 21:07:36.035532       1 proxier.go:259] "Setting route_localnet=1, use nodePortAddresses to filter loopback addresses for NodePorts to skip it https://issues.k8s.io/90259"
	I0630 21:07:36.035701       1 proxier.go:259] "Setting route_localnet=1, use nodePortAddresses to filter loopback addresses for NodePorts to skip it https://issues.k8s.io/90259"
	I0630 21:07:36.035995       1 server.go:661] "Version info" version="v1.24.2"
	I0630 21:07:36.036014       1 server.go:663] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
	I0630 21:07:36.036550       1 config.go:317] "Starting service config controller"
	I0630 21:07:36.036571       1 shared_informer.go:255] Waiting for caches to sync for service config
	I0630 21:07:36.036594       1 config.go:444] "Starting node config controller"
	I0630 21:07:36.036598       1 shared_informer.go:255] Waiting for caches to sync for node config
	I0630 21:07:36.036750       1 config.go:226] "Starting endpoint slice config controller"
	I0630 21:07:36.036770       1 shared_informer.go:255] Waiting for caches to sync for endpoint slice config
	I0630 21:07:36.137118       1 shared_informer.go:262] Caches are synced for endpoint slice config
	I0630 21:07:36.137139       1 shared_informer.go:262] Caches are synced for service config
	I0630 21:07:36.137113       1 shared_informer.go:262] Caches are synced for node config
	
	* 
	* ==> kube-scheduler [ccc3bef31fe3faba9ff6daab0d5ca071fed6adb37d8cc554c7399ac599691557] <==
	* W0630 21:07:19.234494       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	E0630 21:07:19.235636       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	W0630 21:07:19.234110       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	E0630 21:07:19.235666       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	W0630 21:07:19.234672       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E0630 21:07:19.235716       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	W0630 21:07:19.234671       1 reflector.go:324] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	E0630 21:07:19.235796       1 reflector.go:138] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	W0630 21:07:19.234818       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0630 21:07:19.235858       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	W0630 21:07:19.234955       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E0630 21:07:19.235883       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	W0630 21:07:19.234128       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	E0630 21:07:19.235898       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	W0630 21:07:20.099241       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E0630 21:07:20.099281       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	W0630 21:07:20.186118       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E0630 21:07:20.186155       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	W0630 21:07:20.247542       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	E0630 21:07:20.247580       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	W0630 21:07:20.264775       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E0630 21:07:20.264809       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	W0630 21:07:20.394978       1 reflector.go:324] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	E0630 21:07:20.395035       1 reflector.go:138] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	I0630 21:07:23.232820       1 shared_informer.go:262] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	
	* 
	* ==> kubelet <==
	* -- Logs begin at Thu 2022-06-30 21:07:08 UTC, end at Thu 2022-06-30 21:11:36 UTC. --
	Jun 30 21:09:37 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:09:37.677034    1338 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:09:42 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:09:42.678883    1338 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:09:47 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:09:47.680533    1338 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:09:52 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:09:52.681495    1338 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:09:57 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:09:57.683276    1338 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:10:02 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:10:02.684439    1338 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:10:07 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:10:07.685218    1338 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:10:12 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:10:12.686967    1338 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:10:16 embed-certs-20220630210659-9950 kubelet[1338]: I0630 21:10:16.850800    1338 scope.go:110] "RemoveContainer" containerID="abb09f5935beb00881f3602ea9862dad633795ee2a89e31fd20cac6202fb8749"
	Jun 30 21:10:17 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:10:17.688481    1338 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:10:22 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:10:22.689430    1338 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:10:27 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:10:27.690187    1338 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:10:32 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:10:32.691513    1338 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:10:37 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:10:37.692241    1338 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:10:42 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:10:42.693664    1338 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:10:47 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:10:47.695064    1338 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:10:52 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:10:52.696132    1338 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:10:57 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:10:57.697793    1338 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:11:02 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:11:02.698934    1338 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:11:07 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:11:07.700388    1338 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:11:12 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:11:12.701792    1338 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:11:17 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:11:17.702828    1338 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:11:22 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:11:22.704478    1338 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:11:27 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:11:27.705883    1338 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:11:32 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:11:32.706754    1338 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	

                                                
                                                
-- /stdout --
helpers_test.go:254: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p embed-certs-20220630210659-9950 -n embed-certs-20220630210659-9950
helpers_test.go:261: (dbg) Run:  kubectl --context embed-certs-20220630210659-9950 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:270: non-running pods: coredns-6d4b75cb6d-87dwf storage-provisioner
helpers_test.go:272: ======> post-mortem[TestStartStop/group/embed-certs/serial/FirstStart]: describe non-running pods <======
helpers_test.go:275: (dbg) Run:  kubectl --context embed-certs-20220630210659-9950 describe pod coredns-6d4b75cb6d-87dwf storage-provisioner
helpers_test.go:275: (dbg) Non-zero exit: kubectl --context embed-certs-20220630210659-9950 describe pod coredns-6d4b75cb6d-87dwf storage-provisioner: exit status 1 (53.887564ms)

                                                
                                                
** stderr ** 
	Error from server (NotFound): pods "coredns-6d4b75cb6d-87dwf" not found
	Error from server (NotFound): pods "storage-provisioner" not found

                                                
                                                
** /stderr **
helpers_test.go:277: kubectl --context embed-certs-20220630210659-9950 describe pod coredns-6d4b75cb6d-87dwf storage-provisioner: exit status 1
--- FAIL: TestStartStop/group/embed-certs/serial/FirstStart (277.77s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-different-port/serial/DeployApp (484.65s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-different-port/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context default-k8s-different-port-20220630210335-9950 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/default-k8s-different-port/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:342: "busybox" [62fb22e6-eed2-41eb-b19c-06eb0bb0c9d0] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.)
E0630 21:08:30.280182    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/functional-20220630202638-9950/client.crt: no such file or directory
E0630 21:08:50.204102    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/addons-20220630202117-9950/client.crt: no such file or directory
E0630 21:08:50.314491    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/ingress-addon-legacy-20220630202923-9950/client.crt: no such file or directory
E0630 21:09:10.954332    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/bridge-20220630204858-9950/client.crt: no such file or directory

                                                
                                                
=== CONT  TestStartStop/group/default-k8s-different-port/serial/DeployApp
start_stop_delete_test.go:196: ***** TestStartStop/group/default-k8s-different-port/serial/DeployApp: pod "integration-test=busybox" failed to start within 8m0s: timed out waiting for the condition ****
start_stop_delete_test.go:196: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p default-k8s-different-port-20220630210335-9950 -n default-k8s-different-port-20220630210335-9950
start_stop_delete_test.go:196: TestStartStop/group/default-k8s-different-port/serial/DeployApp: showing logs for failed pods as of 2022-06-30 21:16:25.785377976 +0000 UTC m=+3334.024516226
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context default-k8s-different-port-20220630210335-9950 describe po busybox -n default
start_stop_delete_test.go:196: (dbg) kubectl --context default-k8s-different-port-20220630210335-9950 describe po busybox -n default:
Name:         busybox
Namespace:    default
Priority:     0
Node:         <none>
Labels:       integration-test=busybox
Annotations:  <none>
Status:       Pending
IP:           
IPs:          <none>
Containers:
busybox:
Image:      gcr.io/k8s-minikube/busybox:1.28.4-glibc
Port:       <none>
Host Port:  <none>
Command:
sleep
3600
Environment:  <none>
Mounts:
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-kr2bz (ro)
Conditions:
Type           Status
PodScheduled   False 
Volumes:
kube-api-access-kr2bz:
Type:                    Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds:  3607
ConfigMapName:           kube-root-ca.crt
ConfigMapOptional:       <nil>
DownwardAPI:             true
QoS Class:                   BestEffort
Node-Selectors:              <none>
Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type     Reason            Age                 From               Message
----     ------            ----                ----               -------
Warning  FailedScheduling  2m45s (x2 over 8m)  default-scheduler  0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context default-k8s-different-port-20220630210335-9950 logs busybox -n default
start_stop_delete_test.go:196: (dbg) kubectl --context default-k8s-different-port-20220630210335-9950 logs busybox -n default:
start_stop_delete_test.go:196: wait: integration-test=busybox within 8m0s: timed out waiting for the condition
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestStartStop/group/default-k8s-different-port/serial/DeployApp]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect default-k8s-different-port-20220630210335-9950
helpers_test.go:235: (dbg) docker inspect default-k8s-different-port-20220630210335-9950:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "99f8da15dcfc83187a1db4c0b15dfeb5920d55fd52718f4f99a491d1ec9f59fc",
	        "Created": "2022-06-30T21:03:43.366289202Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 243225,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2022-06-30T21:03:43.749415396Z",
	            "FinishedAt": "0001-01-01T00:00:00Z"
	        },
	        "Image": "sha256:573e7be5768273a7845baee1ae90fa2e33b83b10a7fbb0f0f41efbf29b53d1f1",
	        "ResolvConfPath": "/var/lib/docker/containers/99f8da15dcfc83187a1db4c0b15dfeb5920d55fd52718f4f99a491d1ec9f59fc/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/99f8da15dcfc83187a1db4c0b15dfeb5920d55fd52718f4f99a491d1ec9f59fc/hostname",
	        "HostsPath": "/var/lib/docker/containers/99f8da15dcfc83187a1db4c0b15dfeb5920d55fd52718f4f99a491d1ec9f59fc/hosts",
	        "LogPath": "/var/lib/docker/containers/99f8da15dcfc83187a1db4c0b15dfeb5920d55fd52718f4f99a491d1ec9f59fc/99f8da15dcfc83187a1db4c0b15dfeb5920d55fd52718f4f99a491d1ec9f59fc-json.log",
	        "Name": "/default-k8s-different-port-20220630210335-9950",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "default-k8s-different-port-20220630210335-9950:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "default-k8s-different-port-20220630210335-9950",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8444/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 2306867200,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": null,
	            "BlkioDeviceWriteBps": null,
	            "BlkioDeviceReadIOps": null,
	            "BlkioDeviceWriteIOps": null,
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "KernelMemory": 0,
	            "KernelMemoryTCP": 0,
	            "MemoryReservation": 0,
	            "MemorySwap": 4613734400,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": null,
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/6cae4fbb3ff06bafae7d678b8be88c46f728f7e162403189e54b6a928eed1dda-init/diff:/var/lib/docker/overlay2/8b88d9f6f12c48be642a133456203e58549a93f1da67d0349744bd0f78917fba/diff:/var/lib/docker/overlay2/2bcbb3b4718a64188802301a25d7f413bb307cb16d077e7e5af799f9152a2970/diff:/var/lib/docker/overlay2/70b0888bf22fcef1c004704b71288ac581cf26a3b3b19fbca3da296ba10d6978/diff:/var/lib/docker/overlay2/7c5332f38fe652f379ef9b6d23e795158e9994317cfb547b581dd2b1fdf1303b/diff:/var/lib/docker/overlay2/0ddb5a3abf433b644a8bfa124e3c87878eed67878faa35493f2befc2b392e9cb/diff:/var/lib/docker/overlay2/3b7cda5fb0232fdeecbec0531ac704a59eb38fe57664c25777193b07e2df0077/diff:/var/lib/docker/overlay2/a14687ada786c65465b9924ae2d77ba27afc07942851cafaade28e80dfe9da16/diff:/var/lib/docker/overlay2/c49a9b7157aa6e8714e192b2849866d035b59e18de462c0ee9b72f898cc5a485/diff:/var/lib/docker/overlay2/efd71a50e3a1044a6d1c4c1a7d4d91d9f070c066e03e51c6c73a5764b778ad72/diff:/var/lib/docker/overlay2/55476a
1c0a20aa4238a0bb0e43c6402c33dcad312938ad48ee81be0160e12a49/diff:/var/lib/docker/overlay2/c48c4a348a797b9a38f01568a6adbcb4b05b4f56f7b986a4bf1b509d8cb00732/diff:/var/lib/docker/overlay2/568e3f354ab0428de5cf82d1fdfb780c3377f5cc55d9f524731c53e39e0ecae7/diff:/var/lib/docker/overlay2/2857943e320cdcdae9af3d8c2acda1fb61e2f142a88b8b902908071cea67816e/diff:/var/lib/docker/overlay2/bdd9a57f0b65e65c5a16395f239425e794c678b0e8db2f4a368e0a9427fe5116/diff:/var/lib/docker/overlay2/b150183f1b73e8c13c751911bcee09fed8ef973478f4dc3cfdb9e509118bf1ea/diff:/var/lib/docker/overlay2/0a053e7c29417cd6feafb351c7944e81342a52898871bc779f7bf61868c78ec4/diff:/var/lib/docker/overlay2/d3c0de3a44d75d0a05acb7843d53deba5ce0457649d6ed757da9b4c532a81e4f/diff:/var/lib/docker/overlay2/53f6170132880e1697dd802b8577382b31c6f1ba144256f8cc62542998842a6b/diff:/var/lib/docker/overlay2/b5c0be6d8efdb1fcb12e73b8f72853f77baa4bc014ac2c1e28b7b972b07f3325/diff:/var/lib/docker/overlay2/36c908f082a1e5388bb25277f1c957eaecf70fcd958080422fa85a3105724fb2/diff:/var/lib/d
ocker/overlay2/b147fe9dce365cfaf9bfeca2e370829e4d87e2671c133a9836ecb02a85422cc7/diff:/var/lib/docker/overlay2/65f488eb9181a721f01b333f5fa0cb91d216abd7842a9ae193bd95316f378721/diff:/var/lib/docker/overlay2/b04269aa247b68912ddc5b1c98ad55d67af4103f576a900eef4069c196b8a263/diff:/var/lib/docker/overlay2/b714c37e15257ae9d0e15d271dd18a330c38ad765901d9b7e7e3feb73e1b03e4/diff:/var/lib/docker/overlay2/3c253b721193edeaade7bba7ce25ff687c889b8fa86e9489c7ee20d5624e6c5b/diff:/var/lib/docker/overlay2/7f67b74e101fa21dd320393c10576eefa4ce1cec2e210bff405784fa45b360f3/diff:/var/lib/docker/overlay2/c3b2adaa63a06a5e6ed966d7b6f20a757aeadd3f25eb09ef3c7e9a66a8904143/diff:/var/lib/docker/overlay2/ddb5d653d19e8cafc4625a8fe9597667d98b277a7f679e532ad84caa2c6da636/diff:/var/lib/docker/overlay2/03eb172b20323ebeee7cb09025726a6e10de6c3dd8661f4f6bbc5a3a3778bad4/diff:/var/lib/docker/overlay2/80ea9bf34d028e95a8a418b3aeb634be72ab3336448946d7855c51ffdf8258d7/diff:/var/lib/docker/overlay2/e28987ea3fb4d431dee111f38cc76814b85f73e86434be3c463c01fdd59
9ad46/diff:/var/lib/docker/overlay2/6f9a46c7c6cf4fd30ce32a1eb08ed9b1e8dd61cb0e42ce54f0f736f06558c306/diff:/var/lib/docker/overlay2/6fc942eb9ccfc09898edc9a5ef3b3d305a6fcb22e8cefb1a9f9c344d10b59b25/diff:/var/lib/docker/overlay2/f6b8c57540e798dc1dfd51fd29c020193c02a4362f31c6d07aa220327bb07b90/diff:/var/lib/docker/overlay2/85d0aa01a3fab8c77262c59d8a7b0809a72673a3da7d33e4e19c04a66db44a11/diff:/var/lib/docker/overlay2/58dcd81a1605641f785ced5aeb38657eec1f02a31b7adfaf4f6fdd49f4bab1d6/diff:/var/lib/docker/overlay2/9d537e0a65325e4bf85b26da9828002339f5c442ca85f931b340457a80ec8c94/diff:/var/lib/docker/overlay2/a6f73707ee6a74e948a02d03c4a3f12b57c2eb408dc67da3c39961bb3cefcc97/diff:/var/lib/docker/overlay2/922526c310b066dbb73b9a106eef8bf0064ad7907a8d7d7b353f5307a17a4901/diff:/var/lib/docker/overlay2/a4185854870ebf8d34a4c7e1827dbe3bc461559839301ffb23c5efff5e3c9f14/diff:/var/lib/docker/overlay2/8c02b1fcb9d79f5d7b2ee4d44f6625a692c44a0d18df0a5c01cac0cca0fdf3f3/diff",
	                "MergedDir": "/var/lib/docker/overlay2/6cae4fbb3ff06bafae7d678b8be88c46f728f7e162403189e54b6a928eed1dda/merged",
	                "UpperDir": "/var/lib/docker/overlay2/6cae4fbb3ff06bafae7d678b8be88c46f728f7e162403189e54b6a928eed1dda/diff",
	                "WorkDir": "/var/lib/docker/overlay2/6cae4fbb3ff06bafae7d678b8be88c46f728f7e162403189e54b6a928eed1dda/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "default-k8s-different-port-20220630210335-9950",
	                "Source": "/var/lib/docker/volumes/default-k8s-different-port-20220630210335-9950/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "default-k8s-different-port-20220630210335-9950",
	            "Domainname": "",
	            "User": "root",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8444/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e",
	            "Volumes": null,
	            "WorkingDir": "",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "default-k8s-different-port-20220630210335-9950",
	                "name.minikube.sigs.k8s.io": "default-k8s-different-port-20220630210335-9950",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "91a4e2a23477a089405a3194b25b1263bcc345054fdee7c0681d4ae4b4dfdbca",
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49407"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49406"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49403"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49405"
	                    }
	                ],
	                "8444/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49404"
	                    }
	                ]
	            },
	            "SandboxKey": "/var/run/docker/netns/91a4e2a23477",
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "default-k8s-different-port-20220630210335-9950": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.85.2"
	                    },
	                    "Links": null,
	                    "Aliases": [
	                        "99f8da15dcfc",
	                        "default-k8s-different-port-20220630210335-9950"
	                    ],
	                    "NetworkID": "88cfda28f4387ea19e39fbebceded21d3930034fa00fca0cacdd2b97de1da8d9",
	                    "EndpointID": "222afaea3384676d2c5a7ff861094912ad678c6a88a78ac77f7423c8583a4b1b",
	                    "Gateway": "192.168.85.1",
	                    "IPAddress": "192.168.85.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "MacAddress": "02:42:c0:a8:55:02",
	                    "DriverOpts": null
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p default-k8s-different-port-20220630210335-9950 -n default-k8s-different-port-20220630210335-9950
helpers_test.go:244: <<< TestStartStop/group/default-k8s-different-port/serial/DeployApp FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======>  post-mortem[TestStartStop/group/default-k8s-different-port/serial/DeployApp]: minikube logs <======
helpers_test.go:247: (dbg) Run:  out/minikube-linux-amd64 -p default-k8s-different-port-20220630210335-9950 logs -n 25
E0630 21:16:27.108416    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/bridge-20220630204858-9950/client.crt: no such file or directory
helpers_test.go:252: TestStartStop/group/default-k8s-different-port/serial/DeployApp logs: 
-- stdout --
	* 
	* ==> Audit <==
	* |---------|------------------------------------------------------------|----------|---------|---------|---------------------|---------------------|
	| Command |                            Args                            | Profile  |  User   | Version |     Start Time      |      End Time       |
	|---------|------------------------------------------------------------|----------|---------|---------|---------------------|---------------------|
	| stop    | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:03 UTC | 30 Jun 22 21:04 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=3                                     |          |         |         |                     |                     |
	| addons  | enable dashboard -p                                        | minikube | jenkins | v1.26.0 | 30 Jun 22 21:04 UTC | 30 Jun 22 21:04 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|         | --images=MetricsScraper=k8s.gcr.io/echoserver:1.4          |          |         |         |                     |                     |
	| start   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:04 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|         | --memory=2200                                              |          |         |         |                     |                     |
	|         | --alsologtostderr                                          |          |         |         |                     |                     |
	|         | --wait=true --preload=false                                |          |         |         |                     |                     |
	|         | --driver=docker                                            |          |         |         |                     |                     |
	|         | --container-runtime=containerd                             |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                               |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:05 UTC | 30 Jun 22 21:05 UTC |
	|         | enable-default-cni-20220630204858-9950                     |          |         |         |                     |                     |
	| start   | -p newest-cni-20220630210514-9950 --memory=2200            | minikube | jenkins | v1.26.0 | 30 Jun 22 21:05 UTC | 30 Jun 22 21:06 UTC |
	|         | --alsologtostderr --wait=apiserver,system_pods,default_sa  |          |         |         |                     |                     |
	|         | --feature-gates ServerSideApply=true --network-plugin=cni  |          |         |         |                     |                     |
	|         | --extra-config=kubeadm.pod-network-cidr=192.168.111.111/16 |          |         |         |                     |                     |
	|         | --driver=docker  --container-runtime=containerd            |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                               |          |         |         |                     |                     |
	| addons  | enable metrics-server -p                                   | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | --images=MetricsServer=k8s.gcr.io/echoserver:1.4           |          |         |         |                     |                     |
	|         | --registries=MetricsServer=fake.domain                     |          |         |         |                     |                     |
	| stop    | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=3                                     |          |         |         |                     |                     |
	| addons  | enable dashboard -p                                        | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | --images=MetricsScraper=k8s.gcr.io/echoserver:1.4          |          |         |         |                     |                     |
	| start   | -p newest-cni-20220630210514-9950 --memory=2200            | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | --alsologtostderr --wait=apiserver,system_pods,default_sa  |          |         |         |                     |                     |
	|         | --feature-gates ServerSideApply=true --network-plugin=cni  |          |         |         |                     |                     |
	|         | --extra-config=kubeadm.pod-network-cidr=192.168.111.111/16 |          |         |         |                     |                     |
	|         | --driver=docker  --container-runtime=containerd            |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                               |          |         |         |                     |                     |
	| ssh     | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | sudo crictl images -o json                                 |          |         |         |                     |                     |
	| pause   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                     |          |         |         |                     |                     |
	| unpause | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                     |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | disable-driver-mounts-20220630210659-9950                  |          |         |         |                     |                     |
	| start   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC |                     |
	|         | embed-certs-20220630210659-9950                            |          |         |         |                     |                     |
	|         | --memory=2200 --alsologtostderr                            |          |         |         |                     |                     |
	|         | --wait=true --embed-certs                                  |          |         |         |                     |                     |
	|         | --driver=docker                                            |          |         |         |                     |                     |
	|         | --container-runtime=containerd                             |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                               |          |         |         |                     |                     |
	| ssh     | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|         | sudo crictl images -o json                                 |          |         |         |                     |                     |
	| pause   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                     |          |         |         |                     |                     |
	| unpause | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                     |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	| addons  | enable metrics-server -p                                   | minikube | jenkins | v1.26.0 | 30 Jun 22 21:12 UTC | 30 Jun 22 21:12 UTC |
	|         | old-k8s-version-20220630210005-9950                        |          |         |         |                     |                     |
	|         | --images=MetricsServer=k8s.gcr.io/echoserver:1.4           |          |         |         |                     |                     |
	|         | --registries=MetricsServer=fake.domain                     |          |         |         |                     |                     |
	| stop    | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:12 UTC | 30 Jun 22 21:12 UTC |
	|         | old-k8s-version-20220630210005-9950                        |          |         |         |                     |                     |
	|         | --alsologtostderr -v=3                                     |          |         |         |                     |                     |
	| addons  | enable dashboard -p                                        | minikube | jenkins | v1.26.0 | 30 Jun 22 21:12 UTC | 30 Jun 22 21:12 UTC |
	|         | old-k8s-version-20220630210005-9950                        |          |         |         |                     |                     |
	|         | --images=MetricsScraper=k8s.gcr.io/echoserver:1.4          |          |         |         |                     |                     |
	| start   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:12 UTC |                     |
	|         | old-k8s-version-20220630210005-9950                        |          |         |         |                     |                     |
	|         | --memory=2200 --alsologtostderr                            |          |         |         |                     |                     |
	|         | --wait=true --kvm-network=default                          |          |         |         |                     |                     |
	|         | --kvm-qemu-uri=qemu:///system                              |          |         |         |                     |                     |
	|         | --disable-driver-mounts                                    |          |         |         |                     |                     |
	|         | --keep-context=false                                       |          |         |         |                     |                     |
	|         | --driver=docker                                            |          |         |         |                     |                     |
	|         | --container-runtime=containerd                             |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.16.0                               |          |         |         |                     |                     |
	|---------|------------------------------------------------------------|----------|---------|---------|---------------------|---------------------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2022/06/30 21:12:54
	Running on machine: ubuntu-20-agent-8
	Binary: Built with gc go1.18.3 for linux/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0630 21:12:54.458513  271327 out.go:296] Setting OutFile to fd 1 ...
	I0630 21:12:54.458723  271327 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 21:12:54.458735  271327 out.go:309] Setting ErrFile to fd 2...
	I0630 21:12:54.458739  271327 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 21:12:54.459171  271327 root.go:329] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/bin
	I0630 21:12:54.459399  271327 out.go:303] Setting JSON to false
	I0630 21:12:54.460611  271327 start.go:115] hostinfo: {"hostname":"ubuntu-20-agent-8","uptime":3327,"bootTime":1656620248,"procs":353,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1012-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0630 21:12:54.460675  271327 start.go:125] virtualization: kvm guest
	I0630 21:12:54.464187  271327 out.go:177] * [old-k8s-version-20220630210005-9950] minikube v1.26.0 on Ubuntu 20.04 (kvm/amd64)
	I0630 21:12:54.465765  271327 out.go:177]   - MINIKUBE_LOCATION=14420
	I0630 21:12:54.465705  271327 notify.go:193] Checking for updates...
	I0630 21:12:54.467351  271327 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0630 21:12:54.469076  271327 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:12:54.470734  271327 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube
	I0630 21:12:54.472165  271327 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0630 21:12:54.473803  271327 config.go:178] Loaded profile config "old-k8s-version-20220630210005-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.16.0
	I0630 21:12:54.475600  271327 out.go:177] * Kubernetes 1.24.2 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.24.2
	I0630 21:12:54.476739  271327 driver.go:360] Setting default libvirt URI to qemu:///system
	I0630 21:12:54.520439  271327 docker.go:137] docker version: linux-20.10.17
	I0630 21:12:54.520531  271327 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0630 21:12:54.626504  271327 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:8 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:43 OomKillDisable:true NGoroutines:44 SystemTime:2022-06-30 21:12:54.551026919 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1012-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexServ
erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662451712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-8 Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Client
Info:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
	I0630 21:12:54.626609  271327 docker.go:254] overlay module found
	I0630 21:12:54.628919  271327 out.go:177] * Using the docker driver based on existing profile
	I0630 21:12:54.630364  271327 start.go:284] selected driver: docker
	I0630 21:12:54.630380  271327 start.go:808] validating driver "docker" against &{Name:old-k8s-version-20220630210005-9950 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-20220630210005-9950 Nam
espace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.67.2 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[Dashboard:kubernetesui/dashboard:v2.6.0@sha256:4af9580485920635d888efe1eddbd67e12f9d5d84dba87100e93feb4e46636b3 MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] Star
tHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 21:12:54.630494  271327 start.go:819] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0630 21:12:54.631308  271327 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0630 21:12:54.741608  271327 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:8 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:43 OomKillDisable:true NGoroutines:44 SystemTime:2022-06-30 21:12:54.663294597 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1012-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexServ
erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662451712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-8 Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Client
Info:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
	I0630 21:12:54.741886  271327 start_flags.go:853] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0630 21:12:54.741907  271327 cni.go:95] Creating CNI manager for ""
	I0630 21:12:54.741916  271327 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:12:54.741932  271327 start_flags.go:310] config:
	{Name:old-k8s-version-20220630210005-9950 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-20220630210005-9950 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDom
ain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.67.2 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[Dashboard:kubernetesui/dashboard:v2.6.0@sha256:4af9580485920635d888efe1eddbd67e12f9d5d84dba87100e93feb4e46636b3 MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Su
bnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 21:12:54.745032  271327 out.go:177] * Starting control plane node old-k8s-version-20220630210005-9950 in cluster old-k8s-version-20220630210005-9950
	I0630 21:12:54.746400  271327 cache.go:120] Beginning downloading kic base image for docker with containerd
	I0630 21:12:54.747743  271327 out.go:177] * Pulling base image ...
	I0630 21:12:54.749006  271327 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime containerd
	I0630 21:12:54.749038  271327 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e in local docker daemon
	I0630 21:12:54.749076  271327 preload.go:148] Found local preload: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-containerd-overlay2-amd64.tar.lz4
	I0630 21:12:54.749097  271327 cache.go:57] Caching tarball of preloaded images
	I0630 21:12:54.749296  271327 preload.go:174] Found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-containerd-overlay2-amd64.tar.lz4 in cache, skipping download
	I0630 21:12:54.749311  271327 cache.go:60] Finished verifying existence of preloaded tar for  v1.16.0 on containerd
	I0630 21:12:54.749504  271327 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/config.json ...
	I0630 21:12:54.784190  271327 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e in local docker daemon, skipping pull
	I0630 21:12:54.784215  271327 cache.go:142] gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e exists in daemon, skipping load
	I0630 21:12:54.784225  271327 cache.go:208] Successfully downloaded all kic artifacts
	I0630 21:12:54.784263  271327 start.go:352] acquiring machines lock for old-k8s-version-20220630210005-9950: {Name:mkf719e729d8bddb1fc7c2bc9e00e82ad1c17213 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0630 21:12:54.784376  271327 start.go:356] acquired machines lock for "old-k8s-version-20220630210005-9950" in 93.677µs
	I0630 21:12:54.784402  271327 start.go:94] Skipping create...Using existing machine configuration
	I0630 21:12:54.784407  271327 fix.go:55] fixHost starting: 
	I0630 21:12:54.784629  271327 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220630210005-9950 --format={{.State.Status}}
	I0630 21:12:54.819248  271327 fix.go:103] recreateIfNeeded on old-k8s-version-20220630210005-9950: state=Stopped err=<nil>
	W0630 21:12:54.819277  271327 fix.go:129] unexpected machine state, will restart: <nil>
	I0630 21:12:54.822125  271327 out.go:177] * Restarting existing docker container for "old-k8s-version-20220630210005-9950" ...
	I0630 21:12:54.823401  271327 cli_runner.go:164] Run: docker start old-k8s-version-20220630210005-9950
	I0630 21:12:55.228150  271327 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220630210005-9950 --format={{.State.Status}}
	I0630 21:12:55.267612  271327 kic.go:416] container "old-k8s-version-20220630210005-9950" state is running.
	I0630 21:12:55.267996  271327 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-20220630210005-9950
	I0630 21:12:55.304343  271327 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/config.json ...
	I0630 21:12:55.304609  271327 machine.go:88] provisioning docker machine ...
	I0630 21:12:55.304637  271327 ubuntu.go:169] provisioning hostname "old-k8s-version-20220630210005-9950"
	I0630 21:12:55.304740  271327 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220630210005-9950
	I0630 21:12:55.341604  271327 main.go:134] libmachine: Using SSH client type: native
	I0630 21:12:55.341782  271327 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil>  [] 0s} 127.0.0.1 49432 <nil> <nil>}
	I0630 21:12:55.341804  271327 main.go:134] libmachine: About to run SSH command:
	sudo hostname old-k8s-version-20220630210005-9950 && echo "old-k8s-version-20220630210005-9950" | sudo tee /etc/hostname
	I0630 21:12:55.342411  271327 main.go:134] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:33496->127.0.0.1:49432: read: connection reset by peer
	I0630 21:12:58.474026  271327 main.go:134] libmachine: SSH cmd err, output: <nil>: old-k8s-version-20220630210005-9950
	
	I0630 21:12:58.474096  271327 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220630210005-9950
	I0630 21:12:58.510030  271327 main.go:134] libmachine: Using SSH client type: native
	I0630 21:12:58.510179  271327 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil>  [] 0s} 127.0.0.1 49432 <nil> <nil>}
	I0630 21:12:58.510202  271327 main.go:134] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sold-k8s-version-20220630210005-9950' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-20220630210005-9950/g' /etc/hosts;
				else 
					echo '127.0.1.1 old-k8s-version-20220630210005-9950' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0630 21:12:58.625033  271327 main.go:134] libmachine: SSH cmd err, output: <nil>: 
	I0630 21:12:58.625074  271327 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube CaCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/c
erts/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube}
	I0630 21:12:58.625102  271327 ubuntu.go:177] setting up certificates
	I0630 21:12:58.625117  271327 provision.go:83] configureAuth start
	I0630 21:12:58.625175  271327 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-20220630210005-9950
	I0630 21:12:58.662760  271327 provision.go:138] copyHostCerts
	I0630 21:12:58.662859  271327 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem, removing ...
	I0630 21:12:58.662878  271327 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem
	I0630 21:12:58.662960  271327 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem (1082 bytes)
	I0630 21:12:58.663097  271327 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem, removing ...
	I0630 21:12:58.663121  271327 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem
	I0630 21:12:58.663172  271327 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem (1123 bytes)
	I0630 21:12:58.663265  271327 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem, removing ...
	I0630 21:12:58.663278  271327 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem
	I0630 21:12:58.663321  271327 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem (1679 bytes)
	I0630 21:12:58.663395  271327 provision.go:112] generating server cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-20220630210005-9950 san=[192.168.67.2 127.0.0.1 localhost 127.0.0.1 minikube old-k8s-version-20220630210005-9950]
	I0630 21:12:58.752521  271327 provision.go:172] copyRemoteCerts
	I0630 21:12:58.752583  271327 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0630 21:12:58.752626  271327 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220630210005-9950
	I0630 21:12:58.789059  271327 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49432 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/old-k8s-version-20220630210005-9950/id_rsa Username:docker}
	I0630 21:12:58.876530  271327 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
	I0630 21:12:58.894073  271327 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem --> /etc/docker/server.pem (1277 bytes)
	I0630 21:12:58.911294  271327 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0630 21:12:58.928841  271327 provision.go:86] duration metric: configureAuth took 303.702271ms
	I0630 21:12:58.928870  271327 ubuntu.go:193] setting minikube options for container-runtime
	I0630 21:12:58.929141  271327 config.go:178] Loaded profile config "old-k8s-version-20220630210005-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.16.0
	I0630 21:12:58.929157  271327 machine.go:91] provisioned docker machine in 3.624531122s
	I0630 21:12:58.929166  271327 start.go:306] post-start starting for "old-k8s-version-20220630210005-9950" (driver="docker")
	I0630 21:12:58.929174  271327 start.go:316] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0630 21:12:58.929237  271327 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0630 21:12:58.929282  271327 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220630210005-9950
	I0630 21:12:58.964321  271327 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49432 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/old-k8s-version-20220630210005-9950/id_rsa Username:docker}
	I0630 21:12:59.052606  271327 ssh_runner.go:195] Run: cat /etc/os-release
	I0630 21:12:59.055232  271327 main.go:134] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0630 21:12:59.055263  271327 main.go:134] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0630 21:12:59.055278  271327 main.go:134] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0630 21:12:59.055289  271327 info.go:137] Remote host: Ubuntu 20.04.4 LTS
	I0630 21:12:59.055302  271327 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/addons for local assets ...
	I0630 21:12:59.055349  271327 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files for local assets ...
	I0630 21:12:59.055422  271327 filesync.go:149] local asset: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem -> 99502.pem in /etc/ssl/certs
	I0630 21:12:59.055511  271327 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0630 21:12:59.062501  271327 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem --> /etc/ssl/certs/99502.pem (1708 bytes)
	I0630 21:12:59.079749  271327 start.go:309] post-start completed in 150.570292ms
	I0630 21:12:59.079814  271327 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0630 21:12:59.079848  271327 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220630210005-9950
	I0630 21:12:59.115633  271327 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49432 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/old-k8s-version-20220630210005-9950/id_rsa Username:docker}
	I0630 21:12:59.197533  271327 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0630 21:12:59.201551  271327 fix.go:57] fixHost completed within 4.417138459s
	I0630 21:12:59.201580  271327 start.go:81] releasing machines lock for "old-k8s-version-20220630210005-9950", held for 4.41718709s
	I0630 21:12:59.201664  271327 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-20220630210005-9950
	I0630 21:12:59.236396  271327 ssh_runner.go:195] Run: systemctl --version
	I0630 21:12:59.236429  271327 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/
	I0630 21:12:59.236445  271327 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220630210005-9950
	I0630 21:12:59.236479  271327 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220630210005-9950
	I0630 21:12:59.275956  271327 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49432 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/old-k8s-version-20220630210005-9950/id_rsa Username:docker}
	I0630 21:12:59.278139  271327 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49432 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/old-k8s-version-20220630210005-9950/id_rsa Username:docker}
	I0630 21:12:59.357177  271327 ssh_runner.go:195] Run: sudo systemctl stop -f crio
	I0630 21:12:59.396058  271327 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0630 21:12:59.405905  271327 docker.go:179] disabling docker service ...
	I0630 21:12:59.405971  271327 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0630 21:12:59.415565  271327 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0630 21:12:59.425245  271327 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0630 21:12:59.506277  271327 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0630 21:12:59.579576  271327 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0630 21:12:59.588504  271327 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
	image-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0630 21:12:59.600574  271327 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*sandbox_image = .*$|sandbox_image = "k8s.gcr.io/pause:3.1"|' -i /etc/containerd/config.toml"
	I0630 21:12:59.609004  271327 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*restrict_oom_score_adj = .*$|restrict_oom_score_adj = false|' -i /etc/containerd/config.toml"
	I0630 21:12:59.616872  271327 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*SystemdCgroup = .*$|SystemdCgroup = false|' -i /etc/containerd/config.toml"
	I0630 21:12:59.625560  271327 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*conf_dir = .*$|conf_dir = "/etc/cni/net.mk"|' -i /etc/containerd/config.toml"
	I0630 21:12:59.633687  271327 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^# imports|imports = ["/etc/containerd/containerd.conf.d/02-containerd.conf"]|' -i /etc/containerd/config.toml"
	I0630 21:12:59.641489  271327 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc/containerd/containerd.conf.d && printf %!s(MISSING) "dmVyc2lvbiA9IDIK" | base64 -d | sudo tee /etc/containerd/containerd.conf.d/02-containerd.conf"
	I0630 21:12:59.653799  271327 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0630 21:12:59.661303  271327 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0630 21:12:59.667744  271327 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0630 21:12:59.739470  271327 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0630 21:12:59.811957  271327 start.go:447] Will wait 60s for socket path /run/containerd/containerd.sock
	I0630 21:12:59.812020  271327 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
	I0630 21:12:59.815575  271327 start.go:468] Will wait 60s for crictl version
	I0630 21:12:59.815658  271327 ssh_runner.go:195] Run: sudo crictl version
	I0630 21:12:59.840380  271327 retry.go:31] will retry after 11.04660288s: Temporary Error: sudo crictl version: Process exited with status 1
	stdout:
	
	stderr:
	time="2022-06-30T21:12:59Z" level=fatal msg="getting the runtime version: rpc error: code = Unknown desc = server is not initialized yet"
	I0630 21:13:10.887641  271327 ssh_runner.go:195] Run: sudo crictl version
	I0630 21:13:10.911469  271327 start.go:477] Version:  0.1.0
	RuntimeName:  containerd
	RuntimeVersion:  1.6.6
	RuntimeApiVersion:  v1alpha2
	I0630 21:13:10.911525  271327 ssh_runner.go:195] Run: containerd --version
	I0630 21:13:10.941036  271327 ssh_runner.go:195] Run: containerd --version
	I0630 21:13:10.973182  271327 out.go:177] * Preparing Kubernetes v1.16.0 on containerd 1.6.6 ...
	I0630 21:13:10.974662  271327 cli_runner.go:164] Run: docker network inspect old-k8s-version-20220630210005-9950 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0630 21:13:11.009465  271327 ssh_runner.go:195] Run: grep 192.168.67.1	host.minikube.internal$ /etc/hosts
	I0630 21:13:11.012813  271327 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.67.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0630 21:13:11.023782  271327 out.go:177]   - kubelet.cni-conf-dir=/etc/cni/net.mk
	I0630 21:13:11.025280  271327 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime containerd
	I0630 21:13:11.025333  271327 ssh_runner.go:195] Run: sudo crictl images --output json
	I0630 21:13:11.049476  271327 containerd.go:547] all images are preloaded for containerd runtime.
	I0630 21:13:11.049500  271327 containerd.go:461] Images already preloaded, skipping extraction
	I0630 21:13:11.049574  271327 ssh_runner.go:195] Run: sudo crictl images --output json
	I0630 21:13:11.072721  271327 containerd.go:547] all images are preloaded for containerd runtime.
	I0630 21:13:11.072742  271327 cache_images.go:84] Images are preloaded, skipping loading
	I0630 21:13:11.072795  271327 ssh_runner.go:195] Run: sudo crictl info
	I0630 21:13:11.096695  271327 cni.go:95] Creating CNI manager for ""
	I0630 21:13:11.096723  271327 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:13:11.096741  271327 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
	I0630 21:13:11.096759  271327 kubeadm.go:158] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.67.2 APIServerPort:8443 KubernetesVersion:v1.16.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-20220630210005-9950 NodeName:old-k8s-version-20220630210005-9950 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.67.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.67.2 CgroupDriver:cgroupfs
ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}
	I0630 21:13:11.096917  271327 kubeadm.go:162] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta1
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.67.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: /run/containerd/containerd.sock
	  name: "old-k8s-version-20220630210005-9950"
	  kubeletExtraArgs:
	    node-ip: 192.168.67.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta1
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.67.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: old-k8s-version-20220630210005-9950
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	dns:
	  type: CoreDNS
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      listen-metrics-urls: http://127.0.0.1:2381,http://192.168.67.2:2381
	kubernetesVersion: v1.16.0
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%!"(MISSING)
	  nodefs.inodesFree: "0%!"(MISSING)
	  imagefs.available: "0%!"(MISSING)
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0630 21:13:11.097018  271327 kubeadm.go:961] kubelet [Unit]
	Wants=containerd.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.16.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cni-conf-dir=/etc/cni/net.mk --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=old-k8s-version-20220630210005-9950 --image-service-endpoint=unix:///run/containerd/containerd.sock --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.67.2 --runtime-request-timeout=15m
	
	[Install]
	 config:
	{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-20220630210005-9950 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
	I0630 21:13:11.097187  271327 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.16.0
	I0630 21:13:11.104428  271327 binaries.go:44] Found k8s binaries, skipping transfer
	I0630 21:13:11.104504  271327 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0630 21:13:11.111290  271327 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (580 bytes)
	I0630 21:13:11.123946  271327 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0630 21:13:11.136775  271327 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2154 bytes)
	I0630 21:13:11.149718  271327 ssh_runner.go:195] Run: grep 192.168.67.2	control-plane.minikube.internal$ /etc/hosts
	I0630 21:13:11.152625  271327 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.67.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0630 21:13:11.162302  271327 certs.go:54] Setting up /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950 for IP: 192.168.67.2
	I0630 21:13:11.162407  271327 certs.go:182] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.key
	I0630 21:13:11.162454  271327 certs.go:182] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.key
	I0630 21:13:11.162539  271327 certs.go:298] skipping minikube-user signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/client.key
	I0630 21:13:11.162605  271327 certs.go:298] skipping minikube signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/apiserver.key.c7fa3a9e
	I0630 21:13:11.162643  271327 certs.go:298] skipping aggregator signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/proxy-client.key
	I0630 21:13:11.162760  271327 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950.pem (1338 bytes)
	W0630 21:13:11.162806  271327 certs.go:384] ignoring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950_empty.pem, impossibly tiny 0 bytes
	I0630 21:13:11.162820  271327 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem (1679 bytes)
	I0630 21:13:11.162861  271327 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem (1082 bytes)
	I0630 21:13:11.162895  271327 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem (1123 bytes)
	I0630 21:13:11.162931  271327 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/key.pem (1679 bytes)
	I0630 21:13:11.162990  271327 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem (1708 bytes)
	I0630 21:13:11.163904  271327 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
	I0630 21:13:11.184892  271327 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I0630 21:13:11.206289  271327 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0630 21:13:11.224207  271327 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
	I0630 21:13:11.243140  271327 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0630 21:13:11.262116  271327 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
	I0630 21:13:11.280815  271327 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0630 21:13:11.299759  271327 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
	I0630 21:13:11.318450  271327 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem --> /usr/share/ca-certificates/99502.pem (1708 bytes)
	I0630 21:13:11.337118  271327 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0630 21:13:11.355699  271327 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950.pem --> /usr/share/ca-certificates/9950.pem (1338 bytes)
	I0630 21:13:11.374676  271327 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0630 21:13:11.388531  271327 ssh_runner.go:195] Run: openssl version
	I0630 21:13:11.393893  271327 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/99502.pem && ln -fs /usr/share/ca-certificates/99502.pem /etc/ssl/certs/99502.pem"
	I0630 21:13:11.402243  271327 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/99502.pem
	I0630 21:13:11.405519  271327 certs.go:431] hashing: -rw-r--r-- 1 root root 1708 Jun 30 20:26 /usr/share/ca-certificates/99502.pem
	I0630 21:13:11.405568  271327 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/99502.pem
	I0630 21:13:11.410901  271327 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/99502.pem /etc/ssl/certs/3ec20f2e.0"
	I0630 21:13:11.418854  271327 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0630 21:13:11.427866  271327 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:13:11.431311  271327 certs.go:431] hashing: -rw-r--r-- 1 root root 1111 Jun 30 20:22 /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:13:11.431380  271327 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:13:11.436694  271327 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0630 21:13:11.444577  271327 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/9950.pem && ln -fs /usr/share/ca-certificates/9950.pem /etc/ssl/certs/9950.pem"
	I0630 21:13:11.453028  271327 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/9950.pem
	I0630 21:13:11.456607  271327 certs.go:431] hashing: -rw-r--r-- 1 root root 1338 Jun 30 20:26 /usr/share/ca-certificates/9950.pem
	I0630 21:13:11.456670  271327 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/9950.pem
	I0630 21:13:11.462072  271327 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/9950.pem /etc/ssl/certs/51391683.0"
	I0630 21:13:11.470089  271327 kubeadm.go:395] StartCluster: {Name:old-k8s-version-20220630210005-9950 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-20220630210005-9950 Namespace:default APISe
rverName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.67.2 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[Dashboard:kubernetesui/dashboard:v2.6.0@sha256:4af9580485920635d888efe1eddbd67e12f9d5d84dba87100e93feb4e46636b3 MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s Sc
heduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 21:13:11.470197  271327 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
	I0630 21:13:11.470262  271327 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0630 21:13:11.495667  271327 cri.go:87] found id: "c435aa6fdf138d684f721a5f1fb855163b020feb07c989254589c7e901b37b36"
	I0630 21:13:11.495695  271327 cri.go:87] found id: "27b91b4e1595400f52e6c0fd5fb8e3732c524b9757a79a5a9108333797eb3788"
	I0630 21:13:11.495702  271327 cri.go:87] found id: "998b774f4f284a1fcf3dbd179faaa8c69e39ab084d30662575ac04f0146604f3"
	I0630 21:13:11.495708  271327 cri.go:87] found id: "b8604fd1030fac170f4591063a20f1abfb86602e188695c1be545614d1b4e8a0"
	I0630 21:13:11.495714  271327 cri.go:87] found id: "fa267cd65f4eefef8993b275f8625ee5daf30304f18337e27a9944d1b5f03a02"
	I0630 21:13:11.495721  271327 cri.go:87] found id: "f60b30d7e822cbe35e12b31f9d3517de2de1004b26577e8f27750257f416aae1"
	I0630 21:13:11.495726  271327 cri.go:87] found id: ""
	I0630 21:13:11.495764  271327 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
	I0630 21:13:11.508218  271327 cri.go:114] JSON = null
	W0630 21:13:11.508285  271327 kubeadm.go:402] unpause failed: list paused: list returned 0 containers, but ps returned 6
	I0630 21:13:11.508338  271327 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0630 21:13:11.515470  271327 kubeadm.go:410] found existing configuration files, will attempt cluster restart
	I0630 21:13:11.515494  271327 kubeadm.go:626] restartCluster start
	I0630 21:13:11.515548  271327 ssh_runner.go:195] Run: sudo test -d /data/minikube
	I0630 21:13:11.522610  271327 kubeadm.go:127] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:13:11.523454  271327 kubeconfig.go:116] verify returned: extract IP: "old-k8s-version-20220630210005-9950" does not appear in /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:13:11.523977  271327 kubeconfig.go:127] "old-k8s-version-20220630210005-9950" context is missing from /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig - will repair!
	I0630 21:13:11.524766  271327 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig: {Name:mk34e4a4e7b04f624b9adbda4f77ee20b38308ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:13:11.526353  271327 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
	I0630 21:13:11.533966  271327 api_server.go:165] Checking apiserver status ...
	I0630 21:13:11.534055  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:13:11.542772  271327 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:13:11.743200  271327 api_server.go:165] Checking apiserver status ...
	I0630 21:13:11.743292  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:13:11.752122  271327 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:13:11.943426  271327 api_server.go:165] Checking apiserver status ...
	I0630 21:13:11.943525  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:13:11.952325  271327 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:13:12.143391  271327 api_server.go:165] Checking apiserver status ...
	I0630 21:13:12.143459  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:13:12.152022  271327 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:13:12.343343  271327 api_server.go:165] Checking apiserver status ...
	I0630 21:13:12.343418  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:13:12.351771  271327 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:13:12.542984  271327 api_server.go:165] Checking apiserver status ...
	I0630 21:13:12.543070  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:13:12.551394  271327 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:13:12.743674  271327 api_server.go:165] Checking apiserver status ...
	I0630 21:13:12.743754  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:13:12.752328  271327 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:13:12.943661  271327 api_server.go:165] Checking apiserver status ...
	I0630 21:13:12.943743  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:13:12.952370  271327 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:13:13.143661  271327 api_server.go:165] Checking apiserver status ...
	I0630 21:13:13.143764  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:13:13.152169  271327 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:13:13.343351  271327 api_server.go:165] Checking apiserver status ...
	I0630 21:13:13.343449  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:13:13.351834  271327 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:13:13.543065  271327 api_server.go:165] Checking apiserver status ...
	I0630 21:13:13.543164  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:13:13.551421  271327 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:13:13.743766  271327 api_server.go:165] Checking apiserver status ...
	I0630 21:13:13.743846  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:13:13.752113  271327 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:13:13.943447  271327 api_server.go:165] Checking apiserver status ...
	I0630 21:13:13.943571  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:13:13.952255  271327 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:13:14.143533  271327 api_server.go:165] Checking apiserver status ...
	I0630 21:13:14.143631  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:13:14.152151  271327 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:13:14.343440  271327 api_server.go:165] Checking apiserver status ...
	I0630 21:13:14.343531  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:13:14.352323  271327 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:13:14.543945  271327 api_server.go:165] Checking apiserver status ...
	I0630 21:13:14.544019  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:13:14.553233  271327 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:13:14.553258  271327 api_server.go:165] Checking apiserver status ...
	I0630 21:13:14.553299  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:13:14.561647  271327 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:13:14.561683  271327 kubeadm.go:601] needs reconfigure: apiserver error: timed out waiting for the condition
	I0630 21:13:14.561693  271327 kubeadm.go:1092] stopping kube-system containers ...
	I0630 21:13:14.561708  271327 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name: Namespaces:[kube-system]}
	I0630 21:13:14.561815  271327 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0630 21:13:14.586984  271327 cri.go:87] found id: "c435aa6fdf138d684f721a5f1fb855163b020feb07c989254589c7e901b37b36"
	I0630 21:13:14.587017  271327 cri.go:87] found id: "27b91b4e1595400f52e6c0fd5fb8e3732c524b9757a79a5a9108333797eb3788"
	I0630 21:13:14.587024  271327 cri.go:87] found id: "998b774f4f284a1fcf3dbd179faaa8c69e39ab084d30662575ac04f0146604f3"
	I0630 21:13:14.587034  271327 cri.go:87] found id: "b8604fd1030fac170f4591063a20f1abfb86602e188695c1be545614d1b4e8a0"
	I0630 21:13:14.587040  271327 cri.go:87] found id: "fa267cd65f4eefef8993b275f8625ee5daf30304f18337e27a9944d1b5f03a02"
	I0630 21:13:14.587053  271327 cri.go:87] found id: "f60b30d7e822cbe35e12b31f9d3517de2de1004b26577e8f27750257f416aae1"
	I0630 21:13:14.587059  271327 cri.go:87] found id: ""
	I0630 21:13:14.587064  271327 cri.go:232] Stopping containers: [c435aa6fdf138d684f721a5f1fb855163b020feb07c989254589c7e901b37b36 27b91b4e1595400f52e6c0fd5fb8e3732c524b9757a79a5a9108333797eb3788 998b774f4f284a1fcf3dbd179faaa8c69e39ab084d30662575ac04f0146604f3 b8604fd1030fac170f4591063a20f1abfb86602e188695c1be545614d1b4e8a0 fa267cd65f4eefef8993b275f8625ee5daf30304f18337e27a9944d1b5f03a02 f60b30d7e822cbe35e12b31f9d3517de2de1004b26577e8f27750257f416aae1]
	I0630 21:13:14.587112  271327 ssh_runner.go:195] Run: which crictl
	I0630 21:13:14.590164  271327 ssh_runner.go:195] Run: sudo /usr/bin/crictl stop c435aa6fdf138d684f721a5f1fb855163b020feb07c989254589c7e901b37b36 27b91b4e1595400f52e6c0fd5fb8e3732c524b9757a79a5a9108333797eb3788 998b774f4f284a1fcf3dbd179faaa8c69e39ab084d30662575ac04f0146604f3 b8604fd1030fac170f4591063a20f1abfb86602e188695c1be545614d1b4e8a0 fa267cd65f4eefef8993b275f8625ee5daf30304f18337e27a9944d1b5f03a02 f60b30d7e822cbe35e12b31f9d3517de2de1004b26577e8f27750257f416aae1
	I0630 21:13:14.618090  271327 ssh_runner.go:195] Run: sudo systemctl stop kubelet
	I0630 21:13:14.628795  271327 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0630 21:13:14.636533  271327 kubeadm.go:155] found existing configuration files:
	-rw------- 1 root root 5743 Jun 30 21:00 /etc/kubernetes/admin.conf
	-rw------- 1 root root 5779 Jun 30 21:00 /etc/kubernetes/controller-manager.conf
	-rw------- 1 root root 5927 Jun 30 21:00 /etc/kubernetes/kubelet.conf
	-rw------- 1 root root 5731 Jun 30 21:00 /etc/kubernetes/scheduler.conf
	
	I0630 21:13:14.636601  271327 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
	I0630 21:13:14.644036  271327 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
	I0630 21:13:14.651486  271327 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
	I0630 21:13:14.658853  271327 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
	I0630 21:13:14.666211  271327 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0630 21:13:14.673925  271327 kubeadm.go:703] reconfiguring cluster from /var/tmp/minikube/kubeadm.yaml
	I0630 21:13:14.673958  271327 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:13:14.729593  271327 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:13:15.448255  271327 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:13:15.591389  271327 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:13:15.660482  271327 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:13:15.826815  271327 api_server.go:51] waiting for apiserver process to appear ...
	I0630 21:13:15.826889  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 21:13:16.336913  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 21:13:16.837002  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 21:13:16.849966  271327 api_server.go:71] duration metric: took 1.023156233s to wait for apiserver process to appear ...
	I0630 21:13:16.849999  271327 api_server.go:87] waiting for apiserver healthz status ...
	I0630 21:13:16.850013  271327 api_server.go:240] Checking apiserver healthz at https://192.168.67.2:8443/healthz ...
	I0630 21:13:16.850373  271327 api_server.go:256] stopped: https://192.168.67.2:8443/healthz: Get "https://192.168.67.2:8443/healthz": dial tcp 192.168.67.2:8443: connect: connection refused
	I0630 21:13:17.351098  271327 api_server.go:240] Checking apiserver healthz at https://192.168.67.2:8443/healthz ...
	I0630 21:13:21.339028  271327 api_server.go:266] https://192.168.67.2:8443/healthz returned 403:
	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
	W0630 21:13:21.339123  271327 api_server.go:102] status: https://192.168.67.2:8443/healthz returned error 403:
	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
	I0630 21:13:21.351325  271327 api_server.go:240] Checking apiserver healthz at https://192.168.67.2:8443/healthz ...
	I0630 21:13:21.431449  271327 api_server.go:266] https://192.168.67.2:8443/healthz returned 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[-]poststarthook/bootstrap-controller failed: reason withheld
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[-]poststarthook/ca-registration failed: reason withheld
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-registration-controller ok
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	healthz check failed
	W0630 21:13:21.431549  271327 api_server.go:102] status: https://192.168.67.2:8443/healthz returned error 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[-]poststarthook/bootstrap-controller failed: reason withheld
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[-]poststarthook/ca-registration failed: reason withheld
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-registration-controller ok
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	healthz check failed
	I0630 21:13:21.850982  271327 api_server.go:240] Checking apiserver healthz at https://192.168.67.2:8443/healthz ...
	I0630 21:13:21.856550  271327 api_server.go:266] https://192.168.67.2:8443/healthz returned 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/bootstrap-controller ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[-]poststarthook/ca-registration failed: reason withheld
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-registration-controller ok
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	healthz check failed
	W0630 21:13:21.856585  271327 api_server.go:102] status: https://192.168.67.2:8443/healthz returned error 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/bootstrap-controller ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[-]poststarthook/ca-registration failed: reason withheld
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-registration-controller ok
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	healthz check failed
	I0630 21:13:22.350717  271327 api_server.go:240] Checking apiserver healthz at https://192.168.67.2:8443/healthz ...
	I0630 21:13:22.355970  271327 api_server.go:266] https://192.168.67.2:8443/healthz returned 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/bootstrap-controller ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
	[+]poststarthook/ca-registration ok
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-registration-controller ok
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	healthz check failed
	W0630 21:13:22.356001  271327 api_server.go:102] status: https://192.168.67.2:8443/healthz returned error 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/bootstrap-controller ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
	[+]poststarthook/ca-registration ok
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-registration-controller ok
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	healthz check failed
	I0630 21:13:22.850520  271327 api_server.go:240] Checking apiserver healthz at https://192.168.67.2:8443/healthz ...
	I0630 21:13:22.855972  271327 api_server.go:266] https://192.168.67.2:8443/healthz returned 200:
	ok
	I0630 21:13:22.862642  271327 api_server.go:140] control plane version: v1.16.0
	I0630 21:13:22.862666  271327 api_server.go:130] duration metric: took 6.012660599s to wait for apiserver health ...
	I0630 21:13:22.862677  271327 cni.go:95] Creating CNI manager for ""
	I0630 21:13:22.862685  271327 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:13:22.864875  271327 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0630 21:13:22.866242  271327 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0630 21:13:22.869873  271327 cni.go:189] applying CNI manifest using /var/lib/minikube/binaries/v1.16.0/kubectl ...
	I0630 21:13:22.869889  271327 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2429 bytes)
	I0630 21:13:22.883242  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0630 21:13:23.078089  271327 system_pods.go:43] waiting for kube-system pods to appear ...
	I0630 21:13:23.083797  271327 system_pods.go:59] 8 kube-system pods found
	I0630 21:13:23.083832  271327 system_pods.go:61] "coredns-5644d7b6d9-dw8lr" [ef9b1e7f-ea0b-4a1e-b228-2e673c514421] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.)
	I0630 21:13:23.083840  271327 system_pods.go:61] "etcd-old-k8s-version-20220630210005-9950" [78548814-926d-432e-ad9e-e7dc678dbd4d] Running
	I0630 21:13:23.083848  271327 system_pods.go:61] "kindnet-4gs84" [0eb5f5b6-6c40-401a-95c4-bef42040561c] Running / Ready:ContainersNotReady (containers with unready status: [kindnet-cni]) / ContainersReady:ContainersNotReady (containers with unready status: [kindnet-cni])
	I0630 21:13:23.083855  271327 system_pods.go:61] "kube-apiserver-old-k8s-version-20220630210005-9950" [7db23c99-fdec-4457-b812-8b86a9cdbccc] Running
	I0630 21:13:23.083864  271327 system_pods.go:61] "kube-controller-manager-old-k8s-version-20220630210005-9950" [25cb6398-c181-4dfe-84f6-549d2c40f00f] Running
	I0630 21:13:23.083870  271327 system_pods.go:61] "kube-proxy-twls5" [13daeab7-4a9e-4c35-bcc3-ca38e5008060] Running
	I0630 21:13:23.083878  271327 system_pods.go:61] "kube-scheduler-old-k8s-version-20220630210005-9950" [fcfe335c-050b-43c6-b6b4-7e4f3240a670] Running
	I0630 21:13:23.083891  271327 system_pods.go:61] "storage-provisioner" [c652b6dd-3559-4a3f-8df5-27cc49dc32ad] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.)
	I0630 21:13:23.083898  271327 system_pods.go:74] duration metric: took 5.785541ms to wait for pod list to return data ...
	I0630 21:13:23.083912  271327 node_conditions.go:102] verifying NodePressure condition ...
	I0630 21:13:23.086565  271327 node_conditions.go:122] node storage ephemeral capacity is 304695084Ki
	I0630 21:13:23.086591  271327 node_conditions.go:123] node cpu capacity is 8
	I0630 21:13:23.086605  271327 node_conditions.go:105] duration metric: took 2.688226ms to run NodePressure ...
	I0630 21:13:23.086625  271327 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:13:23.243037  271327 kubeadm.go:762] waiting for restarted kubelet to initialise ...
	I0630 21:13:23.246944  271327 retry.go:31] will retry after 360.127272ms: kubelet not initialised
	I0630 21:13:23.611248  271327 retry.go:31] will retry after 436.71002ms: kubelet not initialised
	I0630 21:13:24.052378  271327 retry.go:31] will retry after 527.46423ms: kubelet not initialised
	I0630 21:13:24.584328  271327 retry.go:31] will retry after 780.162888ms: kubelet not initialised
	I0630 21:13:25.369745  271327 retry.go:31] will retry after 1.502072952s: kubelet not initialised
	I0630 21:13:26.877712  271327 retry.go:31] will retry after 1.073826528s: kubelet not initialised
	I0630 21:13:27.955778  271327 retry.go:31] will retry after 1.869541159s: kubelet not initialised
	I0630 21:13:29.829511  271327 retry.go:31] will retry after 2.549945972s: kubelet not initialised
	I0630 21:13:32.383380  271327 retry.go:31] will retry after 5.131623747s: kubelet not initialised
	I0630 21:13:37.520989  271327 retry.go:31] will retry after 9.757045979s: kubelet not initialised
	I0630 21:13:47.284957  271327 retry.go:31] will retry after 18.937774914s: kubelet not initialised
	I0630 21:14:06.227195  271327 retry.go:31] will retry after 15.44552029s: kubelet not initialised
	I0630 21:14:21.677516  271327 kubeadm.go:777] kubelet initialised
	I0630 21:14:21.677540  271327 kubeadm.go:778] duration metric: took 58.434474358s waiting for restarted kubelet to initialise ...
	I0630 21:14:21.677546  271327 pod_ready.go:35] extra waiting up to 4m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0630 21:14:21.681711  271327 pod_ready.go:78] waiting up to 4m0s for pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace to be "Ready" ...
	I0630 21:14:23.686925  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:14:25.687296  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:14:28.187116  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:14:30.686599  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:14:32.687664  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:14:35.186731  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:14:37.187096  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:14:39.686682  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:14:41.686810  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:14:43.687704  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:14:46.186853  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:14:48.686897  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:14:50.687521  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:14:53.186988  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:14:55.686997  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:14:57.687195  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:14:59.687388  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:02.187439  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:04.686700  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:06.687056  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:08.687373  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:11.186627  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:13.186684  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:15.187150  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:17.187477  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:19.687214  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:22.187240  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:24.187424  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:26.687357  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:29.186785  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:31.187234  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:33.187604  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:35.687367  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:38.186782  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:40.187259  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:42.687520  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:45.186683  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:47.186761  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:49.187685  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:51.687221  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:54.186706  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:56.187242  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:58.687242  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:16:00.687294  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:16:02.687326  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:16:05.186772  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:16:07.187252  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:16:09.187423  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:16:11.687149  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:16:13.687259  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:16:16.187748  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:16:18.686407  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:16:20.687360  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:16:22.687865  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	
	* 
	* ==> container status <==
	* CONTAINER           IMAGE               CREATED             STATE               NAME                      ATTEMPT             POD ID
	8a0d676731abf       6fb66cd78abfe       3 minutes ago       Exited              kindnet-cni               3                   0823b9897612c
	aa0dfccd9a7c9       a634548d10b03       12 minutes ago      Running             kube-proxy                0                   c479a4792f00e
	b2e2e7466122c       5d725196c1f47       12 minutes ago      Running             kube-scheduler            0                   406a4d9e4a4e0
	56c1c7bc165ac       34cdf99b1bb3b       12 minutes ago      Running             kube-controller-manager   0                   5eece610e7575
	f0093895eba10       d3377ffb7177c       12 minutes ago      Running             kube-apiserver            0                   07624118b1109
	a126cf77f563c       aebe758cef4cd       12 minutes ago      Running             etcd                      0                   795cd8784cf1c
	
	* 
	* ==> containerd <==
	* -- Logs begin at Thu 2022-06-30 21:03:44 UTC, end at Thu 2022-06-30 21:16:26 UTC. --
	Jun 30 21:09:48 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:09:48.767761250Z" level=warning msg="cleaning up after shim disconnected" id=584280e8bde0ef7bf80df61cbb48a357cfdc1ad65b8de1fea8b6945ea020a7da namespace=k8s.io
	Jun 30 21:09:48 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:09:48.767773589Z" level=info msg="cleaning up dead shim"
	Jun 30 21:09:48 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:09:48.777541668Z" level=warning msg="cleanup warnings time=\"2022-06-30T21:09:48Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=2466 runtime=io.containerd.runc.v2\n"
	Jun 30 21:09:49 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:09:49.375778342Z" level=info msg="RemoveContainer for \"8102f84d94828ce8eeaa9af1d8a6fc6e04b5f6af2c880836155b0488af953431\""
	Jun 30 21:09:49 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:09:49.383456006Z" level=info msg="RemoveContainer for \"8102f84d94828ce8eeaa9af1d8a6fc6e04b5f6af2c880836155b0488af953431\" returns successfully"
	Jun 30 21:10:02 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:10:02.657959221Z" level=info msg="CreateContainer within sandbox \"0823b9897612c7f5b860b2b0d00ed072c571f9d7f024a97a59f9ccd688f6dee7\" for container &ContainerMetadata{Name:kindnet-cni,Attempt:2,}"
	Jun 30 21:10:02 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:10:02.670847576Z" level=info msg="CreateContainer within sandbox \"0823b9897612c7f5b860b2b0d00ed072c571f9d7f024a97a59f9ccd688f6dee7\" for &ContainerMetadata{Name:kindnet-cni,Attempt:2,} returns container id \"83c75d9c0994fb94d26ab5ba6256c2ff44b00012eb2da9924ab513108045ee77\""
	Jun 30 21:10:02 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:10:02.671477181Z" level=info msg="StartContainer for \"83c75d9c0994fb94d26ab5ba6256c2ff44b00012eb2da9924ab513108045ee77\""
	Jun 30 21:10:02 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:10:02.828124629Z" level=info msg="StartContainer for \"83c75d9c0994fb94d26ab5ba6256c2ff44b00012eb2da9924ab513108045ee77\" returns successfully"
	Jun 30 21:12:43 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:12:43.282476348Z" level=info msg="shim disconnected" id=83c75d9c0994fb94d26ab5ba6256c2ff44b00012eb2da9924ab513108045ee77
	Jun 30 21:12:43 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:12:43.282547174Z" level=warning msg="cleaning up after shim disconnected" id=83c75d9c0994fb94d26ab5ba6256c2ff44b00012eb2da9924ab513108045ee77 namespace=k8s.io
	Jun 30 21:12:43 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:12:43.282563986Z" level=info msg="cleaning up dead shim"
	Jun 30 21:12:43 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:12:43.292451513Z" level=warning msg="cleanup warnings time=\"2022-06-30T21:12:43Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=2571 runtime=io.containerd.runc.v2\n"
	Jun 30 21:12:43 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:12:43.699431114Z" level=info msg="RemoveContainer for \"584280e8bde0ef7bf80df61cbb48a357cfdc1ad65b8de1fea8b6945ea020a7da\""
	Jun 30 21:12:43 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:12:43.704100350Z" level=info msg="RemoveContainer for \"584280e8bde0ef7bf80df61cbb48a357cfdc1ad65b8de1fea8b6945ea020a7da\" returns successfully"
	Jun 30 21:13:08 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:13:08.660149544Z" level=info msg="CreateContainer within sandbox \"0823b9897612c7f5b860b2b0d00ed072c571f9d7f024a97a59f9ccd688f6dee7\" for container &ContainerMetadata{Name:kindnet-cni,Attempt:3,}"
	Jun 30 21:13:08 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:13:08.672625483Z" level=info msg="CreateContainer within sandbox \"0823b9897612c7f5b860b2b0d00ed072c571f9d7f024a97a59f9ccd688f6dee7\" for &ContainerMetadata{Name:kindnet-cni,Attempt:3,} returns container id \"8a0d676731abf60921510a3216fa28f73fc776b06a7dd0ee1d1d2654e8b940e0\""
	Jun 30 21:13:08 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:13:08.673292857Z" level=info msg="StartContainer for \"8a0d676731abf60921510a3216fa28f73fc776b06a7dd0ee1d1d2654e8b940e0\""
	Jun 30 21:13:08 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:13:08.740968211Z" level=info msg="StartContainer for \"8a0d676731abf60921510a3216fa28f73fc776b06a7dd0ee1d1d2654e8b940e0\" returns successfully"
	Jun 30 21:15:49 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:15:49.178227813Z" level=info msg="shim disconnected" id=8a0d676731abf60921510a3216fa28f73fc776b06a7dd0ee1d1d2654e8b940e0
	Jun 30 21:15:49 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:15:49.178291379Z" level=warning msg="cleaning up after shim disconnected" id=8a0d676731abf60921510a3216fa28f73fc776b06a7dd0ee1d1d2654e8b940e0 namespace=k8s.io
	Jun 30 21:15:49 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:15:49.178311016Z" level=info msg="cleaning up dead shim"
	Jun 30 21:15:49 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:15:49.189660709Z" level=warning msg="cleanup warnings time=\"2022-06-30T21:15:49Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=2679 runtime=io.containerd.runc.v2\n"
	Jun 30 21:15:50 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:15:50.053327236Z" level=info msg="RemoveContainer for \"83c75d9c0994fb94d26ab5ba6256c2ff44b00012eb2da9924ab513108045ee77\""
	Jun 30 21:15:50 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:15:50.057845179Z" level=info msg="RemoveContainer for \"83c75d9c0994fb94d26ab5ba6256c2ff44b00012eb2da9924ab513108045ee77\" returns successfully"
	
	* 
	* ==> describe nodes <==
	* Name:               default-k8s-different-port-20220630210335-9950
	Roles:              control-plane
	Labels:             beta.kubernetes.io/arch=amd64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=amd64
	                    kubernetes.io/hostname=default-k8s-different-port-20220630210335-9950
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=251ffcec0e4c997cd7732864187747cc579943c9
	                    minikube.k8s.io/name=default-k8s-different-port-20220630210335-9950
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2022_06_30T21_04_10_0700
	                    minikube.k8s.io/version=v1.26.0
	                    node-role.kubernetes.io/control-plane=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///run/containerd/containerd.sock
	                    node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Thu, 30 Jun 2022 21:04:06 +0000
	Taints:             node.kubernetes.io/not-ready:NoSchedule
	Unschedulable:      false
	Lease:
	  HolderIdentity:  default-k8s-different-port-20220630210335-9950
	  AcquireTime:     <unset>
	  RenewTime:       Thu, 30 Jun 2022 21:16:25 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Thu, 30 Jun 2022 21:14:32 +0000   Thu, 30 Jun 2022 21:04:03 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Thu, 30 Jun 2022 21:14:32 +0000   Thu, 30 Jun 2022 21:04:03 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Thu, 30 Jun 2022 21:14:32 +0000   Thu, 30 Jun 2022 21:04:03 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            False   Thu, 30 Jun 2022 21:14:32 +0000   Thu, 30 Jun 2022 21:04:03 +0000   KubeletNotReady              container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Addresses:
	  InternalIP:  192.168.85.2
	  Hostname:    default-k8s-different-port-20220630210335-9950
	Capacity:
	  cpu:                8
	  ephemeral-storage:  304695084Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32873488Ki
	  pods:               110
	Allocatable:
	  cpu:                8
	  ephemeral-storage:  304695084Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32873488Ki
	  pods:               110
	System Info:
	  Machine ID:                 bbe1e1cef6e940328962dca52b3c5731
	  System UUID:                f0807fcb-4145-441b-8a5a-5dbf32733249
	  Boot ID:                    471c4729-f046-4a15-bc49-46f3ad561708
	  Kernel Version:             5.15.0-1012-gcp
	  OS Image:                   Ubuntu 20.04.4 LTS
	  Operating System:           linux
	  Architecture:               amd64
	  Container Runtime Version:  containerd://1.6.6
	  Kubelet Version:            v1.24.2
	  Kube-Proxy Version:         v1.24.2
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (6 in total)
	  Namespace                   Name                                                                      CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                                                      ------------  ----------  ---------------  -------------  ---
	  kube-system                 etcd-default-k8s-different-port-20220630210335-9950                       100m (1%!)(MISSING)     0 (0%!)(MISSING)      100Mi (0%!)(MISSING)       0 (0%!)(MISSING)         12m
	  kube-system                 kindnet-jgsc8                                                             100m (1%!)(MISSING)     100m (1%!)(MISSING)   50Mi (0%!)(MISSING)        50Mi (0%!)(MISSING)      12m
	  kube-system                 kube-apiserver-default-k8s-different-port-20220630210335-9950             250m (3%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         12m
	  kube-system                 kube-controller-manager-default-k8s-different-port-20220630210335-9950    200m (2%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         12m
	  kube-system                 kube-proxy-jb4cj                                                          0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         12m
	  kube-system                 kube-scheduler-default-k8s-different-port-20220630210335-9950             100m (1%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         12m
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                750m (9%!)(MISSING)   100m (1%!)(MISSING)
	  memory             150Mi (0%!)(MISSING)  50Mi (0%!)(MISSING)
	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	Events:
	  Type    Reason                   Age                From             Message
	  ----    ------                   ----               ----             -------
	  Normal  Starting                 12m                kube-proxy       
	  Normal  NodeHasSufficientMemory  12m (x5 over 12m)  kubelet          Node default-k8s-different-port-20220630210335-9950 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    12m (x5 over 12m)  kubelet          Node default-k8s-different-port-20220630210335-9950 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     12m (x4 over 12m)  kubelet          Node default-k8s-different-port-20220630210335-9950 status is now: NodeHasSufficientPID
	  Normal  NodeHasNoDiskPressure    12m                kubelet          Node default-k8s-different-port-20220630210335-9950 status is now: NodeHasNoDiskPressure
	  Normal  Starting                 12m                kubelet          Starting kubelet.
	  Normal  NodeHasSufficientMemory  12m                kubelet          Node default-k8s-different-port-20220630210335-9950 status is now: NodeHasSufficientMemory
	  Normal  NodeHasSufficientPID     12m                kubelet          Node default-k8s-different-port-20220630210335-9950 status is now: NodeHasSufficientPID
	  Normal  NodeAllocatableEnforced  12m                kubelet          Updated Node Allocatable limit across pods
	  Normal  RegisteredNode           12m                node-controller  Node default-k8s-different-port-20220630210335-9950 event: Registered Node default-k8s-different-port-20220630210335-9950 in Controller
	
	* 
	* ==> dmesg <==
	* [  +2.939825] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000011] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.027789] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.019913] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[ +21.968090] IPv4: martian destination 127.0.0.11 from 10.244.0.3, dev veth8071d138
	[ +25.445872] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.029436] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.023957] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +2.947695] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[Jun30 21:05] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.023879] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +2.955783] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.011828] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000005] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.027896] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	
	* 
	* ==> etcd [a126cf77f563c9a045eb277d6616e24e487ddda0de594854165897f596aaacb9] <==
	* {"level":"info","ts":"2022-06-30T21:04:02.744Z","caller":"embed/etcd.go:763","msg":"serving metrics","address":"http://127.0.0.1:2381"}
	{"level":"info","ts":"2022-06-30T21:04:02.744Z","caller":"embed/etcd.go:581","msg":"serving peer traffic","address":"192.168.85.2:2380"}
	{"level":"info","ts":"2022-06-30T21:04:02.744Z","caller":"embed/etcd.go:553","msg":"cmux::serve","address":"192.168.85.2:2380"}
	{"level":"info","ts":"2022-06-30T21:04:03.633Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"9f0758e1c58a86ed is starting a new election at term 1"}
	{"level":"info","ts":"2022-06-30T21:04:03.633Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"9f0758e1c58a86ed became pre-candidate at term 1"}
	{"level":"info","ts":"2022-06-30T21:04:03.633Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"9f0758e1c58a86ed received MsgPreVoteResp from 9f0758e1c58a86ed at term 1"}
	{"level":"info","ts":"2022-06-30T21:04:03.633Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"9f0758e1c58a86ed became candidate at term 2"}
	{"level":"info","ts":"2022-06-30T21:04:03.633Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"9f0758e1c58a86ed received MsgVoteResp from 9f0758e1c58a86ed at term 2"}
	{"level":"info","ts":"2022-06-30T21:04:03.633Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"9f0758e1c58a86ed became leader at term 2"}
	{"level":"info","ts":"2022-06-30T21:04:03.633Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: 9f0758e1c58a86ed elected leader 9f0758e1c58a86ed at term 2"}
	{"level":"info","ts":"2022-06-30T21:04:03.633Z","caller":"etcdserver/server.go:2042","msg":"published local member to cluster through raft","local-member-id":"9f0758e1c58a86ed","local-member-attributes":"{Name:default-k8s-different-port-20220630210335-9950 ClientURLs:[https://192.168.85.2:2379]}","request-path":"/0/members/9f0758e1c58a86ed/attributes","cluster-id":"68eaea490fab4e05","publish-timeout":"7s"}
	{"level":"info","ts":"2022-06-30T21:04:03.633Z","caller":"embed/serve.go:98","msg":"ready to serve client requests"}
	{"level":"info","ts":"2022-06-30T21:04:03.633Z","caller":"etcdserver/server.go:2507","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}
	{"level":"info","ts":"2022-06-30T21:04:03.633Z","caller":"embed/serve.go:98","msg":"ready to serve client requests"}
	{"level":"info","ts":"2022-06-30T21:04:03.634Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
	{"level":"info","ts":"2022-06-30T21:04:03.634Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
	{"level":"info","ts":"2022-06-30T21:04:03.634Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"68eaea490fab4e05","local-member-id":"9f0758e1c58a86ed","cluster-version":"3.5"}
	{"level":"info","ts":"2022-06-30T21:04:03.634Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
	{"level":"info","ts":"2022-06-30T21:04:03.634Z","caller":"etcdserver/server.go:2531","msg":"cluster version is updated","cluster-version":"3.5"}
	{"level":"info","ts":"2022-06-30T21:04:03.635Z","caller":"embed/serve.go:188","msg":"serving client traffic securely","address":"127.0.0.1:2379"}
	{"level":"info","ts":"2022-06-30T21:04:03.635Z","caller":"embed/serve.go:188","msg":"serving client traffic securely","address":"192.168.85.2:2379"}
	{"level":"warn","ts":"2022-06-30T21:07:03.828Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"140.683358ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/\" range_end:\"/registry/pods0\" count_only:true ","response":"range_response_count:0 size:7"}
	{"level":"info","ts":"2022-06-30T21:07:03.828Z","caller":"traceutil/trace.go:171","msg":"trace[45868920] range","detail":"{range_begin:/registry/pods/; range_end:/registry/pods0; response_count:0; response_revision:421; }","duration":"140.817273ms","start":"2022-06-30T21:07:03.687Z","end":"2022-06-30T21:07:03.828Z","steps":["trace[45868920] 'count revisions from in-memory index tree'  (duration: 140.576636ms)"],"step_count":1}
	{"level":"info","ts":"2022-06-30T21:14:03.648Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":455}
	{"level":"info","ts":"2022-06-30T21:14:03.650Z","caller":"mvcc/kvstore_compaction.go:57","msg":"finished scheduled compaction","compact-revision":455,"took":"1.498172ms"}
	
	* 
	* ==> kernel <==
	*  21:16:27 up 58 min,  0 users,  load average: 0.14, 0.57, 1.28
	Linux default-k8s-different-port-20220630210335-9950 5.15.0-1012-gcp #17~20.04.1-Ubuntu SMP Thu Jun 23 16:10:34 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
	PRETTY_NAME="Ubuntu 20.04.4 LTS"
	
	* 
	* ==> kube-apiserver [f0093895eba1080a2212532b5c34b83dc16abf6e2eccfb1bdf732d5e70875609] <==
	* I0630 21:04:06.434171       1 shared_informer.go:262] Caches are synced for cluster_authentication_trust_controller
	I0630 21:04:06.439202       1 controller.go:611] quota admission added evaluator for: namespaces
	I0630 21:04:06.523292       1 apf_controller.go:322] Running API Priority and Fairness config worker
	I0630 21:04:06.523335       1 cache.go:39] Caches are synced for APIServiceRegistrationController controller
	I0630 21:04:06.523484       1 shared_informer.go:262] Caches are synced for node_authorizer
	I0630 21:04:06.523520       1 cache.go:39] Caches are synced for autoregister controller
	I0630 21:04:06.528129       1 shared_informer.go:262] Caches are synced for crd-autoregister
	I0630 21:04:06.987992       1 controller.go:132] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).
	I0630 21:04:07.306964       1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000
	I0630 21:04:07.310021       1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000
	I0630 21:04:07.310040       1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.
	I0630 21:04:07.688455       1 controller.go:611] quota admission added evaluator for: roles.rbac.authorization.k8s.io
	I0630 21:04:07.735835       1 controller.go:611] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
	I0630 21:04:07.854938       1 alloc.go:327] "allocated clusterIPs" service="default/kubernetes" clusterIPs=map[IPv4:10.96.0.1]
	W0630 21:04:07.860197       1 lease.go:234] Resetting endpoints for master service "kubernetes" to [192.168.85.2]
	I0630 21:04:07.861189       1 controller.go:611] quota admission added evaluator for: endpoints
	I0630 21:04:07.864940       1 controller.go:611] quota admission added evaluator for: endpointslices.discovery.k8s.io
	I0630 21:04:08.456765       1 controller.go:611] quota admission added evaluator for: serviceaccounts
	I0630 21:04:09.445974       1 controller.go:611] quota admission added evaluator for: deployments.apps
	I0630 21:04:09.455771       1 alloc.go:327] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs=map[IPv4:10.96.0.10]
	I0630 21:04:09.466333       1 controller.go:611] quota admission added evaluator for: daemonsets.apps
	I0630 21:04:09.563553       1 controller.go:611] quota admission added evaluator for: leases.coordination.k8s.io
	I0630 21:04:21.314803       1 controller.go:611] quota admission added evaluator for: controllerrevisions.apps
	I0630 21:04:22.114650       1 controller.go:611] quota admission added evaluator for: replicasets.apps
	I0630 21:04:22.652116       1 controller.go:611] quota admission added evaluator for: events.events.k8s.io
	
	* 
	* ==> kube-controller-manager [56c1c7bc165ac17cdfb803f71cd26ff02ab6261448f17c5c4ac7f531a632c67b] <==
	* I0630 21:04:21.320479       1 shared_informer.go:262] Caches are synced for namespace
	I0630 21:04:21.320896       1 event.go:294] "Event occurred" object="kube-system/kube-proxy" fieldPath="" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-jb4cj"
	I0630 21:04:21.324363       1 event.go:294] "Event occurred" object="kube-system/kindnet" fieldPath="" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kindnet-jgsc8"
	I0630 21:04:21.355651       1 shared_informer.go:262] Caches are synced for deployment
	I0630 21:04:21.359253       1 shared_informer.go:262] Caches are synced for service account
	I0630 21:04:21.366778       1 shared_informer.go:262] Caches are synced for disruption
	I0630 21:04:21.366798       1 disruption.go:371] Sending events to api server.
	I0630 21:04:21.487997       1 shared_informer.go:262] Caches are synced for endpoint_slice_mirroring
	I0630 21:04:21.490195       1 shared_informer.go:262] Caches are synced for endpoint
	I0630 21:04:21.503596       1 shared_informer.go:262] Caches are synced for expand
	I0630 21:04:21.504800       1 shared_informer.go:262] Caches are synced for stateful set
	I0630 21:04:21.512633       1 shared_informer.go:262] Caches are synced for persistent volume
	I0630 21:04:21.523832       1 shared_informer.go:262] Caches are synced for resource quota
	I0630 21:04:21.524971       1 shared_informer.go:262] Caches are synced for PVC protection
	I0630 21:04:21.556715       1 shared_informer.go:262] Caches are synced for ephemeral
	I0630 21:04:21.561878       1 shared_informer.go:262] Caches are synced for attach detach
	I0630 21:04:21.568100       1 shared_informer.go:262] Caches are synced for resource quota
	I0630 21:04:21.927657       1 shared_informer.go:262] Caches are synced for garbage collector
	I0630 21:04:21.927689       1 garbagecollector.go:158] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
	I0630 21:04:21.943923       1 shared_informer.go:262] Caches are synced for garbage collector
	I0630 21:04:22.116902       1 event.go:294] "Event occurred" object="kube-system/coredns" fieldPath="" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-6d4b75cb6d to 2"
	I0630 21:04:22.317548       1 event.go:294] "Event occurred" object="kube-system/coredns-6d4b75cb6d" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-6d4b75cb6d-cnt2b"
	I0630 21:04:22.323524       1 event.go:294] "Event occurred" object="kube-system/coredns-6d4b75cb6d" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-6d4b75cb6d-rp7g9"
	I0630 21:04:22.469674       1 event.go:294] "Event occurred" object="kube-system/coredns" fieldPath="" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-6d4b75cb6d to 1"
	I0630 21:04:22.523588       1 event.go:294] "Event occurred" object="kube-system/coredns-6d4b75cb6d" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-6d4b75cb6d-rp7g9"
	
	* 
	* ==> kube-proxy [aa0dfccd9a7c940761ea2c4805338d040616ef5e513c23001d346fe07a7c5eff] <==
	* I0630 21:04:22.576102       1 node.go:163] Successfully retrieved node IP: 192.168.85.2
	I0630 21:04:22.576176       1 server_others.go:138] "Detected node IP" address="192.168.85.2"
	I0630 21:04:22.576216       1 server_others.go:578] "Unknown proxy mode, assuming iptables proxy" proxyMode=""
	I0630 21:04:22.648411       1 server_others.go:206] "Using iptables Proxier"
	I0630 21:04:22.648445       1 server_others.go:213] "kube-proxy running in dual-stack mode" ipFamily=IPv4
	I0630 21:04:22.648457       1 server_others.go:214] "Creating dualStackProxier for iptables"
	I0630 21:04:22.648483       1 server_others.go:501] "Detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, , defaulting to no-op detect-local for IPv6"
	I0630 21:04:22.648518       1 proxier.go:259] "Setting route_localnet=1, use nodePortAddresses to filter loopback addresses for NodePorts to skip it https://issues.k8s.io/90259"
	I0630 21:04:22.648694       1 proxier.go:259] "Setting route_localnet=1, use nodePortAddresses to filter loopback addresses for NodePorts to skip it https://issues.k8s.io/90259"
	I0630 21:04:22.648965       1 server.go:661] "Version info" version="v1.24.2"
	I0630 21:04:22.648989       1 server.go:663] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
	I0630 21:04:22.649821       1 config.go:226] "Starting endpoint slice config controller"
	I0630 21:04:22.649843       1 shared_informer.go:255] Waiting for caches to sync for endpoint slice config
	I0630 21:04:22.649889       1 config.go:317] "Starting service config controller"
	I0630 21:04:22.649900       1 shared_informer.go:255] Waiting for caches to sync for service config
	I0630 21:04:22.649946       1 config.go:444] "Starting node config controller"
	I0630 21:04:22.649970       1 shared_informer.go:255] Waiting for caches to sync for node config
	I0630 21:04:22.749993       1 shared_informer.go:262] Caches are synced for service config
	I0630 21:04:22.750048       1 shared_informer.go:262] Caches are synced for node config
	I0630 21:04:22.750021       1 shared_informer.go:262] Caches are synced for endpoint slice config
	
	* 
	* ==> kube-scheduler [b2e2e7466122cde98a4cb1eba9d3f61be1dc7eb41a6935e6c16b3334125a3df7] <==
	* W0630 21:04:06.439138       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E0630 21:04:06.439258       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	W0630 21:04:06.439213       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E0630 21:04:06.439487       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	W0630 21:04:06.439530       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
	W0630 21:04:06.439635       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	E0630 21:04:06.439746       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	E0630 21:04:06.439668       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
	W0630 21:04:06.438273       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	E0630 21:04:06.440521       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	W0630 21:04:06.439545       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0630 21:04:06.440544       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	W0630 21:04:07.244869       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	E0630 21:04:07.244905       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	W0630 21:04:07.276194       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E0630 21:04:07.276227       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	W0630 21:04:07.289458       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	E0630 21:04:07.289489       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	W0630 21:04:07.295610       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E0630 21:04:07.295643       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	W0630 21:04:07.404412       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	E0630 21:04:07.404447       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	W0630 21:04:07.645230       1 reflector.go:324] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	E0630 21:04:07.645267       1 reflector.go:138] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	I0630 21:04:10.336041       1 shared_informer.go:262] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	
	* 
	* ==> kubelet <==
	* -- Logs begin at Thu 2022-06-30 21:03:44 UTC, end at Thu 2022-06-30 21:16:27 UTC. --
	Jun 30 21:15:10 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:15:10.039871    1349 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:15:15 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:15:15.041081    1349 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:15:20 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:15:20.042490    1349 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:15:25 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:15:25.043589    1349 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:15:30 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:15:30.045075    1349 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:15:35 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:15:35.046072    1349 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:15:40 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:15:40.046858    1349 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:15:45 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:15:45.048001    1349 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:15:50 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:15:50.049361    1349 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:15:50 default-k8s-different-port-20220630210335-9950 kubelet[1349]: I0630 21:15:50.051988    1349 scope.go:110] "RemoveContainer" containerID="83c75d9c0994fb94d26ab5ba6256c2ff44b00012eb2da9924ab513108045ee77"
	Jun 30 21:15:50 default-k8s-different-port-20220630210335-9950 kubelet[1349]: I0630 21:15:50.052336    1349 scope.go:110] "RemoveContainer" containerID="8a0d676731abf60921510a3216fa28f73fc776b06a7dd0ee1d1d2654e8b940e0"
	Jun 30 21:15:50 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:15:50.052740    1349 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kindnet-cni\" with CrashLoopBackOff: \"back-off 40s restarting failed container=kindnet-cni pod=kindnet-jgsc8_kube-system(a63f0d82-ce2a-4e93-8747-604386ef8614)\"" pod="kube-system/kindnet-jgsc8" podUID=a63f0d82-ce2a-4e93-8747-604386ef8614
	Jun 30 21:15:55 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:15:55.050118    1349 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:16:00 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:16:00.051441    1349 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:16:01 default-k8s-different-port-20220630210335-9950 kubelet[1349]: I0630 21:16:01.656209    1349 scope.go:110] "RemoveContainer" containerID="8a0d676731abf60921510a3216fa28f73fc776b06a7dd0ee1d1d2654e8b940e0"
	Jun 30 21:16:01 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:16:01.656633    1349 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kindnet-cni\" with CrashLoopBackOff: \"back-off 40s restarting failed container=kindnet-cni pod=kindnet-jgsc8_kube-system(a63f0d82-ce2a-4e93-8747-604386ef8614)\"" pod="kube-system/kindnet-jgsc8" podUID=a63f0d82-ce2a-4e93-8747-604386ef8614
	Jun 30 21:16:05 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:16:05.052595    1349 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:16:10 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:16:10.054012    1349 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:16:12 default-k8s-different-port-20220630210335-9950 kubelet[1349]: I0630 21:16:12.655780    1349 scope.go:110] "RemoveContainer" containerID="8a0d676731abf60921510a3216fa28f73fc776b06a7dd0ee1d1d2654e8b940e0"
	Jun 30 21:16:12 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:16:12.656169    1349 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kindnet-cni\" with CrashLoopBackOff: \"back-off 40s restarting failed container=kindnet-cni pod=kindnet-jgsc8_kube-system(a63f0d82-ce2a-4e93-8747-604386ef8614)\"" pod="kube-system/kindnet-jgsc8" podUID=a63f0d82-ce2a-4e93-8747-604386ef8614
	Jun 30 21:16:15 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:16:15.054795    1349 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:16:20 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:16:20.055700    1349 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:16:25 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:16:25.057501    1349 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:16:25 default-k8s-different-port-20220630210335-9950 kubelet[1349]: I0630 21:16:25.655638    1349 scope.go:110] "RemoveContainer" containerID="8a0d676731abf60921510a3216fa28f73fc776b06a7dd0ee1d1d2654e8b940e0"
	Jun 30 21:16:25 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:16:25.656087    1349 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kindnet-cni\" with CrashLoopBackOff: \"back-off 40s restarting failed container=kindnet-cni pod=kindnet-jgsc8_kube-system(a63f0d82-ce2a-4e93-8747-604386ef8614)\"" pod="kube-system/kindnet-jgsc8" podUID=a63f0d82-ce2a-4e93-8747-604386ef8614
	

                                                
                                                
-- /stdout --
helpers_test.go:254: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p default-k8s-different-port-20220630210335-9950 -n default-k8s-different-port-20220630210335-9950
helpers_test.go:261: (dbg) Run:  kubectl --context default-k8s-different-port-20220630210335-9950 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:270: non-running pods: busybox coredns-6d4b75cb6d-cnt2b storage-provisioner
helpers_test.go:272: ======> post-mortem[TestStartStop/group/default-k8s-different-port/serial/DeployApp]: describe non-running pods <======
helpers_test.go:275: (dbg) Run:  kubectl --context default-k8s-different-port-20220630210335-9950 describe pod busybox coredns-6d4b75cb6d-cnt2b storage-provisioner
helpers_test.go:275: (dbg) Non-zero exit: kubectl --context default-k8s-different-port-20220630210335-9950 describe pod busybox coredns-6d4b75cb6d-cnt2b storage-provisioner: exit status 1 (64.297361ms)

                                                
                                                
-- stdout --
	Name:         busybox
	Namespace:    default
	Priority:     0
	Node:         <none>
	Labels:       integration-test=busybox
	Annotations:  <none>
	Status:       Pending
	IP:           
	IPs:          <none>
	Containers:
	  busybox:
	    Image:      gcr.io/k8s-minikube/busybox:1.28.4-glibc
	    Port:       <none>
	    Host Port:  <none>
	    Command:
	      sleep
	      3600
	    Environment:  <none>
	    Mounts:
	      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-kr2bz (ro)
	Conditions:
	  Type           Status
	  PodScheduled   False 
	Volumes:
	  kube-api-access-kr2bz:
	    Type:                    Projected (a volume that contains injected data from multiple sources)
	    TokenExpirationSeconds:  3607
	    ConfigMapName:           kube-root-ca.crt
	    ConfigMapOptional:       <nil>
	    DownwardAPI:             true
	QoS Class:                   BestEffort
	Node-Selectors:              <none>
	Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
	                             node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
	Events:
	  Type     Reason            Age                   From               Message
	  ----     ------            ----                  ----               -------
	  Warning  FailedScheduling  2m47s (x2 over 8m2s)  default-scheduler  0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.

                                                
                                                
-- /stdout --
** stderr ** 
	Error from server (NotFound): pods "coredns-6d4b75cb6d-cnt2b" not found
	Error from server (NotFound): pods "storage-provisioner" not found

                                                
                                                
** /stderr **
helpers_test.go:277: kubectl --context default-k8s-different-port-20220630210335-9950 describe pod busybox coredns-6d4b75cb6d-cnt2b storage-provisioner: exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestStartStop/group/default-k8s-different-port/serial/DeployApp]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect default-k8s-different-port-20220630210335-9950
helpers_test.go:235: (dbg) docker inspect default-k8s-different-port-20220630210335-9950:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "99f8da15dcfc83187a1db4c0b15dfeb5920d55fd52718f4f99a491d1ec9f59fc",
	        "Created": "2022-06-30T21:03:43.366289202Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 243225,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2022-06-30T21:03:43.749415396Z",
	            "FinishedAt": "0001-01-01T00:00:00Z"
	        },
	        "Image": "sha256:573e7be5768273a7845baee1ae90fa2e33b83b10a7fbb0f0f41efbf29b53d1f1",
	        "ResolvConfPath": "/var/lib/docker/containers/99f8da15dcfc83187a1db4c0b15dfeb5920d55fd52718f4f99a491d1ec9f59fc/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/99f8da15dcfc83187a1db4c0b15dfeb5920d55fd52718f4f99a491d1ec9f59fc/hostname",
	        "HostsPath": "/var/lib/docker/containers/99f8da15dcfc83187a1db4c0b15dfeb5920d55fd52718f4f99a491d1ec9f59fc/hosts",
	        "LogPath": "/var/lib/docker/containers/99f8da15dcfc83187a1db4c0b15dfeb5920d55fd52718f4f99a491d1ec9f59fc/99f8da15dcfc83187a1db4c0b15dfeb5920d55fd52718f4f99a491d1ec9f59fc-json.log",
	        "Name": "/default-k8s-different-port-20220630210335-9950",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "default-k8s-different-port-20220630210335-9950:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "default-k8s-different-port-20220630210335-9950",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8444/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 2306867200,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": null,
	            "BlkioDeviceWriteBps": null,
	            "BlkioDeviceReadIOps": null,
	            "BlkioDeviceWriteIOps": null,
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "KernelMemory": 0,
	            "KernelMemoryTCP": 0,
	            "MemoryReservation": 0,
	            "MemorySwap": 4613734400,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": null,
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/6cae4fbb3ff06bafae7d678b8be88c46f728f7e162403189e54b6a928eed1dda-init/diff:/var/lib/docker/overlay2/8b88d9f6f12c48be642a133456203e58549a93f1da67d0349744bd0f78917fba/diff:/var/lib/docker/overlay2/2bcbb3b4718a64188802301a25d7f413bb307cb16d077e7e5af799f9152a2970/diff:/var/lib/docker/overlay2/70b0888bf22fcef1c004704b71288ac581cf26a3b3b19fbca3da296ba10d6978/diff:/var/lib/docker/overlay2/7c5332f38fe652f379ef9b6d23e795158e9994317cfb547b581dd2b1fdf1303b/diff:/var/lib/docker/overlay2/0ddb5a3abf433b644a8bfa124e3c87878eed67878faa35493f2befc2b392e9cb/diff:/var/lib/docker/overlay2/3b7cda5fb0232fdeecbec0531ac704a59eb38fe57664c25777193b07e2df0077/diff:/var/lib/docker/overlay2/a14687ada786c65465b9924ae2d77ba27afc07942851cafaade28e80dfe9da16/diff:/var/lib/docker/overlay2/c49a9b7157aa6e8714e192b2849866d035b59e18de462c0ee9b72f898cc5a485/diff:/var/lib/docker/overlay2/efd71a50e3a1044a6d1c4c1a7d4d91d9f070c066e03e51c6c73a5764b778ad72/diff:/var/lib/docker/overlay2/55476a
1c0a20aa4238a0bb0e43c6402c33dcad312938ad48ee81be0160e12a49/diff:/var/lib/docker/overlay2/c48c4a348a797b9a38f01568a6adbcb4b05b4f56f7b986a4bf1b509d8cb00732/diff:/var/lib/docker/overlay2/568e3f354ab0428de5cf82d1fdfb780c3377f5cc55d9f524731c53e39e0ecae7/diff:/var/lib/docker/overlay2/2857943e320cdcdae9af3d8c2acda1fb61e2f142a88b8b902908071cea67816e/diff:/var/lib/docker/overlay2/bdd9a57f0b65e65c5a16395f239425e794c678b0e8db2f4a368e0a9427fe5116/diff:/var/lib/docker/overlay2/b150183f1b73e8c13c751911bcee09fed8ef973478f4dc3cfdb9e509118bf1ea/diff:/var/lib/docker/overlay2/0a053e7c29417cd6feafb351c7944e81342a52898871bc779f7bf61868c78ec4/diff:/var/lib/docker/overlay2/d3c0de3a44d75d0a05acb7843d53deba5ce0457649d6ed757da9b4c532a81e4f/diff:/var/lib/docker/overlay2/53f6170132880e1697dd802b8577382b31c6f1ba144256f8cc62542998842a6b/diff:/var/lib/docker/overlay2/b5c0be6d8efdb1fcb12e73b8f72853f77baa4bc014ac2c1e28b7b972b07f3325/diff:/var/lib/docker/overlay2/36c908f082a1e5388bb25277f1c957eaecf70fcd958080422fa85a3105724fb2/diff:/var/lib/d
ocker/overlay2/b147fe9dce365cfaf9bfeca2e370829e4d87e2671c133a9836ecb02a85422cc7/diff:/var/lib/docker/overlay2/65f488eb9181a721f01b333f5fa0cb91d216abd7842a9ae193bd95316f378721/diff:/var/lib/docker/overlay2/b04269aa247b68912ddc5b1c98ad55d67af4103f576a900eef4069c196b8a263/diff:/var/lib/docker/overlay2/b714c37e15257ae9d0e15d271dd18a330c38ad765901d9b7e7e3feb73e1b03e4/diff:/var/lib/docker/overlay2/3c253b721193edeaade7bba7ce25ff687c889b8fa86e9489c7ee20d5624e6c5b/diff:/var/lib/docker/overlay2/7f67b74e101fa21dd320393c10576eefa4ce1cec2e210bff405784fa45b360f3/diff:/var/lib/docker/overlay2/c3b2adaa63a06a5e6ed966d7b6f20a757aeadd3f25eb09ef3c7e9a66a8904143/diff:/var/lib/docker/overlay2/ddb5d653d19e8cafc4625a8fe9597667d98b277a7f679e532ad84caa2c6da636/diff:/var/lib/docker/overlay2/03eb172b20323ebeee7cb09025726a6e10de6c3dd8661f4f6bbc5a3a3778bad4/diff:/var/lib/docker/overlay2/80ea9bf34d028e95a8a418b3aeb634be72ab3336448946d7855c51ffdf8258d7/diff:/var/lib/docker/overlay2/e28987ea3fb4d431dee111f38cc76814b85f73e86434be3c463c01fdd59
9ad46/diff:/var/lib/docker/overlay2/6f9a46c7c6cf4fd30ce32a1eb08ed9b1e8dd61cb0e42ce54f0f736f06558c306/diff:/var/lib/docker/overlay2/6fc942eb9ccfc09898edc9a5ef3b3d305a6fcb22e8cefb1a9f9c344d10b59b25/diff:/var/lib/docker/overlay2/f6b8c57540e798dc1dfd51fd29c020193c02a4362f31c6d07aa220327bb07b90/diff:/var/lib/docker/overlay2/85d0aa01a3fab8c77262c59d8a7b0809a72673a3da7d33e4e19c04a66db44a11/diff:/var/lib/docker/overlay2/58dcd81a1605641f785ced5aeb38657eec1f02a31b7adfaf4f6fdd49f4bab1d6/diff:/var/lib/docker/overlay2/9d537e0a65325e4bf85b26da9828002339f5c442ca85f931b340457a80ec8c94/diff:/var/lib/docker/overlay2/a6f73707ee6a74e948a02d03c4a3f12b57c2eb408dc67da3c39961bb3cefcc97/diff:/var/lib/docker/overlay2/922526c310b066dbb73b9a106eef8bf0064ad7907a8d7d7b353f5307a17a4901/diff:/var/lib/docker/overlay2/a4185854870ebf8d34a4c7e1827dbe3bc461559839301ffb23c5efff5e3c9f14/diff:/var/lib/docker/overlay2/8c02b1fcb9d79f5d7b2ee4d44f6625a692c44a0d18df0a5c01cac0cca0fdf3f3/diff",
	                "MergedDir": "/var/lib/docker/overlay2/6cae4fbb3ff06bafae7d678b8be88c46f728f7e162403189e54b6a928eed1dda/merged",
	                "UpperDir": "/var/lib/docker/overlay2/6cae4fbb3ff06bafae7d678b8be88c46f728f7e162403189e54b6a928eed1dda/diff",
	                "WorkDir": "/var/lib/docker/overlay2/6cae4fbb3ff06bafae7d678b8be88c46f728f7e162403189e54b6a928eed1dda/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "default-k8s-different-port-20220630210335-9950",
	                "Source": "/var/lib/docker/volumes/default-k8s-different-port-20220630210335-9950/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "default-k8s-different-port-20220630210335-9950",
	            "Domainname": "",
	            "User": "root",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8444/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e",
	            "Volumes": null,
	            "WorkingDir": "",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "default-k8s-different-port-20220630210335-9950",
	                "name.minikube.sigs.k8s.io": "default-k8s-different-port-20220630210335-9950",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "91a4e2a23477a089405a3194b25b1263bcc345054fdee7c0681d4ae4b4dfdbca",
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49407"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49406"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49403"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49405"
	                    }
	                ],
	                "8444/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49404"
	                    }
	                ]
	            },
	            "SandboxKey": "/var/run/docker/netns/91a4e2a23477",
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "default-k8s-different-port-20220630210335-9950": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.85.2"
	                    },
	                    "Links": null,
	                    "Aliases": [
	                        "99f8da15dcfc",
	                        "default-k8s-different-port-20220630210335-9950"
	                    ],
	                    "NetworkID": "88cfda28f4387ea19e39fbebceded21d3930034fa00fca0cacdd2b97de1da8d9",
	                    "EndpointID": "222afaea3384676d2c5a7ff861094912ad678c6a88a78ac77f7423c8583a4b1b",
	                    "Gateway": "192.168.85.1",
	                    "IPAddress": "192.168.85.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "MacAddress": "02:42:c0:a8:55:02",
	                    "DriverOpts": null
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p default-k8s-different-port-20220630210335-9950 -n default-k8s-different-port-20220630210335-9950
helpers_test.go:244: <<< TestStartStop/group/default-k8s-different-port/serial/DeployApp FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======>  post-mortem[TestStartStop/group/default-k8s-different-port/serial/DeployApp]: minikube logs <======
helpers_test.go:247: (dbg) Run:  out/minikube-linux-amd64 -p default-k8s-different-port-20220630210335-9950 logs -n 25
helpers_test.go:252: TestStartStop/group/default-k8s-different-port/serial/DeployApp logs: 
-- stdout --
	* 
	* ==> Audit <==
	* |---------|------------------------------------------------------------|----------|---------|---------|---------------------|---------------------|
	| Command |                            Args                            | Profile  |  User   | Version |     Start Time      |      End Time       |
	|---------|------------------------------------------------------------|----------|---------|---------|---------------------|---------------------|
	| stop    | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:03 UTC | 30 Jun 22 21:04 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=3                                     |          |         |         |                     |                     |
	| addons  | enable dashboard -p                                        | minikube | jenkins | v1.26.0 | 30 Jun 22 21:04 UTC | 30 Jun 22 21:04 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|         | --images=MetricsScraper=k8s.gcr.io/echoserver:1.4          |          |         |         |                     |                     |
	| start   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:04 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|         | --memory=2200                                              |          |         |         |                     |                     |
	|         | --alsologtostderr                                          |          |         |         |                     |                     |
	|         | --wait=true --preload=false                                |          |         |         |                     |                     |
	|         | --driver=docker                                            |          |         |         |                     |                     |
	|         | --container-runtime=containerd                             |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                               |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:05 UTC | 30 Jun 22 21:05 UTC |
	|         | enable-default-cni-20220630204858-9950                     |          |         |         |                     |                     |
	| start   | -p newest-cni-20220630210514-9950 --memory=2200            | minikube | jenkins | v1.26.0 | 30 Jun 22 21:05 UTC | 30 Jun 22 21:06 UTC |
	|         | --alsologtostderr --wait=apiserver,system_pods,default_sa  |          |         |         |                     |                     |
	|         | --feature-gates ServerSideApply=true --network-plugin=cni  |          |         |         |                     |                     |
	|         | --extra-config=kubeadm.pod-network-cidr=192.168.111.111/16 |          |         |         |                     |                     |
	|         | --driver=docker  --container-runtime=containerd            |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                               |          |         |         |                     |                     |
	| addons  | enable metrics-server -p                                   | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | --images=MetricsServer=k8s.gcr.io/echoserver:1.4           |          |         |         |                     |                     |
	|         | --registries=MetricsServer=fake.domain                     |          |         |         |                     |                     |
	| stop    | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=3                                     |          |         |         |                     |                     |
	| addons  | enable dashboard -p                                        | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | --images=MetricsScraper=k8s.gcr.io/echoserver:1.4          |          |         |         |                     |                     |
	| start   | -p newest-cni-20220630210514-9950 --memory=2200            | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | --alsologtostderr --wait=apiserver,system_pods,default_sa  |          |         |         |                     |                     |
	|         | --feature-gates ServerSideApply=true --network-plugin=cni  |          |         |         |                     |                     |
	|         | --extra-config=kubeadm.pod-network-cidr=192.168.111.111/16 |          |         |         |                     |                     |
	|         | --driver=docker  --container-runtime=containerd            |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                               |          |         |         |                     |                     |
	| ssh     | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | sudo crictl images -o json                                 |          |         |         |                     |                     |
	| pause   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                     |          |         |         |                     |                     |
	| unpause | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                     |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | disable-driver-mounts-20220630210659-9950                  |          |         |         |                     |                     |
	| start   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC |                     |
	|         | embed-certs-20220630210659-9950                            |          |         |         |                     |                     |
	|         | --memory=2200 --alsologtostderr                            |          |         |         |                     |                     |
	|         | --wait=true --embed-certs                                  |          |         |         |                     |                     |
	|         | --driver=docker                                            |          |         |         |                     |                     |
	|         | --container-runtime=containerd                             |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                               |          |         |         |                     |                     |
	| ssh     | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|         | sudo crictl images -o json                                 |          |         |         |                     |                     |
	| pause   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                     |          |         |         |                     |                     |
	| unpause | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                     |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	| addons  | enable metrics-server -p                                   | minikube | jenkins | v1.26.0 | 30 Jun 22 21:12 UTC | 30 Jun 22 21:12 UTC |
	|         | old-k8s-version-20220630210005-9950                        |          |         |         |                     |                     |
	|         | --images=MetricsServer=k8s.gcr.io/echoserver:1.4           |          |         |         |                     |                     |
	|         | --registries=MetricsServer=fake.domain                     |          |         |         |                     |                     |
	| stop    | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:12 UTC | 30 Jun 22 21:12 UTC |
	|         | old-k8s-version-20220630210005-9950                        |          |         |         |                     |                     |
	|         | --alsologtostderr -v=3                                     |          |         |         |                     |                     |
	| addons  | enable dashboard -p                                        | minikube | jenkins | v1.26.0 | 30 Jun 22 21:12 UTC | 30 Jun 22 21:12 UTC |
	|         | old-k8s-version-20220630210005-9950                        |          |         |         |                     |                     |
	|         | --images=MetricsScraper=k8s.gcr.io/echoserver:1.4          |          |         |         |                     |                     |
	| start   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:12 UTC |                     |
	|         | old-k8s-version-20220630210005-9950                        |          |         |         |                     |                     |
	|         | --memory=2200 --alsologtostderr                            |          |         |         |                     |                     |
	|         | --wait=true --kvm-network=default                          |          |         |         |                     |                     |
	|         | --kvm-qemu-uri=qemu:///system                              |          |         |         |                     |                     |
	|         | --disable-driver-mounts                                    |          |         |         |                     |                     |
	|         | --keep-context=false                                       |          |         |         |                     |                     |
	|         | --driver=docker                                            |          |         |         |                     |                     |
	|         | --container-runtime=containerd                             |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.16.0                               |          |         |         |                     |                     |
	|---------|------------------------------------------------------------|----------|---------|---------|---------------------|---------------------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2022/06/30 21:12:54
	Running on machine: ubuntu-20-agent-8
	Binary: Built with gc go1.18.3 for linux/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0630 21:12:54.458513  271327 out.go:296] Setting OutFile to fd 1 ...
	I0630 21:12:54.458723  271327 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 21:12:54.458735  271327 out.go:309] Setting ErrFile to fd 2...
	I0630 21:12:54.458739  271327 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 21:12:54.459171  271327 root.go:329] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/bin
	I0630 21:12:54.459399  271327 out.go:303] Setting JSON to false
	I0630 21:12:54.460611  271327 start.go:115] hostinfo: {"hostname":"ubuntu-20-agent-8","uptime":3327,"bootTime":1656620248,"procs":353,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1012-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0630 21:12:54.460675  271327 start.go:125] virtualization: kvm guest
	I0630 21:12:54.464187  271327 out.go:177] * [old-k8s-version-20220630210005-9950] minikube v1.26.0 on Ubuntu 20.04 (kvm/amd64)
	I0630 21:12:54.465765  271327 out.go:177]   - MINIKUBE_LOCATION=14420
	I0630 21:12:54.465705  271327 notify.go:193] Checking for updates...
	I0630 21:12:54.467351  271327 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0630 21:12:54.469076  271327 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:12:54.470734  271327 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube
	I0630 21:12:54.472165  271327 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0630 21:12:54.473803  271327 config.go:178] Loaded profile config "old-k8s-version-20220630210005-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.16.0
	I0630 21:12:54.475600  271327 out.go:177] * Kubernetes 1.24.2 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.24.2
	I0630 21:12:54.476739  271327 driver.go:360] Setting default libvirt URI to qemu:///system
	I0630 21:12:54.520439  271327 docker.go:137] docker version: linux-20.10.17
	I0630 21:12:54.520531  271327 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0630 21:12:54.626504  271327 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:8 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:43 OomKillDisable:true NGoroutines:44 SystemTime:2022-06-30 21:12:54.551026919 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1012-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexServ
erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662451712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-8 Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Client
Info:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
	I0630 21:12:54.626609  271327 docker.go:254] overlay module found
	I0630 21:12:54.628919  271327 out.go:177] * Using the docker driver based on existing profile
	I0630 21:12:54.630364  271327 start.go:284] selected driver: docker
	I0630 21:12:54.630380  271327 start.go:808] validating driver "docker" against &{Name:old-k8s-version-20220630210005-9950 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-20220630210005-9950 Nam
espace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.67.2 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[Dashboard:kubernetesui/dashboard:v2.6.0@sha256:4af9580485920635d888efe1eddbd67e12f9d5d84dba87100e93feb4e46636b3 MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] Star
tHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 21:12:54.630494  271327 start.go:819] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0630 21:12:54.631308  271327 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0630 21:12:54.741608  271327 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:8 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:43 OomKillDisable:true NGoroutines:44 SystemTime:2022-06-30 21:12:54.663294597 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1012-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexServ
erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662451712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-8 Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Client
Info:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
	I0630 21:12:54.741886  271327 start_flags.go:853] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0630 21:12:54.741907  271327 cni.go:95] Creating CNI manager for ""
	I0630 21:12:54.741916  271327 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:12:54.741932  271327 start_flags.go:310] config:
	{Name:old-k8s-version-20220630210005-9950 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-20220630210005-9950 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDom
ain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.67.2 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[Dashboard:kubernetesui/dashboard:v2.6.0@sha256:4af9580485920635d888efe1eddbd67e12f9d5d84dba87100e93feb4e46636b3 MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Su
bnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 21:12:54.745032  271327 out.go:177] * Starting control plane node old-k8s-version-20220630210005-9950 in cluster old-k8s-version-20220630210005-9950
	I0630 21:12:54.746400  271327 cache.go:120] Beginning downloading kic base image for docker with containerd
	I0630 21:12:54.747743  271327 out.go:177] * Pulling base image ...
	I0630 21:12:54.749006  271327 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime containerd
	I0630 21:12:54.749038  271327 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e in local docker daemon
	I0630 21:12:54.749076  271327 preload.go:148] Found local preload: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-containerd-overlay2-amd64.tar.lz4
	I0630 21:12:54.749097  271327 cache.go:57] Caching tarball of preloaded images
	I0630 21:12:54.749296  271327 preload.go:174] Found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-containerd-overlay2-amd64.tar.lz4 in cache, skipping download
	I0630 21:12:54.749311  271327 cache.go:60] Finished verifying existence of preloaded tar for  v1.16.0 on containerd
	I0630 21:12:54.749504  271327 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/config.json ...
	I0630 21:12:54.784190  271327 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e in local docker daemon, skipping pull
	I0630 21:12:54.784215  271327 cache.go:142] gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e exists in daemon, skipping load
	I0630 21:12:54.784225  271327 cache.go:208] Successfully downloaded all kic artifacts
	I0630 21:12:54.784263  271327 start.go:352] acquiring machines lock for old-k8s-version-20220630210005-9950: {Name:mkf719e729d8bddb1fc7c2bc9e00e82ad1c17213 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0630 21:12:54.784376  271327 start.go:356] acquired machines lock for "old-k8s-version-20220630210005-9950" in 93.677µs
	I0630 21:12:54.784402  271327 start.go:94] Skipping create...Using existing machine configuration
	I0630 21:12:54.784407  271327 fix.go:55] fixHost starting: 
	I0630 21:12:54.784629  271327 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220630210005-9950 --format={{.State.Status}}
	I0630 21:12:54.819248  271327 fix.go:103] recreateIfNeeded on old-k8s-version-20220630210005-9950: state=Stopped err=<nil>
	W0630 21:12:54.819277  271327 fix.go:129] unexpected machine state, will restart: <nil>
	I0630 21:12:54.822125  271327 out.go:177] * Restarting existing docker container for "old-k8s-version-20220630210005-9950" ...
	I0630 21:12:54.823401  271327 cli_runner.go:164] Run: docker start old-k8s-version-20220630210005-9950
	I0630 21:12:55.228150  271327 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220630210005-9950 --format={{.State.Status}}
	I0630 21:12:55.267612  271327 kic.go:416] container "old-k8s-version-20220630210005-9950" state is running.
	I0630 21:12:55.267996  271327 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-20220630210005-9950
	I0630 21:12:55.304343  271327 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/config.json ...
	I0630 21:12:55.304609  271327 machine.go:88] provisioning docker machine ...
	I0630 21:12:55.304637  271327 ubuntu.go:169] provisioning hostname "old-k8s-version-20220630210005-9950"
	I0630 21:12:55.304740  271327 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220630210005-9950
	I0630 21:12:55.341604  271327 main.go:134] libmachine: Using SSH client type: native
	I0630 21:12:55.341782  271327 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil>  [] 0s} 127.0.0.1 49432 <nil> <nil>}
	I0630 21:12:55.341804  271327 main.go:134] libmachine: About to run SSH command:
	sudo hostname old-k8s-version-20220630210005-9950 && echo "old-k8s-version-20220630210005-9950" | sudo tee /etc/hostname
	I0630 21:12:55.342411  271327 main.go:134] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:33496->127.0.0.1:49432: read: connection reset by peer
	I0630 21:12:58.474026  271327 main.go:134] libmachine: SSH cmd err, output: <nil>: old-k8s-version-20220630210005-9950
	
	I0630 21:12:58.474096  271327 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220630210005-9950
	I0630 21:12:58.510030  271327 main.go:134] libmachine: Using SSH client type: native
	I0630 21:12:58.510179  271327 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil>  [] 0s} 127.0.0.1 49432 <nil> <nil>}
	I0630 21:12:58.510202  271327 main.go:134] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sold-k8s-version-20220630210005-9950' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-20220630210005-9950/g' /etc/hosts;
				else 
					echo '127.0.1.1 old-k8s-version-20220630210005-9950' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0630 21:12:58.625033  271327 main.go:134] libmachine: SSH cmd err, output: <nil>: 
	I0630 21:12:58.625074  271327 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube CaCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/c
erts/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube}
	I0630 21:12:58.625102  271327 ubuntu.go:177] setting up certificates
	I0630 21:12:58.625117  271327 provision.go:83] configureAuth start
	I0630 21:12:58.625175  271327 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-20220630210005-9950
	I0630 21:12:58.662760  271327 provision.go:138] copyHostCerts
	I0630 21:12:58.662859  271327 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem, removing ...
	I0630 21:12:58.662878  271327 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem
	I0630 21:12:58.662960  271327 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem (1082 bytes)
	I0630 21:12:58.663097  271327 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem, removing ...
	I0630 21:12:58.663121  271327 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem
	I0630 21:12:58.663172  271327 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem (1123 bytes)
	I0630 21:12:58.663265  271327 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem, removing ...
	I0630 21:12:58.663278  271327 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem
	I0630 21:12:58.663321  271327 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem (1679 bytes)
	I0630 21:12:58.663395  271327 provision.go:112] generating server cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-20220630210005-9950 san=[192.168.67.2 127.0.0.1 localhost 127.0.0.1 minikube old-k8s-version-20220630210005-9950]
	I0630 21:12:58.752521  271327 provision.go:172] copyRemoteCerts
	I0630 21:12:58.752583  271327 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0630 21:12:58.752626  271327 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220630210005-9950
	I0630 21:12:58.789059  271327 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49432 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/old-k8s-version-20220630210005-9950/id_rsa Username:docker}
	I0630 21:12:58.876530  271327 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
	I0630 21:12:58.894073  271327 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem --> /etc/docker/server.pem (1277 bytes)
	I0630 21:12:58.911294  271327 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0630 21:12:58.928841  271327 provision.go:86] duration metric: configureAuth took 303.702271ms
	I0630 21:12:58.928870  271327 ubuntu.go:193] setting minikube options for container-runtime
	I0630 21:12:58.929141  271327 config.go:178] Loaded profile config "old-k8s-version-20220630210005-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.16.0
	I0630 21:12:58.929157  271327 machine.go:91] provisioned docker machine in 3.624531122s
	I0630 21:12:58.929166  271327 start.go:306] post-start starting for "old-k8s-version-20220630210005-9950" (driver="docker")
	I0630 21:12:58.929174  271327 start.go:316] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0630 21:12:58.929237  271327 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0630 21:12:58.929282  271327 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220630210005-9950
	I0630 21:12:58.964321  271327 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49432 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/old-k8s-version-20220630210005-9950/id_rsa Username:docker}
	I0630 21:12:59.052606  271327 ssh_runner.go:195] Run: cat /etc/os-release
	I0630 21:12:59.055232  271327 main.go:134] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0630 21:12:59.055263  271327 main.go:134] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0630 21:12:59.055278  271327 main.go:134] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0630 21:12:59.055289  271327 info.go:137] Remote host: Ubuntu 20.04.4 LTS
	I0630 21:12:59.055302  271327 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/addons for local assets ...
	I0630 21:12:59.055349  271327 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files for local assets ...
	I0630 21:12:59.055422  271327 filesync.go:149] local asset: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem -> 99502.pem in /etc/ssl/certs
	I0630 21:12:59.055511  271327 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0630 21:12:59.062501  271327 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem --> /etc/ssl/certs/99502.pem (1708 bytes)
	I0630 21:12:59.079749  271327 start.go:309] post-start completed in 150.570292ms
	I0630 21:12:59.079814  271327 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0630 21:12:59.079848  271327 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220630210005-9950
	I0630 21:12:59.115633  271327 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49432 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/old-k8s-version-20220630210005-9950/id_rsa Username:docker}
	I0630 21:12:59.197533  271327 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0630 21:12:59.201551  271327 fix.go:57] fixHost completed within 4.417138459s
	I0630 21:12:59.201580  271327 start.go:81] releasing machines lock for "old-k8s-version-20220630210005-9950", held for 4.41718709s
	I0630 21:12:59.201664  271327 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-20220630210005-9950
	I0630 21:12:59.236396  271327 ssh_runner.go:195] Run: systemctl --version
	I0630 21:12:59.236429  271327 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/
	I0630 21:12:59.236445  271327 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220630210005-9950
	I0630 21:12:59.236479  271327 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220630210005-9950
	I0630 21:12:59.275956  271327 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49432 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/old-k8s-version-20220630210005-9950/id_rsa Username:docker}
	I0630 21:12:59.278139  271327 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49432 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/old-k8s-version-20220630210005-9950/id_rsa Username:docker}
	I0630 21:12:59.357177  271327 ssh_runner.go:195] Run: sudo systemctl stop -f crio
	I0630 21:12:59.396058  271327 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0630 21:12:59.405905  271327 docker.go:179] disabling docker service ...
	I0630 21:12:59.405971  271327 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0630 21:12:59.415565  271327 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0630 21:12:59.425245  271327 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0630 21:12:59.506277  271327 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0630 21:12:59.579576  271327 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0630 21:12:59.588504  271327 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
	image-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0630 21:12:59.600574  271327 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*sandbox_image = .*$|sandbox_image = "k8s.gcr.io/pause:3.1"|' -i /etc/containerd/config.toml"
	I0630 21:12:59.609004  271327 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*restrict_oom_score_adj = .*$|restrict_oom_score_adj = false|' -i /etc/containerd/config.toml"
	I0630 21:12:59.616872  271327 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*SystemdCgroup = .*$|SystemdCgroup = false|' -i /etc/containerd/config.toml"
	I0630 21:12:59.625560  271327 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*conf_dir = .*$|conf_dir = "/etc/cni/net.mk"|' -i /etc/containerd/config.toml"
	I0630 21:12:59.633687  271327 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^# imports|imports = ["/etc/containerd/containerd.conf.d/02-containerd.conf"]|' -i /etc/containerd/config.toml"
	I0630 21:12:59.641489  271327 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc/containerd/containerd.conf.d && printf %!s(MISSING) "dmVyc2lvbiA9IDIK" | base64 -d | sudo tee /etc/containerd/containerd.conf.d/02-containerd.conf"
	I0630 21:12:59.653799  271327 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0630 21:12:59.661303  271327 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0630 21:12:59.667744  271327 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0630 21:12:59.739470  271327 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0630 21:12:59.811957  271327 start.go:447] Will wait 60s for socket path /run/containerd/containerd.sock
	I0630 21:12:59.812020  271327 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
	I0630 21:12:59.815575  271327 start.go:468] Will wait 60s for crictl version
	I0630 21:12:59.815658  271327 ssh_runner.go:195] Run: sudo crictl version
	I0630 21:12:59.840380  271327 retry.go:31] will retry after 11.04660288s: Temporary Error: sudo crictl version: Process exited with status 1
	stdout:
	
	stderr:
	time="2022-06-30T21:12:59Z" level=fatal msg="getting the runtime version: rpc error: code = Unknown desc = server is not initialized yet"
	I0630 21:13:10.887641  271327 ssh_runner.go:195] Run: sudo crictl version
	I0630 21:13:10.911469  271327 start.go:477] Version:  0.1.0
	RuntimeName:  containerd
	RuntimeVersion:  1.6.6
	RuntimeApiVersion:  v1alpha2
	I0630 21:13:10.911525  271327 ssh_runner.go:195] Run: containerd --version
	I0630 21:13:10.941036  271327 ssh_runner.go:195] Run: containerd --version
	I0630 21:13:10.973182  271327 out.go:177] * Preparing Kubernetes v1.16.0 on containerd 1.6.6 ...
	I0630 21:13:10.974662  271327 cli_runner.go:164] Run: docker network inspect old-k8s-version-20220630210005-9950 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0630 21:13:11.009465  271327 ssh_runner.go:195] Run: grep 192.168.67.1	host.minikube.internal$ /etc/hosts
	I0630 21:13:11.012813  271327 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.67.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0630 21:13:11.023782  271327 out.go:177]   - kubelet.cni-conf-dir=/etc/cni/net.mk
	I0630 21:13:11.025280  271327 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime containerd
	I0630 21:13:11.025333  271327 ssh_runner.go:195] Run: sudo crictl images --output json
	I0630 21:13:11.049476  271327 containerd.go:547] all images are preloaded for containerd runtime.
	I0630 21:13:11.049500  271327 containerd.go:461] Images already preloaded, skipping extraction
	I0630 21:13:11.049574  271327 ssh_runner.go:195] Run: sudo crictl images --output json
	I0630 21:13:11.072721  271327 containerd.go:547] all images are preloaded for containerd runtime.
	I0630 21:13:11.072742  271327 cache_images.go:84] Images are preloaded, skipping loading
	I0630 21:13:11.072795  271327 ssh_runner.go:195] Run: sudo crictl info
	I0630 21:13:11.096695  271327 cni.go:95] Creating CNI manager for ""
	I0630 21:13:11.096723  271327 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:13:11.096741  271327 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
	I0630 21:13:11.096759  271327 kubeadm.go:158] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.67.2 APIServerPort:8443 KubernetesVersion:v1.16.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-20220630210005-9950 NodeName:old-k8s-version-20220630210005-9950 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.67.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.67.2 CgroupDriver:cgroupfs
ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}
	I0630 21:13:11.096917  271327 kubeadm.go:162] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta1
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.67.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: /run/containerd/containerd.sock
	  name: "old-k8s-version-20220630210005-9950"
	  kubeletExtraArgs:
	    node-ip: 192.168.67.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta1
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.67.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: old-k8s-version-20220630210005-9950
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	dns:
	  type: CoreDNS
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      listen-metrics-urls: http://127.0.0.1:2381,http://192.168.67.2:2381
	kubernetesVersion: v1.16.0
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%!"(MISSING)
	  nodefs.inodesFree: "0%!"(MISSING)
	  imagefs.available: "0%!"(MISSING)
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0630 21:13:11.097018  271327 kubeadm.go:961] kubelet [Unit]
	Wants=containerd.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.16.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cni-conf-dir=/etc/cni/net.mk --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=old-k8s-version-20220630210005-9950 --image-service-endpoint=unix:///run/containerd/containerd.sock --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.67.2 --runtime-request-timeout=15m
	
	[Install]
	 config:
	{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-20220630210005-9950 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
	I0630 21:13:11.097187  271327 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.16.0
	I0630 21:13:11.104428  271327 binaries.go:44] Found k8s binaries, skipping transfer
	I0630 21:13:11.104504  271327 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0630 21:13:11.111290  271327 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (580 bytes)
	I0630 21:13:11.123946  271327 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0630 21:13:11.136775  271327 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2154 bytes)
	I0630 21:13:11.149718  271327 ssh_runner.go:195] Run: grep 192.168.67.2	control-plane.minikube.internal$ /etc/hosts
	I0630 21:13:11.152625  271327 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.67.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0630 21:13:11.162302  271327 certs.go:54] Setting up /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950 for IP: 192.168.67.2
	I0630 21:13:11.162407  271327 certs.go:182] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.key
	I0630 21:13:11.162454  271327 certs.go:182] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.key
	I0630 21:13:11.162539  271327 certs.go:298] skipping minikube-user signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/client.key
	I0630 21:13:11.162605  271327 certs.go:298] skipping minikube signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/apiserver.key.c7fa3a9e
	I0630 21:13:11.162643  271327 certs.go:298] skipping aggregator signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/proxy-client.key
	I0630 21:13:11.162760  271327 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950.pem (1338 bytes)
	W0630 21:13:11.162806  271327 certs.go:384] ignoring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950_empty.pem, impossibly tiny 0 bytes
	I0630 21:13:11.162820  271327 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem (1679 bytes)
	I0630 21:13:11.162861  271327 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem (1082 bytes)
	I0630 21:13:11.162895  271327 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem (1123 bytes)
	I0630 21:13:11.162931  271327 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/key.pem (1679 bytes)
	I0630 21:13:11.162990  271327 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem (1708 bytes)
	I0630 21:13:11.163904  271327 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
	I0630 21:13:11.184892  271327 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I0630 21:13:11.206289  271327 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0630 21:13:11.224207  271327 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
	I0630 21:13:11.243140  271327 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0630 21:13:11.262116  271327 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
	I0630 21:13:11.280815  271327 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0630 21:13:11.299759  271327 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
	I0630 21:13:11.318450  271327 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem --> /usr/share/ca-certificates/99502.pem (1708 bytes)
	I0630 21:13:11.337118  271327 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0630 21:13:11.355699  271327 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950.pem --> /usr/share/ca-certificates/9950.pem (1338 bytes)
	I0630 21:13:11.374676  271327 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0630 21:13:11.388531  271327 ssh_runner.go:195] Run: openssl version
	I0630 21:13:11.393893  271327 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/99502.pem && ln -fs /usr/share/ca-certificates/99502.pem /etc/ssl/certs/99502.pem"
	I0630 21:13:11.402243  271327 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/99502.pem
	I0630 21:13:11.405519  271327 certs.go:431] hashing: -rw-r--r-- 1 root root 1708 Jun 30 20:26 /usr/share/ca-certificates/99502.pem
	I0630 21:13:11.405568  271327 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/99502.pem
	I0630 21:13:11.410901  271327 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/99502.pem /etc/ssl/certs/3ec20f2e.0"
	I0630 21:13:11.418854  271327 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0630 21:13:11.427866  271327 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:13:11.431311  271327 certs.go:431] hashing: -rw-r--r-- 1 root root 1111 Jun 30 20:22 /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:13:11.431380  271327 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:13:11.436694  271327 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0630 21:13:11.444577  271327 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/9950.pem && ln -fs /usr/share/ca-certificates/9950.pem /etc/ssl/certs/9950.pem"
	I0630 21:13:11.453028  271327 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/9950.pem
	I0630 21:13:11.456607  271327 certs.go:431] hashing: -rw-r--r-- 1 root root 1338 Jun 30 20:26 /usr/share/ca-certificates/9950.pem
	I0630 21:13:11.456670  271327 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/9950.pem
	I0630 21:13:11.462072  271327 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/9950.pem /etc/ssl/certs/51391683.0"
	I0630 21:13:11.470089  271327 kubeadm.go:395] StartCluster: {Name:old-k8s-version-20220630210005-9950 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-20220630210005-9950 Namespace:default APISe
rverName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.67.2 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[Dashboard:kubernetesui/dashboard:v2.6.0@sha256:4af9580485920635d888efe1eddbd67e12f9d5d84dba87100e93feb4e46636b3 MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s Sc
heduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 21:13:11.470197  271327 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
	I0630 21:13:11.470262  271327 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0630 21:13:11.495667  271327 cri.go:87] found id: "c435aa6fdf138d684f721a5f1fb855163b020feb07c989254589c7e901b37b36"
	I0630 21:13:11.495695  271327 cri.go:87] found id: "27b91b4e1595400f52e6c0fd5fb8e3732c524b9757a79a5a9108333797eb3788"
	I0630 21:13:11.495702  271327 cri.go:87] found id: "998b774f4f284a1fcf3dbd179faaa8c69e39ab084d30662575ac04f0146604f3"
	I0630 21:13:11.495708  271327 cri.go:87] found id: "b8604fd1030fac170f4591063a20f1abfb86602e188695c1be545614d1b4e8a0"
	I0630 21:13:11.495714  271327 cri.go:87] found id: "fa267cd65f4eefef8993b275f8625ee5daf30304f18337e27a9944d1b5f03a02"
	I0630 21:13:11.495721  271327 cri.go:87] found id: "f60b30d7e822cbe35e12b31f9d3517de2de1004b26577e8f27750257f416aae1"
	I0630 21:13:11.495726  271327 cri.go:87] found id: ""
	I0630 21:13:11.495764  271327 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
	I0630 21:13:11.508218  271327 cri.go:114] JSON = null
	W0630 21:13:11.508285  271327 kubeadm.go:402] unpause failed: list paused: list returned 0 containers, but ps returned 6
	I0630 21:13:11.508338  271327 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0630 21:13:11.515470  271327 kubeadm.go:410] found existing configuration files, will attempt cluster restart
	I0630 21:13:11.515494  271327 kubeadm.go:626] restartCluster start
	I0630 21:13:11.515548  271327 ssh_runner.go:195] Run: sudo test -d /data/minikube
	I0630 21:13:11.522610  271327 kubeadm.go:127] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:13:11.523454  271327 kubeconfig.go:116] verify returned: extract IP: "old-k8s-version-20220630210005-9950" does not appear in /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:13:11.523977  271327 kubeconfig.go:127] "old-k8s-version-20220630210005-9950" context is missing from /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig - will repair!
	I0630 21:13:11.524766  271327 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig: {Name:mk34e4a4e7b04f624b9adbda4f77ee20b38308ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:13:11.526353  271327 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
	I0630 21:13:11.533966  271327 api_server.go:165] Checking apiserver status ...
	I0630 21:13:11.534055  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:13:11.542772  271327 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:13:11.743200  271327 api_server.go:165] Checking apiserver status ...
	I0630 21:13:11.743292  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:13:11.752122  271327 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:13:11.943426  271327 api_server.go:165] Checking apiserver status ...
	I0630 21:13:11.943525  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:13:11.952325  271327 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:13:12.143391  271327 api_server.go:165] Checking apiserver status ...
	I0630 21:13:12.143459  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:13:12.152022  271327 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:13:12.343343  271327 api_server.go:165] Checking apiserver status ...
	I0630 21:13:12.343418  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:13:12.351771  271327 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:13:12.542984  271327 api_server.go:165] Checking apiserver status ...
	I0630 21:13:12.543070  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:13:12.551394  271327 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:13:12.743674  271327 api_server.go:165] Checking apiserver status ...
	I0630 21:13:12.743754  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:13:12.752328  271327 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:13:12.943661  271327 api_server.go:165] Checking apiserver status ...
	I0630 21:13:12.943743  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:13:12.952370  271327 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:13:13.143661  271327 api_server.go:165] Checking apiserver status ...
	I0630 21:13:13.143764  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:13:13.152169  271327 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:13:13.343351  271327 api_server.go:165] Checking apiserver status ...
	I0630 21:13:13.343449  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:13:13.351834  271327 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:13:13.543065  271327 api_server.go:165] Checking apiserver status ...
	I0630 21:13:13.543164  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:13:13.551421  271327 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:13:13.743766  271327 api_server.go:165] Checking apiserver status ...
	I0630 21:13:13.743846  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:13:13.752113  271327 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:13:13.943447  271327 api_server.go:165] Checking apiserver status ...
	I0630 21:13:13.943571  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:13:13.952255  271327 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:13:14.143533  271327 api_server.go:165] Checking apiserver status ...
	I0630 21:13:14.143631  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:13:14.152151  271327 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:13:14.343440  271327 api_server.go:165] Checking apiserver status ...
	I0630 21:13:14.343531  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:13:14.352323  271327 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:13:14.543945  271327 api_server.go:165] Checking apiserver status ...
	I0630 21:13:14.544019  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:13:14.553233  271327 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:13:14.553258  271327 api_server.go:165] Checking apiserver status ...
	I0630 21:13:14.553299  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:13:14.561647  271327 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:13:14.561683  271327 kubeadm.go:601] needs reconfigure: apiserver error: timed out waiting for the condition
	I0630 21:13:14.561693  271327 kubeadm.go:1092] stopping kube-system containers ...
	I0630 21:13:14.561708  271327 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name: Namespaces:[kube-system]}
	I0630 21:13:14.561815  271327 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0630 21:13:14.586984  271327 cri.go:87] found id: "c435aa6fdf138d684f721a5f1fb855163b020feb07c989254589c7e901b37b36"
	I0630 21:13:14.587017  271327 cri.go:87] found id: "27b91b4e1595400f52e6c0fd5fb8e3732c524b9757a79a5a9108333797eb3788"
	I0630 21:13:14.587024  271327 cri.go:87] found id: "998b774f4f284a1fcf3dbd179faaa8c69e39ab084d30662575ac04f0146604f3"
	I0630 21:13:14.587034  271327 cri.go:87] found id: "b8604fd1030fac170f4591063a20f1abfb86602e188695c1be545614d1b4e8a0"
	I0630 21:13:14.587040  271327 cri.go:87] found id: "fa267cd65f4eefef8993b275f8625ee5daf30304f18337e27a9944d1b5f03a02"
	I0630 21:13:14.587053  271327 cri.go:87] found id: "f60b30d7e822cbe35e12b31f9d3517de2de1004b26577e8f27750257f416aae1"
	I0630 21:13:14.587059  271327 cri.go:87] found id: ""
	I0630 21:13:14.587064  271327 cri.go:232] Stopping containers: [c435aa6fdf138d684f721a5f1fb855163b020feb07c989254589c7e901b37b36 27b91b4e1595400f52e6c0fd5fb8e3732c524b9757a79a5a9108333797eb3788 998b774f4f284a1fcf3dbd179faaa8c69e39ab084d30662575ac04f0146604f3 b8604fd1030fac170f4591063a20f1abfb86602e188695c1be545614d1b4e8a0 fa267cd65f4eefef8993b275f8625ee5daf30304f18337e27a9944d1b5f03a02 f60b30d7e822cbe35e12b31f9d3517de2de1004b26577e8f27750257f416aae1]
	I0630 21:13:14.587112  271327 ssh_runner.go:195] Run: which crictl
	I0630 21:13:14.590164  271327 ssh_runner.go:195] Run: sudo /usr/bin/crictl stop c435aa6fdf138d684f721a5f1fb855163b020feb07c989254589c7e901b37b36 27b91b4e1595400f52e6c0fd5fb8e3732c524b9757a79a5a9108333797eb3788 998b774f4f284a1fcf3dbd179faaa8c69e39ab084d30662575ac04f0146604f3 b8604fd1030fac170f4591063a20f1abfb86602e188695c1be545614d1b4e8a0 fa267cd65f4eefef8993b275f8625ee5daf30304f18337e27a9944d1b5f03a02 f60b30d7e822cbe35e12b31f9d3517de2de1004b26577e8f27750257f416aae1
	I0630 21:13:14.618090  271327 ssh_runner.go:195] Run: sudo systemctl stop kubelet
	I0630 21:13:14.628795  271327 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0630 21:13:14.636533  271327 kubeadm.go:155] found existing configuration files:
	-rw------- 1 root root 5743 Jun 30 21:00 /etc/kubernetes/admin.conf
	-rw------- 1 root root 5779 Jun 30 21:00 /etc/kubernetes/controller-manager.conf
	-rw------- 1 root root 5927 Jun 30 21:00 /etc/kubernetes/kubelet.conf
	-rw------- 1 root root 5731 Jun 30 21:00 /etc/kubernetes/scheduler.conf
	
	I0630 21:13:14.636601  271327 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
	I0630 21:13:14.644036  271327 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
	I0630 21:13:14.651486  271327 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
	I0630 21:13:14.658853  271327 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
	I0630 21:13:14.666211  271327 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0630 21:13:14.673925  271327 kubeadm.go:703] reconfiguring cluster from /var/tmp/minikube/kubeadm.yaml
	I0630 21:13:14.673958  271327 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:13:14.729593  271327 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:13:15.448255  271327 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:13:15.591389  271327 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:13:15.660482  271327 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:13:15.826815  271327 api_server.go:51] waiting for apiserver process to appear ...
	I0630 21:13:15.826889  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 21:13:16.336913  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 21:13:16.837002  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 21:13:16.849966  271327 api_server.go:71] duration metric: took 1.023156233s to wait for apiserver process to appear ...
	I0630 21:13:16.849999  271327 api_server.go:87] waiting for apiserver healthz status ...
	I0630 21:13:16.850013  271327 api_server.go:240] Checking apiserver healthz at https://192.168.67.2:8443/healthz ...
	I0630 21:13:16.850373  271327 api_server.go:256] stopped: https://192.168.67.2:8443/healthz: Get "https://192.168.67.2:8443/healthz": dial tcp 192.168.67.2:8443: connect: connection refused
	I0630 21:13:17.351098  271327 api_server.go:240] Checking apiserver healthz at https://192.168.67.2:8443/healthz ...
	I0630 21:13:21.339028  271327 api_server.go:266] https://192.168.67.2:8443/healthz returned 403:
	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
	W0630 21:13:21.339123  271327 api_server.go:102] status: https://192.168.67.2:8443/healthz returned error 403:
	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
	I0630 21:13:21.351325  271327 api_server.go:240] Checking apiserver healthz at https://192.168.67.2:8443/healthz ...
	I0630 21:13:21.431449  271327 api_server.go:266] https://192.168.67.2:8443/healthz returned 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[-]poststarthook/bootstrap-controller failed: reason withheld
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[-]poststarthook/ca-registration failed: reason withheld
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-registration-controller ok
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	healthz check failed
	W0630 21:13:21.431549  271327 api_server.go:102] status: https://192.168.67.2:8443/healthz returned error 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[-]poststarthook/bootstrap-controller failed: reason withheld
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[-]poststarthook/ca-registration failed: reason withheld
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-registration-controller ok
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	healthz check failed
	I0630 21:13:21.850982  271327 api_server.go:240] Checking apiserver healthz at https://192.168.67.2:8443/healthz ...
	I0630 21:13:21.856550  271327 api_server.go:266] https://192.168.67.2:8443/healthz returned 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/bootstrap-controller ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[-]poststarthook/ca-registration failed: reason withheld
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-registration-controller ok
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	healthz check failed
	W0630 21:13:21.856585  271327 api_server.go:102] status: https://192.168.67.2:8443/healthz returned error 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/bootstrap-controller ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[-]poststarthook/ca-registration failed: reason withheld
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-registration-controller ok
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	healthz check failed
	I0630 21:13:22.350717  271327 api_server.go:240] Checking apiserver healthz at https://192.168.67.2:8443/healthz ...
	I0630 21:13:22.355970  271327 api_server.go:266] https://192.168.67.2:8443/healthz returned 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/bootstrap-controller ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
	[+]poststarthook/ca-registration ok
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-registration-controller ok
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	healthz check failed
	W0630 21:13:22.356001  271327 api_server.go:102] status: https://192.168.67.2:8443/healthz returned error 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/bootstrap-controller ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
	[+]poststarthook/ca-registration ok
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-registration-controller ok
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	healthz check failed
	I0630 21:13:22.850520  271327 api_server.go:240] Checking apiserver healthz at https://192.168.67.2:8443/healthz ...
	I0630 21:13:22.855972  271327 api_server.go:266] https://192.168.67.2:8443/healthz returned 200:
	ok
	I0630 21:13:22.862642  271327 api_server.go:140] control plane version: v1.16.0
	I0630 21:13:22.862666  271327 api_server.go:130] duration metric: took 6.012660599s to wait for apiserver health ...
	I0630 21:13:22.862677  271327 cni.go:95] Creating CNI manager for ""
	I0630 21:13:22.862685  271327 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:13:22.864875  271327 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0630 21:13:22.866242  271327 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0630 21:13:22.869873  271327 cni.go:189] applying CNI manifest using /var/lib/minikube/binaries/v1.16.0/kubectl ...
	I0630 21:13:22.869889  271327 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2429 bytes)
	I0630 21:13:22.883242  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0630 21:13:23.078089  271327 system_pods.go:43] waiting for kube-system pods to appear ...
	I0630 21:13:23.083797  271327 system_pods.go:59] 8 kube-system pods found
	I0630 21:13:23.083832  271327 system_pods.go:61] "coredns-5644d7b6d9-dw8lr" [ef9b1e7f-ea0b-4a1e-b228-2e673c514421] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.)
	I0630 21:13:23.083840  271327 system_pods.go:61] "etcd-old-k8s-version-20220630210005-9950" [78548814-926d-432e-ad9e-e7dc678dbd4d] Running
	I0630 21:13:23.083848  271327 system_pods.go:61] "kindnet-4gs84" [0eb5f5b6-6c40-401a-95c4-bef42040561c] Running / Ready:ContainersNotReady (containers with unready status: [kindnet-cni]) / ContainersReady:ContainersNotReady (containers with unready status: [kindnet-cni])
	I0630 21:13:23.083855  271327 system_pods.go:61] "kube-apiserver-old-k8s-version-20220630210005-9950" [7db23c99-fdec-4457-b812-8b86a9cdbccc] Running
	I0630 21:13:23.083864  271327 system_pods.go:61] "kube-controller-manager-old-k8s-version-20220630210005-9950" [25cb6398-c181-4dfe-84f6-549d2c40f00f] Running
	I0630 21:13:23.083870  271327 system_pods.go:61] "kube-proxy-twls5" [13daeab7-4a9e-4c35-bcc3-ca38e5008060] Running
	I0630 21:13:23.083878  271327 system_pods.go:61] "kube-scheduler-old-k8s-version-20220630210005-9950" [fcfe335c-050b-43c6-b6b4-7e4f3240a670] Running
	I0630 21:13:23.083891  271327 system_pods.go:61] "storage-provisioner" [c652b6dd-3559-4a3f-8df5-27cc49dc32ad] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.)
	I0630 21:13:23.083898  271327 system_pods.go:74] duration metric: took 5.785541ms to wait for pod list to return data ...
	I0630 21:13:23.083912  271327 node_conditions.go:102] verifying NodePressure condition ...
	I0630 21:13:23.086565  271327 node_conditions.go:122] node storage ephemeral capacity is 304695084Ki
	I0630 21:13:23.086591  271327 node_conditions.go:123] node cpu capacity is 8
	I0630 21:13:23.086605  271327 node_conditions.go:105] duration metric: took 2.688226ms to run NodePressure ...
	I0630 21:13:23.086625  271327 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:13:23.243037  271327 kubeadm.go:762] waiting for restarted kubelet to initialise ...
	I0630 21:13:23.246944  271327 retry.go:31] will retry after 360.127272ms: kubelet not initialised
	I0630 21:13:23.611248  271327 retry.go:31] will retry after 436.71002ms: kubelet not initialised
	I0630 21:13:24.052378  271327 retry.go:31] will retry after 527.46423ms: kubelet not initialised
	I0630 21:13:24.584328  271327 retry.go:31] will retry after 780.162888ms: kubelet not initialised
	I0630 21:13:25.369745  271327 retry.go:31] will retry after 1.502072952s: kubelet not initialised
	I0630 21:13:26.877712  271327 retry.go:31] will retry after 1.073826528s: kubelet not initialised
	I0630 21:13:27.955778  271327 retry.go:31] will retry after 1.869541159s: kubelet not initialised
	I0630 21:13:29.829511  271327 retry.go:31] will retry after 2.549945972s: kubelet not initialised
	I0630 21:13:32.383380  271327 retry.go:31] will retry after 5.131623747s: kubelet not initialised
	I0630 21:13:37.520989  271327 retry.go:31] will retry after 9.757045979s: kubelet not initialised
	I0630 21:13:47.284957  271327 retry.go:31] will retry after 18.937774914s: kubelet not initialised
	I0630 21:14:06.227195  271327 retry.go:31] will retry after 15.44552029s: kubelet not initialised
	I0630 21:14:21.677516  271327 kubeadm.go:777] kubelet initialised
	I0630 21:14:21.677540  271327 kubeadm.go:778] duration metric: took 58.434474358s waiting for restarted kubelet to initialise ...
	I0630 21:14:21.677546  271327 pod_ready.go:35] extra waiting up to 4m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0630 21:14:21.681711  271327 pod_ready.go:78] waiting up to 4m0s for pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace to be "Ready" ...
	I0630 21:14:23.686925  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:14:25.687296  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:14:28.187116  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:14:30.686599  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:14:32.687664  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:14:35.186731  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:14:37.187096  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:14:39.686682  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:14:41.686810  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:14:43.687704  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:14:46.186853  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:14:48.686897  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:14:50.687521  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:14:53.186988  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:14:55.686997  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:14:57.687195  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:14:59.687388  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:02.187439  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:04.686700  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:06.687056  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:08.687373  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:11.186627  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:13.186684  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:15.187150  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:17.187477  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:19.687214  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:22.187240  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:24.187424  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:26.687357  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:29.186785  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:31.187234  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:33.187604  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:35.687367  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:38.186782  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:40.187259  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:42.687520  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:45.186683  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:47.186761  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:49.187685  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:51.687221  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:54.186706  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:56.187242  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:58.687242  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:16:00.687294  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:16:02.687326  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:16:05.186772  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:16:07.187252  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:16:09.187423  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:16:11.687149  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:16:13.687259  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:16:16.187748  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:16:18.686407  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:16:20.687360  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:16:22.687865  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	
	* 
	* ==> container status <==
	* CONTAINER           IMAGE               CREATED             STATE               NAME                      ATTEMPT             POD ID
	8a0d676731abf       6fb66cd78abfe       3 minutes ago       Exited              kindnet-cni               3                   0823b9897612c
	aa0dfccd9a7c9       a634548d10b03       12 minutes ago      Running             kube-proxy                0                   c479a4792f00e
	b2e2e7466122c       5d725196c1f47       12 minutes ago      Running             kube-scheduler            0                   406a4d9e4a4e0
	56c1c7bc165ac       34cdf99b1bb3b       12 minutes ago      Running             kube-controller-manager   0                   5eece610e7575
	f0093895eba10       d3377ffb7177c       12 minutes ago      Running             kube-apiserver            0                   07624118b1109
	a126cf77f563c       aebe758cef4cd       12 minutes ago      Running             etcd                      0                   795cd8784cf1c
	
	* 
	* ==> containerd <==
	* -- Logs begin at Thu 2022-06-30 21:03:44 UTC, end at Thu 2022-06-30 21:16:28 UTC. --
	Jun 30 21:09:48 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:09:48.767761250Z" level=warning msg="cleaning up after shim disconnected" id=584280e8bde0ef7bf80df61cbb48a357cfdc1ad65b8de1fea8b6945ea020a7da namespace=k8s.io
	Jun 30 21:09:48 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:09:48.767773589Z" level=info msg="cleaning up dead shim"
	Jun 30 21:09:48 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:09:48.777541668Z" level=warning msg="cleanup warnings time=\"2022-06-30T21:09:48Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=2466 runtime=io.containerd.runc.v2\n"
	Jun 30 21:09:49 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:09:49.375778342Z" level=info msg="RemoveContainer for \"8102f84d94828ce8eeaa9af1d8a6fc6e04b5f6af2c880836155b0488af953431\""
	Jun 30 21:09:49 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:09:49.383456006Z" level=info msg="RemoveContainer for \"8102f84d94828ce8eeaa9af1d8a6fc6e04b5f6af2c880836155b0488af953431\" returns successfully"
	Jun 30 21:10:02 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:10:02.657959221Z" level=info msg="CreateContainer within sandbox \"0823b9897612c7f5b860b2b0d00ed072c571f9d7f024a97a59f9ccd688f6dee7\" for container &ContainerMetadata{Name:kindnet-cni,Attempt:2,}"
	Jun 30 21:10:02 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:10:02.670847576Z" level=info msg="CreateContainer within sandbox \"0823b9897612c7f5b860b2b0d00ed072c571f9d7f024a97a59f9ccd688f6dee7\" for &ContainerMetadata{Name:kindnet-cni,Attempt:2,} returns container id \"83c75d9c0994fb94d26ab5ba6256c2ff44b00012eb2da9924ab513108045ee77\""
	Jun 30 21:10:02 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:10:02.671477181Z" level=info msg="StartContainer for \"83c75d9c0994fb94d26ab5ba6256c2ff44b00012eb2da9924ab513108045ee77\""
	Jun 30 21:10:02 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:10:02.828124629Z" level=info msg="StartContainer for \"83c75d9c0994fb94d26ab5ba6256c2ff44b00012eb2da9924ab513108045ee77\" returns successfully"
	Jun 30 21:12:43 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:12:43.282476348Z" level=info msg="shim disconnected" id=83c75d9c0994fb94d26ab5ba6256c2ff44b00012eb2da9924ab513108045ee77
	Jun 30 21:12:43 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:12:43.282547174Z" level=warning msg="cleaning up after shim disconnected" id=83c75d9c0994fb94d26ab5ba6256c2ff44b00012eb2da9924ab513108045ee77 namespace=k8s.io
	Jun 30 21:12:43 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:12:43.282563986Z" level=info msg="cleaning up dead shim"
	Jun 30 21:12:43 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:12:43.292451513Z" level=warning msg="cleanup warnings time=\"2022-06-30T21:12:43Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=2571 runtime=io.containerd.runc.v2\n"
	Jun 30 21:12:43 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:12:43.699431114Z" level=info msg="RemoveContainer for \"584280e8bde0ef7bf80df61cbb48a357cfdc1ad65b8de1fea8b6945ea020a7da\""
	Jun 30 21:12:43 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:12:43.704100350Z" level=info msg="RemoveContainer for \"584280e8bde0ef7bf80df61cbb48a357cfdc1ad65b8de1fea8b6945ea020a7da\" returns successfully"
	Jun 30 21:13:08 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:13:08.660149544Z" level=info msg="CreateContainer within sandbox \"0823b9897612c7f5b860b2b0d00ed072c571f9d7f024a97a59f9ccd688f6dee7\" for container &ContainerMetadata{Name:kindnet-cni,Attempt:3,}"
	Jun 30 21:13:08 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:13:08.672625483Z" level=info msg="CreateContainer within sandbox \"0823b9897612c7f5b860b2b0d00ed072c571f9d7f024a97a59f9ccd688f6dee7\" for &ContainerMetadata{Name:kindnet-cni,Attempt:3,} returns container id \"8a0d676731abf60921510a3216fa28f73fc776b06a7dd0ee1d1d2654e8b940e0\""
	Jun 30 21:13:08 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:13:08.673292857Z" level=info msg="StartContainer for \"8a0d676731abf60921510a3216fa28f73fc776b06a7dd0ee1d1d2654e8b940e0\""
	Jun 30 21:13:08 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:13:08.740968211Z" level=info msg="StartContainer for \"8a0d676731abf60921510a3216fa28f73fc776b06a7dd0ee1d1d2654e8b940e0\" returns successfully"
	Jun 30 21:15:49 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:15:49.178227813Z" level=info msg="shim disconnected" id=8a0d676731abf60921510a3216fa28f73fc776b06a7dd0ee1d1d2654e8b940e0
	Jun 30 21:15:49 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:15:49.178291379Z" level=warning msg="cleaning up after shim disconnected" id=8a0d676731abf60921510a3216fa28f73fc776b06a7dd0ee1d1d2654e8b940e0 namespace=k8s.io
	Jun 30 21:15:49 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:15:49.178311016Z" level=info msg="cleaning up dead shim"
	Jun 30 21:15:49 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:15:49.189660709Z" level=warning msg="cleanup warnings time=\"2022-06-30T21:15:49Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=2679 runtime=io.containerd.runc.v2\n"
	Jun 30 21:15:50 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:15:50.053327236Z" level=info msg="RemoveContainer for \"83c75d9c0994fb94d26ab5ba6256c2ff44b00012eb2da9924ab513108045ee77\""
	Jun 30 21:15:50 default-k8s-different-port-20220630210335-9950 containerd[520]: time="2022-06-30T21:15:50.057845179Z" level=info msg="RemoveContainer for \"83c75d9c0994fb94d26ab5ba6256c2ff44b00012eb2da9924ab513108045ee77\" returns successfully"
	
	* 
	* ==> describe nodes <==
	* Name:               default-k8s-different-port-20220630210335-9950
	Roles:              control-plane
	Labels:             beta.kubernetes.io/arch=amd64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=amd64
	                    kubernetes.io/hostname=default-k8s-different-port-20220630210335-9950
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=251ffcec0e4c997cd7732864187747cc579943c9
	                    minikube.k8s.io/name=default-k8s-different-port-20220630210335-9950
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2022_06_30T21_04_10_0700
	                    minikube.k8s.io/version=v1.26.0
	                    node-role.kubernetes.io/control-plane=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///run/containerd/containerd.sock
	                    node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Thu, 30 Jun 2022 21:04:06 +0000
	Taints:             node.kubernetes.io/not-ready:NoSchedule
	Unschedulable:      false
	Lease:
	  HolderIdentity:  default-k8s-different-port-20220630210335-9950
	  AcquireTime:     <unset>
	  RenewTime:       Thu, 30 Jun 2022 21:16:25 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Thu, 30 Jun 2022 21:14:32 +0000   Thu, 30 Jun 2022 21:04:03 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Thu, 30 Jun 2022 21:14:32 +0000   Thu, 30 Jun 2022 21:04:03 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Thu, 30 Jun 2022 21:14:32 +0000   Thu, 30 Jun 2022 21:04:03 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            False   Thu, 30 Jun 2022 21:14:32 +0000   Thu, 30 Jun 2022 21:04:03 +0000   KubeletNotReady              container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Addresses:
	  InternalIP:  192.168.85.2
	  Hostname:    default-k8s-different-port-20220630210335-9950
	Capacity:
	  cpu:                8
	  ephemeral-storage:  304695084Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32873488Ki
	  pods:               110
	Allocatable:
	  cpu:                8
	  ephemeral-storage:  304695084Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32873488Ki
	  pods:               110
	System Info:
	  Machine ID:                 bbe1e1cef6e940328962dca52b3c5731
	  System UUID:                f0807fcb-4145-441b-8a5a-5dbf32733249
	  Boot ID:                    471c4729-f046-4a15-bc49-46f3ad561708
	  Kernel Version:             5.15.0-1012-gcp
	  OS Image:                   Ubuntu 20.04.4 LTS
	  Operating System:           linux
	  Architecture:               amd64
	  Container Runtime Version:  containerd://1.6.6
	  Kubelet Version:            v1.24.2
	  Kube-Proxy Version:         v1.24.2
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (6 in total)
	  Namespace                   Name                                                                      CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                                                      ------------  ----------  ---------------  -------------  ---
	  kube-system                 etcd-default-k8s-different-port-20220630210335-9950                       100m (1%!)(MISSING)     0 (0%!)(MISSING)      100Mi (0%!)(MISSING)       0 (0%!)(MISSING)         12m
	  kube-system                 kindnet-jgsc8                                                             100m (1%!)(MISSING)     100m (1%!)(MISSING)   50Mi (0%!)(MISSING)        50Mi (0%!)(MISSING)      12m
	  kube-system                 kube-apiserver-default-k8s-different-port-20220630210335-9950             250m (3%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         12m
	  kube-system                 kube-controller-manager-default-k8s-different-port-20220630210335-9950    200m (2%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         12m
	  kube-system                 kube-proxy-jb4cj                                                          0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         12m
	  kube-system                 kube-scheduler-default-k8s-different-port-20220630210335-9950             100m (1%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         12m
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                750m (9%!)(MISSING)   100m (1%!)(MISSING)
	  memory             150Mi (0%!)(MISSING)  50Mi (0%!)(MISSING)
	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	Events:
	  Type    Reason                   Age                From             Message
	  ----    ------                   ----               ----             -------
	  Normal  Starting                 12m                kube-proxy       
	  Normal  NodeHasSufficientMemory  12m (x5 over 12m)  kubelet          Node default-k8s-different-port-20220630210335-9950 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    12m (x5 over 12m)  kubelet          Node default-k8s-different-port-20220630210335-9950 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     12m (x4 over 12m)  kubelet          Node default-k8s-different-port-20220630210335-9950 status is now: NodeHasSufficientPID
	  Normal  NodeHasNoDiskPressure    12m                kubelet          Node default-k8s-different-port-20220630210335-9950 status is now: NodeHasNoDiskPressure
	  Normal  Starting                 12m                kubelet          Starting kubelet.
	  Normal  NodeHasSufficientMemory  12m                kubelet          Node default-k8s-different-port-20220630210335-9950 status is now: NodeHasSufficientMemory
	  Normal  NodeHasSufficientPID     12m                kubelet          Node default-k8s-different-port-20220630210335-9950 status is now: NodeHasSufficientPID
	  Normal  NodeAllocatableEnforced  12m                kubelet          Updated Node Allocatable limit across pods
	  Normal  RegisteredNode           12m                node-controller  Node default-k8s-different-port-20220630210335-9950 event: Registered Node default-k8s-different-port-20220630210335-9950 in Controller
	
	* 
	* ==> dmesg <==
	* [  +2.939825] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000011] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.027789] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.019913] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[ +21.968090] IPv4: martian destination 127.0.0.11 from 10.244.0.3, dev veth8071d138
	[ +25.445872] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.029436] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.023957] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +2.947695] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[Jun30 21:05] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.023879] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +2.955783] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.011828] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000005] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.027896] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	
	* 
	* ==> etcd [a126cf77f563c9a045eb277d6616e24e487ddda0de594854165897f596aaacb9] <==
	* {"level":"info","ts":"2022-06-30T21:04:02.744Z","caller":"embed/etcd.go:763","msg":"serving metrics","address":"http://127.0.0.1:2381"}
	{"level":"info","ts":"2022-06-30T21:04:02.744Z","caller":"embed/etcd.go:581","msg":"serving peer traffic","address":"192.168.85.2:2380"}
	{"level":"info","ts":"2022-06-30T21:04:02.744Z","caller":"embed/etcd.go:553","msg":"cmux::serve","address":"192.168.85.2:2380"}
	{"level":"info","ts":"2022-06-30T21:04:03.633Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"9f0758e1c58a86ed is starting a new election at term 1"}
	{"level":"info","ts":"2022-06-30T21:04:03.633Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"9f0758e1c58a86ed became pre-candidate at term 1"}
	{"level":"info","ts":"2022-06-30T21:04:03.633Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"9f0758e1c58a86ed received MsgPreVoteResp from 9f0758e1c58a86ed at term 1"}
	{"level":"info","ts":"2022-06-30T21:04:03.633Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"9f0758e1c58a86ed became candidate at term 2"}
	{"level":"info","ts":"2022-06-30T21:04:03.633Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"9f0758e1c58a86ed received MsgVoteResp from 9f0758e1c58a86ed at term 2"}
	{"level":"info","ts":"2022-06-30T21:04:03.633Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"9f0758e1c58a86ed became leader at term 2"}
	{"level":"info","ts":"2022-06-30T21:04:03.633Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: 9f0758e1c58a86ed elected leader 9f0758e1c58a86ed at term 2"}
	{"level":"info","ts":"2022-06-30T21:04:03.633Z","caller":"etcdserver/server.go:2042","msg":"published local member to cluster through raft","local-member-id":"9f0758e1c58a86ed","local-member-attributes":"{Name:default-k8s-different-port-20220630210335-9950 ClientURLs:[https://192.168.85.2:2379]}","request-path":"/0/members/9f0758e1c58a86ed/attributes","cluster-id":"68eaea490fab4e05","publish-timeout":"7s"}
	{"level":"info","ts":"2022-06-30T21:04:03.633Z","caller":"embed/serve.go:98","msg":"ready to serve client requests"}
	{"level":"info","ts":"2022-06-30T21:04:03.633Z","caller":"etcdserver/server.go:2507","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}
	{"level":"info","ts":"2022-06-30T21:04:03.633Z","caller":"embed/serve.go:98","msg":"ready to serve client requests"}
	{"level":"info","ts":"2022-06-30T21:04:03.634Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
	{"level":"info","ts":"2022-06-30T21:04:03.634Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
	{"level":"info","ts":"2022-06-30T21:04:03.634Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"68eaea490fab4e05","local-member-id":"9f0758e1c58a86ed","cluster-version":"3.5"}
	{"level":"info","ts":"2022-06-30T21:04:03.634Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
	{"level":"info","ts":"2022-06-30T21:04:03.634Z","caller":"etcdserver/server.go:2531","msg":"cluster version is updated","cluster-version":"3.5"}
	{"level":"info","ts":"2022-06-30T21:04:03.635Z","caller":"embed/serve.go:188","msg":"serving client traffic securely","address":"127.0.0.1:2379"}
	{"level":"info","ts":"2022-06-30T21:04:03.635Z","caller":"embed/serve.go:188","msg":"serving client traffic securely","address":"192.168.85.2:2379"}
	{"level":"warn","ts":"2022-06-30T21:07:03.828Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"140.683358ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/\" range_end:\"/registry/pods0\" count_only:true ","response":"range_response_count:0 size:7"}
	{"level":"info","ts":"2022-06-30T21:07:03.828Z","caller":"traceutil/trace.go:171","msg":"trace[45868920] range","detail":"{range_begin:/registry/pods/; range_end:/registry/pods0; response_count:0; response_revision:421; }","duration":"140.817273ms","start":"2022-06-30T21:07:03.687Z","end":"2022-06-30T21:07:03.828Z","steps":["trace[45868920] 'count revisions from in-memory index tree'  (duration: 140.576636ms)"],"step_count":1}
	{"level":"info","ts":"2022-06-30T21:14:03.648Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":455}
	{"level":"info","ts":"2022-06-30T21:14:03.650Z","caller":"mvcc/kvstore_compaction.go:57","msg":"finished scheduled compaction","compact-revision":455,"took":"1.498172ms"}
	
	* 
	* ==> kernel <==
	*  21:16:29 up 59 min,  0 users,  load average: 0.14, 0.57, 1.28
	Linux default-k8s-different-port-20220630210335-9950 5.15.0-1012-gcp #17~20.04.1-Ubuntu SMP Thu Jun 23 16:10:34 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
	PRETTY_NAME="Ubuntu 20.04.4 LTS"
	
	* 
	* ==> kube-apiserver [f0093895eba1080a2212532b5c34b83dc16abf6e2eccfb1bdf732d5e70875609] <==
	* I0630 21:04:06.434171       1 shared_informer.go:262] Caches are synced for cluster_authentication_trust_controller
	I0630 21:04:06.439202       1 controller.go:611] quota admission added evaluator for: namespaces
	I0630 21:04:06.523292       1 apf_controller.go:322] Running API Priority and Fairness config worker
	I0630 21:04:06.523335       1 cache.go:39] Caches are synced for APIServiceRegistrationController controller
	I0630 21:04:06.523484       1 shared_informer.go:262] Caches are synced for node_authorizer
	I0630 21:04:06.523520       1 cache.go:39] Caches are synced for autoregister controller
	I0630 21:04:06.528129       1 shared_informer.go:262] Caches are synced for crd-autoregister
	I0630 21:04:06.987992       1 controller.go:132] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).
	I0630 21:04:07.306964       1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000
	I0630 21:04:07.310021       1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000
	I0630 21:04:07.310040       1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.
	I0630 21:04:07.688455       1 controller.go:611] quota admission added evaluator for: roles.rbac.authorization.k8s.io
	I0630 21:04:07.735835       1 controller.go:611] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
	I0630 21:04:07.854938       1 alloc.go:327] "allocated clusterIPs" service="default/kubernetes" clusterIPs=map[IPv4:10.96.0.1]
	W0630 21:04:07.860197       1 lease.go:234] Resetting endpoints for master service "kubernetes" to [192.168.85.2]
	I0630 21:04:07.861189       1 controller.go:611] quota admission added evaluator for: endpoints
	I0630 21:04:07.864940       1 controller.go:611] quota admission added evaluator for: endpointslices.discovery.k8s.io
	I0630 21:04:08.456765       1 controller.go:611] quota admission added evaluator for: serviceaccounts
	I0630 21:04:09.445974       1 controller.go:611] quota admission added evaluator for: deployments.apps
	I0630 21:04:09.455771       1 alloc.go:327] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs=map[IPv4:10.96.0.10]
	I0630 21:04:09.466333       1 controller.go:611] quota admission added evaluator for: daemonsets.apps
	I0630 21:04:09.563553       1 controller.go:611] quota admission added evaluator for: leases.coordination.k8s.io
	I0630 21:04:21.314803       1 controller.go:611] quota admission added evaluator for: controllerrevisions.apps
	I0630 21:04:22.114650       1 controller.go:611] quota admission added evaluator for: replicasets.apps
	I0630 21:04:22.652116       1 controller.go:611] quota admission added evaluator for: events.events.k8s.io
	
	* 
	* ==> kube-controller-manager [56c1c7bc165ac17cdfb803f71cd26ff02ab6261448f17c5c4ac7f531a632c67b] <==
	* I0630 21:04:21.320479       1 shared_informer.go:262] Caches are synced for namespace
	I0630 21:04:21.320896       1 event.go:294] "Event occurred" object="kube-system/kube-proxy" fieldPath="" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-jb4cj"
	I0630 21:04:21.324363       1 event.go:294] "Event occurred" object="kube-system/kindnet" fieldPath="" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kindnet-jgsc8"
	I0630 21:04:21.355651       1 shared_informer.go:262] Caches are synced for deployment
	I0630 21:04:21.359253       1 shared_informer.go:262] Caches are synced for service account
	I0630 21:04:21.366778       1 shared_informer.go:262] Caches are synced for disruption
	I0630 21:04:21.366798       1 disruption.go:371] Sending events to api server.
	I0630 21:04:21.487997       1 shared_informer.go:262] Caches are synced for endpoint_slice_mirroring
	I0630 21:04:21.490195       1 shared_informer.go:262] Caches are synced for endpoint
	I0630 21:04:21.503596       1 shared_informer.go:262] Caches are synced for expand
	I0630 21:04:21.504800       1 shared_informer.go:262] Caches are synced for stateful set
	I0630 21:04:21.512633       1 shared_informer.go:262] Caches are synced for persistent volume
	I0630 21:04:21.523832       1 shared_informer.go:262] Caches are synced for resource quota
	I0630 21:04:21.524971       1 shared_informer.go:262] Caches are synced for PVC protection
	I0630 21:04:21.556715       1 shared_informer.go:262] Caches are synced for ephemeral
	I0630 21:04:21.561878       1 shared_informer.go:262] Caches are synced for attach detach
	I0630 21:04:21.568100       1 shared_informer.go:262] Caches are synced for resource quota
	I0630 21:04:21.927657       1 shared_informer.go:262] Caches are synced for garbage collector
	I0630 21:04:21.927689       1 garbagecollector.go:158] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
	I0630 21:04:21.943923       1 shared_informer.go:262] Caches are synced for garbage collector
	I0630 21:04:22.116902       1 event.go:294] "Event occurred" object="kube-system/coredns" fieldPath="" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-6d4b75cb6d to 2"
	I0630 21:04:22.317548       1 event.go:294] "Event occurred" object="kube-system/coredns-6d4b75cb6d" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-6d4b75cb6d-cnt2b"
	I0630 21:04:22.323524       1 event.go:294] "Event occurred" object="kube-system/coredns-6d4b75cb6d" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-6d4b75cb6d-rp7g9"
	I0630 21:04:22.469674       1 event.go:294] "Event occurred" object="kube-system/coredns" fieldPath="" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-6d4b75cb6d to 1"
	I0630 21:04:22.523588       1 event.go:294] "Event occurred" object="kube-system/coredns-6d4b75cb6d" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-6d4b75cb6d-rp7g9"
	
	* 
	* ==> kube-proxy [aa0dfccd9a7c940761ea2c4805338d040616ef5e513c23001d346fe07a7c5eff] <==
	* I0630 21:04:22.576102       1 node.go:163] Successfully retrieved node IP: 192.168.85.2
	I0630 21:04:22.576176       1 server_others.go:138] "Detected node IP" address="192.168.85.2"
	I0630 21:04:22.576216       1 server_others.go:578] "Unknown proxy mode, assuming iptables proxy" proxyMode=""
	I0630 21:04:22.648411       1 server_others.go:206] "Using iptables Proxier"
	I0630 21:04:22.648445       1 server_others.go:213] "kube-proxy running in dual-stack mode" ipFamily=IPv4
	I0630 21:04:22.648457       1 server_others.go:214] "Creating dualStackProxier for iptables"
	I0630 21:04:22.648483       1 server_others.go:501] "Detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, , defaulting to no-op detect-local for IPv6"
	I0630 21:04:22.648518       1 proxier.go:259] "Setting route_localnet=1, use nodePortAddresses to filter loopback addresses for NodePorts to skip it https://issues.k8s.io/90259"
	I0630 21:04:22.648694       1 proxier.go:259] "Setting route_localnet=1, use nodePortAddresses to filter loopback addresses for NodePorts to skip it https://issues.k8s.io/90259"
	I0630 21:04:22.648965       1 server.go:661] "Version info" version="v1.24.2"
	I0630 21:04:22.648989       1 server.go:663] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
	I0630 21:04:22.649821       1 config.go:226] "Starting endpoint slice config controller"
	I0630 21:04:22.649843       1 shared_informer.go:255] Waiting for caches to sync for endpoint slice config
	I0630 21:04:22.649889       1 config.go:317] "Starting service config controller"
	I0630 21:04:22.649900       1 shared_informer.go:255] Waiting for caches to sync for service config
	I0630 21:04:22.649946       1 config.go:444] "Starting node config controller"
	I0630 21:04:22.649970       1 shared_informer.go:255] Waiting for caches to sync for node config
	I0630 21:04:22.749993       1 shared_informer.go:262] Caches are synced for service config
	I0630 21:04:22.750048       1 shared_informer.go:262] Caches are synced for node config
	I0630 21:04:22.750021       1 shared_informer.go:262] Caches are synced for endpoint slice config
	
	* 
	* ==> kube-scheduler [b2e2e7466122cde98a4cb1eba9d3f61be1dc7eb41a6935e6c16b3334125a3df7] <==
	* W0630 21:04:06.439138       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E0630 21:04:06.439258       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	W0630 21:04:06.439213       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E0630 21:04:06.439487       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	W0630 21:04:06.439530       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
	W0630 21:04:06.439635       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	E0630 21:04:06.439746       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	E0630 21:04:06.439668       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
	W0630 21:04:06.438273       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	E0630 21:04:06.440521       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	W0630 21:04:06.439545       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0630 21:04:06.440544       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	W0630 21:04:07.244869       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	E0630 21:04:07.244905       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	W0630 21:04:07.276194       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E0630 21:04:07.276227       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	W0630 21:04:07.289458       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	E0630 21:04:07.289489       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	W0630 21:04:07.295610       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E0630 21:04:07.295643       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	W0630 21:04:07.404412       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	E0630 21:04:07.404447       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	W0630 21:04:07.645230       1 reflector.go:324] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	E0630 21:04:07.645267       1 reflector.go:138] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	I0630 21:04:10.336041       1 shared_informer.go:262] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	
	* 
	* ==> kubelet <==
	* -- Logs begin at Thu 2022-06-30 21:03:44 UTC, end at Thu 2022-06-30 21:16:29 UTC. --
	Jun 30 21:15:10 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:15:10.039871    1349 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:15:15 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:15:15.041081    1349 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:15:20 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:15:20.042490    1349 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:15:25 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:15:25.043589    1349 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:15:30 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:15:30.045075    1349 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:15:35 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:15:35.046072    1349 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:15:40 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:15:40.046858    1349 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:15:45 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:15:45.048001    1349 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:15:50 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:15:50.049361    1349 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:15:50 default-k8s-different-port-20220630210335-9950 kubelet[1349]: I0630 21:15:50.051988    1349 scope.go:110] "RemoveContainer" containerID="83c75d9c0994fb94d26ab5ba6256c2ff44b00012eb2da9924ab513108045ee77"
	Jun 30 21:15:50 default-k8s-different-port-20220630210335-9950 kubelet[1349]: I0630 21:15:50.052336    1349 scope.go:110] "RemoveContainer" containerID="8a0d676731abf60921510a3216fa28f73fc776b06a7dd0ee1d1d2654e8b940e0"
	Jun 30 21:15:50 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:15:50.052740    1349 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kindnet-cni\" with CrashLoopBackOff: \"back-off 40s restarting failed container=kindnet-cni pod=kindnet-jgsc8_kube-system(a63f0d82-ce2a-4e93-8747-604386ef8614)\"" pod="kube-system/kindnet-jgsc8" podUID=a63f0d82-ce2a-4e93-8747-604386ef8614
	Jun 30 21:15:55 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:15:55.050118    1349 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:16:00 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:16:00.051441    1349 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:16:01 default-k8s-different-port-20220630210335-9950 kubelet[1349]: I0630 21:16:01.656209    1349 scope.go:110] "RemoveContainer" containerID="8a0d676731abf60921510a3216fa28f73fc776b06a7dd0ee1d1d2654e8b940e0"
	Jun 30 21:16:01 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:16:01.656633    1349 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kindnet-cni\" with CrashLoopBackOff: \"back-off 40s restarting failed container=kindnet-cni pod=kindnet-jgsc8_kube-system(a63f0d82-ce2a-4e93-8747-604386ef8614)\"" pod="kube-system/kindnet-jgsc8" podUID=a63f0d82-ce2a-4e93-8747-604386ef8614
	Jun 30 21:16:05 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:16:05.052595    1349 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:16:10 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:16:10.054012    1349 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:16:12 default-k8s-different-port-20220630210335-9950 kubelet[1349]: I0630 21:16:12.655780    1349 scope.go:110] "RemoveContainer" containerID="8a0d676731abf60921510a3216fa28f73fc776b06a7dd0ee1d1d2654e8b940e0"
	Jun 30 21:16:12 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:16:12.656169    1349 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kindnet-cni\" with CrashLoopBackOff: \"back-off 40s restarting failed container=kindnet-cni pod=kindnet-jgsc8_kube-system(a63f0d82-ce2a-4e93-8747-604386ef8614)\"" pod="kube-system/kindnet-jgsc8" podUID=a63f0d82-ce2a-4e93-8747-604386ef8614
	Jun 30 21:16:15 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:16:15.054795    1349 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:16:20 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:16:20.055700    1349 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:16:25 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:16:25.057501    1349 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:16:25 default-k8s-different-port-20220630210335-9950 kubelet[1349]: I0630 21:16:25.655638    1349 scope.go:110] "RemoveContainer" containerID="8a0d676731abf60921510a3216fa28f73fc776b06a7dd0ee1d1d2654e8b940e0"
	Jun 30 21:16:25 default-k8s-different-port-20220630210335-9950 kubelet[1349]: E0630 21:16:25.656087    1349 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kindnet-cni\" with CrashLoopBackOff: \"back-off 40s restarting failed container=kindnet-cni pod=kindnet-jgsc8_kube-system(a63f0d82-ce2a-4e93-8747-604386ef8614)\"" pod="kube-system/kindnet-jgsc8" podUID=a63f0d82-ce2a-4e93-8747-604386ef8614
	

                                                
                                                
-- /stdout --
helpers_test.go:254: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p default-k8s-different-port-20220630210335-9950 -n default-k8s-different-port-20220630210335-9950
helpers_test.go:261: (dbg) Run:  kubectl --context default-k8s-different-port-20220630210335-9950 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:270: non-running pods: busybox coredns-6d4b75cb6d-cnt2b storage-provisioner
helpers_test.go:272: ======> post-mortem[TestStartStop/group/default-k8s-different-port/serial/DeployApp]: describe non-running pods <======
helpers_test.go:275: (dbg) Run:  kubectl --context default-k8s-different-port-20220630210335-9950 describe pod busybox coredns-6d4b75cb6d-cnt2b storage-provisioner
helpers_test.go:275: (dbg) Non-zero exit: kubectl --context default-k8s-different-port-20220630210335-9950 describe pod busybox coredns-6d4b75cb6d-cnt2b storage-provisioner: exit status 1 (58.805101ms)

                                                
                                                
-- stdout --
	Name:         busybox
	Namespace:    default
	Priority:     0
	Node:         <none>
	Labels:       integration-test=busybox
	Annotations:  <none>
	Status:       Pending
	IP:           
	IPs:          <none>
	Containers:
	  busybox:
	    Image:      gcr.io/k8s-minikube/busybox:1.28.4-glibc
	    Port:       <none>
	    Host Port:  <none>
	    Command:
	      sleep
	      3600
	    Environment:  <none>
	    Mounts:
	      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-kr2bz (ro)
	Conditions:
	  Type           Status
	  PodScheduled   False 
	Volumes:
	  kube-api-access-kr2bz:
	    Type:                    Projected (a volume that contains injected data from multiple sources)
	    TokenExpirationSeconds:  3607
	    ConfigMapName:           kube-root-ca.crt
	    ConfigMapOptional:       <nil>
	    DownwardAPI:             true
	QoS Class:                   BestEffort
	Node-Selectors:              <none>
	Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
	                             node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
	Events:
	  Type     Reason            Age                   From               Message
	  ----     ------            ----                  ----               -------
	  Warning  FailedScheduling  2m49s (x2 over 8m4s)  default-scheduler  0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.

                                                
                                                
-- /stdout --
** stderr ** 
	Error from server (NotFound): pods "coredns-6d4b75cb6d-cnt2b" not found
	Error from server (NotFound): pods "storage-provisioner" not found

                                                
                                                
** /stderr **
helpers_test.go:277: kubectl --context default-k8s-different-port-20220630210335-9950 describe pod busybox coredns-6d4b75cb6d-cnt2b storage-provisioner: exit status 1
--- FAIL: TestStartStop/group/default-k8s-different-port/serial/DeployApp (484.65s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/DeployApp (484.55s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context embed-certs-20220630210659-9950 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/embed-certs/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:342: "busybox" [0b6983c5-ef3e-41fc-8594-2937b5823a42] Pending
helpers_test.go:342: "busybox" [0b6983c5-ef3e-41fc-8594-2937b5823a42] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.)
E0630 21:11:54.794968    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/bridge-20220630204858-9950/client.crt: no such file or directory
E0630 21:12:45.272011    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/enable-default-cni-20220630204858-9950/client.crt: no such file or directory

                                                
                                                
=== CONT  TestStartStop/group/embed-certs/serial/DeployApp
start_stop_delete_test.go:196: ***** TestStartStop/group/embed-certs/serial/DeployApp: pod "integration-test=busybox" failed to start within 8m0s: timed out waiting for the condition ****
start_stop_delete_test.go:196: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p embed-certs-20220630210659-9950 -n embed-certs-20220630210659-9950
E0630 21:19:37.807320    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/auto-20220630204858-9950/client.crt: no such file or directory
start_stop_delete_test.go:196: TestStartStop/group/embed-certs/serial/DeployApp: showing logs for failed pods as of 2022-06-30 21:19:38.024647136 +0000 UTC m=+3526.263785394
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context embed-certs-20220630210659-9950 describe po busybox -n default
start_stop_delete_test.go:196: (dbg) kubectl --context embed-certs-20220630210659-9950 describe po busybox -n default:
Name:         busybox
Namespace:    default
Priority:     0
Node:         <none>
Labels:       integration-test=busybox
Annotations:  <none>
Status:       Pending
IP:           
IPs:          <none>
Containers:
busybox:
Image:      gcr.io/k8s-minikube/busybox:1.28.4-glibc
Port:       <none>
Host Port:  <none>
Command:
sleep
3600
Environment:  <none>
Mounts:
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-r2mh6 (ro)
Conditions:
Type           Status
PodScheduled   False 
Volumes:
kube-api-access-r2mh6:
Type:                    Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds:  3607
ConfigMapName:           kube-root-ca.crt
ConfigMapOptional:       <nil>
DownwardAPI:             true
QoS Class:                   BestEffort
Node-Selectors:              <none>
Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type     Reason            Age                   From               Message
----     ------            ----                  ----               -------
Warning  FailedScheduling  2m46s (x2 over 8m1s)  default-scheduler  0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context embed-certs-20220630210659-9950 logs busybox -n default
start_stop_delete_test.go:196: (dbg) kubectl --context embed-certs-20220630210659-9950 logs busybox -n default:
start_stop_delete_test.go:196: wait: integration-test=busybox within 8m0s: timed out waiting for the condition
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestStartStop/group/embed-certs/serial/DeployApp]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect embed-certs-20220630210659-9950
helpers_test.go:235: (dbg) docker inspect embed-certs-20220630210659-9950:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "8d43dca0a5ff56a08f5b0493d261e7c5d2aa00d085ae1a1182a97b5635cc1304",
	        "Created": "2022-06-30T21:07:07.545531471Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 259148,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2022-06-30T21:07:07.92350884Z",
	            "FinishedAt": "0001-01-01T00:00:00Z"
	        },
	        "Image": "sha256:573e7be5768273a7845baee1ae90fa2e33b83b10a7fbb0f0f41efbf29b53d1f1",
	        "ResolvConfPath": "/var/lib/docker/containers/8d43dca0a5ff56a08f5b0493d261e7c5d2aa00d085ae1a1182a97b5635cc1304/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/8d43dca0a5ff56a08f5b0493d261e7c5d2aa00d085ae1a1182a97b5635cc1304/hostname",
	        "HostsPath": "/var/lib/docker/containers/8d43dca0a5ff56a08f5b0493d261e7c5d2aa00d085ae1a1182a97b5635cc1304/hosts",
	        "LogPath": "/var/lib/docker/containers/8d43dca0a5ff56a08f5b0493d261e7c5d2aa00d085ae1a1182a97b5635cc1304/8d43dca0a5ff56a08f5b0493d261e7c5d2aa00d085ae1a1182a97b5635cc1304-json.log",
	        "Name": "/embed-certs-20220630210659-9950",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "embed-certs-20220630210659-9950:/var",
	                "/lib/modules:/lib/modules:ro"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "embed-certs-20220630210659-9950",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 2306867200,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": null,
	            "BlkioDeviceWriteBps": null,
	            "BlkioDeviceReadIOps": null,
	            "BlkioDeviceWriteIOps": null,
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "KernelMemory": 0,
	            "KernelMemoryTCP": 0,
	            "MemoryReservation": 0,
	            "MemorySwap": 4613734400,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": null,
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/9c28feead8af894b180999110a5cc0d8344ae5c74789cd8dc72d94ee221f8e10-init/diff:/var/lib/docker/overlay2/8b88d9f6f12c48be642a133456203e58549a93f1da67d0349744bd0f78917fba/diff:/var/lib/docker/overlay2/2bcbb3b4718a64188802301a25d7f413bb307cb16d077e7e5af799f9152a2970/diff:/var/lib/docker/overlay2/70b0888bf22fcef1c004704b71288ac581cf26a3b3b19fbca3da296ba10d6978/diff:/var/lib/docker/overlay2/7c5332f38fe652f379ef9b6d23e795158e9994317cfb547b581dd2b1fdf1303b/diff:/var/lib/docker/overlay2/0ddb5a3abf433b644a8bfa124e3c87878eed67878faa35493f2befc2b392e9cb/diff:/var/lib/docker/overlay2/3b7cda5fb0232fdeecbec0531ac704a59eb38fe57664c25777193b07e2df0077/diff:/var/lib/docker/overlay2/a14687ada786c65465b9924ae2d77ba27afc07942851cafaade28e80dfe9da16/diff:/var/lib/docker/overlay2/c49a9b7157aa6e8714e192b2849866d035b59e18de462c0ee9b72f898cc5a485/diff:/var/lib/docker/overlay2/efd71a50e3a1044a6d1c4c1a7d4d91d9f070c066e03e51c6c73a5764b778ad72/diff:/var/lib/docker/overlay2/55476a
1c0a20aa4238a0bb0e43c6402c33dcad312938ad48ee81be0160e12a49/diff:/var/lib/docker/overlay2/c48c4a348a797b9a38f01568a6adbcb4b05b4f56f7b986a4bf1b509d8cb00732/diff:/var/lib/docker/overlay2/568e3f354ab0428de5cf82d1fdfb780c3377f5cc55d9f524731c53e39e0ecae7/diff:/var/lib/docker/overlay2/2857943e320cdcdae9af3d8c2acda1fb61e2f142a88b8b902908071cea67816e/diff:/var/lib/docker/overlay2/bdd9a57f0b65e65c5a16395f239425e794c678b0e8db2f4a368e0a9427fe5116/diff:/var/lib/docker/overlay2/b150183f1b73e8c13c751911bcee09fed8ef973478f4dc3cfdb9e509118bf1ea/diff:/var/lib/docker/overlay2/0a053e7c29417cd6feafb351c7944e81342a52898871bc779f7bf61868c78ec4/diff:/var/lib/docker/overlay2/d3c0de3a44d75d0a05acb7843d53deba5ce0457649d6ed757da9b4c532a81e4f/diff:/var/lib/docker/overlay2/53f6170132880e1697dd802b8577382b31c6f1ba144256f8cc62542998842a6b/diff:/var/lib/docker/overlay2/b5c0be6d8efdb1fcb12e73b8f72853f77baa4bc014ac2c1e28b7b972b07f3325/diff:/var/lib/docker/overlay2/36c908f082a1e5388bb25277f1c957eaecf70fcd958080422fa85a3105724fb2/diff:/var/lib/d
ocker/overlay2/b147fe9dce365cfaf9bfeca2e370829e4d87e2671c133a9836ecb02a85422cc7/diff:/var/lib/docker/overlay2/65f488eb9181a721f01b333f5fa0cb91d216abd7842a9ae193bd95316f378721/diff:/var/lib/docker/overlay2/b04269aa247b68912ddc5b1c98ad55d67af4103f576a900eef4069c196b8a263/diff:/var/lib/docker/overlay2/b714c37e15257ae9d0e15d271dd18a330c38ad765901d9b7e7e3feb73e1b03e4/diff:/var/lib/docker/overlay2/3c253b721193edeaade7bba7ce25ff687c889b8fa86e9489c7ee20d5624e6c5b/diff:/var/lib/docker/overlay2/7f67b74e101fa21dd320393c10576eefa4ce1cec2e210bff405784fa45b360f3/diff:/var/lib/docker/overlay2/c3b2adaa63a06a5e6ed966d7b6f20a757aeadd3f25eb09ef3c7e9a66a8904143/diff:/var/lib/docker/overlay2/ddb5d653d19e8cafc4625a8fe9597667d98b277a7f679e532ad84caa2c6da636/diff:/var/lib/docker/overlay2/03eb172b20323ebeee7cb09025726a6e10de6c3dd8661f4f6bbc5a3a3778bad4/diff:/var/lib/docker/overlay2/80ea9bf34d028e95a8a418b3aeb634be72ab3336448946d7855c51ffdf8258d7/diff:/var/lib/docker/overlay2/e28987ea3fb4d431dee111f38cc76814b85f73e86434be3c463c01fdd59
9ad46/diff:/var/lib/docker/overlay2/6f9a46c7c6cf4fd30ce32a1eb08ed9b1e8dd61cb0e42ce54f0f736f06558c306/diff:/var/lib/docker/overlay2/6fc942eb9ccfc09898edc9a5ef3b3d305a6fcb22e8cefb1a9f9c344d10b59b25/diff:/var/lib/docker/overlay2/f6b8c57540e798dc1dfd51fd29c020193c02a4362f31c6d07aa220327bb07b90/diff:/var/lib/docker/overlay2/85d0aa01a3fab8c77262c59d8a7b0809a72673a3da7d33e4e19c04a66db44a11/diff:/var/lib/docker/overlay2/58dcd81a1605641f785ced5aeb38657eec1f02a31b7adfaf4f6fdd49f4bab1d6/diff:/var/lib/docker/overlay2/9d537e0a65325e4bf85b26da9828002339f5c442ca85f931b340457a80ec8c94/diff:/var/lib/docker/overlay2/a6f73707ee6a74e948a02d03c4a3f12b57c2eb408dc67da3c39961bb3cefcc97/diff:/var/lib/docker/overlay2/922526c310b066dbb73b9a106eef8bf0064ad7907a8d7d7b353f5307a17a4901/diff:/var/lib/docker/overlay2/a4185854870ebf8d34a4c7e1827dbe3bc461559839301ffb23c5efff5e3c9f14/diff:/var/lib/docker/overlay2/8c02b1fcb9d79f5d7b2ee4d44f6625a692c44a0d18df0a5c01cac0cca0fdf3f3/diff",
	                "MergedDir": "/var/lib/docker/overlay2/9c28feead8af894b180999110a5cc0d8344ae5c74789cd8dc72d94ee221f8e10/merged",
	                "UpperDir": "/var/lib/docker/overlay2/9c28feead8af894b180999110a5cc0d8344ae5c74789cd8dc72d94ee221f8e10/diff",
	                "WorkDir": "/var/lib/docker/overlay2/9c28feead8af894b180999110a5cc0d8344ae5c74789cd8dc72d94ee221f8e10/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "volume",
	                "Name": "embed-certs-20220630210659-9950",
	                "Source": "/var/lib/docker/volumes/embed-certs-20220630210659-9950/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            },
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            }
	        ],
	        "Config": {
	            "Hostname": "embed-certs-20220630210659-9950",
	            "Domainname": "",
	            "User": "root",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e",
	            "Volumes": null,
	            "WorkingDir": "",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "embed-certs-20220630210659-9950",
	                "name.minikube.sigs.k8s.io": "embed-certs-20220630210659-9950",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "877fceadb9246afa76923272f42d13c3ffa0cb31def97b937ce1263fb518147c",
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49427"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49426"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49423"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49425"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49424"
	                    }
	                ]
	            },
	            "SandboxKey": "/var/run/docker/netns/877fceadb924",
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "embed-certs-20220630210659-9950": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.94.2"
	                    },
	                    "Links": null,
	                    "Aliases": [
	                        "8d43dca0a5ff",
	                        "embed-certs-20220630210659-9950"
	                    ],
	                    "NetworkID": "a762009b1f738e8867dc868c38a8f04b91d930fa90f85eb117025e337ab9ed89",
	                    "EndpointID": "0afa60894f5bfb34a238eac3163af9d64b401d43c8640e4b094e1040817564ec",
	                    "Gateway": "192.168.94.1",
	                    "IPAddress": "192.168.94.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "MacAddress": "02:42:c0:a8:5e:02",
	                    "DriverOpts": null
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-20220630210659-9950 -n embed-certs-20220630210659-9950
helpers_test.go:244: <<< TestStartStop/group/embed-certs/serial/DeployApp FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======>  post-mortem[TestStartStop/group/embed-certs/serial/DeployApp]: minikube logs <======
helpers_test.go:247: (dbg) Run:  out/minikube-linux-amd64 -p embed-certs-20220630210659-9950 logs -n 25
helpers_test.go:252: TestStartStop/group/embed-certs/serial/DeployApp logs: 
-- stdout --
	* 
	* ==> Audit <==
	* |---------|------------------------------------------------------------|----------|---------|---------|---------------------|---------------------|
	| Command |                            Args                            | Profile  |  User   | Version |     Start Time      |      End Time       |
	|---------|------------------------------------------------------------|----------|---------|---------|---------------------|---------------------|
	| start   | -p newest-cni-20220630210514-9950 --memory=2200            | minikube | jenkins | v1.26.0 | 30 Jun 22 21:05 UTC | 30 Jun 22 21:06 UTC |
	|         | --alsologtostderr --wait=apiserver,system_pods,default_sa  |          |         |         |                     |                     |
	|         | --feature-gates ServerSideApply=true --network-plugin=cni  |          |         |         |                     |                     |
	|         | --extra-config=kubeadm.pod-network-cidr=192.168.111.111/16 |          |         |         |                     |                     |
	|         | --driver=docker  --container-runtime=containerd            |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                               |          |         |         |                     |                     |
	| addons  | enable metrics-server -p                                   | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | --images=MetricsServer=k8s.gcr.io/echoserver:1.4           |          |         |         |                     |                     |
	|         | --registries=MetricsServer=fake.domain                     |          |         |         |                     |                     |
	| stop    | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=3                                     |          |         |         |                     |                     |
	| addons  | enable dashboard -p                                        | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | --images=MetricsScraper=k8s.gcr.io/echoserver:1.4          |          |         |         |                     |                     |
	| start   | -p newest-cni-20220630210514-9950 --memory=2200            | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | --alsologtostderr --wait=apiserver,system_pods,default_sa  |          |         |         |                     |                     |
	|         | --feature-gates ServerSideApply=true --network-plugin=cni  |          |         |         |                     |                     |
	|         | --extra-config=kubeadm.pod-network-cidr=192.168.111.111/16 |          |         |         |                     |                     |
	|         | --driver=docker  --container-runtime=containerd            |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                               |          |         |         |                     |                     |
	| ssh     | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | sudo crictl images -o json                                 |          |         |         |                     |                     |
	| pause   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                     |          |         |         |                     |                     |
	| unpause | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                     |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | disable-driver-mounts-20220630210659-9950                  |          |         |         |                     |                     |
	| start   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC |                     |
	|         | embed-certs-20220630210659-9950                            |          |         |         |                     |                     |
	|         | --memory=2200 --alsologtostderr                            |          |         |         |                     |                     |
	|         | --wait=true --embed-certs                                  |          |         |         |                     |                     |
	|         | --driver=docker                                            |          |         |         |                     |                     |
	|         | --container-runtime=containerd                             |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                               |          |         |         |                     |                     |
	| ssh     | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|         | sudo crictl images -o json                                 |          |         |         |                     |                     |
	| pause   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                     |          |         |         |                     |                     |
	| unpause | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                     |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	| addons  | enable metrics-server -p                                   | minikube | jenkins | v1.26.0 | 30 Jun 22 21:12 UTC | 30 Jun 22 21:12 UTC |
	|         | old-k8s-version-20220630210005-9950                        |          |         |         |                     |                     |
	|         | --images=MetricsServer=k8s.gcr.io/echoserver:1.4           |          |         |         |                     |                     |
	|         | --registries=MetricsServer=fake.domain                     |          |         |         |                     |                     |
	| stop    | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:12 UTC | 30 Jun 22 21:12 UTC |
	|         | old-k8s-version-20220630210005-9950                        |          |         |         |                     |                     |
	|         | --alsologtostderr -v=3                                     |          |         |         |                     |                     |
	| addons  | enable dashboard -p                                        | minikube | jenkins | v1.26.0 | 30 Jun 22 21:12 UTC | 30 Jun 22 21:12 UTC |
	|         | old-k8s-version-20220630210005-9950                        |          |         |         |                     |                     |
	|         | --images=MetricsScraper=k8s.gcr.io/echoserver:1.4          |          |         |         |                     |                     |
	| start   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:12 UTC |                     |
	|         | old-k8s-version-20220630210005-9950                        |          |         |         |                     |                     |
	|         | --memory=2200 --alsologtostderr                            |          |         |         |                     |                     |
	|         | --wait=true --kvm-network=default                          |          |         |         |                     |                     |
	|         | --kvm-qemu-uri=qemu:///system                              |          |         |         |                     |                     |
	|         | --disable-driver-mounts                                    |          |         |         |                     |                     |
	|         | --keep-context=false                                       |          |         |         |                     |                     |
	|         | --driver=docker                                            |          |         |         |                     |                     |
	|         | --container-runtime=containerd                             |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.16.0                               |          |         |         |                     |                     |
	| addons  | enable metrics-server -p                                   | minikube | jenkins | v1.26.0 | 30 Jun 22 21:16 UTC | 30 Jun 22 21:16 UTC |
	|         | default-k8s-different-port-20220630210335-9950             |          |         |         |                     |                     |
	|         | --images=MetricsServer=k8s.gcr.io/echoserver:1.4           |          |         |         |                     |                     |
	|         | --registries=MetricsServer=fake.domain                     |          |         |         |                     |                     |
	| stop    | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:16 UTC | 30 Jun 22 21:16 UTC |
	|         | default-k8s-different-port-20220630210335-9950             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=3                                     |          |         |         |                     |                     |
	| addons  | enable dashboard -p                                        | minikube | jenkins | v1.26.0 | 30 Jun 22 21:16 UTC | 30 Jun 22 21:16 UTC |
	|         | default-k8s-different-port-20220630210335-9950             |          |         |         |                     |                     |
	|         | --images=MetricsScraper=k8s.gcr.io/echoserver:1.4          |          |         |         |                     |                     |
	| start   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:16 UTC |                     |
	|         | default-k8s-different-port-20220630210335-9950             |          |         |         |                     |                     |
	|         | --memory=2200 --alsologtostderr --wait=true                |          |         |         |                     |                     |
	|         | --apiserver-port=8444 --driver=docker                      |          |         |         |                     |                     |
	|         |  --container-runtime=containerd                            |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                               |          |         |         |                     |                     |
	|---------|------------------------------------------------------------|----------|---------|---------|---------------------|---------------------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2022/06/30 21:16:50
	Running on machine: ubuntu-20-agent-8
	Binary: Built with gc go1.18.3 for linux/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0630 21:16:50.966935  276064 out.go:296] Setting OutFile to fd 1 ...
	I0630 21:16:50.967050  276064 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 21:16:50.967058  276064 out.go:309] Setting ErrFile to fd 2...
	I0630 21:16:50.967063  276064 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 21:16:50.967572  276064 root.go:329] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/bin
	I0630 21:16:50.967827  276064 out.go:303] Setting JSON to false
	I0630 21:16:50.969254  276064 start.go:115] hostinfo: {"hostname":"ubuntu-20-agent-8","uptime":3563,"bootTime":1656620248,"procs":364,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1012-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0630 21:16:50.969334  276064 start.go:125] virtualization: kvm guest
	I0630 21:16:50.972514  276064 out.go:177] * [default-k8s-different-port-20220630210335-9950] minikube v1.26.0 on Ubuntu 20.04 (kvm/amd64)
	I0630 21:16:50.974253  276064 notify.go:193] Checking for updates...
	I0630 21:16:50.974279  276064 out.go:177]   - MINIKUBE_LOCATION=14420
	I0630 21:16:50.976279  276064 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0630 21:16:50.977800  276064 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:16:50.979219  276064 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube
	I0630 21:16:50.980678  276064 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0630 21:16:50.982554  276064 config.go:178] Loaded profile config "default-k8s-different-port-20220630210335-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:16:50.982967  276064 driver.go:360] Setting default libvirt URI to qemu:///system
	I0630 21:16:51.027931  276064 docker.go:137] docker version: linux-20.10.17
	I0630 21:16:51.028102  276064 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0630 21:16:51.144684  276064 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:8 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:43 OomKillDisable:true NGoroutines:44 SystemTime:2022-06-30 21:16:51.060686748 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1012-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexServ
erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662451712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-8 Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Client
Info:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
	I0630 21:16:51.144792  276064 docker.go:254] overlay module found
	I0630 21:16:51.147252  276064 out.go:177] * Using the docker driver based on existing profile
	I0630 21:16:51.148837  276064 start.go:284] selected driver: docker
	I0630 21:16:51.148852  276064 start.go:808] validating driver "docker" against &{Name:default-k8s-different-port-20220630210335-9950 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:default-k8s-different-port-
20220630210335-9950 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8444 NodeName:} Nodes:[{Name: IP:192.168.85.2 Port:8444 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[Dashboard:kubernetesui/dashboard:v2.6.0@sha256:4af9580485920635d888efe1eddbd67e12f9d5d84dba87100e93feb4e46636b3 MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<ni
l> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 21:16:51.148978  276064 start.go:819] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0630 21:16:51.149857  276064 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0630 21:16:51.265416  276064 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:8 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:43 OomKillDisable:true NGoroutines:44 SystemTime:2022-06-30 21:16:51.183664679 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1012-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexServ
erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662451712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-8 Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Client
Info:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
	I0630 21:16:51.265705  276064 start_flags.go:853] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0630 21:16:51.265738  276064 cni.go:95] Creating CNI manager for ""
	I0630 21:16:51.265748  276064 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:16:51.265764  276064 start_flags.go:310] config:
	{Name:default-k8s-different-port-20220630210335-9950 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:default-k8s-different-port-20220630210335-9950 Namespace:default APIServerName:minikubeCA APIServerNames:[]
APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8444 NodeName:} Nodes:[{Name: IP:192.168.85.2 Port:8444 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[Dashboard:kubernetesui/dashboard:v2.6.0@sha256:4af9580485920635d888efe1eddbd67e12f9d5d84dba87100e93feb4e46636b3 MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false Extr
aDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 21:16:51.268956  276064 out.go:177] * Starting control plane node default-k8s-different-port-20220630210335-9950 in cluster default-k8s-different-port-20220630210335-9950
	I0630 21:16:51.270454  276064 cache.go:120] Beginning downloading kic base image for docker with containerd
	I0630 21:16:51.272072  276064 out.go:177] * Pulling base image ...
	I0630 21:16:51.273432  276064 preload.go:132] Checking if preload exists for k8s version v1.24.2 and runtime containerd
	I0630 21:16:51.273492  276064 preload.go:148] Found local preload: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-containerd-overlay2-amd64.tar.lz4
	I0630 21:16:51.273512  276064 cache.go:57] Caching tarball of preloaded images
	I0630 21:16:51.273529  276064 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e in local docker daemon
	I0630 21:16:51.273772  276064 preload.go:174] Found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-containerd-overlay2-amd64.tar.lz4 in cache, skipping download
	I0630 21:16:51.273795  276064 cache.go:60] Finished verifying existence of preloaded tar for  v1.24.2 on containerd
	I0630 21:16:51.273980  276064 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950/config.json ...
	I0630 21:16:51.311432  276064 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e in local docker daemon, skipping pull
	I0630 21:16:51.311463  276064 cache.go:142] gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e exists in daemon, skipping load
	I0630 21:16:51.311486  276064 cache.go:208] Successfully downloaded all kic artifacts
	I0630 21:16:51.311527  276064 start.go:352] acquiring machines lock for default-k8s-different-port-20220630210335-9950: {Name:mkd6267dded0280a468a53ba1411e87336e1a91d Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0630 21:16:51.311690  276064 start.go:356] acquired machines lock for "default-k8s-different-port-20220630210335-9950" in 121.686µs
	I0630 21:16:51.311717  276064 start.go:94] Skipping create...Using existing machine configuration
	I0630 21:16:51.311723  276064 fix.go:55] fixHost starting: 
	I0630 21:16:51.312051  276064 cli_runner.go:164] Run: docker container inspect default-k8s-different-port-20220630210335-9950 --format={{.State.Status}}
	I0630 21:16:51.348817  276064 fix.go:103] recreateIfNeeded on default-k8s-different-port-20220630210335-9950: state=Stopped err=<nil>
	W0630 21:16:51.348859  276064 fix.go:129] unexpected machine state, will restart: <nil>
	I0630 21:16:51.351576  276064 out.go:177] * Restarting existing docker container for "default-k8s-different-port-20220630210335-9950" ...
	I0630 21:16:50.687885  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:16:53.186788  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:16:51.353211  276064 cli_runner.go:164] Run: docker start default-k8s-different-port-20220630210335-9950
	I0630 21:16:51.784125  276064 cli_runner.go:164] Run: docker container inspect default-k8s-different-port-20220630210335-9950 --format={{.State.Status}}
	I0630 21:16:51.823431  276064 kic.go:416] container "default-k8s-different-port-20220630210335-9950" state is running.
	I0630 21:16:51.823821  276064 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" default-k8s-different-port-20220630210335-9950
	I0630 21:16:51.864121  276064 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950/config.json ...
	I0630 21:16:51.864335  276064 machine.go:88] provisioning docker machine ...
	I0630 21:16:51.864360  276064 ubuntu.go:169] provisioning hostname "default-k8s-different-port-20220630210335-9950"
	I0630 21:16:51.864403  276064 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	I0630 21:16:51.902321  276064 main.go:134] libmachine: Using SSH client type: native
	I0630 21:16:51.902482  276064 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil>  [] 0s} 127.0.0.1 49437 <nil> <nil>}
	I0630 21:16:51.902498  276064 main.go:134] libmachine: About to run SSH command:
	sudo hostname default-k8s-different-port-20220630210335-9950 && echo "default-k8s-different-port-20220630210335-9950" | sudo tee /etc/hostname
	I0630 21:16:51.903111  276064 main.go:134] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:37264->127.0.0.1:49437: read: connection reset by peer
	I0630 21:16:55.029787  276064 main.go:134] libmachine: SSH cmd err, output: <nil>: default-k8s-different-port-20220630210335-9950
	
	I0630 21:16:55.029873  276064 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	I0630 21:16:55.064739  276064 main.go:134] libmachine: Using SSH client type: native
	I0630 21:16:55.064912  276064 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil>  [] 0s} 127.0.0.1 49437 <nil> <nil>}
	I0630 21:16:55.064939  276064 main.go:134] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sdefault-k8s-different-port-20220630210335-9950' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 default-k8s-different-port-20220630210335-9950/g' /etc/hosts;
				else 
					echo '127.0.1.1 default-k8s-different-port-20220630210335-9950' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0630 21:16:55.180883  276064 main.go:134] libmachine: SSH cmd err, output: <nil>: 
	I0630 21:16:55.180914  276064 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube CaCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/c
erts/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube}
	I0630 21:16:55.180940  276064 ubuntu.go:177] setting up certificates
	I0630 21:16:55.180951  276064 provision.go:83] configureAuth start
	I0630 21:16:55.181011  276064 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" default-k8s-different-port-20220630210335-9950
	I0630 21:16:55.215343  276064 provision.go:138] copyHostCerts
	I0630 21:16:55.215420  276064 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem, removing ...
	I0630 21:16:55.215439  276064 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem
	I0630 21:16:55.215511  276064 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem (1679 bytes)
	I0630 21:16:55.215622  276064 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem, removing ...
	I0630 21:16:55.215634  276064 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem
	I0630 21:16:55.215677  276064 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem (1082 bytes)
	I0630 21:16:55.215759  276064 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem, removing ...
	I0630 21:16:55.215770  276064 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem
	I0630 21:16:55.215809  276064 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem (1123 bytes)
	I0630 21:16:55.215903  276064 provision.go:112] generating server cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem org=jenkins.default-k8s-different-port-20220630210335-9950 san=[192.168.85.2 127.0.0.1 localhost 127.0.0.1 minikube default-k8s-different-port-20220630210335-9950]
	I0630 21:16:55.303627  276064 provision.go:172] copyRemoteCerts
	I0630 21:16:55.303701  276064 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0630 21:16:55.303743  276064 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	I0630 21:16:55.339259  276064 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49437 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/default-k8s-different-port-20220630210335-9950/id_rsa Username:docker}
	I0630 21:16:55.425035  276064 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
	I0630 21:16:55.442972  276064 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem --> /etc/docker/server.pem (1306 bytes)
	I0630 21:16:55.460939  276064 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0630 21:16:55.479535  276064 provision.go:86] duration metric: configureAuth took 298.567386ms
	I0630 21:16:55.479564  276064 ubuntu.go:193] setting minikube options for container-runtime
	I0630 21:16:55.479755  276064 config.go:178] Loaded profile config "default-k8s-different-port-20220630210335-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:16:55.479769  276064 machine.go:91] provisioned docker machine in 3.615419564s
	I0630 21:16:55.479776  276064 start.go:306] post-start starting for "default-k8s-different-port-20220630210335-9950" (driver="docker")
	I0630 21:16:55.479781  276064 start.go:316] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0630 21:16:55.479826  276064 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0630 21:16:55.479856  276064 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	I0630 21:16:55.516445  276064 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49437 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/default-k8s-different-port-20220630210335-9950/id_rsa Username:docker}
	I0630 21:16:55.605006  276064 ssh_runner.go:195] Run: cat /etc/os-release
	I0630 21:16:55.607796  276064 main.go:134] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0630 21:16:55.607819  276064 main.go:134] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0630 21:16:55.607827  276064 main.go:134] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0630 21:16:55.607832  276064 info.go:137] Remote host: Ubuntu 20.04.4 LTS
	I0630 21:16:55.607842  276064 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/addons for local assets ...
	I0630 21:16:55.607887  276064 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files for local assets ...
	I0630 21:16:55.607954  276064 filesync.go:149] local asset: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem -> 99502.pem in /etc/ssl/certs
	I0630 21:16:55.608055  276064 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0630 21:16:55.615374  276064 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem --> /etc/ssl/certs/99502.pem (1708 bytes)
	I0630 21:16:55.632721  276064 start.go:309] post-start completed in 152.929775ms
	I0630 21:16:55.632792  276064 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0630 21:16:55.632840  276064 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	I0630 21:16:55.668667  276064 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49437 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/default-k8s-different-port-20220630210335-9950/id_rsa Username:docker}
	I0630 21:16:55.753554  276064 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0630 21:16:55.757419  276064 fix.go:57] fixHost completed within 4.445691374s
	I0630 21:16:55.757441  276064 start.go:81] releasing machines lock for "default-k8s-different-port-20220630210335-9950", held for 4.445735411s
	I0630 21:16:55.757521  276064 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" default-k8s-different-port-20220630210335-9950
	I0630 21:16:55.792226  276064 ssh_runner.go:195] Run: systemctl --version
	I0630 21:16:55.792274  276064 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	I0630 21:16:55.792285  276064 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/
	I0630 21:16:55.792345  276064 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	I0630 21:16:55.828844  276064 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49437 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/default-k8s-different-port-20220630210335-9950/id_rsa Username:docker}
	I0630 21:16:55.830622  276064 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49437 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/default-k8s-different-port-20220630210335-9950/id_rsa Username:docker}
	I0630 21:16:55.937225  276064 ssh_runner.go:195] Run: sudo systemctl stop -f crio
	I0630 21:16:55.949138  276064 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0630 21:16:55.958414  276064 docker.go:179] disabling docker service ...
	I0630 21:16:55.958460  276064 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0630 21:16:55.187448  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:16:57.687435  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:16:55.968294  276064 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0630 21:16:55.980142  276064 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0630 21:16:56.063123  276064 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0630 21:16:56.138018  276064 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0630 21:16:56.147719  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
	image-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0630 21:16:56.161177  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*sandbox_image = .*$|sandbox_image = "k8s.gcr.io/pause:3.7"|' -i /etc/containerd/config.toml"
	I0630 21:16:56.169502  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*restrict_oom_score_adj = .*$|restrict_oom_score_adj = false|' -i /etc/containerd/config.toml"
	I0630 21:16:56.177922  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*SystemdCgroup = .*$|SystemdCgroup = false|' -i /etc/containerd/config.toml"
	I0630 21:16:56.186445  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*conf_dir = .*$|conf_dir = "/etc/cni/net.mk"|' -i /etc/containerd/config.toml"
	I0630 21:16:56.195374  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^# imports|imports = ["/etc/containerd/containerd.conf.d/02-containerd.conf"]|' -i /etc/containerd/config.toml"
	I0630 21:16:56.203928  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc/containerd/containerd.conf.d && printf %!s(MISSING) "dmVyc2lvbiA9IDIK" | base64 -d | sudo tee /etc/containerd/containerd.conf.d/02-containerd.conf"
	I0630 21:16:56.217454  276064 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0630 21:16:56.224869  276064 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0630 21:16:56.231883  276064 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0630 21:16:56.308696  276064 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0630 21:16:56.383126  276064 start.go:447] Will wait 60s for socket path /run/containerd/containerd.sock
	I0630 21:16:56.383218  276064 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
	I0630 21:16:56.386796  276064 start.go:468] Will wait 60s for crictl version
	I0630 21:16:56.386869  276064 ssh_runner.go:195] Run: sudo crictl version
	I0630 21:16:56.414891  276064 retry.go:31] will retry after 11.04660288s: Temporary Error: sudo crictl version: Process exited with status 1
	stdout:
	
	stderr:
	time="2022-06-30T21:16:56Z" level=fatal msg="getting the runtime version: rpc error: code = Unknown desc = server is not initialized yet"
	I0630 21:17:00.187349  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:02.686418  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:07.461709  276064 ssh_runner.go:195] Run: sudo crictl version
	I0630 21:17:07.486784  276064 start.go:477] Version:  0.1.0
	RuntimeName:  containerd
	RuntimeVersion:  1.6.6
	RuntimeApiVersion:  v1alpha2
	I0630 21:17:07.486852  276064 ssh_runner.go:195] Run: containerd --version
	I0630 21:17:07.518176  276064 ssh_runner.go:195] Run: containerd --version
	I0630 21:17:07.553071  276064 out.go:177] * Preparing Kubernetes v1.24.2 on containerd 1.6.6 ...
	I0630 21:17:04.687385  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:07.187278  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:07.554517  276064 cli_runner.go:164] Run: docker network inspect default-k8s-different-port-20220630210335-9950 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0630 21:17:07.590707  276064 ssh_runner.go:195] Run: grep 192.168.85.1	host.minikube.internal$ /etc/hosts
	I0630 21:17:07.594132  276064 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.85.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0630 21:17:07.603860  276064 preload.go:132] Checking if preload exists for k8s version v1.24.2 and runtime containerd
	I0630 21:17:07.603916  276064 ssh_runner.go:195] Run: sudo crictl images --output json
	I0630 21:17:07.628574  276064 containerd.go:547] all images are preloaded for containerd runtime.
	I0630 21:17:07.628598  276064 containerd.go:461] Images already preloaded, skipping extraction
	I0630 21:17:07.628640  276064 ssh_runner.go:195] Run: sudo crictl images --output json
	I0630 21:17:07.652928  276064 containerd.go:547] all images are preloaded for containerd runtime.
	I0630 21:17:07.652952  276064 cache_images.go:84] Images are preloaded, skipping loading
	I0630 21:17:07.652995  276064 ssh_runner.go:195] Run: sudo crictl info
	I0630 21:17:07.678461  276064 cni.go:95] Creating CNI manager for ""
	I0630 21:17:07.678485  276064 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:17:07.678497  276064 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
	I0630 21:17:07.678508  276064 kubeadm.go:158] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.85.2 APIServerPort:8444 KubernetesVersion:v1.24.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:default-k8s-different-port-20220630210335-9950 NodeName:default-k8s-different-port-20220630210335-9950 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.85.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.85.2
CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}
	I0630 21:17:07.678640  276064 kubeadm.go:162] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.85.2
	  bindPort: 8444
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: /run/containerd/containerd.sock
	  name: "default-k8s-different-port-20220630210335-9950"
	  kubeletExtraArgs:
	    node-ip: 192.168.85.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.85.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8444
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.24.2
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%!"(MISSING)
	  nodefs.inodesFree: "0%!"(MISSING)
	  imagefs.available: "0%!"(MISSING)
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0630 21:17:07.678737  276064 kubeadm.go:961] kubelet [Unit]
	Wants=containerd.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.24.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=default-k8s-different-port-20220630210335-9950 --image-service-endpoint=unix:///run/containerd/containerd.sock --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.85.2 --runtime-request-timeout=15m
	
	[Install]
	 config:
	{KubernetesVersion:v1.24.2 ClusterName:default-k8s-different-port-20220630210335-9950 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8444 NodeName:}
	I0630 21:17:07.678784  276064 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.24.2
	I0630 21:17:07.686457  276064 binaries.go:44] Found k8s binaries, skipping transfer
	I0630 21:17:07.686529  276064 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0630 21:17:07.693832  276064 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (539 bytes)
	I0630 21:17:07.707636  276064 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0630 21:17:07.721677  276064 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2075 bytes)
	I0630 21:17:07.734937  276064 ssh_runner.go:195] Run: grep 192.168.85.2	control-plane.minikube.internal$ /etc/hosts
	I0630 21:17:07.738005  276064 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.85.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0630 21:17:07.747537  276064 certs.go:54] Setting up /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950 for IP: 192.168.85.2
	I0630 21:17:07.747650  276064 certs.go:182] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.key
	I0630 21:17:07.747694  276064 certs.go:182] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.key
	I0630 21:17:07.747791  276064 certs.go:298] skipping minikube-user signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950/client.key
	I0630 21:17:07.747859  276064 certs.go:298] skipping minikube signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950/apiserver.key.43b9df8c
	I0630 21:17:07.747913  276064 certs.go:298] skipping aggregator signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950/proxy-client.key
	I0630 21:17:07.748040  276064 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950.pem (1338 bytes)
	W0630 21:17:07.748082  276064 certs.go:384] ignoring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950_empty.pem, impossibly tiny 0 bytes
	I0630 21:17:07.748098  276064 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem (1679 bytes)
	I0630 21:17:07.748133  276064 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem (1082 bytes)
	I0630 21:17:07.748167  276064 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem (1123 bytes)
	I0630 21:17:07.748198  276064 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/key.pem (1679 bytes)
	I0630 21:17:07.748264  276064 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem (1708 bytes)
	I0630 21:17:07.749106  276064 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
	I0630 21:17:07.767893  276064 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I0630 21:17:07.785630  276064 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0630 21:17:07.803337  276064 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
	I0630 21:17:07.820730  276064 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0630 21:17:07.838616  276064 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
	I0630 21:17:07.856055  276064 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0630 21:17:07.873512  276064 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
	I0630 21:17:07.890585  276064 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950.pem --> /usr/share/ca-certificates/9950.pem (1338 bytes)
	I0630 21:17:07.907549  276064 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem --> /usr/share/ca-certificates/99502.pem (1708 bytes)
	I0630 21:17:07.924815  276064 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0630 21:17:07.942013  276064 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0630 21:17:07.954570  276064 ssh_runner.go:195] Run: openssl version
	I0630 21:17:07.959418  276064 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/99502.pem && ln -fs /usr/share/ca-certificates/99502.pem /etc/ssl/certs/99502.pem"
	I0630 21:17:07.966969  276064 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/99502.pem
	I0630 21:17:07.970294  276064 certs.go:431] hashing: -rw-r--r-- 1 root root 1708 Jun 30 20:26 /usr/share/ca-certificates/99502.pem
	I0630 21:17:07.970348  276064 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/99502.pem
	I0630 21:17:07.975425  276064 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/99502.pem /etc/ssl/certs/3ec20f2e.0"
	I0630 21:17:07.982570  276064 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0630 21:17:07.990075  276064 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:17:07.993227  276064 certs.go:431] hashing: -rw-r--r-- 1 root root 1111 Jun 30 20:22 /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:17:07.993308  276064 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:17:07.997936  276064 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0630 21:17:08.004870  276064 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/9950.pem && ln -fs /usr/share/ca-certificates/9950.pem /etc/ssl/certs/9950.pem"
	I0630 21:17:08.012388  276064 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/9950.pem
	I0630 21:17:08.015454  276064 certs.go:431] hashing: -rw-r--r-- 1 root root 1338 Jun 30 20:26 /usr/share/ca-certificates/9950.pem
	I0630 21:17:08.015507  276064 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/9950.pem
	I0630 21:17:08.020347  276064 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/9950.pem /etc/ssl/certs/51391683.0"
	I0630 21:17:08.027230  276064 kubeadm.go:395] StartCluster: {Name:default-k8s-different-port-20220630210335-9950 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:default-k8s-different-port-20220630210335-9950
Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8444 NodeName:} Nodes:[{Name: IP:192.168.85.2 Port:8444 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[Dashboard:kubernetesui/dashboard:v2.6.0@sha256:4af9580485920635d888efe1eddbd67e12f9d5d84dba87100e93feb4e46636b3 MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] L
istenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 21:17:08.027336  276064 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
	I0630 21:17:08.027399  276064 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0630 21:17:08.053422  276064 cri.go:87] found id: "8a0d676731abf60921510a3216fa28f73fc776b06a7dd0ee1d1d2654e8b940e0"
	I0630 21:17:08.053446  276064 cri.go:87] found id: "aa0dfccd9a7c940761ea2c4805338d040616ef5e513c23001d346fe07a7c5eff"
	I0630 21:17:08.053454  276064 cri.go:87] found id: "b2e2e7466122cde98a4cb1eba9d3f61be1dc7eb41a6935e6c16b3334125a3df7"
	I0630 21:17:08.053465  276064 cri.go:87] found id: "56c1c7bc165ac17cdfb803f71cd26ff02ab6261448f17c5c4ac7f531a632c67b"
	I0630 21:17:08.053471  276064 cri.go:87] found id: "f0093895eba1080a2212532b5c34b83dc16abf6e2eccfb1bdf732d5e70875609"
	I0630 21:17:08.053477  276064 cri.go:87] found id: "a126cf77f563c9a045eb277d6616e24e487ddda0de594854165897f596aaacb9"
	I0630 21:17:08.053483  276064 cri.go:87] found id: ""
	I0630 21:17:08.053523  276064 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
	I0630 21:17:08.065844  276064 cri.go:114] JSON = null
	W0630 21:17:08.065891  276064 kubeadm.go:402] unpause failed: list paused: list returned 0 containers, but ps returned 6
	I0630 21:17:08.065932  276064 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0630 21:17:08.072868  276064 kubeadm.go:410] found existing configuration files, will attempt cluster restart
	I0630 21:17:08.072896  276064 kubeadm.go:626] restartCluster start
	I0630 21:17:08.072944  276064 ssh_runner.go:195] Run: sudo test -d /data/minikube
	I0630 21:17:08.079338  276064 kubeadm.go:127] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:08.080135  276064 kubeconfig.go:116] verify returned: extract IP: "default-k8s-different-port-20220630210335-9950" does not appear in /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:17:08.080723  276064 kubeconfig.go:127] "default-k8s-different-port-20220630210335-9950" context is missing from /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig - will repair!
	I0630 21:17:08.082722  276064 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig: {Name:mk34e4a4e7b04f624b9adbda4f77ee20b38308ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:17:08.084238  276064 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
	I0630 21:17:08.091015  276064 api_server.go:165] Checking apiserver status ...
	I0630 21:17:08.091128  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:17:08.099254  276064 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:08.299650  276064 api_server.go:165] Checking apiserver status ...
	I0630 21:17:08.299740  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:17:08.308443  276064 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:08.499766  276064 api_server.go:165] Checking apiserver status ...
	I0630 21:17:08.499859  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:17:08.508591  276064 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:08.699887  276064 api_server.go:165] Checking apiserver status ...
	I0630 21:17:08.699956  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:17:08.708853  276064 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:08.900127  276064 api_server.go:165] Checking apiserver status ...
	I0630 21:17:08.900211  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:17:08.908677  276064 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:09.099958  276064 api_server.go:165] Checking apiserver status ...
	I0630 21:17:09.100035  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:17:09.108964  276064 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:09.300024  276064 api_server.go:165] Checking apiserver status ...
	I0630 21:17:09.300118  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:17:09.308631  276064 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:09.499927  276064 api_server.go:165] Checking apiserver status ...
	I0630 21:17:09.500026  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:17:09.508471  276064 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:09.699757  276064 api_server.go:165] Checking apiserver status ...
	I0630 21:17:09.699831  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:17:09.708256  276064 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:09.899494  276064 api_server.go:165] Checking apiserver status ...
	I0630 21:17:09.899570  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:17:09.907971  276064 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:10.100304  276064 api_server.go:165] Checking apiserver status ...
	I0630 21:17:10.100402  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:17:10.109094  276064 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:10.300336  276064 api_server.go:165] Checking apiserver status ...
	I0630 21:17:10.300426  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:17:10.309013  276064 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:10.500327  276064 api_server.go:165] Checking apiserver status ...
	I0630 21:17:10.500416  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:17:10.509116  276064 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:10.699333  276064 api_server.go:165] Checking apiserver status ...
	I0630 21:17:10.699419  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:17:10.708381  276064 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:10.899430  276064 api_server.go:165] Checking apiserver status ...
	I0630 21:17:10.899511  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:17:10.908350  276064 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:09.686662  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:11.687397  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:14.187575  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:11.099965  276064 api_server.go:165] Checking apiserver status ...
	I0630 21:17:11.100038  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:17:11.108876  276064 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:11.108901  276064 api_server.go:165] Checking apiserver status ...
	I0630 21:17:11.108941  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:17:11.116800  276064 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:11.116827  276064 kubeadm.go:601] needs reconfigure: apiserver error: timed out waiting for the condition
	I0630 21:17:11.116834  276064 kubeadm.go:1092] stopping kube-system containers ...
	I0630 21:17:11.116847  276064 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name: Namespaces:[kube-system]}
	I0630 21:17:11.116901  276064 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0630 21:17:11.141421  276064 cri.go:87] found id: "8a0d676731abf60921510a3216fa28f73fc776b06a7dd0ee1d1d2654e8b940e0"
	I0630 21:17:11.141447  276064 cri.go:87] found id: "aa0dfccd9a7c940761ea2c4805338d040616ef5e513c23001d346fe07a7c5eff"
	I0630 21:17:11.141456  276064 cri.go:87] found id: "b2e2e7466122cde98a4cb1eba9d3f61be1dc7eb41a6935e6c16b3334125a3df7"
	I0630 21:17:11.141464  276064 cri.go:87] found id: "56c1c7bc165ac17cdfb803f71cd26ff02ab6261448f17c5c4ac7f531a632c67b"
	I0630 21:17:11.141472  276064 cri.go:87] found id: "f0093895eba1080a2212532b5c34b83dc16abf6e2eccfb1bdf732d5e70875609"
	I0630 21:17:11.141481  276064 cri.go:87] found id: "a126cf77f563c9a045eb277d6616e24e487ddda0de594854165897f596aaacb9"
	I0630 21:17:11.141491  276064 cri.go:87] found id: ""
	I0630 21:17:11.141498  276064 cri.go:232] Stopping containers: [8a0d676731abf60921510a3216fa28f73fc776b06a7dd0ee1d1d2654e8b940e0 aa0dfccd9a7c940761ea2c4805338d040616ef5e513c23001d346fe07a7c5eff b2e2e7466122cde98a4cb1eba9d3f61be1dc7eb41a6935e6c16b3334125a3df7 56c1c7bc165ac17cdfb803f71cd26ff02ab6261448f17c5c4ac7f531a632c67b f0093895eba1080a2212532b5c34b83dc16abf6e2eccfb1bdf732d5e70875609 a126cf77f563c9a045eb277d6616e24e487ddda0de594854165897f596aaacb9]
	I0630 21:17:11.141550  276064 ssh_runner.go:195] Run: which crictl
	I0630 21:17:11.144525  276064 ssh_runner.go:195] Run: sudo /usr/bin/crictl stop 8a0d676731abf60921510a3216fa28f73fc776b06a7dd0ee1d1d2654e8b940e0 aa0dfccd9a7c940761ea2c4805338d040616ef5e513c23001d346fe07a7c5eff b2e2e7466122cde98a4cb1eba9d3f61be1dc7eb41a6935e6c16b3334125a3df7 56c1c7bc165ac17cdfb803f71cd26ff02ab6261448f17c5c4ac7f531a632c67b f0093895eba1080a2212532b5c34b83dc16abf6e2eccfb1bdf732d5e70875609 a126cf77f563c9a045eb277d6616e24e487ddda0de594854165897f596aaacb9
	I0630 21:17:11.169277  276064 ssh_runner.go:195] Run: sudo systemctl stop kubelet
	I0630 21:17:11.179637  276064 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0630 21:17:11.187013  276064 kubeadm.go:155] found existing configuration files:
	-rw------- 1 root root 5643 Jun 30 21:04 /etc/kubernetes/admin.conf
	-rw------- 1 root root 5656 Jun 30 21:04 /etc/kubernetes/controller-manager.conf
	-rw------- 1 root root 2123 Jun 30 21:04 /etc/kubernetes/kubelet.conf
	-rw------- 1 root root 5600 Jun 30 21:04 /etc/kubernetes/scheduler.conf
	
	I0630 21:17:11.187084  276064 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/admin.conf
	I0630 21:17:11.194742  276064 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/kubelet.conf
	I0630 21:17:11.201953  276064 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/controller-manager.conf
	I0630 21:17:11.209038  276064 kubeadm.go:166] "https://control-plane.minikube.internal:8444" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/controller-manager.conf: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:11.209190  276064 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
	I0630 21:17:11.215649  276064 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/scheduler.conf
	I0630 21:17:11.223164  276064 kubeadm.go:166] "https://control-plane.minikube.internal:8444" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/scheduler.conf: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:11.223223  276064 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
	I0630 21:17:11.229790  276064 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0630 21:17:11.236785  276064 kubeadm.go:703] reconfiguring cluster from /var/tmp/minikube/kubeadm.yaml
	I0630 21:17:11.236816  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:17:11.281948  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:17:12.032331  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:17:12.230970  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:17:12.282521  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:17:12.364001  276064 api_server.go:51] waiting for apiserver process to appear ...
	I0630 21:17:12.364069  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 21:17:12.928375  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 21:17:13.428055  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 21:17:13.439931  276064 api_server.go:71] duration metric: took 1.075932663s to wait for apiserver process to appear ...
	I0630 21:17:13.439968  276064 api_server.go:87] waiting for apiserver healthz status ...
	I0630 21:17:13.439983  276064 api_server.go:240] Checking apiserver healthz at https://192.168.85.2:8444/healthz ...
	I0630 21:17:13.440396  276064 api_server.go:256] stopped: https://192.168.85.2:8444/healthz: Get "https://192.168.85.2:8444/healthz": dial tcp 192.168.85.2:8444: connect: connection refused
	I0630 21:17:13.941137  276064 api_server.go:240] Checking apiserver healthz at https://192.168.85.2:8444/healthz ...
	I0630 21:17:16.970176  276064 api_server.go:266] https://192.168.85.2:8444/healthz returned 403:
	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
	W0630 21:17:16.970281  276064 api_server.go:102] status: https://192.168.85.2:8444/healthz returned error 403:
	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
	I0630 21:17:17.440596  276064 api_server.go:240] Checking apiserver healthz at https://192.168.85.2:8444/healthz ...
	I0630 21:17:17.445089  276064 api_server.go:266] https://192.168.85.2:8444/healthz returned 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/bootstrap-controller ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-registration-controller ok
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	W0630 21:17:17.445118  276064 api_server.go:102] status: https://192.168.85.2:8444/healthz returned error 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/bootstrap-controller ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-registration-controller ok
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	I0630 21:17:17.940639  276064 api_server.go:240] Checking apiserver healthz at https://192.168.85.2:8444/healthz ...
	I0630 21:17:17.945039  276064 api_server.go:266] https://192.168.85.2:8444/healthz returned 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/bootstrap-controller ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-registration-controller ok
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	W0630 21:17:17.945092  276064 api_server.go:102] status: https://192.168.85.2:8444/healthz returned error 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/bootstrap-controller ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-registration-controller ok
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	I0630 21:17:18.440744  276064 api_server.go:240] Checking apiserver healthz at https://192.168.85.2:8444/healthz ...
	I0630 21:17:18.446044  276064 api_server.go:266] https://192.168.85.2:8444/healthz returned 200:
	ok
	I0630 21:17:18.452561  276064 api_server.go:140] control plane version: v1.24.2
	I0630 21:17:18.452593  276064 api_server.go:130] duration metric: took 5.012617644s to wait for apiserver health ...
	I0630 21:17:18.452606  276064 cni.go:95] Creating CNI manager for ""
	I0630 21:17:18.452614  276064 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:17:18.455712  276064 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0630 21:17:16.686966  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:18.687594  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:18.457354  276064 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0630 21:17:18.461356  276064 cni.go:189] applying CNI manifest using /var/lib/minikube/binaries/v1.24.2/kubectl ...
	I0630 21:17:18.461384  276064 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2429 bytes)
	I0630 21:17:18.476680  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0630 21:17:19.208419  276064 system_pods.go:43] waiting for kube-system pods to appear ...
	I0630 21:17:19.215629  276064 system_pods.go:59] 9 kube-system pods found
	I0630 21:17:19.215671  276064 system_pods.go:61] "coredns-6d4b75cb6d-cnt2b" [b58df724-5405-4aba-a22f-f4120f8779bc] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.)
	I0630 21:17:19.215688  276064 system_pods.go:61] "etcd-default-k8s-different-port-20220630210335-9950" [8da212f9-02a7-4954-94f5-8077bf78d9fb] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
	I0630 21:17:19.215695  276064 system_pods.go:61] "kindnet-jgsc8" [a63f0d82-ce2a-4e93-8747-604386ef8614] Running
	I0630 21:17:19.215705  276064 system_pods.go:61] "kube-apiserver-default-k8s-different-port-20220630210335-9950" [54b12248-2640-4cf7-871c-4dbef2dc7c9a] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
	I0630 21:17:19.215712  276064 system_pods.go:61] "kube-controller-manager-default-k8s-different-port-20220630210335-9950" [ff13afcf-d2e9-4331-af05-4bd5b381c79f] Running
	I0630 21:17:19.215722  276064 system_pods.go:61] "kube-proxy-jb4cj" [f292d396-44fc-483d-953b-c68f7b577b9b] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])
	I0630 21:17:19.215740  276064 system_pods.go:61] "kube-scheduler-default-k8s-different-port-20220630210335-9950" [5084f0d6-256a-49d8-ad62-a4387b3294e6] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
	I0630 21:17:19.215754  276064 system_pods.go:61] "metrics-server-5c6f97fb75-x6zm5" [a1e08a16-27f2-46e5-b750-2cc850c04f6b] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.)
	I0630 21:17:19.215764  276064 system_pods.go:61] "storage-provisioner" [d81da5a0-3c72-4f2c-809f-765c2a24f394] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.)
	I0630 21:17:19.215777  276064 system_pods.go:74] duration metric: took 7.333478ms to wait for pod list to return data ...
	I0630 21:17:19.215791  276064 node_conditions.go:102] verifying NodePressure condition ...
	I0630 21:17:19.219070  276064 node_conditions.go:122] node storage ephemeral capacity is 304695084Ki
	I0630 21:17:19.219100  276064 node_conditions.go:123] node cpu capacity is 8
	I0630 21:17:19.219117  276064 node_conditions.go:105] duration metric: took 3.314072ms to run NodePressure ...
	I0630 21:17:19.219138  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:17:19.376298  276064 kubeadm.go:762] waiting for restarted kubelet to initialise ...
	I0630 21:17:19.381176  276064 kubeadm.go:777] kubelet initialised
	I0630 21:17:19.381202  276064 kubeadm.go:778] duration metric: took 4.876872ms waiting for restarted kubelet to initialise ...
	I0630 21:17:19.381212  276064 pod_ready.go:35] extra waiting up to 4m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0630 21:17:19.386560  276064 pod_ready.go:78] waiting up to 4m0s for pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace to be "Ready" ...
	I0630 21:17:21.187251  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:23.187322  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:21.392685  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:23.393750  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:25.893175  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:25.686393  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:27.687277  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:27.893469  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:29.893499  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:30.187379  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:32.187457  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:32.393130  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:34.393582  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:34.687308  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:37.186708  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:39.187266  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:36.892837  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:38.893539  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:40.893713  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:41.687415  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:44.187382  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:43.392717  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:45.393415  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:46.686460  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:48.687429  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:47.893653  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:50.393622  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:51.187093  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:53.686989  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:52.893793  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:55.393246  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:56.187543  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:58.687303  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:57.393362  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:59.893210  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:00.687467  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:03.187454  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:01.893501  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:04.392897  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:05.687327  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:07.687411  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:06.393131  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:08.393775  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:10.893517  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:10.187617  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:12.686908  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:13.392641  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:15.393306  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:15.187574  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:17.686720  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:17.893231  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:20.393182  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:20.187057  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:21.683999  271327 pod_ready.go:81] duration metric: took 4m0.002237734s waiting for pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace to be "Ready" ...
	E0630 21:18:21.684032  271327 pod_ready.go:66] WaitExtra: waitPodCondition: timed out waiting 4m0s for pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace to be "Ready" (will not retry!)
	I0630 21:18:21.684058  271327 pod_ready.go:38] duration metric: took 4m0.006502514s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0630 21:18:21.684091  271327 kubeadm.go:630] restartCluster took 5m10.168591345s
	W0630 21:18:21.684270  271327 out.go:239] ! Unable to restart cluster, will reset it: extra: timed out waiting 4m0s for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready"
	I0630 21:18:21.684307  271327 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm reset --cri-socket /run/containerd/containerd.sock --force"
	I0630 21:18:22.982137  271327 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm reset --cri-socket /run/containerd/containerd.sock --force": (1.297795627s)
	I0630 21:18:22.982220  271327 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 21:18:22.992216  271327 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0630 21:18:22.999444  271327 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver
	I0630 21:18:22.999505  271327 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0630 21:18:23.006620  271327 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0630 21:18:23.006669  271327 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0630 21:18:23.382034  271327 out.go:204]   - Generating certificates and keys ...
	I0630 21:18:24.453656  271327 out.go:204]   - Booting up control plane ...
	I0630 21:18:22.394236  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:24.893780  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:27.393787  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:29.893470  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:33.995591  271327 out.go:204]   - Configuring RBAC rules ...
	I0630 21:18:34.415334  271327 cni.go:95] Creating CNI manager for ""
	I0630 21:18:34.415359  271327 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:18:34.417145  271327 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0630 21:18:34.418585  271327 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0630 21:18:34.422112  271327 cni.go:189] applying CNI manifest using /var/lib/minikube/binaries/v1.16.0/kubectl ...
	I0630 21:18:34.422134  271327 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2429 bytes)
	I0630 21:18:34.435402  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0630 21:18:31.893548  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:33.899294  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:34.646160  271327 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0630 21:18:34.646255  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:34.646257  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl label nodes minikube.k8s.io/version=v1.26.0 minikube.k8s.io/commit=251ffcec0e4c997cd7732864187747cc579943c9 minikube.k8s.io/name=old-k8s-version-20220630210005-9950 minikube.k8s.io/updated_at=2022_06_30T21_18_34_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:34.759440  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:34.766243  271327 ops.go:34] apiserver oom_adj: -16
	I0630 21:18:35.357818  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:35.858238  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:36.358268  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:36.857690  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:37.357705  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:37.858150  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:38.358096  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:38.858275  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:39.357688  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:36.392935  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:38.393728  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:40.893778  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:39.858283  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:40.358258  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:40.858225  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:41.357655  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:41.857721  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:42.358090  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:42.857766  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:43.357530  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:43.857798  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:44.357917  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:43.393444  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:45.393499  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:44.858250  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:45.358264  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:45.858251  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:46.358237  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:46.857708  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:47.358260  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:47.858095  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:48.358247  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:48.858229  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:49.357794  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:49.546778  271327 kubeadm.go:1045] duration metric: took 14.900577693s to wait for elevateKubeSystemPrivileges.
	I0630 21:18:49.546811  271327 kubeadm.go:397] StartCluster complete in 5m38.076732902s
	I0630 21:18:49.546833  271327 settings.go:142] acquiring lock: {Name:mkcbd229caa05b60d3551ef0b47eea08424c9b5d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:18:49.546946  271327 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:18:49.548969  271327 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig: {Name:mk34e4a4e7b04f624b9adbda4f77ee20b38308ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:18:50.068438  271327 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "old-k8s-version-20220630210005-9950" rescaled to 1
	I0630 21:18:50.068510  271327 start.go:208] Will wait 6m0s for node &{Name: IP:192.168.67.2 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0630 21:18:50.070683  271327 out.go:177] * Verifying Kubernetes components...
	I0630 21:18:50.068547  271327 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0630 21:18:50.068572  271327 addons.go:412] enableAddons start: toEnable=map[dashboard:true metrics-server:true], additional=[]
	I0630 21:18:50.068725  271327 config.go:178] Loaded profile config "old-k8s-version-20220630210005-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.16.0
	I0630 21:18:50.072305  271327 addons.go:65] Setting default-storageclass=true in profile "old-k8s-version-20220630210005-9950"
	I0630 21:18:50.072321  271327 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 21:18:50.072329  271327 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-20220630210005-9950"
	I0630 21:18:50.072306  271327 addons.go:65] Setting storage-provisioner=true in profile "old-k8s-version-20220630210005-9950"
	I0630 21:18:50.072355  271327 addons.go:65] Setting metrics-server=true in profile "old-k8s-version-20220630210005-9950"
	I0630 21:18:50.072354  271327 addons.go:65] Setting dashboard=true in profile "old-k8s-version-20220630210005-9950"
	I0630 21:18:50.072405  271327 addons.go:153] Setting addon metrics-server=true in "old-k8s-version-20220630210005-9950"
	I0630 21:18:50.072399  271327 addons.go:153] Setting addon storage-provisioner=true in "old-k8s-version-20220630210005-9950"
	W0630 21:18:50.072417  271327 addons.go:162] addon metrics-server should already be in state true
	W0630 21:18:50.072421  271327 addons.go:162] addon storage-provisioner should already be in state true
	I0630 21:18:50.072432  271327 addons.go:153] Setting addon dashboard=true in "old-k8s-version-20220630210005-9950"
	W0630 21:18:50.072449  271327 addons.go:162] addon dashboard should already be in state true
	I0630 21:18:50.072481  271327 host.go:66] Checking if "old-k8s-version-20220630210005-9950" exists ...
	I0630 21:18:50.072489  271327 host.go:66] Checking if "old-k8s-version-20220630210005-9950" exists ...
	I0630 21:18:50.072512  271327 host.go:66] Checking if "old-k8s-version-20220630210005-9950" exists ...
	I0630 21:18:50.072678  271327 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220630210005-9950 --format={{.State.Status}}
	I0630 21:18:50.072921  271327 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220630210005-9950 --format={{.State.Status}}
	I0630 21:18:50.073004  271327 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220630210005-9950 --format={{.State.Status}}
	I0630 21:18:50.073005  271327 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220630210005-9950 --format={{.State.Status}}
	I0630 21:18:50.122946  271327 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0630 21:18:50.124681  271327 addons.go:345] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 21:18:50.124711  271327 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0630 21:18:50.124768  271327 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220630210005-9950
	I0630 21:18:50.124685  271327 out.go:177]   - Using image kubernetesui/dashboard:v2.6.0
	I0630 21:18:50.126299  271327 out.go:177]   - Using image k8s.gcr.io/echoserver:1.4
	I0630 21:18:50.127661  271327 addons.go:345] installing /etc/kubernetes/addons/dashboard-ns.yaml
	I0630 21:18:50.127684  271327 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
	I0630 21:18:50.127695  271327 addons.go:153] Setting addon default-storageclass=true in "old-k8s-version-20220630210005-9950"
	W0630 21:18:50.127710  271327 addons.go:162] addon default-storageclass should already be in state true
	I0630 21:18:50.127744  271327 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220630210005-9950
	I0630 21:18:50.127789  271327 host.go:66] Checking if "old-k8s-version-20220630210005-9950" exists ...
	I0630 21:18:50.128250  271327 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220630210005-9950 --format={{.State.Status}}
	I0630 21:18:50.130021  271327 out.go:177]   - Using image fake.domain/k8s.gcr.io/echoserver:1.4
	I0630 21:18:47.893388  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:50.393444  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:50.131423  271327 addons.go:345] installing /etc/kubernetes/addons/metrics-apiservice.yaml
	I0630 21:18:50.131451  271327 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
	I0630 21:18:50.131510  271327 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220630210005-9950
	I0630 21:18:50.174874  271327 addons.go:345] installing /etc/kubernetes/addons/storageclass.yaml
	I0630 21:18:50.174898  271327 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0630 21:18:50.174953  271327 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220630210005-9950
	I0630 21:18:50.175467  271327 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49432 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/old-k8s-version-20220630210005-9950/id_rsa Username:docker}
	I0630 21:18:50.176273  271327 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-20220630210005-9950" to be "Ready" ...
	I0630 21:18:50.176312  271327 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.67.1 host.minikube.internal\n           fallthrough\n        }' | sudo /var/lib/minikube/binaries/v1.16.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0630 21:18:50.179407  271327 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49432 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/old-k8s-version-20220630210005-9950/id_rsa Username:docker}
	I0630 21:18:50.192160  271327 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49432 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/old-k8s-version-20220630210005-9950/id_rsa Username:docker}
	I0630 21:18:50.219445  271327 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49432 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/old-k8s-version-20220630210005-9950/id_rsa Username:docker}
	I0630 21:18:50.340138  271327 addons.go:345] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
	I0630 21:18:50.340167  271327 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
	I0630 21:18:50.342249  271327 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.16.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 21:18:50.345605  271327 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.16.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0630 21:18:50.346238  271327 addons.go:345] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
	I0630 21:18:50.346271  271327 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1820 bytes)
	I0630 21:18:50.427910  271327 addons.go:345] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
	I0630 21:18:50.427939  271327 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
	I0630 21:18:50.428864  271327 addons.go:345] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
	I0630 21:18:50.428889  271327 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
	I0630 21:18:50.445609  271327 addons.go:345] installing /etc/kubernetes/addons/metrics-server-service.yaml
	I0630 21:18:50.445642  271327 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
	I0630 21:18:50.445878  271327 addons.go:345] installing /etc/kubernetes/addons/dashboard-configmap.yaml
	I0630 21:18:50.445901  271327 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
	I0630 21:18:50.526468  271327 addons.go:345] installing /etc/kubernetes/addons/dashboard-dp.yaml
	I0630 21:18:50.526498  271327 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4196 bytes)
	I0630 21:18:50.527802  271327 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.16.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I0630 21:18:50.545627  271327 addons.go:345] installing /etc/kubernetes/addons/dashboard-role.yaml
	I0630 21:18:50.545659  271327 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
	I0630 21:18:50.635021  271327 addons.go:345] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
	I0630 21:18:50.635050  271327 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
	I0630 21:18:50.642890  271327 start.go:806] {"host.minikube.internal": 192.168.67.1} host record injected into CoreDNS
	I0630 21:18:50.724734  271327 addons.go:345] installing /etc/kubernetes/addons/dashboard-sa.yaml
	I0630 21:18:50.724764  271327 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
	I0630 21:18:50.739030  271327 addons.go:345] installing /etc/kubernetes/addons/dashboard-secret.yaml
	I0630 21:18:50.739055  271327 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
	I0630 21:18:50.759486  271327 addons.go:345] installing /etc/kubernetes/addons/dashboard-svc.yaml
	I0630 21:18:50.759516  271327 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
	I0630 21:18:50.832116  271327 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.16.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	I0630 21:18:51.330111  271327 addons.go:383] Verifying addon metrics-server=true in "old-k8s-version-20220630210005-9950"
	I0630 21:18:51.650538  271327 out.go:177] * Enabled addons: default-storageclass, storage-provisioner, metrics-server, dashboard
	I0630 21:18:51.652184  271327 addons.go:414] enableAddons completed in 1.583616991s
	I0630 21:18:52.183124  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:18:52.894083  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:55.393258  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:54.682470  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:18:56.682550  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:18:58.682784  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:18:57.393506  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:59.893037  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:19:01.182368  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:19:03.182653  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:19:01.893409  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:19:04.393312  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:19:05.682177  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:19:07.682617  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:19:06.393389  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:19:08.893380  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:19:10.182307  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:19:12.182785  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:19:11.394532  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:19:13.893106  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:19:15.893450  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:19:14.682663  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:19:16.683157  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:19:19.182264  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:19:18.393510  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:19:20.893487  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:19:21.182311  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:19:23.682308  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:19:23.393825  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:19:25.892844  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:19:25.682442  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:19:28.182873  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:19:27.893374  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:19:30.393226  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:19:30.183093  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:19:32.683019  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:19:32.893321  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:19:35.393425  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	
	* 
	* ==> container status <==
	* CONTAINER           IMAGE               CREATED             STATE               NAME                      ATTEMPT             POD ID
	6bdce580a9d69       6fb66cd78abfe       3 minutes ago       Exited              kindnet-cni               3                   7fc20cc54e9dd
	8341041be1bdb       a634548d10b03       12 minutes ago      Running             kube-proxy                0                   3f9b2696c23cf
	157c2b0c199b6       d3377ffb7177c       12 minutes ago      Running             kube-apiserver            0                   529084b2bca78
	ccc3bef31fe3f       5d725196c1f47       12 minutes ago      Running             kube-scheduler            0                   1d1f80645e258
	d56e346d0980d       aebe758cef4cd       12 minutes ago      Running             etcd                      0                   db374d07bb628
	7734f08ca2670       34cdf99b1bb3b       12 minutes ago      Running             kube-controller-manager   0                   8db8d6937f223
	
	* 
	* ==> containerd <==
	* -- Logs begin at Thu 2022-06-30 21:07:08 UTC, end at Thu 2022-06-30 21:19:39 UTC. --
	Jun 30 21:12:57 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:12:57.386574579Z" level=warning msg="cleaning up after shim disconnected" id=ab6ea818181456a82b827f8508aa0a7fd54e93aafe963afa8bec216aa0475af1 namespace=k8s.io
	Jun 30 21:12:57 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:12:57.386590032Z" level=info msg="cleaning up dead shim"
	Jun 30 21:12:57 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:12:57.396947117Z" level=warning msg="cleanup warnings time=\"2022-06-30T21:12:57Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=2445 runtime=io.containerd.runc.v2\n"
	Jun 30 21:12:58 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:12:58.151667963Z" level=info msg="RemoveContainer for \"abb09f5935beb00881f3602ea9862dad633795ee2a89e31fd20cac6202fb8749\""
	Jun 30 21:12:58 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:12:58.157826419Z" level=info msg="RemoveContainer for \"abb09f5935beb00881f3602ea9862dad633795ee2a89e31fd20cac6202fb8749\" returns successfully"
	Jun 30 21:13:10 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:13:10.455194392Z" level=info msg="CreateContainer within sandbox \"7fc20cc54e9dd3e3e5cefee272490af70d0f9c8c9cd77f065c7a4450e9d1efab\" for container &ContainerMetadata{Name:kindnet-cni,Attempt:2,}"
	Jun 30 21:13:10 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:13:10.467472118Z" level=info msg="CreateContainer within sandbox \"7fc20cc54e9dd3e3e5cefee272490af70d0f9c8c9cd77f065c7a4450e9d1efab\" for &ContainerMetadata{Name:kindnet-cni,Attempt:2,} returns container id \"dd64884ab93c0c3890ada26549c0b777e79f7690d5ff461606312535f761ab83\""
	Jun 30 21:13:10 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:13:10.468045795Z" level=info msg="StartContainer for \"dd64884ab93c0c3890ada26549c0b777e79f7690d5ff461606312535f761ab83\""
	Jun 30 21:13:10 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:13:10.627568878Z" level=info msg="StartContainer for \"dd64884ab93c0c3890ada26549c0b777e79f7690d5ff461606312535f761ab83\" returns successfully"
	Jun 30 21:15:50 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:15:50.977187008Z" level=info msg="shim disconnected" id=dd64884ab93c0c3890ada26549c0b777e79f7690d5ff461606312535f761ab83
	Jun 30 21:15:50 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:15:50.977253148Z" level=warning msg="cleaning up after shim disconnected" id=dd64884ab93c0c3890ada26549c0b777e79f7690d5ff461606312535f761ab83 namespace=k8s.io
	Jun 30 21:15:50 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:15:50.977277780Z" level=info msg="cleaning up dead shim"
	Jun 30 21:15:50 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:15:50.986981410Z" level=warning msg="cleanup warnings time=\"2022-06-30T21:15:50Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=2555 runtime=io.containerd.runc.v2\n"
	Jun 30 21:15:51 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:15:51.473456096Z" level=info msg="RemoveContainer for \"ab6ea818181456a82b827f8508aa0a7fd54e93aafe963afa8bec216aa0475af1\""
	Jun 30 21:15:51 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:15:51.478741889Z" level=info msg="RemoveContainer for \"ab6ea818181456a82b827f8508aa0a7fd54e93aafe963afa8bec216aa0475af1\" returns successfully"
	Jun 30 21:16:16 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:16:16.455842232Z" level=info msg="CreateContainer within sandbox \"7fc20cc54e9dd3e3e5cefee272490af70d0f9c8c9cd77f065c7a4450e9d1efab\" for container &ContainerMetadata{Name:kindnet-cni,Attempt:3,}"
	Jun 30 21:16:16 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:16:16.471592085Z" level=info msg="CreateContainer within sandbox \"7fc20cc54e9dd3e3e5cefee272490af70d0f9c8c9cd77f065c7a4450e9d1efab\" for &ContainerMetadata{Name:kindnet-cni,Attempt:3,} returns container id \"6bdce580a9d6963de5c12d9e017d5662e2685851e130abf85abf7ccd2206a8a6\""
	Jun 30 21:16:16 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:16:16.472342816Z" level=info msg="StartContainer for \"6bdce580a9d6963de5c12d9e017d5662e2685851e130abf85abf7ccd2206a8a6\""
	Jun 30 21:16:16 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:16:16.644126342Z" level=info msg="StartContainer for \"6bdce580a9d6963de5c12d9e017d5662e2685851e130abf85abf7ccd2206a8a6\" returns successfully"
	Jun 30 21:18:57 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:18:57.088736169Z" level=info msg="shim disconnected" id=6bdce580a9d6963de5c12d9e017d5662e2685851e130abf85abf7ccd2206a8a6
	Jun 30 21:18:57 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:18:57.088796065Z" level=warning msg="cleaning up after shim disconnected" id=6bdce580a9d6963de5c12d9e017d5662e2685851e130abf85abf7ccd2206a8a6 namespace=k8s.io
	Jun 30 21:18:57 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:18:57.088810788Z" level=info msg="cleaning up dead shim"
	Jun 30 21:18:57 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:18:57.098628278Z" level=warning msg="cleanup warnings time=\"2022-06-30T21:18:57Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=2659 runtime=io.containerd.runc.v2\n"
	Jun 30 21:18:57 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:18:57.822887759Z" level=info msg="RemoveContainer for \"dd64884ab93c0c3890ada26549c0b777e79f7690d5ff461606312535f761ab83\""
	Jun 30 21:18:57 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:18:57.827591073Z" level=info msg="RemoveContainer for \"dd64884ab93c0c3890ada26549c0b777e79f7690d5ff461606312535f761ab83\" returns successfully"
	
	* 
	* ==> describe nodes <==
	* Name:               embed-certs-20220630210659-9950
	Roles:              control-plane
	Labels:             beta.kubernetes.io/arch=amd64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=amd64
	                    kubernetes.io/hostname=embed-certs-20220630210659-9950
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=251ffcec0e4c997cd7732864187747cc579943c9
	                    minikube.k8s.io/name=embed-certs-20220630210659-9950
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2022_06_30T21_07_23_0700
	                    minikube.k8s.io/version=v1.26.0
	                    node-role.kubernetes.io/control-plane=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///run/containerd/containerd.sock
	                    node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Thu, 30 Jun 2022 21:07:19 +0000
	Taints:             node.kubernetes.io/not-ready:NoSchedule
	Unschedulable:      false
	Lease:
	  HolderIdentity:  embed-certs-20220630210659-9950
	  AcquireTime:     <unset>
	  RenewTime:       Thu, 30 Jun 2022 21:19:36 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Thu, 30 Jun 2022 21:17:45 +0000   Thu, 30 Jun 2022 21:07:16 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Thu, 30 Jun 2022 21:17:45 +0000   Thu, 30 Jun 2022 21:07:16 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Thu, 30 Jun 2022 21:17:45 +0000   Thu, 30 Jun 2022 21:07:16 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            False   Thu, 30 Jun 2022 21:17:45 +0000   Thu, 30 Jun 2022 21:07:16 +0000   KubeletNotReady              container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Addresses:
	  InternalIP:  192.168.94.2
	  Hostname:    embed-certs-20220630210659-9950
	Capacity:
	  cpu:                8
	  ephemeral-storage:  304695084Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32873488Ki
	  pods:               110
	Allocatable:
	  cpu:                8
	  ephemeral-storage:  304695084Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32873488Ki
	  pods:               110
	System Info:
	  Machine ID:                 bbe1e1cef6e940328962dca52b3c5731
	  System UUID:                e149cbc8-bbc1-4888-b53f-97553d30d981
	  Boot ID:                    471c4729-f046-4a15-bc49-46f3ad561708
	  Kernel Version:             5.15.0-1012-gcp
	  OS Image:                   Ubuntu 20.04.4 LTS
	  Operating System:           linux
	  Architecture:               amd64
	  Container Runtime Version:  containerd://1.6.6
	  Kubelet Version:            v1.24.2
	  Kube-Proxy Version:         v1.24.2
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (6 in total)
	  Namespace                   Name                                                       CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                                       ------------  ----------  ---------------  -------------  ---
	  kube-system                 etcd-embed-certs-20220630210659-9950                       100m (1%!)(MISSING)     0 (0%!)(MISSING)      100Mi (0%!)(MISSING)       0 (0%!)(MISSING)         12m
	  kube-system                 kindnet-z7fgt                                              100m (1%!)(MISSING)     100m (1%!)(MISSING)   50Mi (0%!)(MISSING)        50Mi (0%!)(MISSING)      12m
	  kube-system                 kube-apiserver-embed-certs-20220630210659-9950             250m (3%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         12m
	  kube-system                 kube-controller-manager-embed-certs-20220630210659-9950    200m (2%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         12m
	  kube-system                 kube-proxy-jhw4d                                           0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         12m
	  kube-system                 kube-scheduler-embed-certs-20220630210659-9950             100m (1%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         12m
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                750m (9%!)(MISSING)   100m (1%!)(MISSING)
	  memory             150Mi (0%!)(MISSING)  50Mi (0%!)(MISSING)
	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	Events:
	  Type    Reason                   Age                From             Message
	  ----    ------                   ----               ----             -------
	  Normal  Starting                 12m                kube-proxy       
	  Normal  NodeHasSufficientMemory  12m (x5 over 12m)  kubelet          Node embed-certs-20220630210659-9950 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    12m (x5 over 12m)  kubelet          Node embed-certs-20220630210659-9950 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     12m (x4 over 12m)  kubelet          Node embed-certs-20220630210659-9950 status is now: NodeHasSufficientPID
	  Normal  NodeHasNoDiskPressure    12m                kubelet          Node embed-certs-20220630210659-9950 status is now: NodeHasNoDiskPressure
	  Normal  Starting                 12m                kubelet          Starting kubelet.
	  Normal  NodeHasSufficientMemory  12m                kubelet          Node embed-certs-20220630210659-9950 status is now: NodeHasSufficientMemory
	  Normal  NodeHasSufficientPID     12m                kubelet          Node embed-certs-20220630210659-9950 status is now: NodeHasSufficientPID
	  Normal  NodeAllocatableEnforced  12m                kubelet          Updated Node Allocatable limit across pods
	  Normal  RegisteredNode           12m                node-controller  Node embed-certs-20220630210659-9950 event: Registered Node embed-certs-20220630210659-9950 in Controller
	
	* 
	* ==> dmesg <==
	* [  +2.939825] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000011] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.027789] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.019913] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[ +21.968090] IPv4: martian destination 127.0.0.11 from 10.244.0.3, dev veth8071d138
	[ +25.445872] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.029436] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.023957] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +2.947695] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[Jun30 21:05] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.023879] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +2.955783] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.011828] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000005] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.027896] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	
	* 
	* ==> etcd [d56e346d0980d838b9cd42c94d9e084ef84bb0fdeb4316ae2dd5c8a25cc054a1] <==
	* {"level":"info","ts":"2022-06-30T21:07:15.947Z","caller":"embed/etcd.go:688","msg":"starting with client TLS","tls-info":"cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, client-cert=, client-key=, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = ","cipher-suites":[]}
	{"level":"info","ts":"2022-06-30T21:07:15.948Z","caller":"embed/etcd.go:277","msg":"now serving peer/client/metrics","local-member-id":"dfc97eb0aae75b33","initial-advertise-peer-urls":["https://192.168.94.2:2380"],"listen-peer-urls":["https://192.168.94.2:2380"],"advertise-client-urls":["https://192.168.94.2:2379"],"listen-client-urls":["https://127.0.0.1:2379","https://192.168.94.2:2379"],"listen-metrics-urls":["http://127.0.0.1:2381"]}
	{"level":"info","ts":"2022-06-30T21:07:15.948Z","caller":"embed/etcd.go:581","msg":"serving peer traffic","address":"192.168.94.2:2380"}
	{"level":"info","ts":"2022-06-30T21:07:15.948Z","caller":"embed/etcd.go:763","msg":"serving metrics","address":"http://127.0.0.1:2381"}
	{"level":"info","ts":"2022-06-30T21:07:15.948Z","caller":"embed/etcd.go:553","msg":"cmux::serve","address":"192.168.94.2:2380"}
	{"level":"info","ts":"2022-06-30T21:07:16.036Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"dfc97eb0aae75b33 is starting a new election at term 1"}
	{"level":"info","ts":"2022-06-30T21:07:16.036Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"dfc97eb0aae75b33 became pre-candidate at term 1"}
	{"level":"info","ts":"2022-06-30T21:07:16.036Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"dfc97eb0aae75b33 received MsgPreVoteResp from dfc97eb0aae75b33 at term 1"}
	{"level":"info","ts":"2022-06-30T21:07:16.036Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"dfc97eb0aae75b33 became candidate at term 2"}
	{"level":"info","ts":"2022-06-30T21:07:16.036Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"dfc97eb0aae75b33 received MsgVoteResp from dfc97eb0aae75b33 at term 2"}
	{"level":"info","ts":"2022-06-30T21:07:16.036Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"dfc97eb0aae75b33 became leader at term 2"}
	{"level":"info","ts":"2022-06-30T21:07:16.036Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: dfc97eb0aae75b33 elected leader dfc97eb0aae75b33 at term 2"}
	{"level":"info","ts":"2022-06-30T21:07:16.036Z","caller":"etcdserver/server.go:2507","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}
	{"level":"info","ts":"2022-06-30T21:07:16.036Z","caller":"etcdserver/server.go:2042","msg":"published local member to cluster through raft","local-member-id":"dfc97eb0aae75b33","local-member-attributes":"{Name:embed-certs-20220630210659-9950 ClientURLs:[https://192.168.94.2:2379]}","request-path":"/0/members/dfc97eb0aae75b33/attributes","cluster-id":"da400bbece288f5a","publish-timeout":"7s"}
	{"level":"info","ts":"2022-06-30T21:07:16.036Z","caller":"embed/serve.go:98","msg":"ready to serve client requests"}
	{"level":"info","ts":"2022-06-30T21:07:16.036Z","caller":"embed/serve.go:98","msg":"ready to serve client requests"}
	{"level":"info","ts":"2022-06-30T21:07:16.037Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
	{"level":"info","ts":"2022-06-30T21:07:16.037Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
	{"level":"info","ts":"2022-06-30T21:07:16.037Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"da400bbece288f5a","local-member-id":"dfc97eb0aae75b33","cluster-version":"3.5"}
	{"level":"info","ts":"2022-06-30T21:07:16.037Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
	{"level":"info","ts":"2022-06-30T21:07:16.037Z","caller":"etcdserver/server.go:2531","msg":"cluster version is updated","cluster-version":"3.5"}
	{"level":"info","ts":"2022-06-30T21:07:16.038Z","caller":"embed/serve.go:188","msg":"serving client traffic securely","address":"127.0.0.1:2379"}
	{"level":"info","ts":"2022-06-30T21:07:16.038Z","caller":"embed/serve.go:188","msg":"serving client traffic securely","address":"192.168.94.2:2379"}
	{"level":"info","ts":"2022-06-30T21:17:16.547Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":441}
	{"level":"info","ts":"2022-06-30T21:17:16.548Z","caller":"mvcc/kvstore_compaction.go:57","msg":"finished scheduled compaction","compact-revision":441,"took":"398.905µs"}
	
	* 
	* ==> kernel <==
	*  21:19:39 up  1:02,  0 users,  load average: 0.97, 0.78, 1.22
	Linux embed-certs-20220630210659-9950 5.15.0-1012-gcp #17~20.04.1-Ubuntu SMP Thu Jun 23 16:10:34 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
	PRETTY_NAME="Ubuntu 20.04.4 LTS"
	
	* 
	* ==> kube-apiserver [157c2b0c199b65e53b31cbc33bd298586d30106a66d587ee22f9c486df45d1ba] <==
	* I0630 21:07:19.225159       1 cache.go:39] Caches are synced for APIServiceRegistrationController controller
	I0630 21:07:19.225172       1 cache.go:39] Caches are synced for autoregister controller
	I0630 21:07:19.229589       1 controller.go:611] quota admission added evaluator for: namespaces
	I0630 21:07:19.267453       1 apf_controller.go:322] Running API Priority and Fairness config worker
	I0630 21:07:19.268797       1 cache.go:39] Caches are synced for AvailableConditionController controller
	I0630 21:07:19.272028       1 shared_informer.go:262] Caches are synced for crd-autoregister
	I0630 21:07:19.327812       1 shared_informer.go:262] Caches are synced for node_authorizer
	I0630 21:07:19.793196       1 controller.go:132] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).
	I0630 21:07:20.081878       1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000
	I0630 21:07:20.085097       1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000
	I0630 21:07:20.085124       1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.
	I0630 21:07:20.500795       1 controller.go:611] quota admission added evaluator for: roles.rbac.authorization.k8s.io
	I0630 21:07:20.554121       1 controller.go:611] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
	I0630 21:07:20.649489       1 alloc.go:327] "allocated clusterIPs" service="default/kubernetes" clusterIPs=map[IPv4:10.96.0.1]
	W0630 21:07:20.655776       1 lease.go:234] Resetting endpoints for master service "kubernetes" to [192.168.94.2]
	I0630 21:07:20.656777       1 controller.go:611] quota admission added evaluator for: endpoints
	I0630 21:07:20.660110       1 controller.go:611] quota admission added evaluator for: endpointslices.discovery.k8s.io
	I0630 21:07:21.241414       1 controller.go:611] quota admission added evaluator for: serviceaccounts
	I0630 21:07:22.286912       1 controller.go:611] quota admission added evaluator for: deployments.apps
	I0630 21:07:22.296519       1 alloc.go:327] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs=map[IPv4:10.96.0.10]
	I0630 21:07:22.305814       1 controller.go:611] quota admission added evaluator for: daemonsets.apps
	I0630 21:07:22.430261       1 controller.go:611] quota admission added evaluator for: leases.coordination.k8s.io
	I0630 21:07:34.975370       1 controller.go:611] quota admission added evaluator for: controllerrevisions.apps
	I0630 21:07:35.000925       1 controller.go:611] quota admission added evaluator for: replicasets.apps
	I0630 21:07:36.039694       1 controller.go:611] quota admission added evaluator for: events.events.k8s.io
	
	* 
	* ==> kube-controller-manager [7734f08ca26708ce34ae224077718432c05bc3133a11bb3d600a7d29c4df0045] <==
	* I0630 21:07:34.940748       1 shared_informer.go:262] Caches are synced for PVC protection
	I0630 21:07:34.940779       1 shared_informer.go:262] Caches are synced for endpoint
	I0630 21:07:34.940788       1 shared_informer.go:262] Caches are synced for attach detach
	I0630 21:07:34.940728       1 shared_informer.go:262] Caches are synced for stateful set
	I0630 21:07:34.940864       1 shared_informer.go:262] Caches are synced for GC
	I0630 21:07:34.942018       1 shared_informer.go:262] Caches are synced for persistent volume
	I0630 21:07:34.955637       1 shared_informer.go:262] Caches are synced for resource quota
	I0630 21:07:34.964899       1 shared_informer.go:262] Caches are synced for daemon sets
	I0630 21:07:34.969897       1 shared_informer.go:262] Caches are synced for job
	I0630 21:07:34.980424       1 event.go:294] "Event occurred" object="kube-system/kube-proxy" fieldPath="" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-jhw4d"
	I0630 21:07:34.982490       1 event.go:294] "Event occurred" object="kube-system/kindnet" fieldPath="" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kindnet-z7fgt"
	I0630 21:07:34.988369       1 shared_informer.go:262] Caches are synced for endpoint_slice
	I0630 21:07:34.990561       1 shared_informer.go:262] Caches are synced for ephemeral
	I0630 21:07:34.991707       1 shared_informer.go:262] Caches are synced for taint
	I0630 21:07:34.991768       1 shared_informer.go:262] Caches are synced for deployment
	I0630 21:07:34.991797       1 node_lifecycle_controller.go:1399] Initializing eviction metric for zone: 
	I0630 21:07:34.991839       1 taint_manager.go:187] "Starting NoExecuteTaintManager"
	W0630 21:07:34.991867       1 node_lifecycle_controller.go:1014] Missing timestamp for Node embed-certs-20220630210659-9950. Assuming now as a timestamp.
	I0630 21:07:34.991912       1 node_lifecycle_controller.go:1165] Controller detected that all Nodes are not-Ready. Entering master disruption mode.
	I0630 21:07:34.991954       1 event.go:294] "Event occurred" object="embed-certs-20220630210659-9950" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node embed-certs-20220630210659-9950 event: Registered Node embed-certs-20220630210659-9950 in Controller"
	I0630 21:07:35.002644       1 event.go:294] "Event occurred" object="kube-system/coredns" fieldPath="" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-6d4b75cb6d to 1"
	I0630 21:07:35.099654       1 event.go:294] "Event occurred" object="kube-system/coredns-6d4b75cb6d" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-6d4b75cb6d-87dwf"
	I0630 21:07:35.374123       1 shared_informer.go:262] Caches are synced for garbage collector
	I0630 21:07:35.396784       1 shared_informer.go:262] Caches are synced for garbage collector
	I0630 21:07:35.396818       1 garbagecollector.go:158] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
	
	* 
	* ==> kube-proxy [8341041be1bdbcf0e0425bd1832777e15b2ed89bf8696d0c78d14301820032c3] <==
	* I0630 21:07:35.930193       1 node.go:163] Successfully retrieved node IP: 192.168.94.2
	I0630 21:07:35.930280       1 server_others.go:138] "Detected node IP" address="192.168.94.2"
	I0630 21:07:35.930318       1 server_others.go:578] "Unknown proxy mode, assuming iptables proxy" proxyMode=""
	I0630 21:07:36.035407       1 server_others.go:206] "Using iptables Proxier"
	I0630 21:07:36.035471       1 server_others.go:213] "kube-proxy running in dual-stack mode" ipFamily=IPv4
	I0630 21:07:36.035484       1 server_others.go:214] "Creating dualStackProxier for iptables"
	I0630 21:07:36.035502       1 server_others.go:501] "Detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, , defaulting to no-op detect-local for IPv6"
	I0630 21:07:36.035532       1 proxier.go:259] "Setting route_localnet=1, use nodePortAddresses to filter loopback addresses for NodePorts to skip it https://issues.k8s.io/90259"
	I0630 21:07:36.035701       1 proxier.go:259] "Setting route_localnet=1, use nodePortAddresses to filter loopback addresses for NodePorts to skip it https://issues.k8s.io/90259"
	I0630 21:07:36.035995       1 server.go:661] "Version info" version="v1.24.2"
	I0630 21:07:36.036014       1 server.go:663] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
	I0630 21:07:36.036550       1 config.go:317] "Starting service config controller"
	I0630 21:07:36.036571       1 shared_informer.go:255] Waiting for caches to sync for service config
	I0630 21:07:36.036594       1 config.go:444] "Starting node config controller"
	I0630 21:07:36.036598       1 shared_informer.go:255] Waiting for caches to sync for node config
	I0630 21:07:36.036750       1 config.go:226] "Starting endpoint slice config controller"
	I0630 21:07:36.036770       1 shared_informer.go:255] Waiting for caches to sync for endpoint slice config
	I0630 21:07:36.137118       1 shared_informer.go:262] Caches are synced for endpoint slice config
	I0630 21:07:36.137139       1 shared_informer.go:262] Caches are synced for service config
	I0630 21:07:36.137113       1 shared_informer.go:262] Caches are synced for node config
	
	* 
	* ==> kube-scheduler [ccc3bef31fe3faba9ff6daab0d5ca071fed6adb37d8cc554c7399ac599691557] <==
	* W0630 21:07:19.234494       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	E0630 21:07:19.235636       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	W0630 21:07:19.234110       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	E0630 21:07:19.235666       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	W0630 21:07:19.234672       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E0630 21:07:19.235716       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	W0630 21:07:19.234671       1 reflector.go:324] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	E0630 21:07:19.235796       1 reflector.go:138] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	W0630 21:07:19.234818       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0630 21:07:19.235858       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	W0630 21:07:19.234955       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E0630 21:07:19.235883       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	W0630 21:07:19.234128       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	E0630 21:07:19.235898       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	W0630 21:07:20.099241       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E0630 21:07:20.099281       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	W0630 21:07:20.186118       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E0630 21:07:20.186155       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	W0630 21:07:20.247542       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	E0630 21:07:20.247580       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	W0630 21:07:20.264775       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E0630 21:07:20.264809       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	W0630 21:07:20.394978       1 reflector.go:324] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	E0630 21:07:20.395035       1 reflector.go:138] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	I0630 21:07:23.232820       1 shared_informer.go:262] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	
	* 
	* ==> kubelet <==
	* -- Logs begin at Thu 2022-06-30 21:07:08 UTC, end at Thu 2022-06-30 21:19:39 UTC. --
	Jun 30 21:18:22 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:18:22.814104    1338 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:18:27 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:18:27.815097    1338 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:18:32 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:18:32.816217    1338 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:18:37 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:18:37.817148    1338 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:18:42 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:18:42.818243    1338 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:18:47 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:18:47.819889    1338 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:18:52 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:18:52.821499    1338 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:18:57 embed-certs-20220630210659-9950 kubelet[1338]: I0630 21:18:57.821808    1338 scope.go:110] "RemoveContainer" containerID="dd64884ab93c0c3890ada26549c0b777e79f7690d5ff461606312535f761ab83"
	Jun 30 21:18:57 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:18:57.821962    1338 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:18:57 embed-certs-20220630210659-9950 kubelet[1338]: I0630 21:18:57.822192    1338 scope.go:110] "RemoveContainer" containerID="6bdce580a9d6963de5c12d9e017d5662e2685851e130abf85abf7ccd2206a8a6"
	Jun 30 21:18:57 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:18:57.822602    1338 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kindnet-cni\" with CrashLoopBackOff: \"back-off 40s restarting failed container=kindnet-cni pod=kindnet-z7fgt_kube-system(9d385a59-b071-48be-b547-db80254669bc)\"" pod="kube-system/kindnet-z7fgt" podUID=9d385a59-b071-48be-b547-db80254669bc
	Jun 30 21:19:02 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:19:02.823098    1338 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:19:07 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:19:07.824578    1338 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:19:09 embed-certs-20220630210659-9950 kubelet[1338]: I0630 21:19:09.452458    1338 scope.go:110] "RemoveContainer" containerID="6bdce580a9d6963de5c12d9e017d5662e2685851e130abf85abf7ccd2206a8a6"
	Jun 30 21:19:09 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:19:09.452939    1338 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kindnet-cni\" with CrashLoopBackOff: \"back-off 40s restarting failed container=kindnet-cni pod=kindnet-z7fgt_kube-system(9d385a59-b071-48be-b547-db80254669bc)\"" pod="kube-system/kindnet-z7fgt" podUID=9d385a59-b071-48be-b547-db80254669bc
	Jun 30 21:19:12 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:19:12.826264    1338 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:19:17 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:19:17.827939    1338 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:19:22 embed-certs-20220630210659-9950 kubelet[1338]: I0630 21:19:22.452139    1338 scope.go:110] "RemoveContainer" containerID="6bdce580a9d6963de5c12d9e017d5662e2685851e130abf85abf7ccd2206a8a6"
	Jun 30 21:19:22 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:19:22.452400    1338 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kindnet-cni\" with CrashLoopBackOff: \"back-off 40s restarting failed container=kindnet-cni pod=kindnet-z7fgt_kube-system(9d385a59-b071-48be-b547-db80254669bc)\"" pod="kube-system/kindnet-z7fgt" podUID=9d385a59-b071-48be-b547-db80254669bc
	Jun 30 21:19:22 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:19:22.829219    1338 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:19:27 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:19:27.830978    1338 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:19:32 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:19:32.831640    1338 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:19:36 embed-certs-20220630210659-9950 kubelet[1338]: I0630 21:19:36.452853    1338 scope.go:110] "RemoveContainer" containerID="6bdce580a9d6963de5c12d9e017d5662e2685851e130abf85abf7ccd2206a8a6"
	Jun 30 21:19:36 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:19:36.453199    1338 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kindnet-cni\" with CrashLoopBackOff: \"back-off 40s restarting failed container=kindnet-cni pod=kindnet-z7fgt_kube-system(9d385a59-b071-48be-b547-db80254669bc)\"" pod="kube-system/kindnet-z7fgt" podUID=9d385a59-b071-48be-b547-db80254669bc
	Jun 30 21:19:37 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:19:37.832729    1338 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	

                                                
                                                
-- /stdout --
helpers_test.go:254: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p embed-certs-20220630210659-9950 -n embed-certs-20220630210659-9950
helpers_test.go:261: (dbg) Run:  kubectl --context embed-certs-20220630210659-9950 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:270: non-running pods: busybox coredns-6d4b75cb6d-87dwf storage-provisioner
helpers_test.go:272: ======> post-mortem[TestStartStop/group/embed-certs/serial/DeployApp]: describe non-running pods <======
helpers_test.go:275: (dbg) Run:  kubectl --context embed-certs-20220630210659-9950 describe pod busybox coredns-6d4b75cb6d-87dwf storage-provisioner
helpers_test.go:275: (dbg) Non-zero exit: kubectl --context embed-certs-20220630210659-9950 describe pod busybox coredns-6d4b75cb6d-87dwf storage-provisioner: exit status 1 (61.103418ms)

                                                
                                                
-- stdout --
	Name:         busybox
	Namespace:    default
	Priority:     0
	Node:         <none>
	Labels:       integration-test=busybox
	Annotations:  <none>
	Status:       Pending
	IP:           
	IPs:          <none>
	Containers:
	  busybox:
	    Image:      gcr.io/k8s-minikube/busybox:1.28.4-glibc
	    Port:       <none>
	    Host Port:  <none>
	    Command:
	      sleep
	      3600
	    Environment:  <none>
	    Mounts:
	      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-r2mh6 (ro)
	Conditions:
	  Type           Status
	  PodScheduled   False 
	Volumes:
	  kube-api-access-r2mh6:
	    Type:                    Projected (a volume that contains injected data from multiple sources)
	    TokenExpirationSeconds:  3607
	    ConfigMapName:           kube-root-ca.crt
	    ConfigMapOptional:       <nil>
	    DownwardAPI:             true
	QoS Class:                   BestEffort
	Node-Selectors:              <none>
	Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
	                             node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
	Events:
	  Type     Reason            Age                   From               Message
	  ----     ------            ----                  ----               -------
	  Warning  FailedScheduling  2m48s (x2 over 8m3s)  default-scheduler  0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.

                                                
                                                
-- /stdout --
** stderr ** 
	Error from server (NotFound): pods "coredns-6d4b75cb6d-87dwf" not found
	Error from server (NotFound): pods "storage-provisioner" not found

                                                
                                                
** /stderr **
helpers_test.go:277: kubectl --context embed-certs-20220630210659-9950 describe pod busybox coredns-6d4b75cb6d-87dwf storage-provisioner: exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestStartStop/group/embed-certs/serial/DeployApp]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect embed-certs-20220630210659-9950
helpers_test.go:235: (dbg) docker inspect embed-certs-20220630210659-9950:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "8d43dca0a5ff56a08f5b0493d261e7c5d2aa00d085ae1a1182a97b5635cc1304",
	        "Created": "2022-06-30T21:07:07.545531471Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 259148,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2022-06-30T21:07:07.92350884Z",
	            "FinishedAt": "0001-01-01T00:00:00Z"
	        },
	        "Image": "sha256:573e7be5768273a7845baee1ae90fa2e33b83b10a7fbb0f0f41efbf29b53d1f1",
	        "ResolvConfPath": "/var/lib/docker/containers/8d43dca0a5ff56a08f5b0493d261e7c5d2aa00d085ae1a1182a97b5635cc1304/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/8d43dca0a5ff56a08f5b0493d261e7c5d2aa00d085ae1a1182a97b5635cc1304/hostname",
	        "HostsPath": "/var/lib/docker/containers/8d43dca0a5ff56a08f5b0493d261e7c5d2aa00d085ae1a1182a97b5635cc1304/hosts",
	        "LogPath": "/var/lib/docker/containers/8d43dca0a5ff56a08f5b0493d261e7c5d2aa00d085ae1a1182a97b5635cc1304/8d43dca0a5ff56a08f5b0493d261e7c5d2aa00d085ae1a1182a97b5635cc1304-json.log",
	        "Name": "/embed-certs-20220630210659-9950",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "embed-certs-20220630210659-9950:/var",
	                "/lib/modules:/lib/modules:ro"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "embed-certs-20220630210659-9950",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 2306867200,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": null,
	            "BlkioDeviceWriteBps": null,
	            "BlkioDeviceReadIOps": null,
	            "BlkioDeviceWriteIOps": null,
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "KernelMemory": 0,
	            "KernelMemoryTCP": 0,
	            "MemoryReservation": 0,
	            "MemorySwap": 4613734400,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": null,
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/9c28feead8af894b180999110a5cc0d8344ae5c74789cd8dc72d94ee221f8e10-init/diff:/var/lib/docker/overlay2/8b88d9f6f12c48be642a133456203e58549a93f1da67d0349744bd0f78917fba/diff:/var/lib/docker/overlay2/2bcbb3b4718a64188802301a25d7f413bb307cb16d077e7e5af799f9152a2970/diff:/var/lib/docker/overlay2/70b0888bf22fcef1c004704b71288ac581cf26a3b3b19fbca3da296ba10d6978/diff:/var/lib/docker/overlay2/7c5332f38fe652f379ef9b6d23e795158e9994317cfb547b581dd2b1fdf1303b/diff:/var/lib/docker/overlay2/0ddb5a3abf433b644a8bfa124e3c87878eed67878faa35493f2befc2b392e9cb/diff:/var/lib/docker/overlay2/3b7cda5fb0232fdeecbec0531ac704a59eb38fe57664c25777193b07e2df0077/diff:/var/lib/docker/overlay2/a14687ada786c65465b9924ae2d77ba27afc07942851cafaade28e80dfe9da16/diff:/var/lib/docker/overlay2/c49a9b7157aa6e8714e192b2849866d035b59e18de462c0ee9b72f898cc5a485/diff:/var/lib/docker/overlay2/efd71a50e3a1044a6d1c4c1a7d4d91d9f070c066e03e51c6c73a5764b778ad72/diff:/var/lib/docker/overlay2/55476a
1c0a20aa4238a0bb0e43c6402c33dcad312938ad48ee81be0160e12a49/diff:/var/lib/docker/overlay2/c48c4a348a797b9a38f01568a6adbcb4b05b4f56f7b986a4bf1b509d8cb00732/diff:/var/lib/docker/overlay2/568e3f354ab0428de5cf82d1fdfb780c3377f5cc55d9f524731c53e39e0ecae7/diff:/var/lib/docker/overlay2/2857943e320cdcdae9af3d8c2acda1fb61e2f142a88b8b902908071cea67816e/diff:/var/lib/docker/overlay2/bdd9a57f0b65e65c5a16395f239425e794c678b0e8db2f4a368e0a9427fe5116/diff:/var/lib/docker/overlay2/b150183f1b73e8c13c751911bcee09fed8ef973478f4dc3cfdb9e509118bf1ea/diff:/var/lib/docker/overlay2/0a053e7c29417cd6feafb351c7944e81342a52898871bc779f7bf61868c78ec4/diff:/var/lib/docker/overlay2/d3c0de3a44d75d0a05acb7843d53deba5ce0457649d6ed757da9b4c532a81e4f/diff:/var/lib/docker/overlay2/53f6170132880e1697dd802b8577382b31c6f1ba144256f8cc62542998842a6b/diff:/var/lib/docker/overlay2/b5c0be6d8efdb1fcb12e73b8f72853f77baa4bc014ac2c1e28b7b972b07f3325/diff:/var/lib/docker/overlay2/36c908f082a1e5388bb25277f1c957eaecf70fcd958080422fa85a3105724fb2/diff:/var/lib/d
ocker/overlay2/b147fe9dce365cfaf9bfeca2e370829e4d87e2671c133a9836ecb02a85422cc7/diff:/var/lib/docker/overlay2/65f488eb9181a721f01b333f5fa0cb91d216abd7842a9ae193bd95316f378721/diff:/var/lib/docker/overlay2/b04269aa247b68912ddc5b1c98ad55d67af4103f576a900eef4069c196b8a263/diff:/var/lib/docker/overlay2/b714c37e15257ae9d0e15d271dd18a330c38ad765901d9b7e7e3feb73e1b03e4/diff:/var/lib/docker/overlay2/3c253b721193edeaade7bba7ce25ff687c889b8fa86e9489c7ee20d5624e6c5b/diff:/var/lib/docker/overlay2/7f67b74e101fa21dd320393c10576eefa4ce1cec2e210bff405784fa45b360f3/diff:/var/lib/docker/overlay2/c3b2adaa63a06a5e6ed966d7b6f20a757aeadd3f25eb09ef3c7e9a66a8904143/diff:/var/lib/docker/overlay2/ddb5d653d19e8cafc4625a8fe9597667d98b277a7f679e532ad84caa2c6da636/diff:/var/lib/docker/overlay2/03eb172b20323ebeee7cb09025726a6e10de6c3dd8661f4f6bbc5a3a3778bad4/diff:/var/lib/docker/overlay2/80ea9bf34d028e95a8a418b3aeb634be72ab3336448946d7855c51ffdf8258d7/diff:/var/lib/docker/overlay2/e28987ea3fb4d431dee111f38cc76814b85f73e86434be3c463c01fdd59
9ad46/diff:/var/lib/docker/overlay2/6f9a46c7c6cf4fd30ce32a1eb08ed9b1e8dd61cb0e42ce54f0f736f06558c306/diff:/var/lib/docker/overlay2/6fc942eb9ccfc09898edc9a5ef3b3d305a6fcb22e8cefb1a9f9c344d10b59b25/diff:/var/lib/docker/overlay2/f6b8c57540e798dc1dfd51fd29c020193c02a4362f31c6d07aa220327bb07b90/diff:/var/lib/docker/overlay2/85d0aa01a3fab8c77262c59d8a7b0809a72673a3da7d33e4e19c04a66db44a11/diff:/var/lib/docker/overlay2/58dcd81a1605641f785ced5aeb38657eec1f02a31b7adfaf4f6fdd49f4bab1d6/diff:/var/lib/docker/overlay2/9d537e0a65325e4bf85b26da9828002339f5c442ca85f931b340457a80ec8c94/diff:/var/lib/docker/overlay2/a6f73707ee6a74e948a02d03c4a3f12b57c2eb408dc67da3c39961bb3cefcc97/diff:/var/lib/docker/overlay2/922526c310b066dbb73b9a106eef8bf0064ad7907a8d7d7b353f5307a17a4901/diff:/var/lib/docker/overlay2/a4185854870ebf8d34a4c7e1827dbe3bc461559839301ffb23c5efff5e3c9f14/diff:/var/lib/docker/overlay2/8c02b1fcb9d79f5d7b2ee4d44f6625a692c44a0d18df0a5c01cac0cca0fdf3f3/diff",
	                "MergedDir": "/var/lib/docker/overlay2/9c28feead8af894b180999110a5cc0d8344ae5c74789cd8dc72d94ee221f8e10/merged",
	                "UpperDir": "/var/lib/docker/overlay2/9c28feead8af894b180999110a5cc0d8344ae5c74789cd8dc72d94ee221f8e10/diff",
	                "WorkDir": "/var/lib/docker/overlay2/9c28feead8af894b180999110a5cc0d8344ae5c74789cd8dc72d94ee221f8e10/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "volume",
	                "Name": "embed-certs-20220630210659-9950",
	                "Source": "/var/lib/docker/volumes/embed-certs-20220630210659-9950/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            },
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            }
	        ],
	        "Config": {
	            "Hostname": "embed-certs-20220630210659-9950",
	            "Domainname": "",
	            "User": "root",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e",
	            "Volumes": null,
	            "WorkingDir": "",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "embed-certs-20220630210659-9950",
	                "name.minikube.sigs.k8s.io": "embed-certs-20220630210659-9950",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "877fceadb9246afa76923272f42d13c3ffa0cb31def97b937ce1263fb518147c",
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49427"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49426"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49423"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49425"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49424"
	                    }
	                ]
	            },
	            "SandboxKey": "/var/run/docker/netns/877fceadb924",
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "embed-certs-20220630210659-9950": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.94.2"
	                    },
	                    "Links": null,
	                    "Aliases": [
	                        "8d43dca0a5ff",
	                        "embed-certs-20220630210659-9950"
	                    ],
	                    "NetworkID": "a762009b1f738e8867dc868c38a8f04b91d930fa90f85eb117025e337ab9ed89",
	                    "EndpointID": "0afa60894f5bfb34a238eac3163af9d64b401d43c8640e4b094e1040817564ec",
	                    "Gateway": "192.168.94.1",
	                    "IPAddress": "192.168.94.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "MacAddress": "02:42:c0:a8:5e:02",
	                    "DriverOpts": null
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-20220630210659-9950 -n embed-certs-20220630210659-9950
helpers_test.go:244: <<< TestStartStop/group/embed-certs/serial/DeployApp FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======>  post-mortem[TestStartStop/group/embed-certs/serial/DeployApp]: minikube logs <======
helpers_test.go:247: (dbg) Run:  out/minikube-linux-amd64 -p embed-certs-20220630210659-9950 logs -n 25
E0630 21:19:41.442140    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/kindnet-20220630204858-9950/client.crt: no such file or directory
helpers_test.go:252: TestStartStop/group/embed-certs/serial/DeployApp logs: 
-- stdout --
	* 
	* ==> Audit <==
	* |---------|------------------------------------------------------------|----------|---------|---------|---------------------|---------------------|
	| Command |                            Args                            | Profile  |  User   | Version |     Start Time      |      End Time       |
	|---------|------------------------------------------------------------|----------|---------|---------|---------------------|---------------------|
	| start   | -p newest-cni-20220630210514-9950 --memory=2200            | minikube | jenkins | v1.26.0 | 30 Jun 22 21:05 UTC | 30 Jun 22 21:06 UTC |
	|         | --alsologtostderr --wait=apiserver,system_pods,default_sa  |          |         |         |                     |                     |
	|         | --feature-gates ServerSideApply=true --network-plugin=cni  |          |         |         |                     |                     |
	|         | --extra-config=kubeadm.pod-network-cidr=192.168.111.111/16 |          |         |         |                     |                     |
	|         | --driver=docker  --container-runtime=containerd            |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                               |          |         |         |                     |                     |
	| addons  | enable metrics-server -p                                   | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | --images=MetricsServer=k8s.gcr.io/echoserver:1.4           |          |         |         |                     |                     |
	|         | --registries=MetricsServer=fake.domain                     |          |         |         |                     |                     |
	| stop    | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=3                                     |          |         |         |                     |                     |
	| addons  | enable dashboard -p                                        | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | --images=MetricsScraper=k8s.gcr.io/echoserver:1.4          |          |         |         |                     |                     |
	| start   | -p newest-cni-20220630210514-9950 --memory=2200            | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | --alsologtostderr --wait=apiserver,system_pods,default_sa  |          |         |         |                     |                     |
	|         | --feature-gates ServerSideApply=true --network-plugin=cni  |          |         |         |                     |                     |
	|         | --extra-config=kubeadm.pod-network-cidr=192.168.111.111/16 |          |         |         |                     |                     |
	|         | --driver=docker  --container-runtime=containerd            |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                               |          |         |         |                     |                     |
	| ssh     | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | sudo crictl images -o json                                 |          |         |         |                     |                     |
	| pause   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                     |          |         |         |                     |                     |
	| unpause | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                     |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | disable-driver-mounts-20220630210659-9950                  |          |         |         |                     |                     |
	| start   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC |                     |
	|         | embed-certs-20220630210659-9950                            |          |         |         |                     |                     |
	|         | --memory=2200 --alsologtostderr                            |          |         |         |                     |                     |
	|         | --wait=true --embed-certs                                  |          |         |         |                     |                     |
	|         | --driver=docker                                            |          |         |         |                     |                     |
	|         | --container-runtime=containerd                             |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                               |          |         |         |                     |                     |
	| ssh     | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|         | sudo crictl images -o json                                 |          |         |         |                     |                     |
	| pause   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                     |          |         |         |                     |                     |
	| unpause | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                     |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	| addons  | enable metrics-server -p                                   | minikube | jenkins | v1.26.0 | 30 Jun 22 21:12 UTC | 30 Jun 22 21:12 UTC |
	|         | old-k8s-version-20220630210005-9950                        |          |         |         |                     |                     |
	|         | --images=MetricsServer=k8s.gcr.io/echoserver:1.4           |          |         |         |                     |                     |
	|         | --registries=MetricsServer=fake.domain                     |          |         |         |                     |                     |
	| stop    | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:12 UTC | 30 Jun 22 21:12 UTC |
	|         | old-k8s-version-20220630210005-9950                        |          |         |         |                     |                     |
	|         | --alsologtostderr -v=3                                     |          |         |         |                     |                     |
	| addons  | enable dashboard -p                                        | minikube | jenkins | v1.26.0 | 30 Jun 22 21:12 UTC | 30 Jun 22 21:12 UTC |
	|         | old-k8s-version-20220630210005-9950                        |          |         |         |                     |                     |
	|         | --images=MetricsScraper=k8s.gcr.io/echoserver:1.4          |          |         |         |                     |                     |
	| start   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:12 UTC |                     |
	|         | old-k8s-version-20220630210005-9950                        |          |         |         |                     |                     |
	|         | --memory=2200 --alsologtostderr                            |          |         |         |                     |                     |
	|         | --wait=true --kvm-network=default                          |          |         |         |                     |                     |
	|         | --kvm-qemu-uri=qemu:///system                              |          |         |         |                     |                     |
	|         | --disable-driver-mounts                                    |          |         |         |                     |                     |
	|         | --keep-context=false                                       |          |         |         |                     |                     |
	|         | --driver=docker                                            |          |         |         |                     |                     |
	|         | --container-runtime=containerd                             |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.16.0                               |          |         |         |                     |                     |
	| addons  | enable metrics-server -p                                   | minikube | jenkins | v1.26.0 | 30 Jun 22 21:16 UTC | 30 Jun 22 21:16 UTC |
	|         | default-k8s-different-port-20220630210335-9950             |          |         |         |                     |                     |
	|         | --images=MetricsServer=k8s.gcr.io/echoserver:1.4           |          |         |         |                     |                     |
	|         | --registries=MetricsServer=fake.domain                     |          |         |         |                     |                     |
	| stop    | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:16 UTC | 30 Jun 22 21:16 UTC |
	|         | default-k8s-different-port-20220630210335-9950             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=3                                     |          |         |         |                     |                     |
	| addons  | enable dashboard -p                                        | minikube | jenkins | v1.26.0 | 30 Jun 22 21:16 UTC | 30 Jun 22 21:16 UTC |
	|         | default-k8s-different-port-20220630210335-9950             |          |         |         |                     |                     |
	|         | --images=MetricsScraper=k8s.gcr.io/echoserver:1.4          |          |         |         |                     |                     |
	| start   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:16 UTC |                     |
	|         | default-k8s-different-port-20220630210335-9950             |          |         |         |                     |                     |
	|         | --memory=2200 --alsologtostderr --wait=true                |          |         |         |                     |                     |
	|         | --apiserver-port=8444 --driver=docker                      |          |         |         |                     |                     |
	|         |  --container-runtime=containerd                            |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                               |          |         |         |                     |                     |
	|---------|------------------------------------------------------------|----------|---------|---------|---------------------|---------------------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2022/06/30 21:16:50
	Running on machine: ubuntu-20-agent-8
	Binary: Built with gc go1.18.3 for linux/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0630 21:16:50.966935  276064 out.go:296] Setting OutFile to fd 1 ...
	I0630 21:16:50.967050  276064 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 21:16:50.967058  276064 out.go:309] Setting ErrFile to fd 2...
	I0630 21:16:50.967063  276064 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 21:16:50.967572  276064 root.go:329] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/bin
	I0630 21:16:50.967827  276064 out.go:303] Setting JSON to false
	I0630 21:16:50.969254  276064 start.go:115] hostinfo: {"hostname":"ubuntu-20-agent-8","uptime":3563,"bootTime":1656620248,"procs":364,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1012-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0630 21:16:50.969334  276064 start.go:125] virtualization: kvm guest
	I0630 21:16:50.972514  276064 out.go:177] * [default-k8s-different-port-20220630210335-9950] minikube v1.26.0 on Ubuntu 20.04 (kvm/amd64)
	I0630 21:16:50.974253  276064 notify.go:193] Checking for updates...
	I0630 21:16:50.974279  276064 out.go:177]   - MINIKUBE_LOCATION=14420
	I0630 21:16:50.976279  276064 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0630 21:16:50.977800  276064 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:16:50.979219  276064 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube
	I0630 21:16:50.980678  276064 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0630 21:16:50.982554  276064 config.go:178] Loaded profile config "default-k8s-different-port-20220630210335-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:16:50.982967  276064 driver.go:360] Setting default libvirt URI to qemu:///system
	I0630 21:16:51.027931  276064 docker.go:137] docker version: linux-20.10.17
	I0630 21:16:51.028102  276064 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0630 21:16:51.144684  276064 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:8 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:43 OomKillDisable:true NGoroutines:44 SystemTime:2022-06-30 21:16:51.060686748 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1012-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexServ
erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662451712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-8 Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Client
Info:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
	I0630 21:16:51.144792  276064 docker.go:254] overlay module found
	I0630 21:16:51.147252  276064 out.go:177] * Using the docker driver based on existing profile
	I0630 21:16:51.148837  276064 start.go:284] selected driver: docker
	I0630 21:16:51.148852  276064 start.go:808] validating driver "docker" against &{Name:default-k8s-different-port-20220630210335-9950 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:default-k8s-different-port-
20220630210335-9950 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8444 NodeName:} Nodes:[{Name: IP:192.168.85.2 Port:8444 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[Dashboard:kubernetesui/dashboard:v2.6.0@sha256:4af9580485920635d888efe1eddbd67e12f9d5d84dba87100e93feb4e46636b3 MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<ni
l> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 21:16:51.148978  276064 start.go:819] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0630 21:16:51.149857  276064 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0630 21:16:51.265416  276064 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:8 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:43 OomKillDisable:true NGoroutines:44 SystemTime:2022-06-30 21:16:51.183664679 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1012-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexServ
erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662451712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-8 Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Client
Info:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
	I0630 21:16:51.265705  276064 start_flags.go:853] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0630 21:16:51.265738  276064 cni.go:95] Creating CNI manager for ""
	I0630 21:16:51.265748  276064 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:16:51.265764  276064 start_flags.go:310] config:
	{Name:default-k8s-different-port-20220630210335-9950 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:default-k8s-different-port-20220630210335-9950 Namespace:default APIServerName:minikubeCA APIServerNames:[]
APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8444 NodeName:} Nodes:[{Name: IP:192.168.85.2 Port:8444 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[Dashboard:kubernetesui/dashboard:v2.6.0@sha256:4af9580485920635d888efe1eddbd67e12f9d5d84dba87100e93feb4e46636b3 MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false Extr
aDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 21:16:51.268956  276064 out.go:177] * Starting control plane node default-k8s-different-port-20220630210335-9950 in cluster default-k8s-different-port-20220630210335-9950
	I0630 21:16:51.270454  276064 cache.go:120] Beginning downloading kic base image for docker with containerd
	I0630 21:16:51.272072  276064 out.go:177] * Pulling base image ...
	I0630 21:16:51.273432  276064 preload.go:132] Checking if preload exists for k8s version v1.24.2 and runtime containerd
	I0630 21:16:51.273492  276064 preload.go:148] Found local preload: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-containerd-overlay2-amd64.tar.lz4
	I0630 21:16:51.273512  276064 cache.go:57] Caching tarball of preloaded images
	I0630 21:16:51.273529  276064 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e in local docker daemon
	I0630 21:16:51.273772  276064 preload.go:174] Found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-containerd-overlay2-amd64.tar.lz4 in cache, skipping download
	I0630 21:16:51.273795  276064 cache.go:60] Finished verifying existence of preloaded tar for  v1.24.2 on containerd
	I0630 21:16:51.273980  276064 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950/config.json ...
	I0630 21:16:51.311432  276064 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e in local docker daemon, skipping pull
	I0630 21:16:51.311463  276064 cache.go:142] gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e exists in daemon, skipping load
	I0630 21:16:51.311486  276064 cache.go:208] Successfully downloaded all kic artifacts
	I0630 21:16:51.311527  276064 start.go:352] acquiring machines lock for default-k8s-different-port-20220630210335-9950: {Name:mkd6267dded0280a468a53ba1411e87336e1a91d Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0630 21:16:51.311690  276064 start.go:356] acquired machines lock for "default-k8s-different-port-20220630210335-9950" in 121.686µs
	I0630 21:16:51.311717  276064 start.go:94] Skipping create...Using existing machine configuration
	I0630 21:16:51.311723  276064 fix.go:55] fixHost starting: 
	I0630 21:16:51.312051  276064 cli_runner.go:164] Run: docker container inspect default-k8s-different-port-20220630210335-9950 --format={{.State.Status}}
	I0630 21:16:51.348817  276064 fix.go:103] recreateIfNeeded on default-k8s-different-port-20220630210335-9950: state=Stopped err=<nil>
	W0630 21:16:51.348859  276064 fix.go:129] unexpected machine state, will restart: <nil>
	I0630 21:16:51.351576  276064 out.go:177] * Restarting existing docker container for "default-k8s-different-port-20220630210335-9950" ...
	I0630 21:16:50.687885  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:16:53.186788  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:16:51.353211  276064 cli_runner.go:164] Run: docker start default-k8s-different-port-20220630210335-9950
	I0630 21:16:51.784125  276064 cli_runner.go:164] Run: docker container inspect default-k8s-different-port-20220630210335-9950 --format={{.State.Status}}
	I0630 21:16:51.823431  276064 kic.go:416] container "default-k8s-different-port-20220630210335-9950" state is running.
	I0630 21:16:51.823821  276064 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" default-k8s-different-port-20220630210335-9950
	I0630 21:16:51.864121  276064 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950/config.json ...
	I0630 21:16:51.864335  276064 machine.go:88] provisioning docker machine ...
	I0630 21:16:51.864360  276064 ubuntu.go:169] provisioning hostname "default-k8s-different-port-20220630210335-9950"
	I0630 21:16:51.864403  276064 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	I0630 21:16:51.902321  276064 main.go:134] libmachine: Using SSH client type: native
	I0630 21:16:51.902482  276064 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil>  [] 0s} 127.0.0.1 49437 <nil> <nil>}
	I0630 21:16:51.902498  276064 main.go:134] libmachine: About to run SSH command:
	sudo hostname default-k8s-different-port-20220630210335-9950 && echo "default-k8s-different-port-20220630210335-9950" | sudo tee /etc/hostname
	I0630 21:16:51.903111  276064 main.go:134] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:37264->127.0.0.1:49437: read: connection reset by peer
	I0630 21:16:55.029787  276064 main.go:134] libmachine: SSH cmd err, output: <nil>: default-k8s-different-port-20220630210335-9950
	
	I0630 21:16:55.029873  276064 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	I0630 21:16:55.064739  276064 main.go:134] libmachine: Using SSH client type: native
	I0630 21:16:55.064912  276064 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil>  [] 0s} 127.0.0.1 49437 <nil> <nil>}
	I0630 21:16:55.064939  276064 main.go:134] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sdefault-k8s-different-port-20220630210335-9950' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 default-k8s-different-port-20220630210335-9950/g' /etc/hosts;
				else 
					echo '127.0.1.1 default-k8s-different-port-20220630210335-9950' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0630 21:16:55.180883  276064 main.go:134] libmachine: SSH cmd err, output: <nil>: 
	I0630 21:16:55.180914  276064 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube CaCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/c
erts/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube}
	I0630 21:16:55.180940  276064 ubuntu.go:177] setting up certificates
	I0630 21:16:55.180951  276064 provision.go:83] configureAuth start
	I0630 21:16:55.181011  276064 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" default-k8s-different-port-20220630210335-9950
	I0630 21:16:55.215343  276064 provision.go:138] copyHostCerts
	I0630 21:16:55.215420  276064 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem, removing ...
	I0630 21:16:55.215439  276064 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem
	I0630 21:16:55.215511  276064 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem (1679 bytes)
	I0630 21:16:55.215622  276064 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem, removing ...
	I0630 21:16:55.215634  276064 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem
	I0630 21:16:55.215677  276064 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem (1082 bytes)
	I0630 21:16:55.215759  276064 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem, removing ...
	I0630 21:16:55.215770  276064 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem
	I0630 21:16:55.215809  276064 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem (1123 bytes)
	I0630 21:16:55.215903  276064 provision.go:112] generating server cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem org=jenkins.default-k8s-different-port-20220630210335-9950 san=[192.168.85.2 127.0.0.1 localhost 127.0.0.1 minikube default-k8s-different-port-20220630210335-9950]
	I0630 21:16:55.303627  276064 provision.go:172] copyRemoteCerts
	I0630 21:16:55.303701  276064 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0630 21:16:55.303743  276064 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	I0630 21:16:55.339259  276064 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49437 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/default-k8s-different-port-20220630210335-9950/id_rsa Username:docker}
	I0630 21:16:55.425035  276064 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
	I0630 21:16:55.442972  276064 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem --> /etc/docker/server.pem (1306 bytes)
	I0630 21:16:55.460939  276064 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0630 21:16:55.479535  276064 provision.go:86] duration metric: configureAuth took 298.567386ms
	I0630 21:16:55.479564  276064 ubuntu.go:193] setting minikube options for container-runtime
	I0630 21:16:55.479755  276064 config.go:178] Loaded profile config "default-k8s-different-port-20220630210335-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:16:55.479769  276064 machine.go:91] provisioned docker machine in 3.615419564s
	I0630 21:16:55.479776  276064 start.go:306] post-start starting for "default-k8s-different-port-20220630210335-9950" (driver="docker")
	I0630 21:16:55.479781  276064 start.go:316] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0630 21:16:55.479826  276064 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0630 21:16:55.479856  276064 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	I0630 21:16:55.516445  276064 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49437 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/default-k8s-different-port-20220630210335-9950/id_rsa Username:docker}
	I0630 21:16:55.605006  276064 ssh_runner.go:195] Run: cat /etc/os-release
	I0630 21:16:55.607796  276064 main.go:134] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0630 21:16:55.607819  276064 main.go:134] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0630 21:16:55.607827  276064 main.go:134] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0630 21:16:55.607832  276064 info.go:137] Remote host: Ubuntu 20.04.4 LTS
	I0630 21:16:55.607842  276064 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/addons for local assets ...
	I0630 21:16:55.607887  276064 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files for local assets ...
	I0630 21:16:55.607954  276064 filesync.go:149] local asset: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem -> 99502.pem in /etc/ssl/certs
	I0630 21:16:55.608055  276064 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0630 21:16:55.615374  276064 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem --> /etc/ssl/certs/99502.pem (1708 bytes)
	I0630 21:16:55.632721  276064 start.go:309] post-start completed in 152.929775ms
	I0630 21:16:55.632792  276064 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0630 21:16:55.632840  276064 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	I0630 21:16:55.668667  276064 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49437 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/default-k8s-different-port-20220630210335-9950/id_rsa Username:docker}
	I0630 21:16:55.753554  276064 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0630 21:16:55.757419  276064 fix.go:57] fixHost completed within 4.445691374s
	I0630 21:16:55.757441  276064 start.go:81] releasing machines lock for "default-k8s-different-port-20220630210335-9950", held for 4.445735411s
	I0630 21:16:55.757521  276064 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" default-k8s-different-port-20220630210335-9950
	I0630 21:16:55.792226  276064 ssh_runner.go:195] Run: systemctl --version
	I0630 21:16:55.792274  276064 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	I0630 21:16:55.792285  276064 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/
	I0630 21:16:55.792345  276064 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	I0630 21:16:55.828844  276064 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49437 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/default-k8s-different-port-20220630210335-9950/id_rsa Username:docker}
	I0630 21:16:55.830622  276064 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49437 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/default-k8s-different-port-20220630210335-9950/id_rsa Username:docker}
	I0630 21:16:55.937225  276064 ssh_runner.go:195] Run: sudo systemctl stop -f crio
	I0630 21:16:55.949138  276064 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0630 21:16:55.958414  276064 docker.go:179] disabling docker service ...
	I0630 21:16:55.958460  276064 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0630 21:16:55.187448  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:16:57.687435  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:16:55.968294  276064 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0630 21:16:55.980142  276064 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0630 21:16:56.063123  276064 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0630 21:16:56.138018  276064 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0630 21:16:56.147719  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
	image-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0630 21:16:56.161177  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*sandbox_image = .*$|sandbox_image = "k8s.gcr.io/pause:3.7"|' -i /etc/containerd/config.toml"
	I0630 21:16:56.169502  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*restrict_oom_score_adj = .*$|restrict_oom_score_adj = false|' -i /etc/containerd/config.toml"
	I0630 21:16:56.177922  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*SystemdCgroup = .*$|SystemdCgroup = false|' -i /etc/containerd/config.toml"
	I0630 21:16:56.186445  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*conf_dir = .*$|conf_dir = "/etc/cni/net.mk"|' -i /etc/containerd/config.toml"
	I0630 21:16:56.195374  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^# imports|imports = ["/etc/containerd/containerd.conf.d/02-containerd.conf"]|' -i /etc/containerd/config.toml"
	I0630 21:16:56.203928  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc/containerd/containerd.conf.d && printf %!s(MISSING) "dmVyc2lvbiA9IDIK" | base64 -d | sudo tee /etc/containerd/containerd.conf.d/02-containerd.conf"
	I0630 21:16:56.217454  276064 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0630 21:16:56.224869  276064 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0630 21:16:56.231883  276064 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0630 21:16:56.308696  276064 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0630 21:16:56.383126  276064 start.go:447] Will wait 60s for socket path /run/containerd/containerd.sock
	I0630 21:16:56.383218  276064 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
	I0630 21:16:56.386796  276064 start.go:468] Will wait 60s for crictl version
	I0630 21:16:56.386869  276064 ssh_runner.go:195] Run: sudo crictl version
	I0630 21:16:56.414891  276064 retry.go:31] will retry after 11.04660288s: Temporary Error: sudo crictl version: Process exited with status 1
	stdout:
	
	stderr:
	time="2022-06-30T21:16:56Z" level=fatal msg="getting the runtime version: rpc error: code = Unknown desc = server is not initialized yet"
	I0630 21:17:00.187349  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:02.686418  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:07.461709  276064 ssh_runner.go:195] Run: sudo crictl version
	I0630 21:17:07.486784  276064 start.go:477] Version:  0.1.0
	RuntimeName:  containerd
	RuntimeVersion:  1.6.6
	RuntimeApiVersion:  v1alpha2
	I0630 21:17:07.486852  276064 ssh_runner.go:195] Run: containerd --version
	I0630 21:17:07.518176  276064 ssh_runner.go:195] Run: containerd --version
	I0630 21:17:07.553071  276064 out.go:177] * Preparing Kubernetes v1.24.2 on containerd 1.6.6 ...
	I0630 21:17:04.687385  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:07.187278  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:07.554517  276064 cli_runner.go:164] Run: docker network inspect default-k8s-different-port-20220630210335-9950 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0630 21:17:07.590707  276064 ssh_runner.go:195] Run: grep 192.168.85.1	host.minikube.internal$ /etc/hosts
	I0630 21:17:07.594132  276064 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.85.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0630 21:17:07.603860  276064 preload.go:132] Checking if preload exists for k8s version v1.24.2 and runtime containerd
	I0630 21:17:07.603916  276064 ssh_runner.go:195] Run: sudo crictl images --output json
	I0630 21:17:07.628574  276064 containerd.go:547] all images are preloaded for containerd runtime.
	I0630 21:17:07.628598  276064 containerd.go:461] Images already preloaded, skipping extraction
	I0630 21:17:07.628640  276064 ssh_runner.go:195] Run: sudo crictl images --output json
	I0630 21:17:07.652928  276064 containerd.go:547] all images are preloaded for containerd runtime.
	I0630 21:17:07.652952  276064 cache_images.go:84] Images are preloaded, skipping loading
	I0630 21:17:07.652995  276064 ssh_runner.go:195] Run: sudo crictl info
	I0630 21:17:07.678461  276064 cni.go:95] Creating CNI manager for ""
	I0630 21:17:07.678485  276064 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:17:07.678497  276064 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
	I0630 21:17:07.678508  276064 kubeadm.go:158] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.85.2 APIServerPort:8444 KubernetesVersion:v1.24.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:default-k8s-different-port-20220630210335-9950 NodeName:default-k8s-different-port-20220630210335-9950 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.85.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.85.2
CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}
	I0630 21:17:07.678640  276064 kubeadm.go:162] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.85.2
	  bindPort: 8444
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: /run/containerd/containerd.sock
	  name: "default-k8s-different-port-20220630210335-9950"
	  kubeletExtraArgs:
	    node-ip: 192.168.85.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.85.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8444
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.24.2
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%!"(MISSING)
	  nodefs.inodesFree: "0%!"(MISSING)
	  imagefs.available: "0%!"(MISSING)
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0630 21:17:07.678737  276064 kubeadm.go:961] kubelet [Unit]
	Wants=containerd.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.24.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=default-k8s-different-port-20220630210335-9950 --image-service-endpoint=unix:///run/containerd/containerd.sock --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.85.2 --runtime-request-timeout=15m
	
	[Install]
	 config:
	{KubernetesVersion:v1.24.2 ClusterName:default-k8s-different-port-20220630210335-9950 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8444 NodeName:}
	I0630 21:17:07.678784  276064 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.24.2
	I0630 21:17:07.686457  276064 binaries.go:44] Found k8s binaries, skipping transfer
	I0630 21:17:07.686529  276064 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0630 21:17:07.693832  276064 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (539 bytes)
	I0630 21:17:07.707636  276064 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0630 21:17:07.721677  276064 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2075 bytes)
	I0630 21:17:07.734937  276064 ssh_runner.go:195] Run: grep 192.168.85.2	control-plane.minikube.internal$ /etc/hosts
	I0630 21:17:07.738005  276064 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.85.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0630 21:17:07.747537  276064 certs.go:54] Setting up /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950 for IP: 192.168.85.2
	I0630 21:17:07.747650  276064 certs.go:182] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.key
	I0630 21:17:07.747694  276064 certs.go:182] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.key
	I0630 21:17:07.747791  276064 certs.go:298] skipping minikube-user signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950/client.key
	I0630 21:17:07.747859  276064 certs.go:298] skipping minikube signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950/apiserver.key.43b9df8c
	I0630 21:17:07.747913  276064 certs.go:298] skipping aggregator signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950/proxy-client.key
	I0630 21:17:07.748040  276064 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950.pem (1338 bytes)
	W0630 21:17:07.748082  276064 certs.go:384] ignoring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950_empty.pem, impossibly tiny 0 bytes
	I0630 21:17:07.748098  276064 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem (1679 bytes)
	I0630 21:17:07.748133  276064 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem (1082 bytes)
	I0630 21:17:07.748167  276064 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem (1123 bytes)
	I0630 21:17:07.748198  276064 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/key.pem (1679 bytes)
	I0630 21:17:07.748264  276064 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem (1708 bytes)
	I0630 21:17:07.749106  276064 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
	I0630 21:17:07.767893  276064 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I0630 21:17:07.785630  276064 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0630 21:17:07.803337  276064 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
	I0630 21:17:07.820730  276064 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0630 21:17:07.838616  276064 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
	I0630 21:17:07.856055  276064 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0630 21:17:07.873512  276064 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
	I0630 21:17:07.890585  276064 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950.pem --> /usr/share/ca-certificates/9950.pem (1338 bytes)
	I0630 21:17:07.907549  276064 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem --> /usr/share/ca-certificates/99502.pem (1708 bytes)
	I0630 21:17:07.924815  276064 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0630 21:17:07.942013  276064 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0630 21:17:07.954570  276064 ssh_runner.go:195] Run: openssl version
	I0630 21:17:07.959418  276064 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/99502.pem && ln -fs /usr/share/ca-certificates/99502.pem /etc/ssl/certs/99502.pem"
	I0630 21:17:07.966969  276064 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/99502.pem
	I0630 21:17:07.970294  276064 certs.go:431] hashing: -rw-r--r-- 1 root root 1708 Jun 30 20:26 /usr/share/ca-certificates/99502.pem
	I0630 21:17:07.970348  276064 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/99502.pem
	I0630 21:17:07.975425  276064 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/99502.pem /etc/ssl/certs/3ec20f2e.0"
	I0630 21:17:07.982570  276064 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0630 21:17:07.990075  276064 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:17:07.993227  276064 certs.go:431] hashing: -rw-r--r-- 1 root root 1111 Jun 30 20:22 /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:17:07.993308  276064 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:17:07.997936  276064 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0630 21:17:08.004870  276064 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/9950.pem && ln -fs /usr/share/ca-certificates/9950.pem /etc/ssl/certs/9950.pem"
	I0630 21:17:08.012388  276064 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/9950.pem
	I0630 21:17:08.015454  276064 certs.go:431] hashing: -rw-r--r-- 1 root root 1338 Jun 30 20:26 /usr/share/ca-certificates/9950.pem
	I0630 21:17:08.015507  276064 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/9950.pem
	I0630 21:17:08.020347  276064 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/9950.pem /etc/ssl/certs/51391683.0"
	I0630 21:17:08.027230  276064 kubeadm.go:395] StartCluster: {Name:default-k8s-different-port-20220630210335-9950 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:default-k8s-different-port-20220630210335-9950
Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8444 NodeName:} Nodes:[{Name: IP:192.168.85.2 Port:8444 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[Dashboard:kubernetesui/dashboard:v2.6.0@sha256:4af9580485920635d888efe1eddbd67e12f9d5d84dba87100e93feb4e46636b3 MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] L
istenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 21:17:08.027336  276064 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
	I0630 21:17:08.027399  276064 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0630 21:17:08.053422  276064 cri.go:87] found id: "8a0d676731abf60921510a3216fa28f73fc776b06a7dd0ee1d1d2654e8b940e0"
	I0630 21:17:08.053446  276064 cri.go:87] found id: "aa0dfccd9a7c940761ea2c4805338d040616ef5e513c23001d346fe07a7c5eff"
	I0630 21:17:08.053454  276064 cri.go:87] found id: "b2e2e7466122cde98a4cb1eba9d3f61be1dc7eb41a6935e6c16b3334125a3df7"
	I0630 21:17:08.053465  276064 cri.go:87] found id: "56c1c7bc165ac17cdfb803f71cd26ff02ab6261448f17c5c4ac7f531a632c67b"
	I0630 21:17:08.053471  276064 cri.go:87] found id: "f0093895eba1080a2212532b5c34b83dc16abf6e2eccfb1bdf732d5e70875609"
	I0630 21:17:08.053477  276064 cri.go:87] found id: "a126cf77f563c9a045eb277d6616e24e487ddda0de594854165897f596aaacb9"
	I0630 21:17:08.053483  276064 cri.go:87] found id: ""
	I0630 21:17:08.053523  276064 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
	I0630 21:17:08.065844  276064 cri.go:114] JSON = null
	W0630 21:17:08.065891  276064 kubeadm.go:402] unpause failed: list paused: list returned 0 containers, but ps returned 6
	I0630 21:17:08.065932  276064 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0630 21:17:08.072868  276064 kubeadm.go:410] found existing configuration files, will attempt cluster restart
	I0630 21:17:08.072896  276064 kubeadm.go:626] restartCluster start
	I0630 21:17:08.072944  276064 ssh_runner.go:195] Run: sudo test -d /data/minikube
	I0630 21:17:08.079338  276064 kubeadm.go:127] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:08.080135  276064 kubeconfig.go:116] verify returned: extract IP: "default-k8s-different-port-20220630210335-9950" does not appear in /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:17:08.080723  276064 kubeconfig.go:127] "default-k8s-different-port-20220630210335-9950" context is missing from /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig - will repair!
	I0630 21:17:08.082722  276064 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig: {Name:mk34e4a4e7b04f624b9adbda4f77ee20b38308ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:17:08.084238  276064 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
	I0630 21:17:08.091015  276064 api_server.go:165] Checking apiserver status ...
	I0630 21:17:08.091128  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:17:08.099254  276064 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:08.299650  276064 api_server.go:165] Checking apiserver status ...
	I0630 21:17:08.299740  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:17:08.308443  276064 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:08.499766  276064 api_server.go:165] Checking apiserver status ...
	I0630 21:17:08.499859  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:17:08.508591  276064 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:08.699887  276064 api_server.go:165] Checking apiserver status ...
	I0630 21:17:08.699956  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:17:08.708853  276064 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:08.900127  276064 api_server.go:165] Checking apiserver status ...
	I0630 21:17:08.900211  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:17:08.908677  276064 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:09.099958  276064 api_server.go:165] Checking apiserver status ...
	I0630 21:17:09.100035  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:17:09.108964  276064 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:09.300024  276064 api_server.go:165] Checking apiserver status ...
	I0630 21:17:09.300118  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:17:09.308631  276064 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:09.499927  276064 api_server.go:165] Checking apiserver status ...
	I0630 21:17:09.500026  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:17:09.508471  276064 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:09.699757  276064 api_server.go:165] Checking apiserver status ...
	I0630 21:17:09.699831  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:17:09.708256  276064 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:09.899494  276064 api_server.go:165] Checking apiserver status ...
	I0630 21:17:09.899570  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:17:09.907971  276064 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:10.100304  276064 api_server.go:165] Checking apiserver status ...
	I0630 21:17:10.100402  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:17:10.109094  276064 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:10.300336  276064 api_server.go:165] Checking apiserver status ...
	I0630 21:17:10.300426  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:17:10.309013  276064 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:10.500327  276064 api_server.go:165] Checking apiserver status ...
	I0630 21:17:10.500416  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:17:10.509116  276064 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:10.699333  276064 api_server.go:165] Checking apiserver status ...
	I0630 21:17:10.699419  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:17:10.708381  276064 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:10.899430  276064 api_server.go:165] Checking apiserver status ...
	I0630 21:17:10.899511  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:17:10.908350  276064 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:09.686662  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:11.687397  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:14.187575  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:11.099965  276064 api_server.go:165] Checking apiserver status ...
	I0630 21:17:11.100038  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:17:11.108876  276064 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:11.108901  276064 api_server.go:165] Checking apiserver status ...
	I0630 21:17:11.108941  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:17:11.116800  276064 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:11.116827  276064 kubeadm.go:601] needs reconfigure: apiserver error: timed out waiting for the condition
	I0630 21:17:11.116834  276064 kubeadm.go:1092] stopping kube-system containers ...
	I0630 21:17:11.116847  276064 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name: Namespaces:[kube-system]}
	I0630 21:17:11.116901  276064 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0630 21:17:11.141421  276064 cri.go:87] found id: "8a0d676731abf60921510a3216fa28f73fc776b06a7dd0ee1d1d2654e8b940e0"
	I0630 21:17:11.141447  276064 cri.go:87] found id: "aa0dfccd9a7c940761ea2c4805338d040616ef5e513c23001d346fe07a7c5eff"
	I0630 21:17:11.141456  276064 cri.go:87] found id: "b2e2e7466122cde98a4cb1eba9d3f61be1dc7eb41a6935e6c16b3334125a3df7"
	I0630 21:17:11.141464  276064 cri.go:87] found id: "56c1c7bc165ac17cdfb803f71cd26ff02ab6261448f17c5c4ac7f531a632c67b"
	I0630 21:17:11.141472  276064 cri.go:87] found id: "f0093895eba1080a2212532b5c34b83dc16abf6e2eccfb1bdf732d5e70875609"
	I0630 21:17:11.141481  276064 cri.go:87] found id: "a126cf77f563c9a045eb277d6616e24e487ddda0de594854165897f596aaacb9"
	I0630 21:17:11.141491  276064 cri.go:87] found id: ""
	I0630 21:17:11.141498  276064 cri.go:232] Stopping containers: [8a0d676731abf60921510a3216fa28f73fc776b06a7dd0ee1d1d2654e8b940e0 aa0dfccd9a7c940761ea2c4805338d040616ef5e513c23001d346fe07a7c5eff b2e2e7466122cde98a4cb1eba9d3f61be1dc7eb41a6935e6c16b3334125a3df7 56c1c7bc165ac17cdfb803f71cd26ff02ab6261448f17c5c4ac7f531a632c67b f0093895eba1080a2212532b5c34b83dc16abf6e2eccfb1bdf732d5e70875609 a126cf77f563c9a045eb277d6616e24e487ddda0de594854165897f596aaacb9]
	I0630 21:17:11.141550  276064 ssh_runner.go:195] Run: which crictl
	I0630 21:17:11.144525  276064 ssh_runner.go:195] Run: sudo /usr/bin/crictl stop 8a0d676731abf60921510a3216fa28f73fc776b06a7dd0ee1d1d2654e8b940e0 aa0dfccd9a7c940761ea2c4805338d040616ef5e513c23001d346fe07a7c5eff b2e2e7466122cde98a4cb1eba9d3f61be1dc7eb41a6935e6c16b3334125a3df7 56c1c7bc165ac17cdfb803f71cd26ff02ab6261448f17c5c4ac7f531a632c67b f0093895eba1080a2212532b5c34b83dc16abf6e2eccfb1bdf732d5e70875609 a126cf77f563c9a045eb277d6616e24e487ddda0de594854165897f596aaacb9
	I0630 21:17:11.169277  276064 ssh_runner.go:195] Run: sudo systemctl stop kubelet
	I0630 21:17:11.179637  276064 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0630 21:17:11.187013  276064 kubeadm.go:155] found existing configuration files:
	-rw------- 1 root root 5643 Jun 30 21:04 /etc/kubernetes/admin.conf
	-rw------- 1 root root 5656 Jun 30 21:04 /etc/kubernetes/controller-manager.conf
	-rw------- 1 root root 2123 Jun 30 21:04 /etc/kubernetes/kubelet.conf
	-rw------- 1 root root 5600 Jun 30 21:04 /etc/kubernetes/scheduler.conf
	
	I0630 21:17:11.187084  276064 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/admin.conf
	I0630 21:17:11.194742  276064 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/kubelet.conf
	I0630 21:17:11.201953  276064 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/controller-manager.conf
	I0630 21:17:11.209038  276064 kubeadm.go:166] "https://control-plane.minikube.internal:8444" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/controller-manager.conf: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:11.209190  276064 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
	I0630 21:17:11.215649  276064 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/scheduler.conf
	I0630 21:17:11.223164  276064 kubeadm.go:166] "https://control-plane.minikube.internal:8444" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/scheduler.conf: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:11.223223  276064 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
	I0630 21:17:11.229790  276064 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0630 21:17:11.236785  276064 kubeadm.go:703] reconfiguring cluster from /var/tmp/minikube/kubeadm.yaml
	I0630 21:17:11.236816  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:17:11.281948  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:17:12.032331  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:17:12.230970  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:17:12.282521  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:17:12.364001  276064 api_server.go:51] waiting for apiserver process to appear ...
	I0630 21:17:12.364069  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 21:17:12.928375  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 21:17:13.428055  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 21:17:13.439931  276064 api_server.go:71] duration metric: took 1.075932663s to wait for apiserver process to appear ...
	I0630 21:17:13.439968  276064 api_server.go:87] waiting for apiserver healthz status ...
	I0630 21:17:13.439983  276064 api_server.go:240] Checking apiserver healthz at https://192.168.85.2:8444/healthz ...
	I0630 21:17:13.440396  276064 api_server.go:256] stopped: https://192.168.85.2:8444/healthz: Get "https://192.168.85.2:8444/healthz": dial tcp 192.168.85.2:8444: connect: connection refused
	I0630 21:17:13.941137  276064 api_server.go:240] Checking apiserver healthz at https://192.168.85.2:8444/healthz ...
	I0630 21:17:16.970176  276064 api_server.go:266] https://192.168.85.2:8444/healthz returned 403:
	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
	W0630 21:17:16.970281  276064 api_server.go:102] status: https://192.168.85.2:8444/healthz returned error 403:
	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
	I0630 21:17:17.440596  276064 api_server.go:240] Checking apiserver healthz at https://192.168.85.2:8444/healthz ...
	I0630 21:17:17.445089  276064 api_server.go:266] https://192.168.85.2:8444/healthz returned 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/bootstrap-controller ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-registration-controller ok
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	W0630 21:17:17.445118  276064 api_server.go:102] status: https://192.168.85.2:8444/healthz returned error 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/bootstrap-controller ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-registration-controller ok
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	I0630 21:17:17.940639  276064 api_server.go:240] Checking apiserver healthz at https://192.168.85.2:8444/healthz ...
	I0630 21:17:17.945039  276064 api_server.go:266] https://192.168.85.2:8444/healthz returned 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/bootstrap-controller ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-registration-controller ok
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	W0630 21:17:17.945092  276064 api_server.go:102] status: https://192.168.85.2:8444/healthz returned error 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/bootstrap-controller ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-registration-controller ok
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	I0630 21:17:18.440744  276064 api_server.go:240] Checking apiserver healthz at https://192.168.85.2:8444/healthz ...
	I0630 21:17:18.446044  276064 api_server.go:266] https://192.168.85.2:8444/healthz returned 200:
	ok
	I0630 21:17:18.452561  276064 api_server.go:140] control plane version: v1.24.2
	I0630 21:17:18.452593  276064 api_server.go:130] duration metric: took 5.012617644s to wait for apiserver health ...
	I0630 21:17:18.452606  276064 cni.go:95] Creating CNI manager for ""
	I0630 21:17:18.452614  276064 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:17:18.455712  276064 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0630 21:17:16.686966  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:18.687594  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:18.457354  276064 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0630 21:17:18.461356  276064 cni.go:189] applying CNI manifest using /var/lib/minikube/binaries/v1.24.2/kubectl ...
	I0630 21:17:18.461384  276064 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2429 bytes)
	I0630 21:17:18.476680  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0630 21:17:19.208419  276064 system_pods.go:43] waiting for kube-system pods to appear ...
	I0630 21:17:19.215629  276064 system_pods.go:59] 9 kube-system pods found
	I0630 21:17:19.215671  276064 system_pods.go:61] "coredns-6d4b75cb6d-cnt2b" [b58df724-5405-4aba-a22f-f4120f8779bc] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.)
	I0630 21:17:19.215688  276064 system_pods.go:61] "etcd-default-k8s-different-port-20220630210335-9950" [8da212f9-02a7-4954-94f5-8077bf78d9fb] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
	I0630 21:17:19.215695  276064 system_pods.go:61] "kindnet-jgsc8" [a63f0d82-ce2a-4e93-8747-604386ef8614] Running
	I0630 21:17:19.215705  276064 system_pods.go:61] "kube-apiserver-default-k8s-different-port-20220630210335-9950" [54b12248-2640-4cf7-871c-4dbef2dc7c9a] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
	I0630 21:17:19.215712  276064 system_pods.go:61] "kube-controller-manager-default-k8s-different-port-20220630210335-9950" [ff13afcf-d2e9-4331-af05-4bd5b381c79f] Running
	I0630 21:17:19.215722  276064 system_pods.go:61] "kube-proxy-jb4cj" [f292d396-44fc-483d-953b-c68f7b577b9b] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])
	I0630 21:17:19.215740  276064 system_pods.go:61] "kube-scheduler-default-k8s-different-port-20220630210335-9950" [5084f0d6-256a-49d8-ad62-a4387b3294e6] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
	I0630 21:17:19.215754  276064 system_pods.go:61] "metrics-server-5c6f97fb75-x6zm5" [a1e08a16-27f2-46e5-b750-2cc850c04f6b] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.)
	I0630 21:17:19.215764  276064 system_pods.go:61] "storage-provisioner" [d81da5a0-3c72-4f2c-809f-765c2a24f394] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.)
	I0630 21:17:19.215777  276064 system_pods.go:74] duration metric: took 7.333478ms to wait for pod list to return data ...
	I0630 21:17:19.215791  276064 node_conditions.go:102] verifying NodePressure condition ...
	I0630 21:17:19.219070  276064 node_conditions.go:122] node storage ephemeral capacity is 304695084Ki
	I0630 21:17:19.219100  276064 node_conditions.go:123] node cpu capacity is 8
	I0630 21:17:19.219117  276064 node_conditions.go:105] duration metric: took 3.314072ms to run NodePressure ...
	I0630 21:17:19.219138  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:17:19.376298  276064 kubeadm.go:762] waiting for restarted kubelet to initialise ...
	I0630 21:17:19.381176  276064 kubeadm.go:777] kubelet initialised
	I0630 21:17:19.381202  276064 kubeadm.go:778] duration metric: took 4.876872ms waiting for restarted kubelet to initialise ...
	I0630 21:17:19.381212  276064 pod_ready.go:35] extra waiting up to 4m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0630 21:17:19.386560  276064 pod_ready.go:78] waiting up to 4m0s for pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace to be "Ready" ...
	I0630 21:17:21.187251  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:23.187322  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:21.392685  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:23.393750  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:25.893175  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:25.686393  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:27.687277  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:27.893469  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:29.893499  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:30.187379  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:32.187457  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:32.393130  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:34.393582  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:34.687308  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:37.186708  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:39.187266  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:36.892837  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:38.893539  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:40.893713  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:41.687415  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:44.187382  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:43.392717  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:45.393415  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:46.686460  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:48.687429  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:47.893653  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:50.393622  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:51.187093  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:53.686989  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:52.893793  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:55.393246  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:56.187543  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:58.687303  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:57.393362  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:59.893210  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:00.687467  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:03.187454  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:01.893501  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:04.392897  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:05.687327  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:07.687411  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:06.393131  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:08.393775  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:10.893517  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:10.187617  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:12.686908  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:13.392641  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:15.393306  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:15.187574  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:17.686720  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:17.893231  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:20.393182  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:20.187057  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:21.683999  271327 pod_ready.go:81] duration metric: took 4m0.002237734s waiting for pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace to be "Ready" ...
	E0630 21:18:21.684032  271327 pod_ready.go:66] WaitExtra: waitPodCondition: timed out waiting 4m0s for pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace to be "Ready" (will not retry!)
	I0630 21:18:21.684058  271327 pod_ready.go:38] duration metric: took 4m0.006502514s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0630 21:18:21.684091  271327 kubeadm.go:630] restartCluster took 5m10.168591345s
	W0630 21:18:21.684270  271327 out.go:239] ! Unable to restart cluster, will reset it: extra: timed out waiting 4m0s for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready"
	I0630 21:18:21.684307  271327 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm reset --cri-socket /run/containerd/containerd.sock --force"
	I0630 21:18:22.982137  271327 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm reset --cri-socket /run/containerd/containerd.sock --force": (1.297795627s)
	I0630 21:18:22.982220  271327 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 21:18:22.992216  271327 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0630 21:18:22.999444  271327 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver
	I0630 21:18:22.999505  271327 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0630 21:18:23.006620  271327 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0630 21:18:23.006669  271327 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0630 21:18:23.382034  271327 out.go:204]   - Generating certificates and keys ...
	I0630 21:18:24.453656  271327 out.go:204]   - Booting up control plane ...
	I0630 21:18:22.394236  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:24.893780  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:27.393787  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:29.893470  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:33.995591  271327 out.go:204]   - Configuring RBAC rules ...
	I0630 21:18:34.415334  271327 cni.go:95] Creating CNI manager for ""
	I0630 21:18:34.415359  271327 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:18:34.417145  271327 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0630 21:18:34.418585  271327 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0630 21:18:34.422112  271327 cni.go:189] applying CNI manifest using /var/lib/minikube/binaries/v1.16.0/kubectl ...
	I0630 21:18:34.422134  271327 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2429 bytes)
	I0630 21:18:34.435402  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0630 21:18:31.893548  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:33.899294  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:34.646160  271327 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0630 21:18:34.646255  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:34.646257  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl label nodes minikube.k8s.io/version=v1.26.0 minikube.k8s.io/commit=251ffcec0e4c997cd7732864187747cc579943c9 minikube.k8s.io/name=old-k8s-version-20220630210005-9950 minikube.k8s.io/updated_at=2022_06_30T21_18_34_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:34.759440  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:34.766243  271327 ops.go:34] apiserver oom_adj: -16
	I0630 21:18:35.357818  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:35.858238  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:36.358268  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:36.857690  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:37.357705  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:37.858150  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:38.358096  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:38.858275  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:39.357688  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:36.392935  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:38.393728  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:40.893778  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:39.858283  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:40.358258  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:40.858225  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:41.357655  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:41.857721  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:42.358090  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:42.857766  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:43.357530  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:43.857798  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:44.357917  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:43.393444  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:45.393499  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:44.858250  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:45.358264  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:45.858251  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:46.358237  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:46.857708  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:47.358260  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:47.858095  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:48.358247  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:48.858229  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:49.357794  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:49.546778  271327 kubeadm.go:1045] duration metric: took 14.900577693s to wait for elevateKubeSystemPrivileges.
	I0630 21:18:49.546811  271327 kubeadm.go:397] StartCluster complete in 5m38.076732902s
	I0630 21:18:49.546833  271327 settings.go:142] acquiring lock: {Name:mkcbd229caa05b60d3551ef0b47eea08424c9b5d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:18:49.546946  271327 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:18:49.548969  271327 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig: {Name:mk34e4a4e7b04f624b9adbda4f77ee20b38308ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:18:50.068438  271327 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "old-k8s-version-20220630210005-9950" rescaled to 1
	I0630 21:18:50.068510  271327 start.go:208] Will wait 6m0s for node &{Name: IP:192.168.67.2 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0630 21:18:50.070683  271327 out.go:177] * Verifying Kubernetes components...
	I0630 21:18:50.068547  271327 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0630 21:18:50.068572  271327 addons.go:412] enableAddons start: toEnable=map[dashboard:true metrics-server:true], additional=[]
	I0630 21:18:50.068725  271327 config.go:178] Loaded profile config "old-k8s-version-20220630210005-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.16.0
	I0630 21:18:50.072305  271327 addons.go:65] Setting default-storageclass=true in profile "old-k8s-version-20220630210005-9950"
	I0630 21:18:50.072321  271327 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 21:18:50.072329  271327 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-20220630210005-9950"
	I0630 21:18:50.072306  271327 addons.go:65] Setting storage-provisioner=true in profile "old-k8s-version-20220630210005-9950"
	I0630 21:18:50.072355  271327 addons.go:65] Setting metrics-server=true in profile "old-k8s-version-20220630210005-9950"
	I0630 21:18:50.072354  271327 addons.go:65] Setting dashboard=true in profile "old-k8s-version-20220630210005-9950"
	I0630 21:18:50.072405  271327 addons.go:153] Setting addon metrics-server=true in "old-k8s-version-20220630210005-9950"
	I0630 21:18:50.072399  271327 addons.go:153] Setting addon storage-provisioner=true in "old-k8s-version-20220630210005-9950"
	W0630 21:18:50.072417  271327 addons.go:162] addon metrics-server should already be in state true
	W0630 21:18:50.072421  271327 addons.go:162] addon storage-provisioner should already be in state true
	I0630 21:18:50.072432  271327 addons.go:153] Setting addon dashboard=true in "old-k8s-version-20220630210005-9950"
	W0630 21:18:50.072449  271327 addons.go:162] addon dashboard should already be in state true
	I0630 21:18:50.072481  271327 host.go:66] Checking if "old-k8s-version-20220630210005-9950" exists ...
	I0630 21:18:50.072489  271327 host.go:66] Checking if "old-k8s-version-20220630210005-9950" exists ...
	I0630 21:18:50.072512  271327 host.go:66] Checking if "old-k8s-version-20220630210005-9950" exists ...
	I0630 21:18:50.072678  271327 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220630210005-9950 --format={{.State.Status}}
	I0630 21:18:50.072921  271327 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220630210005-9950 --format={{.State.Status}}
	I0630 21:18:50.073004  271327 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220630210005-9950 --format={{.State.Status}}
	I0630 21:18:50.073005  271327 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220630210005-9950 --format={{.State.Status}}
	I0630 21:18:50.122946  271327 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0630 21:18:50.124681  271327 addons.go:345] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 21:18:50.124711  271327 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0630 21:18:50.124768  271327 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220630210005-9950
	I0630 21:18:50.124685  271327 out.go:177]   - Using image kubernetesui/dashboard:v2.6.0
	I0630 21:18:50.126299  271327 out.go:177]   - Using image k8s.gcr.io/echoserver:1.4
	I0630 21:18:50.127661  271327 addons.go:345] installing /etc/kubernetes/addons/dashboard-ns.yaml
	I0630 21:18:50.127684  271327 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
	I0630 21:18:50.127695  271327 addons.go:153] Setting addon default-storageclass=true in "old-k8s-version-20220630210005-9950"
	W0630 21:18:50.127710  271327 addons.go:162] addon default-storageclass should already be in state true
	I0630 21:18:50.127744  271327 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220630210005-9950
	I0630 21:18:50.127789  271327 host.go:66] Checking if "old-k8s-version-20220630210005-9950" exists ...
	I0630 21:18:50.128250  271327 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220630210005-9950 --format={{.State.Status}}
	I0630 21:18:50.130021  271327 out.go:177]   - Using image fake.domain/k8s.gcr.io/echoserver:1.4
	I0630 21:18:47.893388  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:50.393444  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:50.131423  271327 addons.go:345] installing /etc/kubernetes/addons/metrics-apiservice.yaml
	I0630 21:18:50.131451  271327 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
	I0630 21:18:50.131510  271327 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220630210005-9950
	I0630 21:18:50.174874  271327 addons.go:345] installing /etc/kubernetes/addons/storageclass.yaml
	I0630 21:18:50.174898  271327 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0630 21:18:50.174953  271327 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220630210005-9950
	I0630 21:18:50.175467  271327 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49432 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/old-k8s-version-20220630210005-9950/id_rsa Username:docker}
	I0630 21:18:50.176273  271327 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-20220630210005-9950" to be "Ready" ...
	I0630 21:18:50.176312  271327 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.67.1 host.minikube.internal\n           fallthrough\n        }' | sudo /var/lib/minikube/binaries/v1.16.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0630 21:18:50.179407  271327 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49432 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/old-k8s-version-20220630210005-9950/id_rsa Username:docker}
	I0630 21:18:50.192160  271327 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49432 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/old-k8s-version-20220630210005-9950/id_rsa Username:docker}
	I0630 21:18:50.219445  271327 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49432 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/old-k8s-version-20220630210005-9950/id_rsa Username:docker}
	I0630 21:18:50.340138  271327 addons.go:345] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
	I0630 21:18:50.340167  271327 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
	I0630 21:18:50.342249  271327 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.16.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 21:18:50.345605  271327 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.16.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0630 21:18:50.346238  271327 addons.go:345] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
	I0630 21:18:50.346271  271327 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1820 bytes)
	I0630 21:18:50.427910  271327 addons.go:345] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
	I0630 21:18:50.427939  271327 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
	I0630 21:18:50.428864  271327 addons.go:345] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
	I0630 21:18:50.428889  271327 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
	I0630 21:18:50.445609  271327 addons.go:345] installing /etc/kubernetes/addons/metrics-server-service.yaml
	I0630 21:18:50.445642  271327 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
	I0630 21:18:50.445878  271327 addons.go:345] installing /etc/kubernetes/addons/dashboard-configmap.yaml
	I0630 21:18:50.445901  271327 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
	I0630 21:18:50.526468  271327 addons.go:345] installing /etc/kubernetes/addons/dashboard-dp.yaml
	I0630 21:18:50.526498  271327 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4196 bytes)
	I0630 21:18:50.527802  271327 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.16.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I0630 21:18:50.545627  271327 addons.go:345] installing /etc/kubernetes/addons/dashboard-role.yaml
	I0630 21:18:50.545659  271327 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
	I0630 21:18:50.635021  271327 addons.go:345] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
	I0630 21:18:50.635050  271327 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
	I0630 21:18:50.642890  271327 start.go:806] {"host.minikube.internal": 192.168.67.1} host record injected into CoreDNS
	I0630 21:18:50.724734  271327 addons.go:345] installing /etc/kubernetes/addons/dashboard-sa.yaml
	I0630 21:18:50.724764  271327 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
	I0630 21:18:50.739030  271327 addons.go:345] installing /etc/kubernetes/addons/dashboard-secret.yaml
	I0630 21:18:50.739055  271327 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
	I0630 21:18:50.759486  271327 addons.go:345] installing /etc/kubernetes/addons/dashboard-svc.yaml
	I0630 21:18:50.759516  271327 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
	I0630 21:18:50.832116  271327 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.16.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	I0630 21:18:51.330111  271327 addons.go:383] Verifying addon metrics-server=true in "old-k8s-version-20220630210005-9950"
	I0630 21:18:51.650538  271327 out.go:177] * Enabled addons: default-storageclass, storage-provisioner, metrics-server, dashboard
	I0630 21:18:51.652184  271327 addons.go:414] enableAddons completed in 1.583616991s
	I0630 21:18:52.183124  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:18:52.894083  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:55.393258  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:54.682470  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:18:56.682550  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:18:58.682784  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:18:57.393506  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:59.893037  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:19:01.182368  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:19:03.182653  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:19:01.893409  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:19:04.393312  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:19:05.682177  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:19:07.682617  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:19:06.393389  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:19:08.893380  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:19:10.182307  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:19:12.182785  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:19:11.394532  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:19:13.893106  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:19:15.893450  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:19:14.682663  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:19:16.683157  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:19:19.182264  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:19:18.393510  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:19:20.893487  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:19:21.182311  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:19:23.682308  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:19:23.393825  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:19:25.892844  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:19:25.682442  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:19:28.182873  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:19:27.893374  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:19:30.393226  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:19:30.183093  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:19:32.683019  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:19:32.893321  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:19:35.393425  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:19:35.182952  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:19:37.682858  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	
	* 
	* ==> container status <==
	* CONTAINER           IMAGE               CREATED             STATE               NAME                      ATTEMPT             POD ID
	6bdce580a9d69       6fb66cd78abfe       3 minutes ago       Exited              kindnet-cni               3                   7fc20cc54e9dd
	8341041be1bdb       a634548d10b03       12 minutes ago      Running             kube-proxy                0                   3f9b2696c23cf
	157c2b0c199b6       d3377ffb7177c       12 minutes ago      Running             kube-apiserver            0                   529084b2bca78
	ccc3bef31fe3f       5d725196c1f47       12 minutes ago      Running             kube-scheduler            0                   1d1f80645e258
	d56e346d0980d       aebe758cef4cd       12 minutes ago      Running             etcd                      0                   db374d07bb628
	7734f08ca2670       34cdf99b1bb3b       12 minutes ago      Running             kube-controller-manager   0                   8db8d6937f223
	
	* 
	* ==> containerd <==
	* -- Logs begin at Thu 2022-06-30 21:07:08 UTC, end at Thu 2022-06-30 21:19:41 UTC. --
	Jun 30 21:12:57 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:12:57.386574579Z" level=warning msg="cleaning up after shim disconnected" id=ab6ea818181456a82b827f8508aa0a7fd54e93aafe963afa8bec216aa0475af1 namespace=k8s.io
	Jun 30 21:12:57 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:12:57.386590032Z" level=info msg="cleaning up dead shim"
	Jun 30 21:12:57 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:12:57.396947117Z" level=warning msg="cleanup warnings time=\"2022-06-30T21:12:57Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=2445 runtime=io.containerd.runc.v2\n"
	Jun 30 21:12:58 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:12:58.151667963Z" level=info msg="RemoveContainer for \"abb09f5935beb00881f3602ea9862dad633795ee2a89e31fd20cac6202fb8749\""
	Jun 30 21:12:58 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:12:58.157826419Z" level=info msg="RemoveContainer for \"abb09f5935beb00881f3602ea9862dad633795ee2a89e31fd20cac6202fb8749\" returns successfully"
	Jun 30 21:13:10 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:13:10.455194392Z" level=info msg="CreateContainer within sandbox \"7fc20cc54e9dd3e3e5cefee272490af70d0f9c8c9cd77f065c7a4450e9d1efab\" for container &ContainerMetadata{Name:kindnet-cni,Attempt:2,}"
	Jun 30 21:13:10 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:13:10.467472118Z" level=info msg="CreateContainer within sandbox \"7fc20cc54e9dd3e3e5cefee272490af70d0f9c8c9cd77f065c7a4450e9d1efab\" for &ContainerMetadata{Name:kindnet-cni,Attempt:2,} returns container id \"dd64884ab93c0c3890ada26549c0b777e79f7690d5ff461606312535f761ab83\""
	Jun 30 21:13:10 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:13:10.468045795Z" level=info msg="StartContainer for \"dd64884ab93c0c3890ada26549c0b777e79f7690d5ff461606312535f761ab83\""
	Jun 30 21:13:10 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:13:10.627568878Z" level=info msg="StartContainer for \"dd64884ab93c0c3890ada26549c0b777e79f7690d5ff461606312535f761ab83\" returns successfully"
	Jun 30 21:15:50 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:15:50.977187008Z" level=info msg="shim disconnected" id=dd64884ab93c0c3890ada26549c0b777e79f7690d5ff461606312535f761ab83
	Jun 30 21:15:50 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:15:50.977253148Z" level=warning msg="cleaning up after shim disconnected" id=dd64884ab93c0c3890ada26549c0b777e79f7690d5ff461606312535f761ab83 namespace=k8s.io
	Jun 30 21:15:50 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:15:50.977277780Z" level=info msg="cleaning up dead shim"
	Jun 30 21:15:50 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:15:50.986981410Z" level=warning msg="cleanup warnings time=\"2022-06-30T21:15:50Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=2555 runtime=io.containerd.runc.v2\n"
	Jun 30 21:15:51 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:15:51.473456096Z" level=info msg="RemoveContainer for \"ab6ea818181456a82b827f8508aa0a7fd54e93aafe963afa8bec216aa0475af1\""
	Jun 30 21:15:51 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:15:51.478741889Z" level=info msg="RemoveContainer for \"ab6ea818181456a82b827f8508aa0a7fd54e93aafe963afa8bec216aa0475af1\" returns successfully"
	Jun 30 21:16:16 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:16:16.455842232Z" level=info msg="CreateContainer within sandbox \"7fc20cc54e9dd3e3e5cefee272490af70d0f9c8c9cd77f065c7a4450e9d1efab\" for container &ContainerMetadata{Name:kindnet-cni,Attempt:3,}"
	Jun 30 21:16:16 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:16:16.471592085Z" level=info msg="CreateContainer within sandbox \"7fc20cc54e9dd3e3e5cefee272490af70d0f9c8c9cd77f065c7a4450e9d1efab\" for &ContainerMetadata{Name:kindnet-cni,Attempt:3,} returns container id \"6bdce580a9d6963de5c12d9e017d5662e2685851e130abf85abf7ccd2206a8a6\""
	Jun 30 21:16:16 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:16:16.472342816Z" level=info msg="StartContainer for \"6bdce580a9d6963de5c12d9e017d5662e2685851e130abf85abf7ccd2206a8a6\""
	Jun 30 21:16:16 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:16:16.644126342Z" level=info msg="StartContainer for \"6bdce580a9d6963de5c12d9e017d5662e2685851e130abf85abf7ccd2206a8a6\" returns successfully"
	Jun 30 21:18:57 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:18:57.088736169Z" level=info msg="shim disconnected" id=6bdce580a9d6963de5c12d9e017d5662e2685851e130abf85abf7ccd2206a8a6
	Jun 30 21:18:57 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:18:57.088796065Z" level=warning msg="cleaning up after shim disconnected" id=6bdce580a9d6963de5c12d9e017d5662e2685851e130abf85abf7ccd2206a8a6 namespace=k8s.io
	Jun 30 21:18:57 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:18:57.088810788Z" level=info msg="cleaning up dead shim"
	Jun 30 21:18:57 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:18:57.098628278Z" level=warning msg="cleanup warnings time=\"2022-06-30T21:18:57Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=2659 runtime=io.containerd.runc.v2\n"
	Jun 30 21:18:57 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:18:57.822887759Z" level=info msg="RemoveContainer for \"dd64884ab93c0c3890ada26549c0b777e79f7690d5ff461606312535f761ab83\""
	Jun 30 21:18:57 embed-certs-20220630210659-9950 containerd[520]: time="2022-06-30T21:18:57.827591073Z" level=info msg="RemoveContainer for \"dd64884ab93c0c3890ada26549c0b777e79f7690d5ff461606312535f761ab83\" returns successfully"
	
	* 
	* ==> describe nodes <==
	* Name:               embed-certs-20220630210659-9950
	Roles:              control-plane
	Labels:             beta.kubernetes.io/arch=amd64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=amd64
	                    kubernetes.io/hostname=embed-certs-20220630210659-9950
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=251ffcec0e4c997cd7732864187747cc579943c9
	                    minikube.k8s.io/name=embed-certs-20220630210659-9950
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2022_06_30T21_07_23_0700
	                    minikube.k8s.io/version=v1.26.0
	                    node-role.kubernetes.io/control-plane=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///run/containerd/containerd.sock
	                    node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Thu, 30 Jun 2022 21:07:19 +0000
	Taints:             node.kubernetes.io/not-ready:NoSchedule
	Unschedulable:      false
	Lease:
	  HolderIdentity:  embed-certs-20220630210659-9950
	  AcquireTime:     <unset>
	  RenewTime:       Thu, 30 Jun 2022 21:19:36 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Thu, 30 Jun 2022 21:17:45 +0000   Thu, 30 Jun 2022 21:07:16 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Thu, 30 Jun 2022 21:17:45 +0000   Thu, 30 Jun 2022 21:07:16 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Thu, 30 Jun 2022 21:17:45 +0000   Thu, 30 Jun 2022 21:07:16 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            False   Thu, 30 Jun 2022 21:17:45 +0000   Thu, 30 Jun 2022 21:07:16 +0000   KubeletNotReady              container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Addresses:
	  InternalIP:  192.168.94.2
	  Hostname:    embed-certs-20220630210659-9950
	Capacity:
	  cpu:                8
	  ephemeral-storage:  304695084Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32873488Ki
	  pods:               110
	Allocatable:
	  cpu:                8
	  ephemeral-storage:  304695084Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32873488Ki
	  pods:               110
	System Info:
	  Machine ID:                 bbe1e1cef6e940328962dca52b3c5731
	  System UUID:                e149cbc8-bbc1-4888-b53f-97553d30d981
	  Boot ID:                    471c4729-f046-4a15-bc49-46f3ad561708
	  Kernel Version:             5.15.0-1012-gcp
	  OS Image:                   Ubuntu 20.04.4 LTS
	  Operating System:           linux
	  Architecture:               amd64
	  Container Runtime Version:  containerd://1.6.6
	  Kubelet Version:            v1.24.2
	  Kube-Proxy Version:         v1.24.2
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (6 in total)
	  Namespace                   Name                                                       CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                                       ------------  ----------  ---------------  -------------  ---
	  kube-system                 etcd-embed-certs-20220630210659-9950                       100m (1%!)(MISSING)     0 (0%!)(MISSING)      100Mi (0%!)(MISSING)       0 (0%!)(MISSING)         12m
	  kube-system                 kindnet-z7fgt                                              100m (1%!)(MISSING)     100m (1%!)(MISSING)   50Mi (0%!)(MISSING)        50Mi (0%!)(MISSING)      12m
	  kube-system                 kube-apiserver-embed-certs-20220630210659-9950             250m (3%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         12m
	  kube-system                 kube-controller-manager-embed-certs-20220630210659-9950    200m (2%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         12m
	  kube-system                 kube-proxy-jhw4d                                           0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         12m
	  kube-system                 kube-scheduler-embed-certs-20220630210659-9950             100m (1%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         12m
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                750m (9%!)(MISSING)   100m (1%!)(MISSING)
	  memory             150Mi (0%!)(MISSING)  50Mi (0%!)(MISSING)
	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	Events:
	  Type    Reason                   Age                From             Message
	  ----    ------                   ----               ----             -------
	  Normal  Starting                 12m                kube-proxy       
	  Normal  NodeHasSufficientMemory  12m (x5 over 12m)  kubelet          Node embed-certs-20220630210659-9950 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    12m (x5 over 12m)  kubelet          Node embed-certs-20220630210659-9950 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     12m (x4 over 12m)  kubelet          Node embed-certs-20220630210659-9950 status is now: NodeHasSufficientPID
	  Normal  NodeHasNoDiskPressure    12m                kubelet          Node embed-certs-20220630210659-9950 status is now: NodeHasNoDiskPressure
	  Normal  Starting                 12m                kubelet          Starting kubelet.
	  Normal  NodeHasSufficientMemory  12m                kubelet          Node embed-certs-20220630210659-9950 status is now: NodeHasSufficientMemory
	  Normal  NodeHasSufficientPID     12m                kubelet          Node embed-certs-20220630210659-9950 status is now: NodeHasSufficientPID
	  Normal  NodeAllocatableEnforced  12m                kubelet          Updated Node Allocatable limit across pods
	  Normal  RegisteredNode           12m                node-controller  Node embed-certs-20220630210659-9950 event: Registered Node embed-certs-20220630210659-9950 in Controller
	
	* 
	* ==> dmesg <==
	* [  +2.939825] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000011] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.027789] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.019913] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[ +21.968090] IPv4: martian destination 127.0.0.11 from 10.244.0.3, dev veth8071d138
	[ +25.445872] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.029436] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.023957] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +2.947695] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[Jun30 21:05] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.023879] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +2.955783] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.011828] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000005] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.027896] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	
	* 
	* ==> etcd [d56e346d0980d838b9cd42c94d9e084ef84bb0fdeb4316ae2dd5c8a25cc054a1] <==
	* {"level":"info","ts":"2022-06-30T21:07:15.947Z","caller":"embed/etcd.go:688","msg":"starting with client TLS","tls-info":"cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, client-cert=, client-key=, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = ","cipher-suites":[]}
	{"level":"info","ts":"2022-06-30T21:07:15.948Z","caller":"embed/etcd.go:277","msg":"now serving peer/client/metrics","local-member-id":"dfc97eb0aae75b33","initial-advertise-peer-urls":["https://192.168.94.2:2380"],"listen-peer-urls":["https://192.168.94.2:2380"],"advertise-client-urls":["https://192.168.94.2:2379"],"listen-client-urls":["https://127.0.0.1:2379","https://192.168.94.2:2379"],"listen-metrics-urls":["http://127.0.0.1:2381"]}
	{"level":"info","ts":"2022-06-30T21:07:15.948Z","caller":"embed/etcd.go:581","msg":"serving peer traffic","address":"192.168.94.2:2380"}
	{"level":"info","ts":"2022-06-30T21:07:15.948Z","caller":"embed/etcd.go:763","msg":"serving metrics","address":"http://127.0.0.1:2381"}
	{"level":"info","ts":"2022-06-30T21:07:15.948Z","caller":"embed/etcd.go:553","msg":"cmux::serve","address":"192.168.94.2:2380"}
	{"level":"info","ts":"2022-06-30T21:07:16.036Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"dfc97eb0aae75b33 is starting a new election at term 1"}
	{"level":"info","ts":"2022-06-30T21:07:16.036Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"dfc97eb0aae75b33 became pre-candidate at term 1"}
	{"level":"info","ts":"2022-06-30T21:07:16.036Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"dfc97eb0aae75b33 received MsgPreVoteResp from dfc97eb0aae75b33 at term 1"}
	{"level":"info","ts":"2022-06-30T21:07:16.036Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"dfc97eb0aae75b33 became candidate at term 2"}
	{"level":"info","ts":"2022-06-30T21:07:16.036Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"dfc97eb0aae75b33 received MsgVoteResp from dfc97eb0aae75b33 at term 2"}
	{"level":"info","ts":"2022-06-30T21:07:16.036Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"dfc97eb0aae75b33 became leader at term 2"}
	{"level":"info","ts":"2022-06-30T21:07:16.036Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: dfc97eb0aae75b33 elected leader dfc97eb0aae75b33 at term 2"}
	{"level":"info","ts":"2022-06-30T21:07:16.036Z","caller":"etcdserver/server.go:2507","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}
	{"level":"info","ts":"2022-06-30T21:07:16.036Z","caller":"etcdserver/server.go:2042","msg":"published local member to cluster through raft","local-member-id":"dfc97eb0aae75b33","local-member-attributes":"{Name:embed-certs-20220630210659-9950 ClientURLs:[https://192.168.94.2:2379]}","request-path":"/0/members/dfc97eb0aae75b33/attributes","cluster-id":"da400bbece288f5a","publish-timeout":"7s"}
	{"level":"info","ts":"2022-06-30T21:07:16.036Z","caller":"embed/serve.go:98","msg":"ready to serve client requests"}
	{"level":"info","ts":"2022-06-30T21:07:16.036Z","caller":"embed/serve.go:98","msg":"ready to serve client requests"}
	{"level":"info","ts":"2022-06-30T21:07:16.037Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
	{"level":"info","ts":"2022-06-30T21:07:16.037Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
	{"level":"info","ts":"2022-06-30T21:07:16.037Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"da400bbece288f5a","local-member-id":"dfc97eb0aae75b33","cluster-version":"3.5"}
	{"level":"info","ts":"2022-06-30T21:07:16.037Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
	{"level":"info","ts":"2022-06-30T21:07:16.037Z","caller":"etcdserver/server.go:2531","msg":"cluster version is updated","cluster-version":"3.5"}
	{"level":"info","ts":"2022-06-30T21:07:16.038Z","caller":"embed/serve.go:188","msg":"serving client traffic securely","address":"127.0.0.1:2379"}
	{"level":"info","ts":"2022-06-30T21:07:16.038Z","caller":"embed/serve.go:188","msg":"serving client traffic securely","address":"192.168.94.2:2379"}
	{"level":"info","ts":"2022-06-30T21:17:16.547Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":441}
	{"level":"info","ts":"2022-06-30T21:17:16.548Z","caller":"mvcc/kvstore_compaction.go:57","msg":"finished scheduled compaction","compact-revision":441,"took":"398.905µs"}
	
	* 
	* ==> kernel <==
	*  21:19:41 up  1:02,  0 users,  load average: 0.97, 0.78, 1.22
	Linux embed-certs-20220630210659-9950 5.15.0-1012-gcp #17~20.04.1-Ubuntu SMP Thu Jun 23 16:10:34 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
	PRETTY_NAME="Ubuntu 20.04.4 LTS"
	
	* 
	* ==> kube-apiserver [157c2b0c199b65e53b31cbc33bd298586d30106a66d587ee22f9c486df45d1ba] <==
	* I0630 21:07:19.225159       1 cache.go:39] Caches are synced for APIServiceRegistrationController controller
	I0630 21:07:19.225172       1 cache.go:39] Caches are synced for autoregister controller
	I0630 21:07:19.229589       1 controller.go:611] quota admission added evaluator for: namespaces
	I0630 21:07:19.267453       1 apf_controller.go:322] Running API Priority and Fairness config worker
	I0630 21:07:19.268797       1 cache.go:39] Caches are synced for AvailableConditionController controller
	I0630 21:07:19.272028       1 shared_informer.go:262] Caches are synced for crd-autoregister
	I0630 21:07:19.327812       1 shared_informer.go:262] Caches are synced for node_authorizer
	I0630 21:07:19.793196       1 controller.go:132] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).
	I0630 21:07:20.081878       1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000
	I0630 21:07:20.085097       1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000
	I0630 21:07:20.085124       1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.
	I0630 21:07:20.500795       1 controller.go:611] quota admission added evaluator for: roles.rbac.authorization.k8s.io
	I0630 21:07:20.554121       1 controller.go:611] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
	I0630 21:07:20.649489       1 alloc.go:327] "allocated clusterIPs" service="default/kubernetes" clusterIPs=map[IPv4:10.96.0.1]
	W0630 21:07:20.655776       1 lease.go:234] Resetting endpoints for master service "kubernetes" to [192.168.94.2]
	I0630 21:07:20.656777       1 controller.go:611] quota admission added evaluator for: endpoints
	I0630 21:07:20.660110       1 controller.go:611] quota admission added evaluator for: endpointslices.discovery.k8s.io
	I0630 21:07:21.241414       1 controller.go:611] quota admission added evaluator for: serviceaccounts
	I0630 21:07:22.286912       1 controller.go:611] quota admission added evaluator for: deployments.apps
	I0630 21:07:22.296519       1 alloc.go:327] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs=map[IPv4:10.96.0.10]
	I0630 21:07:22.305814       1 controller.go:611] quota admission added evaluator for: daemonsets.apps
	I0630 21:07:22.430261       1 controller.go:611] quota admission added evaluator for: leases.coordination.k8s.io
	I0630 21:07:34.975370       1 controller.go:611] quota admission added evaluator for: controllerrevisions.apps
	I0630 21:07:35.000925       1 controller.go:611] quota admission added evaluator for: replicasets.apps
	I0630 21:07:36.039694       1 controller.go:611] quota admission added evaluator for: events.events.k8s.io
	
	* 
	* ==> kube-controller-manager [7734f08ca26708ce34ae224077718432c05bc3133a11bb3d600a7d29c4df0045] <==
	* I0630 21:07:34.940748       1 shared_informer.go:262] Caches are synced for PVC protection
	I0630 21:07:34.940779       1 shared_informer.go:262] Caches are synced for endpoint
	I0630 21:07:34.940788       1 shared_informer.go:262] Caches are synced for attach detach
	I0630 21:07:34.940728       1 shared_informer.go:262] Caches are synced for stateful set
	I0630 21:07:34.940864       1 shared_informer.go:262] Caches are synced for GC
	I0630 21:07:34.942018       1 shared_informer.go:262] Caches are synced for persistent volume
	I0630 21:07:34.955637       1 shared_informer.go:262] Caches are synced for resource quota
	I0630 21:07:34.964899       1 shared_informer.go:262] Caches are synced for daemon sets
	I0630 21:07:34.969897       1 shared_informer.go:262] Caches are synced for job
	I0630 21:07:34.980424       1 event.go:294] "Event occurred" object="kube-system/kube-proxy" fieldPath="" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-jhw4d"
	I0630 21:07:34.982490       1 event.go:294] "Event occurred" object="kube-system/kindnet" fieldPath="" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kindnet-z7fgt"
	I0630 21:07:34.988369       1 shared_informer.go:262] Caches are synced for endpoint_slice
	I0630 21:07:34.990561       1 shared_informer.go:262] Caches are synced for ephemeral
	I0630 21:07:34.991707       1 shared_informer.go:262] Caches are synced for taint
	I0630 21:07:34.991768       1 shared_informer.go:262] Caches are synced for deployment
	I0630 21:07:34.991797       1 node_lifecycle_controller.go:1399] Initializing eviction metric for zone: 
	I0630 21:07:34.991839       1 taint_manager.go:187] "Starting NoExecuteTaintManager"
	W0630 21:07:34.991867       1 node_lifecycle_controller.go:1014] Missing timestamp for Node embed-certs-20220630210659-9950. Assuming now as a timestamp.
	I0630 21:07:34.991912       1 node_lifecycle_controller.go:1165] Controller detected that all Nodes are not-Ready. Entering master disruption mode.
	I0630 21:07:34.991954       1 event.go:294] "Event occurred" object="embed-certs-20220630210659-9950" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node embed-certs-20220630210659-9950 event: Registered Node embed-certs-20220630210659-9950 in Controller"
	I0630 21:07:35.002644       1 event.go:294] "Event occurred" object="kube-system/coredns" fieldPath="" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-6d4b75cb6d to 1"
	I0630 21:07:35.099654       1 event.go:294] "Event occurred" object="kube-system/coredns-6d4b75cb6d" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-6d4b75cb6d-87dwf"
	I0630 21:07:35.374123       1 shared_informer.go:262] Caches are synced for garbage collector
	I0630 21:07:35.396784       1 shared_informer.go:262] Caches are synced for garbage collector
	I0630 21:07:35.396818       1 garbagecollector.go:158] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
	
	* 
	* ==> kube-proxy [8341041be1bdbcf0e0425bd1832777e15b2ed89bf8696d0c78d14301820032c3] <==
	* I0630 21:07:35.930193       1 node.go:163] Successfully retrieved node IP: 192.168.94.2
	I0630 21:07:35.930280       1 server_others.go:138] "Detected node IP" address="192.168.94.2"
	I0630 21:07:35.930318       1 server_others.go:578] "Unknown proxy mode, assuming iptables proxy" proxyMode=""
	I0630 21:07:36.035407       1 server_others.go:206] "Using iptables Proxier"
	I0630 21:07:36.035471       1 server_others.go:213] "kube-proxy running in dual-stack mode" ipFamily=IPv4
	I0630 21:07:36.035484       1 server_others.go:214] "Creating dualStackProxier for iptables"
	I0630 21:07:36.035502       1 server_others.go:501] "Detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, , defaulting to no-op detect-local for IPv6"
	I0630 21:07:36.035532       1 proxier.go:259] "Setting route_localnet=1, use nodePortAddresses to filter loopback addresses for NodePorts to skip it https://issues.k8s.io/90259"
	I0630 21:07:36.035701       1 proxier.go:259] "Setting route_localnet=1, use nodePortAddresses to filter loopback addresses for NodePorts to skip it https://issues.k8s.io/90259"
	I0630 21:07:36.035995       1 server.go:661] "Version info" version="v1.24.2"
	I0630 21:07:36.036014       1 server.go:663] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
	I0630 21:07:36.036550       1 config.go:317] "Starting service config controller"
	I0630 21:07:36.036571       1 shared_informer.go:255] Waiting for caches to sync for service config
	I0630 21:07:36.036594       1 config.go:444] "Starting node config controller"
	I0630 21:07:36.036598       1 shared_informer.go:255] Waiting for caches to sync for node config
	I0630 21:07:36.036750       1 config.go:226] "Starting endpoint slice config controller"
	I0630 21:07:36.036770       1 shared_informer.go:255] Waiting for caches to sync for endpoint slice config
	I0630 21:07:36.137118       1 shared_informer.go:262] Caches are synced for endpoint slice config
	I0630 21:07:36.137139       1 shared_informer.go:262] Caches are synced for service config
	I0630 21:07:36.137113       1 shared_informer.go:262] Caches are synced for node config
	
	* 
	* ==> kube-scheduler [ccc3bef31fe3faba9ff6daab0d5ca071fed6adb37d8cc554c7399ac599691557] <==
	* W0630 21:07:19.234494       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	E0630 21:07:19.235636       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	W0630 21:07:19.234110       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	E0630 21:07:19.235666       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	W0630 21:07:19.234672       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E0630 21:07:19.235716       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	W0630 21:07:19.234671       1 reflector.go:324] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	E0630 21:07:19.235796       1 reflector.go:138] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	W0630 21:07:19.234818       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0630 21:07:19.235858       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	W0630 21:07:19.234955       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E0630 21:07:19.235883       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	W0630 21:07:19.234128       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	E0630 21:07:19.235898       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	W0630 21:07:20.099241       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E0630 21:07:20.099281       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	W0630 21:07:20.186118       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E0630 21:07:20.186155       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	W0630 21:07:20.247542       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	E0630 21:07:20.247580       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	W0630 21:07:20.264775       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E0630 21:07:20.264809       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	W0630 21:07:20.394978       1 reflector.go:324] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	E0630 21:07:20.395035       1 reflector.go:138] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	I0630 21:07:23.232820       1 shared_informer.go:262] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	
	* 
	* ==> kubelet <==
	* -- Logs begin at Thu 2022-06-30 21:07:08 UTC, end at Thu 2022-06-30 21:19:41 UTC. --
	Jun 30 21:18:22 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:18:22.814104    1338 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:18:27 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:18:27.815097    1338 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:18:32 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:18:32.816217    1338 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:18:37 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:18:37.817148    1338 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:18:42 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:18:42.818243    1338 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:18:47 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:18:47.819889    1338 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:18:52 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:18:52.821499    1338 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:18:57 embed-certs-20220630210659-9950 kubelet[1338]: I0630 21:18:57.821808    1338 scope.go:110] "RemoveContainer" containerID="dd64884ab93c0c3890ada26549c0b777e79f7690d5ff461606312535f761ab83"
	Jun 30 21:18:57 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:18:57.821962    1338 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:18:57 embed-certs-20220630210659-9950 kubelet[1338]: I0630 21:18:57.822192    1338 scope.go:110] "RemoveContainer" containerID="6bdce580a9d6963de5c12d9e017d5662e2685851e130abf85abf7ccd2206a8a6"
	Jun 30 21:18:57 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:18:57.822602    1338 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kindnet-cni\" with CrashLoopBackOff: \"back-off 40s restarting failed container=kindnet-cni pod=kindnet-z7fgt_kube-system(9d385a59-b071-48be-b547-db80254669bc)\"" pod="kube-system/kindnet-z7fgt" podUID=9d385a59-b071-48be-b547-db80254669bc
	Jun 30 21:19:02 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:19:02.823098    1338 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:19:07 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:19:07.824578    1338 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:19:09 embed-certs-20220630210659-9950 kubelet[1338]: I0630 21:19:09.452458    1338 scope.go:110] "RemoveContainer" containerID="6bdce580a9d6963de5c12d9e017d5662e2685851e130abf85abf7ccd2206a8a6"
	Jun 30 21:19:09 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:19:09.452939    1338 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kindnet-cni\" with CrashLoopBackOff: \"back-off 40s restarting failed container=kindnet-cni pod=kindnet-z7fgt_kube-system(9d385a59-b071-48be-b547-db80254669bc)\"" pod="kube-system/kindnet-z7fgt" podUID=9d385a59-b071-48be-b547-db80254669bc
	Jun 30 21:19:12 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:19:12.826264    1338 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:19:17 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:19:17.827939    1338 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:19:22 embed-certs-20220630210659-9950 kubelet[1338]: I0630 21:19:22.452139    1338 scope.go:110] "RemoveContainer" containerID="6bdce580a9d6963de5c12d9e017d5662e2685851e130abf85abf7ccd2206a8a6"
	Jun 30 21:19:22 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:19:22.452400    1338 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kindnet-cni\" with CrashLoopBackOff: \"back-off 40s restarting failed container=kindnet-cni pod=kindnet-z7fgt_kube-system(9d385a59-b071-48be-b547-db80254669bc)\"" pod="kube-system/kindnet-z7fgt" podUID=9d385a59-b071-48be-b547-db80254669bc
	Jun 30 21:19:22 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:19:22.829219    1338 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:19:27 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:19:27.830978    1338 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:19:32 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:19:32.831640    1338 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:19:36 embed-certs-20220630210659-9950 kubelet[1338]: I0630 21:19:36.452853    1338 scope.go:110] "RemoveContainer" containerID="6bdce580a9d6963de5c12d9e017d5662e2685851e130abf85abf7ccd2206a8a6"
	Jun 30 21:19:36 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:19:36.453199    1338 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kindnet-cni\" with CrashLoopBackOff: \"back-off 40s restarting failed container=kindnet-cni pod=kindnet-z7fgt_kube-system(9d385a59-b071-48be-b547-db80254669bc)\"" pod="kube-system/kindnet-z7fgt" podUID=9d385a59-b071-48be-b547-db80254669bc
	Jun 30 21:19:37 embed-certs-20220630210659-9950 kubelet[1338]: E0630 21:19:37.832729    1338 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	

                                                
                                                
-- /stdout --
helpers_test.go:254: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p embed-certs-20220630210659-9950 -n embed-certs-20220630210659-9950
helpers_test.go:261: (dbg) Run:  kubectl --context embed-certs-20220630210659-9950 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:270: non-running pods: busybox coredns-6d4b75cb6d-87dwf storage-provisioner
helpers_test.go:272: ======> post-mortem[TestStartStop/group/embed-certs/serial/DeployApp]: describe non-running pods <======
helpers_test.go:275: (dbg) Run:  kubectl --context embed-certs-20220630210659-9950 describe pod busybox coredns-6d4b75cb6d-87dwf storage-provisioner
helpers_test.go:275: (dbg) Non-zero exit: kubectl --context embed-certs-20220630210659-9950 describe pod busybox coredns-6d4b75cb6d-87dwf storage-provisioner: exit status 1 (59.567348ms)

                                                
                                                
-- stdout --
	Name:         busybox
	Namespace:    default
	Priority:     0
	Node:         <none>
	Labels:       integration-test=busybox
	Annotations:  <none>
	Status:       Pending
	IP:           
	IPs:          <none>
	Containers:
	  busybox:
	    Image:      gcr.io/k8s-minikube/busybox:1.28.4-glibc
	    Port:       <none>
	    Host Port:  <none>
	    Command:
	      sleep
	      3600
	    Environment:  <none>
	    Mounts:
	      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-r2mh6 (ro)
	Conditions:
	  Type           Status
	  PodScheduled   False 
	Volumes:
	  kube-api-access-r2mh6:
	    Type:                    Projected (a volume that contains injected data from multiple sources)
	    TokenExpirationSeconds:  3607
	    ConfigMapName:           kube-root-ca.crt
	    ConfigMapOptional:       <nil>
	    DownwardAPI:             true
	QoS Class:                   BestEffort
	Node-Selectors:              <none>
	Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
	                             node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
	Events:
	  Type     Reason            Age                   From               Message
	  ----     ------            ----                  ----               -------
	  Warning  FailedScheduling  2m49s (x2 over 8m4s)  default-scheduler  0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.

                                                
                                                
-- /stdout --
** stderr ** 
	Error from server (NotFound): pods "coredns-6d4b75cb6d-87dwf" not found
	Error from server (NotFound): pods "storage-provisioner" not found

                                                
                                                
** /stderr **
helpers_test.go:277: kubectl --context embed-certs-20220630210659-9950 describe pod busybox coredns-6d4b75cb6d-87dwf storage-provisioner: exit status 1
--- FAIL: TestStartStop/group/embed-certs/serial/DeployApp (484.55s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/SecondStart (597.98s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-amd64 start -p old-k8s-version-20220630210005-9950 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.16.0
E0630 21:13:30.280303    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/functional-20220630202638-9950/client.crt: no such file or directory
E0630 21:13:30.339541    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/no-preload-20220630210237-9950/client.crt: no such file or directory
E0630 21:13:30.344806    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/no-preload-20220630210237-9950/client.crt: no such file or directory
E0630 21:13:30.355101    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/no-preload-20220630210237-9950/client.crt: no such file or directory
E0630 21:13:30.375571    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/no-preload-20220630210237-9950/client.crt: no such file or directory
E0630 21:13:30.415862    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/no-preload-20220630210237-9950/client.crt: no such file or directory
E0630 21:13:30.496182    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/no-preload-20220630210237-9950/client.crt: no such file or directory
E0630 21:13:30.657161    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/no-preload-20220630210237-9950/client.crt: no such file or directory
E0630 21:13:30.977726    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/no-preload-20220630210237-9950/client.crt: no such file or directory
E0630 21:13:31.618692    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/no-preload-20220630210237-9950/client.crt: no such file or directory
E0630 21:13:32.898931    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/no-preload-20220630210237-9950/client.crt: no such file or directory
E0630 21:13:35.459650    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/no-preload-20220630210237-9950/client.crt: no such file or directory
E0630 21:13:40.579789    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/no-preload-20220630210237-9950/client.crt: no such file or directory
E0630 21:13:50.204707    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/addons-20220630202117-9950/client.crt: no such file or directory
E0630 21:13:50.820568    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/no-preload-20220630210237-9950/client.crt: no such file or directory
E0630 21:14:11.300742    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/no-preload-20220630210237-9950/client.crt: no such file or directory
E0630 21:14:37.806414    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/auto-20220630204858-9950/client.crt: no such file or directory
E0630 21:14:41.441891    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/kindnet-20220630204858-9950/client.crt: no such file or directory
E0630 21:14:52.261095    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/no-preload-20220630210237-9950/client.crt: no such file or directory
E0630 21:15:01.427216    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/enable-default-cni-20220630204858-9950/client.crt: no such file or directory
E0630 21:15:25.851257    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/cilium-20220630204859-9950/client.crt: no such file or directory
E0630 21:15:29.112427    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/enable-default-cni-20220630204858-9950/client.crt: no such file or directory
E0630 21:15:47.269147    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/ingress-addon-legacy-20220630202923-9950/client.crt: no such file or directory
E0630 21:16:00.851749    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/auto-20220630204858-9950/client.crt: no such file or directory
E0630 21:16:04.486431    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/kindnet-20220630204858-9950/client.crt: no such file or directory
E0630 21:16:14.182019    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/no-preload-20220630210237-9950/client.crt: no such file or directory

                                                
                                                
=== CONT  TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-20220630210005-9950 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.16.0: exit status 80 (9m55.800093508s)

                                                
                                                
-- stdout --
	* [old-k8s-version-20220630210005-9950] minikube v1.26.0 on Ubuntu 20.04 (kvm/amd64)
	  - MINIKUBE_LOCATION=14420
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-amd64
	* Kubernetes 1.24.2 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.24.2
	* Using the docker driver based on existing profile
	* Starting control plane node old-k8s-version-20220630210005-9950 in cluster old-k8s-version-20220630210005-9950
	* Pulling base image ...
	* Restarting existing docker container for "old-k8s-version-20220630210005-9950" ...
	* Preparing Kubernetes v1.16.0 on containerd 1.6.6 ...
	  - kubelet.cni-conf-dir=/etc/cni/net.mk
	* Configuring CNI (Container Networking Interface) ...
	  - Generating certificates and keys ...
	  - Booting up control plane ...
	  - Configuring RBAC rules ...
	* Configuring CNI (Container Networking Interface) ...
	* Verifying Kubernetes components...
	  - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	  - Using image kubernetesui/dashboard:v2.6.0
	  - Using image k8s.gcr.io/echoserver:1.4
	  - Using image fake.domain/k8s.gcr.io/echoserver:1.4
	* Enabled addons: default-storageclass, storage-provisioner, metrics-server, dashboard
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0630 21:12:54.458513  271327 out.go:296] Setting OutFile to fd 1 ...
	I0630 21:12:54.458723  271327 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 21:12:54.458735  271327 out.go:309] Setting ErrFile to fd 2...
	I0630 21:12:54.458739  271327 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 21:12:54.459171  271327 root.go:329] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/bin
	I0630 21:12:54.459399  271327 out.go:303] Setting JSON to false
	I0630 21:12:54.460611  271327 start.go:115] hostinfo: {"hostname":"ubuntu-20-agent-8","uptime":3327,"bootTime":1656620248,"procs":353,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1012-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0630 21:12:54.460675  271327 start.go:125] virtualization: kvm guest
	I0630 21:12:54.464187  271327 out.go:177] * [old-k8s-version-20220630210005-9950] minikube v1.26.0 on Ubuntu 20.04 (kvm/amd64)
	I0630 21:12:54.465765  271327 out.go:177]   - MINIKUBE_LOCATION=14420
	I0630 21:12:54.465705  271327 notify.go:193] Checking for updates...
	I0630 21:12:54.467351  271327 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0630 21:12:54.469076  271327 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:12:54.470734  271327 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube
	I0630 21:12:54.472165  271327 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0630 21:12:54.473803  271327 config.go:178] Loaded profile config "old-k8s-version-20220630210005-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.16.0
	I0630 21:12:54.475600  271327 out.go:177] * Kubernetes 1.24.2 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.24.2
	I0630 21:12:54.476739  271327 driver.go:360] Setting default libvirt URI to qemu:///system
	I0630 21:12:54.520439  271327 docker.go:137] docker version: linux-20.10.17
	I0630 21:12:54.520531  271327 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0630 21:12:54.626504  271327 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:8 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:43 OomKillDisable:true NGoroutines:44 SystemTime:2022-06-30 21:12:54.551026919 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1012-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexServ
erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662451712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-8 Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Client
Info:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
	I0630 21:12:54.626609  271327 docker.go:254] overlay module found
	I0630 21:12:54.628919  271327 out.go:177] * Using the docker driver based on existing profile
	I0630 21:12:54.630364  271327 start.go:284] selected driver: docker
	I0630 21:12:54.630380  271327 start.go:808] validating driver "docker" against &{Name:old-k8s-version-20220630210005-9950 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-20220630210005-9950 Nam
espace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.67.2 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[Dashboard:kubernetesui/dashboard:v2.6.0@sha256:4af9580485920635d888efe1eddbd67e12f9d5d84dba87100e93feb4e46636b3 MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] Star
tHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 21:12:54.630494  271327 start.go:819] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0630 21:12:54.631308  271327 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0630 21:12:54.741608  271327 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:8 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:43 OomKillDisable:true NGoroutines:44 SystemTime:2022-06-30 21:12:54.663294597 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1012-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexServ
erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662451712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-8 Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Client
Info:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
	I0630 21:12:54.741886  271327 start_flags.go:853] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0630 21:12:54.741907  271327 cni.go:95] Creating CNI manager for ""
	I0630 21:12:54.741916  271327 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:12:54.741932  271327 start_flags.go:310] config:
	{Name:old-k8s-version-20220630210005-9950 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-20220630210005-9950 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDom
ain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.67.2 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[Dashboard:kubernetesui/dashboard:v2.6.0@sha256:4af9580485920635d888efe1eddbd67e12f9d5d84dba87100e93feb4e46636b3 MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Su
bnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 21:12:54.745032  271327 out.go:177] * Starting control plane node old-k8s-version-20220630210005-9950 in cluster old-k8s-version-20220630210005-9950
	I0630 21:12:54.746400  271327 cache.go:120] Beginning downloading kic base image for docker with containerd
	I0630 21:12:54.747743  271327 out.go:177] * Pulling base image ...
	I0630 21:12:54.749006  271327 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime containerd
	I0630 21:12:54.749038  271327 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e in local docker daemon
	I0630 21:12:54.749076  271327 preload.go:148] Found local preload: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-containerd-overlay2-amd64.tar.lz4
	I0630 21:12:54.749097  271327 cache.go:57] Caching tarball of preloaded images
	I0630 21:12:54.749296  271327 preload.go:174] Found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-containerd-overlay2-amd64.tar.lz4 in cache, skipping download
	I0630 21:12:54.749311  271327 cache.go:60] Finished verifying existence of preloaded tar for  v1.16.0 on containerd
	I0630 21:12:54.749504  271327 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/config.json ...
	I0630 21:12:54.784190  271327 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e in local docker daemon, skipping pull
	I0630 21:12:54.784215  271327 cache.go:142] gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e exists in daemon, skipping load
	I0630 21:12:54.784225  271327 cache.go:208] Successfully downloaded all kic artifacts
	I0630 21:12:54.784263  271327 start.go:352] acquiring machines lock for old-k8s-version-20220630210005-9950: {Name:mkf719e729d8bddb1fc7c2bc9e00e82ad1c17213 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0630 21:12:54.784376  271327 start.go:356] acquired machines lock for "old-k8s-version-20220630210005-9950" in 93.677µs
	I0630 21:12:54.784402  271327 start.go:94] Skipping create...Using existing machine configuration
	I0630 21:12:54.784407  271327 fix.go:55] fixHost starting: 
	I0630 21:12:54.784629  271327 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220630210005-9950 --format={{.State.Status}}
	I0630 21:12:54.819248  271327 fix.go:103] recreateIfNeeded on old-k8s-version-20220630210005-9950: state=Stopped err=<nil>
	W0630 21:12:54.819277  271327 fix.go:129] unexpected machine state, will restart: <nil>
	I0630 21:12:54.822125  271327 out.go:177] * Restarting existing docker container for "old-k8s-version-20220630210005-9950" ...
	I0630 21:12:54.823401  271327 cli_runner.go:164] Run: docker start old-k8s-version-20220630210005-9950
	I0630 21:12:55.228150  271327 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220630210005-9950 --format={{.State.Status}}
	I0630 21:12:55.267612  271327 kic.go:416] container "old-k8s-version-20220630210005-9950" state is running.
	I0630 21:12:55.267996  271327 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-20220630210005-9950
	I0630 21:12:55.304343  271327 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/config.json ...
	I0630 21:12:55.304609  271327 machine.go:88] provisioning docker machine ...
	I0630 21:12:55.304637  271327 ubuntu.go:169] provisioning hostname "old-k8s-version-20220630210005-9950"
	I0630 21:12:55.304740  271327 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220630210005-9950
	I0630 21:12:55.341604  271327 main.go:134] libmachine: Using SSH client type: native
	I0630 21:12:55.341782  271327 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil>  [] 0s} 127.0.0.1 49432 <nil> <nil>}
	I0630 21:12:55.341804  271327 main.go:134] libmachine: About to run SSH command:
	sudo hostname old-k8s-version-20220630210005-9950 && echo "old-k8s-version-20220630210005-9950" | sudo tee /etc/hostname
	I0630 21:12:55.342411  271327 main.go:134] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:33496->127.0.0.1:49432: read: connection reset by peer
	I0630 21:12:58.474026  271327 main.go:134] libmachine: SSH cmd err, output: <nil>: old-k8s-version-20220630210005-9950
	
	I0630 21:12:58.474096  271327 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220630210005-9950
	I0630 21:12:58.510030  271327 main.go:134] libmachine: Using SSH client type: native
	I0630 21:12:58.510179  271327 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil>  [] 0s} 127.0.0.1 49432 <nil> <nil>}
	I0630 21:12:58.510202  271327 main.go:134] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sold-k8s-version-20220630210005-9950' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-20220630210005-9950/g' /etc/hosts;
				else 
					echo '127.0.1.1 old-k8s-version-20220630210005-9950' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0630 21:12:58.625033  271327 main.go:134] libmachine: SSH cmd err, output: <nil>: 
	I0630 21:12:58.625074  271327 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube CaCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/c
erts/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube}
	I0630 21:12:58.625102  271327 ubuntu.go:177] setting up certificates
	I0630 21:12:58.625117  271327 provision.go:83] configureAuth start
	I0630 21:12:58.625175  271327 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-20220630210005-9950
	I0630 21:12:58.662760  271327 provision.go:138] copyHostCerts
	I0630 21:12:58.662859  271327 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem, removing ...
	I0630 21:12:58.662878  271327 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem
	I0630 21:12:58.662960  271327 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem (1082 bytes)
	I0630 21:12:58.663097  271327 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem, removing ...
	I0630 21:12:58.663121  271327 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem
	I0630 21:12:58.663172  271327 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem (1123 bytes)
	I0630 21:12:58.663265  271327 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem, removing ...
	I0630 21:12:58.663278  271327 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem
	I0630 21:12:58.663321  271327 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem (1679 bytes)
	I0630 21:12:58.663395  271327 provision.go:112] generating server cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-20220630210005-9950 san=[192.168.67.2 127.0.0.1 localhost 127.0.0.1 minikube old-k8s-version-20220630210005-9950]
	I0630 21:12:58.752521  271327 provision.go:172] copyRemoteCerts
	I0630 21:12:58.752583  271327 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0630 21:12:58.752626  271327 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220630210005-9950
	I0630 21:12:58.789059  271327 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49432 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/old-k8s-version-20220630210005-9950/id_rsa Username:docker}
	I0630 21:12:58.876530  271327 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
	I0630 21:12:58.894073  271327 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem --> /etc/docker/server.pem (1277 bytes)
	I0630 21:12:58.911294  271327 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0630 21:12:58.928841  271327 provision.go:86] duration metric: configureAuth took 303.702271ms
	I0630 21:12:58.928870  271327 ubuntu.go:193] setting minikube options for container-runtime
	I0630 21:12:58.929141  271327 config.go:178] Loaded profile config "old-k8s-version-20220630210005-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.16.0
	I0630 21:12:58.929157  271327 machine.go:91] provisioned docker machine in 3.624531122s
	I0630 21:12:58.929166  271327 start.go:306] post-start starting for "old-k8s-version-20220630210005-9950" (driver="docker")
	I0630 21:12:58.929174  271327 start.go:316] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0630 21:12:58.929237  271327 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0630 21:12:58.929282  271327 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220630210005-9950
	I0630 21:12:58.964321  271327 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49432 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/old-k8s-version-20220630210005-9950/id_rsa Username:docker}
	I0630 21:12:59.052606  271327 ssh_runner.go:195] Run: cat /etc/os-release
	I0630 21:12:59.055232  271327 main.go:134] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0630 21:12:59.055263  271327 main.go:134] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0630 21:12:59.055278  271327 main.go:134] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0630 21:12:59.055289  271327 info.go:137] Remote host: Ubuntu 20.04.4 LTS
	I0630 21:12:59.055302  271327 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/addons for local assets ...
	I0630 21:12:59.055349  271327 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files for local assets ...
	I0630 21:12:59.055422  271327 filesync.go:149] local asset: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem -> 99502.pem in /etc/ssl/certs
	I0630 21:12:59.055511  271327 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0630 21:12:59.062501  271327 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem --> /etc/ssl/certs/99502.pem (1708 bytes)
	I0630 21:12:59.079749  271327 start.go:309] post-start completed in 150.570292ms
	I0630 21:12:59.079814  271327 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0630 21:12:59.079848  271327 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220630210005-9950
	I0630 21:12:59.115633  271327 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49432 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/old-k8s-version-20220630210005-9950/id_rsa Username:docker}
	I0630 21:12:59.197533  271327 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0630 21:12:59.201551  271327 fix.go:57] fixHost completed within 4.417138459s
	I0630 21:12:59.201580  271327 start.go:81] releasing machines lock for "old-k8s-version-20220630210005-9950", held for 4.41718709s
	I0630 21:12:59.201664  271327 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-20220630210005-9950
	I0630 21:12:59.236396  271327 ssh_runner.go:195] Run: systemctl --version
	I0630 21:12:59.236429  271327 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/
	I0630 21:12:59.236445  271327 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220630210005-9950
	I0630 21:12:59.236479  271327 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220630210005-9950
	I0630 21:12:59.275956  271327 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49432 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/old-k8s-version-20220630210005-9950/id_rsa Username:docker}
	I0630 21:12:59.278139  271327 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49432 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/old-k8s-version-20220630210005-9950/id_rsa Username:docker}
	I0630 21:12:59.357177  271327 ssh_runner.go:195] Run: sudo systemctl stop -f crio
	I0630 21:12:59.396058  271327 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0630 21:12:59.405905  271327 docker.go:179] disabling docker service ...
	I0630 21:12:59.405971  271327 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0630 21:12:59.415565  271327 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0630 21:12:59.425245  271327 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0630 21:12:59.506277  271327 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0630 21:12:59.579576  271327 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0630 21:12:59.588504  271327 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
	image-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0630 21:12:59.600574  271327 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*sandbox_image = .*$|sandbox_image = "k8s.gcr.io/pause:3.1"|' -i /etc/containerd/config.toml"
	I0630 21:12:59.609004  271327 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*restrict_oom_score_adj = .*$|restrict_oom_score_adj = false|' -i /etc/containerd/config.toml"
	I0630 21:12:59.616872  271327 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*SystemdCgroup = .*$|SystemdCgroup = false|' -i /etc/containerd/config.toml"
	I0630 21:12:59.625560  271327 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*conf_dir = .*$|conf_dir = "/etc/cni/net.mk"|' -i /etc/containerd/config.toml"
	I0630 21:12:59.633687  271327 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^# imports|imports = ["/etc/containerd/containerd.conf.d/02-containerd.conf"]|' -i /etc/containerd/config.toml"
	I0630 21:12:59.641489  271327 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc/containerd/containerd.conf.d && printf %s "dmVyc2lvbiA9IDIK" | base64 -d | sudo tee /etc/containerd/containerd.conf.d/02-containerd.conf"
	I0630 21:12:59.653799  271327 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0630 21:12:59.661303  271327 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0630 21:12:59.667744  271327 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0630 21:12:59.739470  271327 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0630 21:12:59.811957  271327 start.go:447] Will wait 60s for socket path /run/containerd/containerd.sock
	I0630 21:12:59.812020  271327 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
	I0630 21:12:59.815575  271327 start.go:468] Will wait 60s for crictl version
	I0630 21:12:59.815658  271327 ssh_runner.go:195] Run: sudo crictl version
	I0630 21:12:59.840380  271327 retry.go:31] will retry after 11.04660288s: Temporary Error: sudo crictl version: Process exited with status 1
	stdout:
	
	stderr:
	time="2022-06-30T21:12:59Z" level=fatal msg="getting the runtime version: rpc error: code = Unknown desc = server is not initialized yet"
	I0630 21:13:10.887641  271327 ssh_runner.go:195] Run: sudo crictl version
	I0630 21:13:10.911469  271327 start.go:477] Version:  0.1.0
	RuntimeName:  containerd
	RuntimeVersion:  1.6.6
	RuntimeApiVersion:  v1alpha2
	I0630 21:13:10.911525  271327 ssh_runner.go:195] Run: containerd --version
	I0630 21:13:10.941036  271327 ssh_runner.go:195] Run: containerd --version
	I0630 21:13:10.973182  271327 out.go:177] * Preparing Kubernetes v1.16.0 on containerd 1.6.6 ...
	I0630 21:13:10.974662  271327 cli_runner.go:164] Run: docker network inspect old-k8s-version-20220630210005-9950 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0630 21:13:11.009465  271327 ssh_runner.go:195] Run: grep 192.168.67.1	host.minikube.internal$ /etc/hosts
	I0630 21:13:11.012813  271327 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.67.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0630 21:13:11.023782  271327 out.go:177]   - kubelet.cni-conf-dir=/etc/cni/net.mk
	I0630 21:13:11.025280  271327 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime containerd
	I0630 21:13:11.025333  271327 ssh_runner.go:195] Run: sudo crictl images --output json
	I0630 21:13:11.049476  271327 containerd.go:547] all images are preloaded for containerd runtime.
	I0630 21:13:11.049500  271327 containerd.go:461] Images already preloaded, skipping extraction
	I0630 21:13:11.049574  271327 ssh_runner.go:195] Run: sudo crictl images --output json
	I0630 21:13:11.072721  271327 containerd.go:547] all images are preloaded for containerd runtime.
	I0630 21:13:11.072742  271327 cache_images.go:84] Images are preloaded, skipping loading
	I0630 21:13:11.072795  271327 ssh_runner.go:195] Run: sudo crictl info
	I0630 21:13:11.096695  271327 cni.go:95] Creating CNI manager for ""
	I0630 21:13:11.096723  271327 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:13:11.096741  271327 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
	I0630 21:13:11.096759  271327 kubeadm.go:158] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.67.2 APIServerPort:8443 KubernetesVersion:v1.16.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-20220630210005-9950 NodeName:old-k8s-version-20220630210005-9950 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.67.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.67.2 CgroupDriver:cgroupfs
ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}
	I0630 21:13:11.096917  271327 kubeadm.go:162] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta1
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.67.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: /run/containerd/containerd.sock
	  name: "old-k8s-version-20220630210005-9950"
	  kubeletExtraArgs:
	    node-ip: 192.168.67.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta1
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.67.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: old-k8s-version-20220630210005-9950
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	dns:
	  type: CoreDNS
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      listen-metrics-urls: http://127.0.0.1:2381,http://192.168.67.2:2381
	kubernetesVersion: v1.16.0
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%"
	  nodefs.inodesFree: "0%"
	  imagefs.available: "0%"
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0630 21:13:11.097018  271327 kubeadm.go:961] kubelet [Unit]
	Wants=containerd.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.16.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cni-conf-dir=/etc/cni/net.mk --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=old-k8s-version-20220630210005-9950 --image-service-endpoint=unix:///run/containerd/containerd.sock --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.67.2 --runtime-request-timeout=15m
	
	[Install]
	 config:
	{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-20220630210005-9950 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
	I0630 21:13:11.097187  271327 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.16.0
	I0630 21:13:11.104428  271327 binaries.go:44] Found k8s binaries, skipping transfer
	I0630 21:13:11.104504  271327 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0630 21:13:11.111290  271327 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (580 bytes)
	I0630 21:13:11.123946  271327 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0630 21:13:11.136775  271327 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2154 bytes)
	I0630 21:13:11.149718  271327 ssh_runner.go:195] Run: grep 192.168.67.2	control-plane.minikube.internal$ /etc/hosts
	I0630 21:13:11.152625  271327 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.67.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0630 21:13:11.162302  271327 certs.go:54] Setting up /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950 for IP: 192.168.67.2
	I0630 21:13:11.162407  271327 certs.go:182] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.key
	I0630 21:13:11.162454  271327 certs.go:182] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.key
	I0630 21:13:11.162539  271327 certs.go:298] skipping minikube-user signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/client.key
	I0630 21:13:11.162605  271327 certs.go:298] skipping minikube signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/apiserver.key.c7fa3a9e
	I0630 21:13:11.162643  271327 certs.go:298] skipping aggregator signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/proxy-client.key
	I0630 21:13:11.162760  271327 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950.pem (1338 bytes)
	W0630 21:13:11.162806  271327 certs.go:384] ignoring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950_empty.pem, impossibly tiny 0 bytes
	I0630 21:13:11.162820  271327 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem (1679 bytes)
	I0630 21:13:11.162861  271327 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem (1082 bytes)
	I0630 21:13:11.162895  271327 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem (1123 bytes)
	I0630 21:13:11.162931  271327 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/key.pem (1679 bytes)
	I0630 21:13:11.162990  271327 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem (1708 bytes)
	I0630 21:13:11.163904  271327 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
	I0630 21:13:11.184892  271327 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I0630 21:13:11.206289  271327 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0630 21:13:11.224207  271327 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
	I0630 21:13:11.243140  271327 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0630 21:13:11.262116  271327 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
	I0630 21:13:11.280815  271327 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0630 21:13:11.299759  271327 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
	I0630 21:13:11.318450  271327 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem --> /usr/share/ca-certificates/99502.pem (1708 bytes)
	I0630 21:13:11.337118  271327 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0630 21:13:11.355699  271327 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950.pem --> /usr/share/ca-certificates/9950.pem (1338 bytes)
	I0630 21:13:11.374676  271327 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0630 21:13:11.388531  271327 ssh_runner.go:195] Run: openssl version
	I0630 21:13:11.393893  271327 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/99502.pem && ln -fs /usr/share/ca-certificates/99502.pem /etc/ssl/certs/99502.pem"
	I0630 21:13:11.402243  271327 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/99502.pem
	I0630 21:13:11.405519  271327 certs.go:431] hashing: -rw-r--r-- 1 root root 1708 Jun 30 20:26 /usr/share/ca-certificates/99502.pem
	I0630 21:13:11.405568  271327 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/99502.pem
	I0630 21:13:11.410901  271327 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/99502.pem /etc/ssl/certs/3ec20f2e.0"
	I0630 21:13:11.418854  271327 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0630 21:13:11.427866  271327 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:13:11.431311  271327 certs.go:431] hashing: -rw-r--r-- 1 root root 1111 Jun 30 20:22 /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:13:11.431380  271327 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:13:11.436694  271327 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0630 21:13:11.444577  271327 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/9950.pem && ln -fs /usr/share/ca-certificates/9950.pem /etc/ssl/certs/9950.pem"
	I0630 21:13:11.453028  271327 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/9950.pem
	I0630 21:13:11.456607  271327 certs.go:431] hashing: -rw-r--r-- 1 root root 1338 Jun 30 20:26 /usr/share/ca-certificates/9950.pem
	I0630 21:13:11.456670  271327 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/9950.pem
	I0630 21:13:11.462072  271327 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/9950.pem /etc/ssl/certs/51391683.0"
	I0630 21:13:11.470089  271327 kubeadm.go:395] StartCluster: {Name:old-k8s-version-20220630210005-9950 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-20220630210005-9950 Namespace:default APISe
rverName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.67.2 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[Dashboard:kubernetesui/dashboard:v2.6.0@sha256:4af9580485920635d888efe1eddbd67e12f9d5d84dba87100e93feb4e46636b3 MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s Sc
heduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 21:13:11.470197  271327 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
	I0630 21:13:11.470262  271327 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0630 21:13:11.495667  271327 cri.go:87] found id: "c435aa6fdf138d684f721a5f1fb855163b020feb07c989254589c7e901b37b36"
	I0630 21:13:11.495695  271327 cri.go:87] found id: "27b91b4e1595400f52e6c0fd5fb8e3732c524b9757a79a5a9108333797eb3788"
	I0630 21:13:11.495702  271327 cri.go:87] found id: "998b774f4f284a1fcf3dbd179faaa8c69e39ab084d30662575ac04f0146604f3"
	I0630 21:13:11.495708  271327 cri.go:87] found id: "b8604fd1030fac170f4591063a20f1abfb86602e188695c1be545614d1b4e8a0"
	I0630 21:13:11.495714  271327 cri.go:87] found id: "fa267cd65f4eefef8993b275f8625ee5daf30304f18337e27a9944d1b5f03a02"
	I0630 21:13:11.495721  271327 cri.go:87] found id: "f60b30d7e822cbe35e12b31f9d3517de2de1004b26577e8f27750257f416aae1"
	I0630 21:13:11.495726  271327 cri.go:87] found id: ""
	I0630 21:13:11.495764  271327 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
	I0630 21:13:11.508218  271327 cri.go:114] JSON = null
	W0630 21:13:11.508285  271327 kubeadm.go:402] unpause failed: list paused: list returned 0 containers, but ps returned 6
	I0630 21:13:11.508338  271327 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0630 21:13:11.515470  271327 kubeadm.go:410] found existing configuration files, will attempt cluster restart
	I0630 21:13:11.515494  271327 kubeadm.go:626] restartCluster start
	I0630 21:13:11.515548  271327 ssh_runner.go:195] Run: sudo test -d /data/minikube
	I0630 21:13:11.522610  271327 kubeadm.go:127] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:13:11.523454  271327 kubeconfig.go:116] verify returned: extract IP: "old-k8s-version-20220630210005-9950" does not appear in /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:13:11.523977  271327 kubeconfig.go:127] "old-k8s-version-20220630210005-9950" context is missing from /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig - will repair!
	I0630 21:13:11.524766  271327 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig: {Name:mk34e4a4e7b04f624b9adbda4f77ee20b38308ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:13:11.526353  271327 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
	I0630 21:13:11.533966  271327 api_server.go:165] Checking apiserver status ...
	I0630 21:13:11.534055  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:13:11.542772  271327 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:13:11.743200  271327 api_server.go:165] Checking apiserver status ...
	I0630 21:13:11.743292  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:13:11.752122  271327 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:13:11.943426  271327 api_server.go:165] Checking apiserver status ...
	I0630 21:13:11.943525  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:13:11.952325  271327 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:13:12.143391  271327 api_server.go:165] Checking apiserver status ...
	I0630 21:13:12.143459  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:13:12.152022  271327 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:13:12.343343  271327 api_server.go:165] Checking apiserver status ...
	I0630 21:13:12.343418  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:13:12.351771  271327 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:13:12.542984  271327 api_server.go:165] Checking apiserver status ...
	I0630 21:13:12.543070  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:13:12.551394  271327 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:13:12.743674  271327 api_server.go:165] Checking apiserver status ...
	I0630 21:13:12.743754  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:13:12.752328  271327 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:13:12.943661  271327 api_server.go:165] Checking apiserver status ...
	I0630 21:13:12.943743  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:13:12.952370  271327 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:13:13.143661  271327 api_server.go:165] Checking apiserver status ...
	I0630 21:13:13.143764  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:13:13.152169  271327 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:13:13.343351  271327 api_server.go:165] Checking apiserver status ...
	I0630 21:13:13.343449  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:13:13.351834  271327 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:13:13.543065  271327 api_server.go:165] Checking apiserver status ...
	I0630 21:13:13.543164  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:13:13.551421  271327 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:13:13.743766  271327 api_server.go:165] Checking apiserver status ...
	I0630 21:13:13.743846  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:13:13.752113  271327 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:13:13.943447  271327 api_server.go:165] Checking apiserver status ...
	I0630 21:13:13.943571  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:13:13.952255  271327 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:13:14.143533  271327 api_server.go:165] Checking apiserver status ...
	I0630 21:13:14.143631  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:13:14.152151  271327 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:13:14.343440  271327 api_server.go:165] Checking apiserver status ...
	I0630 21:13:14.343531  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:13:14.352323  271327 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:13:14.543945  271327 api_server.go:165] Checking apiserver status ...
	I0630 21:13:14.544019  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:13:14.553233  271327 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:13:14.553258  271327 api_server.go:165] Checking apiserver status ...
	I0630 21:13:14.553299  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:13:14.561647  271327 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:13:14.561683  271327 kubeadm.go:601] needs reconfigure: apiserver error: timed out waiting for the condition
	I0630 21:13:14.561693  271327 kubeadm.go:1092] stopping kube-system containers ...
	I0630 21:13:14.561708  271327 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name: Namespaces:[kube-system]}
	I0630 21:13:14.561815  271327 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0630 21:13:14.586984  271327 cri.go:87] found id: "c435aa6fdf138d684f721a5f1fb855163b020feb07c989254589c7e901b37b36"
	I0630 21:13:14.587017  271327 cri.go:87] found id: "27b91b4e1595400f52e6c0fd5fb8e3732c524b9757a79a5a9108333797eb3788"
	I0630 21:13:14.587024  271327 cri.go:87] found id: "998b774f4f284a1fcf3dbd179faaa8c69e39ab084d30662575ac04f0146604f3"
	I0630 21:13:14.587034  271327 cri.go:87] found id: "b8604fd1030fac170f4591063a20f1abfb86602e188695c1be545614d1b4e8a0"
	I0630 21:13:14.587040  271327 cri.go:87] found id: "fa267cd65f4eefef8993b275f8625ee5daf30304f18337e27a9944d1b5f03a02"
	I0630 21:13:14.587053  271327 cri.go:87] found id: "f60b30d7e822cbe35e12b31f9d3517de2de1004b26577e8f27750257f416aae1"
	I0630 21:13:14.587059  271327 cri.go:87] found id: ""
	I0630 21:13:14.587064  271327 cri.go:232] Stopping containers: [c435aa6fdf138d684f721a5f1fb855163b020feb07c989254589c7e901b37b36 27b91b4e1595400f52e6c0fd5fb8e3732c524b9757a79a5a9108333797eb3788 998b774f4f284a1fcf3dbd179faaa8c69e39ab084d30662575ac04f0146604f3 b8604fd1030fac170f4591063a20f1abfb86602e188695c1be545614d1b4e8a0 fa267cd65f4eefef8993b275f8625ee5daf30304f18337e27a9944d1b5f03a02 f60b30d7e822cbe35e12b31f9d3517de2de1004b26577e8f27750257f416aae1]
	I0630 21:13:14.587112  271327 ssh_runner.go:195] Run: which crictl
	I0630 21:13:14.590164  271327 ssh_runner.go:195] Run: sudo /usr/bin/crictl stop c435aa6fdf138d684f721a5f1fb855163b020feb07c989254589c7e901b37b36 27b91b4e1595400f52e6c0fd5fb8e3732c524b9757a79a5a9108333797eb3788 998b774f4f284a1fcf3dbd179faaa8c69e39ab084d30662575ac04f0146604f3 b8604fd1030fac170f4591063a20f1abfb86602e188695c1be545614d1b4e8a0 fa267cd65f4eefef8993b275f8625ee5daf30304f18337e27a9944d1b5f03a02 f60b30d7e822cbe35e12b31f9d3517de2de1004b26577e8f27750257f416aae1
	I0630 21:13:14.618090  271327 ssh_runner.go:195] Run: sudo systemctl stop kubelet
	I0630 21:13:14.628795  271327 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0630 21:13:14.636533  271327 kubeadm.go:155] found existing configuration files:
	-rw------- 1 root root 5743 Jun 30 21:00 /etc/kubernetes/admin.conf
	-rw------- 1 root root 5779 Jun 30 21:00 /etc/kubernetes/controller-manager.conf
	-rw------- 1 root root 5927 Jun 30 21:00 /etc/kubernetes/kubelet.conf
	-rw------- 1 root root 5731 Jun 30 21:00 /etc/kubernetes/scheduler.conf
	
	I0630 21:13:14.636601  271327 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
	I0630 21:13:14.644036  271327 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
	I0630 21:13:14.651486  271327 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
	I0630 21:13:14.658853  271327 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
	I0630 21:13:14.666211  271327 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0630 21:13:14.673925  271327 kubeadm.go:703] reconfiguring cluster from /var/tmp/minikube/kubeadm.yaml
	I0630 21:13:14.673958  271327 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:13:14.729593  271327 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:13:15.448255  271327 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:13:15.591389  271327 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:13:15.660482  271327 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:13:15.826815  271327 api_server.go:51] waiting for apiserver process to appear ...
	I0630 21:13:15.826889  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 21:13:16.336913  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 21:13:16.837002  271327 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 21:13:16.849966  271327 api_server.go:71] duration metric: took 1.023156233s to wait for apiserver process to appear ...
	I0630 21:13:16.849999  271327 api_server.go:87] waiting for apiserver healthz status ...
	I0630 21:13:16.850013  271327 api_server.go:240] Checking apiserver healthz at https://192.168.67.2:8443/healthz ...
	I0630 21:13:16.850373  271327 api_server.go:256] stopped: https://192.168.67.2:8443/healthz: Get "https://192.168.67.2:8443/healthz": dial tcp 192.168.67.2:8443: connect: connection refused
	I0630 21:13:17.351098  271327 api_server.go:240] Checking apiserver healthz at https://192.168.67.2:8443/healthz ...
	I0630 21:13:21.339028  271327 api_server.go:266] https://192.168.67.2:8443/healthz returned 403:
	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
	W0630 21:13:21.339123  271327 api_server.go:102] status: https://192.168.67.2:8443/healthz returned error 403:
	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
	I0630 21:13:21.351325  271327 api_server.go:240] Checking apiserver healthz at https://192.168.67.2:8443/healthz ...
	I0630 21:13:21.431449  271327 api_server.go:266] https://192.168.67.2:8443/healthz returned 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[-]poststarthook/bootstrap-controller failed: reason withheld
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[-]poststarthook/ca-registration failed: reason withheld
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-registration-controller ok
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	healthz check failed
	W0630 21:13:21.431549  271327 api_server.go:102] status: https://192.168.67.2:8443/healthz returned error 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[-]poststarthook/bootstrap-controller failed: reason withheld
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[-]poststarthook/ca-registration failed: reason withheld
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-registration-controller ok
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	healthz check failed
	I0630 21:13:21.850982  271327 api_server.go:240] Checking apiserver healthz at https://192.168.67.2:8443/healthz ...
	I0630 21:13:21.856550  271327 api_server.go:266] https://192.168.67.2:8443/healthz returned 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/bootstrap-controller ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[-]poststarthook/ca-registration failed: reason withheld
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-registration-controller ok
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	healthz check failed
	W0630 21:13:21.856585  271327 api_server.go:102] status: https://192.168.67.2:8443/healthz returned error 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/bootstrap-controller ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[-]poststarthook/ca-registration failed: reason withheld
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-registration-controller ok
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	healthz check failed
	I0630 21:13:22.350717  271327 api_server.go:240] Checking apiserver healthz at https://192.168.67.2:8443/healthz ...
	I0630 21:13:22.355970  271327 api_server.go:266] https://192.168.67.2:8443/healthz returned 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/bootstrap-controller ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
	[+]poststarthook/ca-registration ok
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-registration-controller ok
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	healthz check failed
	W0630 21:13:22.356001  271327 api_server.go:102] status: https://192.168.67.2:8443/healthz returned error 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/bootstrap-controller ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
	[+]poststarthook/ca-registration ok
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-registration-controller ok
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	healthz check failed
	I0630 21:13:22.850520  271327 api_server.go:240] Checking apiserver healthz at https://192.168.67.2:8443/healthz ...
	I0630 21:13:22.855972  271327 api_server.go:266] https://192.168.67.2:8443/healthz returned 200:
	ok
	I0630 21:13:22.862642  271327 api_server.go:140] control plane version: v1.16.0
	I0630 21:13:22.862666  271327 api_server.go:130] duration metric: took 6.012660599s to wait for apiserver health ...
	I0630 21:13:22.862677  271327 cni.go:95] Creating CNI manager for ""
	I0630 21:13:22.862685  271327 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:13:22.864875  271327 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0630 21:13:22.866242  271327 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0630 21:13:22.869873  271327 cni.go:189] applying CNI manifest using /var/lib/minikube/binaries/v1.16.0/kubectl ...
	I0630 21:13:22.869889  271327 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2429 bytes)
	I0630 21:13:22.883242  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0630 21:13:23.078089  271327 system_pods.go:43] waiting for kube-system pods to appear ...
	I0630 21:13:23.083797  271327 system_pods.go:59] 8 kube-system pods found
	I0630 21:13:23.083832  271327 system_pods.go:61] "coredns-5644d7b6d9-dw8lr" [ef9b1e7f-ea0b-4a1e-b228-2e673c514421] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.)
	I0630 21:13:23.083840  271327 system_pods.go:61] "etcd-old-k8s-version-20220630210005-9950" [78548814-926d-432e-ad9e-e7dc678dbd4d] Running
	I0630 21:13:23.083848  271327 system_pods.go:61] "kindnet-4gs84" [0eb5f5b6-6c40-401a-95c4-bef42040561c] Running / Ready:ContainersNotReady (containers with unready status: [kindnet-cni]) / ContainersReady:ContainersNotReady (containers with unready status: [kindnet-cni])
	I0630 21:13:23.083855  271327 system_pods.go:61] "kube-apiserver-old-k8s-version-20220630210005-9950" [7db23c99-fdec-4457-b812-8b86a9cdbccc] Running
	I0630 21:13:23.083864  271327 system_pods.go:61] "kube-controller-manager-old-k8s-version-20220630210005-9950" [25cb6398-c181-4dfe-84f6-549d2c40f00f] Running
	I0630 21:13:23.083870  271327 system_pods.go:61] "kube-proxy-twls5" [13daeab7-4a9e-4c35-bcc3-ca38e5008060] Running
	I0630 21:13:23.083878  271327 system_pods.go:61] "kube-scheduler-old-k8s-version-20220630210005-9950" [fcfe335c-050b-43c6-b6b4-7e4f3240a670] Running
	I0630 21:13:23.083891  271327 system_pods.go:61] "storage-provisioner" [c652b6dd-3559-4a3f-8df5-27cc49dc32ad] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.)
	I0630 21:13:23.083898  271327 system_pods.go:74] duration metric: took 5.785541ms to wait for pod list to return data ...
	I0630 21:13:23.083912  271327 node_conditions.go:102] verifying NodePressure condition ...
	I0630 21:13:23.086565  271327 node_conditions.go:122] node storage ephemeral capacity is 304695084Ki
	I0630 21:13:23.086591  271327 node_conditions.go:123] node cpu capacity is 8
	I0630 21:13:23.086605  271327 node_conditions.go:105] duration metric: took 2.688226ms to run NodePressure ...
	I0630 21:13:23.086625  271327 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:13:23.243037  271327 kubeadm.go:762] waiting for restarted kubelet to initialise ...
	I0630 21:13:23.246944  271327 retry.go:31] will retry after 360.127272ms: kubelet not initialised
	I0630 21:13:23.611248  271327 retry.go:31] will retry after 436.71002ms: kubelet not initialised
	I0630 21:13:24.052378  271327 retry.go:31] will retry after 527.46423ms: kubelet not initialised
	I0630 21:13:24.584328  271327 retry.go:31] will retry after 780.162888ms: kubelet not initialised
	I0630 21:13:25.369745  271327 retry.go:31] will retry after 1.502072952s: kubelet not initialised
	I0630 21:13:26.877712  271327 retry.go:31] will retry after 1.073826528s: kubelet not initialised
	I0630 21:13:27.955778  271327 retry.go:31] will retry after 1.869541159s: kubelet not initialised
	I0630 21:13:29.829511  271327 retry.go:31] will retry after 2.549945972s: kubelet not initialised
	I0630 21:13:32.383380  271327 retry.go:31] will retry after 5.131623747s: kubelet not initialised
	I0630 21:13:37.520989  271327 retry.go:31] will retry after 9.757045979s: kubelet not initialised
	I0630 21:13:47.284957  271327 retry.go:31] will retry after 18.937774914s: kubelet not initialised
	I0630 21:14:06.227195  271327 retry.go:31] will retry after 15.44552029s: kubelet not initialised
	I0630 21:14:21.677516  271327 kubeadm.go:777] kubelet initialised
	I0630 21:14:21.677540  271327 kubeadm.go:778] duration metric: took 58.434474358s waiting for restarted kubelet to initialise ...
	I0630 21:14:21.677546  271327 pod_ready.go:35] extra waiting up to 4m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0630 21:14:21.681711  271327 pod_ready.go:78] waiting up to 4m0s for pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace to be "Ready" ...
	I0630 21:14:23.686925  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:14:25.687296  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:14:28.187116  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:14:30.686599  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:14:32.687664  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:14:35.186731  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:14:37.187096  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:14:39.686682  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:14:41.686810  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:14:43.687704  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:14:46.186853  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:14:48.686897  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:14:50.687521  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:14:53.186988  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:14:55.686997  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:14:57.687195  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:14:59.687388  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:02.187439  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:04.686700  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:06.687056  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:08.687373  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:11.186627  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:13.186684  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:15.187150  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:17.187477  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:19.687214  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:22.187240  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:24.187424  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:26.687357  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:29.186785  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:31.187234  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:33.187604  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:35.687367  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:38.186782  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:40.187259  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:42.687520  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:45.186683  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:47.186761  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:49.187685  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:51.687221  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:54.186706  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:56.187242  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:15:58.687242  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:16:00.687294  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:16:02.687326  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:16:05.186772  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:16:07.187252  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:16:09.187423  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:16:11.687149  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:16:13.687259  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:16:16.187748  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:16:18.686407  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:16:20.687360  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:16:22.687865  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:16:25.187602  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:16:27.687369  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:16:30.186701  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:16:32.686836  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:16:35.187524  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:16:37.187615  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:16:39.686774  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:16:42.186839  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:16:44.187335  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:16:46.687424  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:16:48.687538  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:16:50.687885  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:16:53.186788  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:16:55.187448  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:16:57.687435  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:00.187349  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:02.686418  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:04.687385  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:07.187278  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:09.686662  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:11.687397  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:14.187575  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:16.686966  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:18.687594  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:21.187251  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:23.187322  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:25.686393  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:27.687277  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:30.187379  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:32.187457  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:34.687308  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:37.186708  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:39.187266  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:41.687415  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:44.187382  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:46.686460  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:48.687429  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:51.187093  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:53.686989  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:56.187543  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:58.687303  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:00.687467  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:03.187454  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:05.687327  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:07.687411  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:10.187617  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:12.686908  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:15.187574  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:17.686720  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:20.187057  271327 pod_ready.go:102] pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:00:44 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:21.683999  271327 pod_ready.go:81] duration metric: took 4m0.002237734s waiting for pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace to be "Ready" ...
	E0630 21:18:21.684032  271327 pod_ready.go:66] WaitExtra: waitPodCondition: timed out waiting 4m0s for pod "coredns-5644d7b6d9-dw8lr" in "kube-system" namespace to be "Ready" (will not retry!)
	I0630 21:18:21.684058  271327 pod_ready.go:38] duration metric: took 4m0.006502514s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0630 21:18:21.684091  271327 kubeadm.go:630] restartCluster took 5m10.168591345s
	W0630 21:18:21.684270  271327 out.go:239] ! Unable to restart cluster, will reset it: extra: timed out waiting 4m0s for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready"
	! Unable to restart cluster, will reset it: extra: timed out waiting 4m0s for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready"
	I0630 21:18:21.684307  271327 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm reset --cri-socket /run/containerd/containerd.sock --force"
	I0630 21:18:22.982137  271327 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm reset --cri-socket /run/containerd/containerd.sock --force": (1.297795627s)
	I0630 21:18:22.982220  271327 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 21:18:22.992216  271327 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0630 21:18:22.999444  271327 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver
	I0630 21:18:22.999505  271327 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0630 21:18:23.006620  271327 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0630 21:18:23.006669  271327 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0630 21:18:23.382034  271327 out.go:204]   - Generating certificates and keys ...
	I0630 21:18:24.453656  271327 out.go:204]   - Booting up control plane ...
	I0630 21:18:33.995591  271327 out.go:204]   - Configuring RBAC rules ...
	I0630 21:18:34.415334  271327 cni.go:95] Creating CNI manager for ""
	I0630 21:18:34.415359  271327 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:18:34.417145  271327 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0630 21:18:34.418585  271327 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0630 21:18:34.422112  271327 cni.go:189] applying CNI manifest using /var/lib/minikube/binaries/v1.16.0/kubectl ...
	I0630 21:18:34.422134  271327 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2429 bytes)
	I0630 21:18:34.435402  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0630 21:18:34.646160  271327 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0630 21:18:34.646255  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:34.646257  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl label nodes minikube.k8s.io/version=v1.26.0 minikube.k8s.io/commit=251ffcec0e4c997cd7732864187747cc579943c9 minikube.k8s.io/name=old-k8s-version-20220630210005-9950 minikube.k8s.io/updated_at=2022_06_30T21_18_34_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:34.759440  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:34.766243  271327 ops.go:34] apiserver oom_adj: -16
	I0630 21:18:35.357818  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:35.858238  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:36.358268  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:36.857690  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:37.357705  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:37.858150  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:38.358096  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:38.858275  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:39.357688  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:39.858283  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:40.358258  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:40.858225  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:41.357655  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:41.857721  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:42.358090  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:42.857766  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:43.357530  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:43.857798  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:44.357917  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:44.858250  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:45.358264  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:45.858251  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:46.358237  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:46.857708  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:47.358260  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:47.858095  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:48.358247  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:48.858229  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:49.357794  271327 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:18:49.546778  271327 kubeadm.go:1045] duration metric: took 14.900577693s to wait for elevateKubeSystemPrivileges.
	I0630 21:18:49.546811  271327 kubeadm.go:397] StartCluster complete in 5m38.076732902s
	I0630 21:18:49.546833  271327 settings.go:142] acquiring lock: {Name:mkcbd229caa05b60d3551ef0b47eea08424c9b5d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:18:49.546946  271327 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:18:49.548969  271327 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig: {Name:mk34e4a4e7b04f624b9adbda4f77ee20b38308ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:18:50.068438  271327 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "old-k8s-version-20220630210005-9950" rescaled to 1
	I0630 21:18:50.068510  271327 start.go:208] Will wait 6m0s for node &{Name: IP:192.168.67.2 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0630 21:18:50.070683  271327 out.go:177] * Verifying Kubernetes components...
	I0630 21:18:50.068547  271327 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0630 21:18:50.068572  271327 addons.go:412] enableAddons start: toEnable=map[dashboard:true metrics-server:true], additional=[]
	I0630 21:18:50.068725  271327 config.go:178] Loaded profile config "old-k8s-version-20220630210005-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.16.0
	I0630 21:18:50.072305  271327 addons.go:65] Setting default-storageclass=true in profile "old-k8s-version-20220630210005-9950"
	I0630 21:18:50.072321  271327 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 21:18:50.072329  271327 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-20220630210005-9950"
	I0630 21:18:50.072306  271327 addons.go:65] Setting storage-provisioner=true in profile "old-k8s-version-20220630210005-9950"
	I0630 21:18:50.072355  271327 addons.go:65] Setting metrics-server=true in profile "old-k8s-version-20220630210005-9950"
	I0630 21:18:50.072354  271327 addons.go:65] Setting dashboard=true in profile "old-k8s-version-20220630210005-9950"
	I0630 21:18:50.072405  271327 addons.go:153] Setting addon metrics-server=true in "old-k8s-version-20220630210005-9950"
	I0630 21:18:50.072399  271327 addons.go:153] Setting addon storage-provisioner=true in "old-k8s-version-20220630210005-9950"
	W0630 21:18:50.072417  271327 addons.go:162] addon metrics-server should already be in state true
	W0630 21:18:50.072421  271327 addons.go:162] addon storage-provisioner should already be in state true
	I0630 21:18:50.072432  271327 addons.go:153] Setting addon dashboard=true in "old-k8s-version-20220630210005-9950"
	W0630 21:18:50.072449  271327 addons.go:162] addon dashboard should already be in state true
	I0630 21:18:50.072481  271327 host.go:66] Checking if "old-k8s-version-20220630210005-9950" exists ...
	I0630 21:18:50.072489  271327 host.go:66] Checking if "old-k8s-version-20220630210005-9950" exists ...
	I0630 21:18:50.072512  271327 host.go:66] Checking if "old-k8s-version-20220630210005-9950" exists ...
	I0630 21:18:50.072678  271327 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220630210005-9950 --format={{.State.Status}}
	I0630 21:18:50.072921  271327 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220630210005-9950 --format={{.State.Status}}
	I0630 21:18:50.073004  271327 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220630210005-9950 --format={{.State.Status}}
	I0630 21:18:50.073005  271327 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220630210005-9950 --format={{.State.Status}}
	I0630 21:18:50.122946  271327 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0630 21:18:50.124681  271327 addons.go:345] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 21:18:50.124711  271327 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0630 21:18:50.124768  271327 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220630210005-9950
	I0630 21:18:50.124685  271327 out.go:177]   - Using image kubernetesui/dashboard:v2.6.0
	I0630 21:18:50.126299  271327 out.go:177]   - Using image k8s.gcr.io/echoserver:1.4
	I0630 21:18:50.127661  271327 addons.go:345] installing /etc/kubernetes/addons/dashboard-ns.yaml
	I0630 21:18:50.127684  271327 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
	I0630 21:18:50.127695  271327 addons.go:153] Setting addon default-storageclass=true in "old-k8s-version-20220630210005-9950"
	W0630 21:18:50.127710  271327 addons.go:162] addon default-storageclass should already be in state true
	I0630 21:18:50.127744  271327 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220630210005-9950
	I0630 21:18:50.127789  271327 host.go:66] Checking if "old-k8s-version-20220630210005-9950" exists ...
	I0630 21:18:50.128250  271327 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220630210005-9950 --format={{.State.Status}}
	I0630 21:18:50.130021  271327 out.go:177]   - Using image fake.domain/k8s.gcr.io/echoserver:1.4
	I0630 21:18:50.131423  271327 addons.go:345] installing /etc/kubernetes/addons/metrics-apiservice.yaml
	I0630 21:18:50.131451  271327 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
	I0630 21:18:50.131510  271327 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220630210005-9950
	I0630 21:18:50.174874  271327 addons.go:345] installing /etc/kubernetes/addons/storageclass.yaml
	I0630 21:18:50.174898  271327 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0630 21:18:50.174953  271327 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220630210005-9950
	I0630 21:18:50.175467  271327 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49432 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/old-k8s-version-20220630210005-9950/id_rsa Username:docker}
	I0630 21:18:50.176273  271327 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-20220630210005-9950" to be "Ready" ...
	I0630 21:18:50.176312  271327 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.67.1 host.minikube.internal\n           fallthrough\n        }' | sudo /var/lib/minikube/binaries/v1.16.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0630 21:18:50.179407  271327 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49432 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/old-k8s-version-20220630210005-9950/id_rsa Username:docker}
	I0630 21:18:50.192160  271327 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49432 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/old-k8s-version-20220630210005-9950/id_rsa Username:docker}
	I0630 21:18:50.219445  271327 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49432 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/old-k8s-version-20220630210005-9950/id_rsa Username:docker}
	I0630 21:18:50.340138  271327 addons.go:345] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
	I0630 21:18:50.340167  271327 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
	I0630 21:18:50.342249  271327 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.16.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 21:18:50.345605  271327 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.16.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0630 21:18:50.346238  271327 addons.go:345] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
	I0630 21:18:50.346271  271327 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1820 bytes)
	I0630 21:18:50.427910  271327 addons.go:345] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
	I0630 21:18:50.427939  271327 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
	I0630 21:18:50.428864  271327 addons.go:345] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
	I0630 21:18:50.428889  271327 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
	I0630 21:18:50.445609  271327 addons.go:345] installing /etc/kubernetes/addons/metrics-server-service.yaml
	I0630 21:18:50.445642  271327 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
	I0630 21:18:50.445878  271327 addons.go:345] installing /etc/kubernetes/addons/dashboard-configmap.yaml
	I0630 21:18:50.445901  271327 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
	I0630 21:18:50.526468  271327 addons.go:345] installing /etc/kubernetes/addons/dashboard-dp.yaml
	I0630 21:18:50.526498  271327 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4196 bytes)
	I0630 21:18:50.527802  271327 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.16.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I0630 21:18:50.545627  271327 addons.go:345] installing /etc/kubernetes/addons/dashboard-role.yaml
	I0630 21:18:50.545659  271327 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
	I0630 21:18:50.635021  271327 addons.go:345] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
	I0630 21:18:50.635050  271327 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
	I0630 21:18:50.642890  271327 start.go:806] {"host.minikube.internal": 192.168.67.1} host record injected into CoreDNS
	I0630 21:18:50.724734  271327 addons.go:345] installing /etc/kubernetes/addons/dashboard-sa.yaml
	I0630 21:18:50.724764  271327 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
	I0630 21:18:50.739030  271327 addons.go:345] installing /etc/kubernetes/addons/dashboard-secret.yaml
	I0630 21:18:50.739055  271327 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
	I0630 21:18:50.759486  271327 addons.go:345] installing /etc/kubernetes/addons/dashboard-svc.yaml
	I0630 21:18:50.759516  271327 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
	I0630 21:18:50.832116  271327 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.16.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	I0630 21:18:51.330111  271327 addons.go:383] Verifying addon metrics-server=true in "old-k8s-version-20220630210005-9950"
	I0630 21:18:51.650538  271327 out.go:177] * Enabled addons: default-storageclass, storage-provisioner, metrics-server, dashboard
	I0630 21:18:51.652184  271327 addons.go:414] enableAddons completed in 1.583616991s
	I0630 21:18:52.183124  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:18:54.682470  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:18:56.682550  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:18:58.682784  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:19:01.182368  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:19:03.182653  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:19:05.682177  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:19:07.682617  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:19:10.182307  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:19:12.182785  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:19:14.682663  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:19:16.683157  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:19:19.182264  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:19:21.182311  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:19:23.682308  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:19:25.682442  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:19:28.182873  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:19:30.183093  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:19:32.683019  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:19:35.182952  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:19:37.682858  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:19:40.182119  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:19:42.182774  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:19:44.682858  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:19:47.182683  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:19:49.182922  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:19:51.681971  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:19:53.683115  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:19:56.182957  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:19:58.682586  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:01.182137  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:03.183061  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:05.682082  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:07.682788  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:10.182344  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:12.182594  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:14.682680  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:17.182245  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:19.182817  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:21.682805  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:24.182683  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:26.183141  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:28.683133  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:30.683577  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:33.182578  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:35.182728  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:37.682510  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:39.683375  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:42.182068  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:44.183054  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:46.683087  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:49.183229  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:51.682409  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:53.682570  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:55.682710  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:58.182130  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:00.182447  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:02.182840  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:04.182886  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:06.682224  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:08.682691  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:11.182893  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:13.182991  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:15.682251  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:17.683152  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:20.183474  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:22.682948  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:25.181883  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:27.183120  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:29.682587  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:31.682697  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:33.683054  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:36.183245  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:38.681927  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:40.682196  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:42.682640  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:45.182445  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:47.682514  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:50.182451  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:52.183083  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:54.683102  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:57.182501  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:59.182957  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:01.183043  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:03.682640  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:05.682843  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:08.182414  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:10.682414  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:12.682830  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:15.183230  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:17.681937  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:19.682685  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:22.182341  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:24.682559  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:26.682712  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:28.682765  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:31.182114  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:33.182667  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:35.682410  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:37.682440  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:39.682506  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:42.182441  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:44.182613  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:46.182890  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:48.682065  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:50.184705  271327 node_ready.go:38] duration metric: took 4m0.008399385s waiting for node "old-k8s-version-20220630210005-9950" to be "Ready" ...
	I0630 21:22:50.186899  271327 out.go:177] 
	W0630 21:22:50.188676  271327 out.go:239] X Exiting due to GUEST_START: wait 6m0s for node: waiting for node to be ready: waitNodeCondition: timed out waiting for the condition
	X Exiting due to GUEST_START: wait 6m0s for node: waiting for node to be ready: waitNodeCondition: timed out waiting for the condition
	W0630 21:22:50.188714  271327 out.go:239] * 
	* 
	W0630 21:22:50.189487  271327 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0630 21:22:50.191389  271327 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-linux-amd64 start -p old-k8s-version-20220630210005-9950 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.16.0": exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect old-k8s-version-20220630210005-9950
helpers_test.go:235: (dbg) docker inspect old-k8s-version-20220630210005-9950:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "1b84433fb68bbf2bd151038738e402e5c525e45c0c466b954c0a2fc61a335d66",
	        "Created": "2022-06-30T21:00:13.927977074Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 271627,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2022-06-30T21:12:55.219965216Z",
	            "FinishedAt": "2022-06-30T21:12:53.417533807Z"
	        },
	        "Image": "sha256:573e7be5768273a7845baee1ae90fa2e33b83b10a7fbb0f0f41efbf29b53d1f1",
	        "ResolvConfPath": "/var/lib/docker/containers/1b84433fb68bbf2bd151038738e402e5c525e45c0c466b954c0a2fc61a335d66/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/1b84433fb68bbf2bd151038738e402e5c525e45c0c466b954c0a2fc61a335d66/hostname",
	        "HostsPath": "/var/lib/docker/containers/1b84433fb68bbf2bd151038738e402e5c525e45c0c466b954c0a2fc61a335d66/hosts",
	        "LogPath": "/var/lib/docker/containers/1b84433fb68bbf2bd151038738e402e5c525e45c0c466b954c0a2fc61a335d66/1b84433fb68bbf2bd151038738e402e5c525e45c0c466b954c0a2fc61a335d66-json.log",
	        "Name": "/old-k8s-version-20220630210005-9950",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "old-k8s-version-20220630210005-9950:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "old-k8s-version-20220630210005-9950",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 2306867200,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": null,
	            "BlkioDeviceWriteBps": null,
	            "BlkioDeviceReadIOps": null,
	            "BlkioDeviceWriteIOps": null,
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "KernelMemory": 0,
	            "KernelMemoryTCP": 0,
	            "MemoryReservation": 0,
	            "MemorySwap": 4613734400,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": null,
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/d94571e47e569545ea7c101defd143650d23877c940361aa1535ed742bae26c1-init/diff:/var/lib/docker/overlay2/8b88d9f6f12c48be642a133456203e58549a93f1da67d0349744bd0f78917fba/diff:/var/lib/docker/overlay2/2bcbb3b4718a64188802301a25d7f413bb307cb16d077e7e5af799f9152a2970/diff:/var/lib/docker/overlay2/70b0888bf22fcef1c004704b71288ac581cf26a3b3b19fbca3da296ba10d6978/diff:/var/lib/docker/overlay2/7c5332f38fe652f379ef9b6d23e795158e9994317cfb547b581dd2b1fdf1303b/diff:/var/lib/docker/overlay2/0ddb5a3abf433b644a8bfa124e3c87878eed67878faa35493f2befc2b392e9cb/diff:/var/lib/docker/overlay2/3b7cda5fb0232fdeecbec0531ac704a59eb38fe57664c25777193b07e2df0077/diff:/var/lib/docker/overlay2/a14687ada786c65465b9924ae2d77ba27afc07942851cafaade28e80dfe9da16/diff:/var/lib/docker/overlay2/c49a9b7157aa6e8714e192b2849866d035b59e18de462c0ee9b72f898cc5a485/diff:/var/lib/docker/overlay2/efd71a50e3a1044a6d1c4c1a7d4d91d9f070c066e03e51c6c73a5764b778ad72/diff:/var/lib/docker/overlay2/55476a
1c0a20aa4238a0bb0e43c6402c33dcad312938ad48ee81be0160e12a49/diff:/var/lib/docker/overlay2/c48c4a348a797b9a38f01568a6adbcb4b05b4f56f7b986a4bf1b509d8cb00732/diff:/var/lib/docker/overlay2/568e3f354ab0428de5cf82d1fdfb780c3377f5cc55d9f524731c53e39e0ecae7/diff:/var/lib/docker/overlay2/2857943e320cdcdae9af3d8c2acda1fb61e2f142a88b8b902908071cea67816e/diff:/var/lib/docker/overlay2/bdd9a57f0b65e65c5a16395f239425e794c678b0e8db2f4a368e0a9427fe5116/diff:/var/lib/docker/overlay2/b150183f1b73e8c13c751911bcee09fed8ef973478f4dc3cfdb9e509118bf1ea/diff:/var/lib/docker/overlay2/0a053e7c29417cd6feafb351c7944e81342a52898871bc779f7bf61868c78ec4/diff:/var/lib/docker/overlay2/d3c0de3a44d75d0a05acb7843d53deba5ce0457649d6ed757da9b4c532a81e4f/diff:/var/lib/docker/overlay2/53f6170132880e1697dd802b8577382b31c6f1ba144256f8cc62542998842a6b/diff:/var/lib/docker/overlay2/b5c0be6d8efdb1fcb12e73b8f72853f77baa4bc014ac2c1e28b7b972b07f3325/diff:/var/lib/docker/overlay2/36c908f082a1e5388bb25277f1c957eaecf70fcd958080422fa85a3105724fb2/diff:/var/lib/d
ocker/overlay2/b147fe9dce365cfaf9bfeca2e370829e4d87e2671c133a9836ecb02a85422cc7/diff:/var/lib/docker/overlay2/65f488eb9181a721f01b333f5fa0cb91d216abd7842a9ae193bd95316f378721/diff:/var/lib/docker/overlay2/b04269aa247b68912ddc5b1c98ad55d67af4103f576a900eef4069c196b8a263/diff:/var/lib/docker/overlay2/b714c37e15257ae9d0e15d271dd18a330c38ad765901d9b7e7e3feb73e1b03e4/diff:/var/lib/docker/overlay2/3c253b721193edeaade7bba7ce25ff687c889b8fa86e9489c7ee20d5624e6c5b/diff:/var/lib/docker/overlay2/7f67b74e101fa21dd320393c10576eefa4ce1cec2e210bff405784fa45b360f3/diff:/var/lib/docker/overlay2/c3b2adaa63a06a5e6ed966d7b6f20a757aeadd3f25eb09ef3c7e9a66a8904143/diff:/var/lib/docker/overlay2/ddb5d653d19e8cafc4625a8fe9597667d98b277a7f679e532ad84caa2c6da636/diff:/var/lib/docker/overlay2/03eb172b20323ebeee7cb09025726a6e10de6c3dd8661f4f6bbc5a3a3778bad4/diff:/var/lib/docker/overlay2/80ea9bf34d028e95a8a418b3aeb634be72ab3336448946d7855c51ffdf8258d7/diff:/var/lib/docker/overlay2/e28987ea3fb4d431dee111f38cc76814b85f73e86434be3c463c01fdd59
9ad46/diff:/var/lib/docker/overlay2/6f9a46c7c6cf4fd30ce32a1eb08ed9b1e8dd61cb0e42ce54f0f736f06558c306/diff:/var/lib/docker/overlay2/6fc942eb9ccfc09898edc9a5ef3b3d305a6fcb22e8cefb1a9f9c344d10b59b25/diff:/var/lib/docker/overlay2/f6b8c57540e798dc1dfd51fd29c020193c02a4362f31c6d07aa220327bb07b90/diff:/var/lib/docker/overlay2/85d0aa01a3fab8c77262c59d8a7b0809a72673a3da7d33e4e19c04a66db44a11/diff:/var/lib/docker/overlay2/58dcd81a1605641f785ced5aeb38657eec1f02a31b7adfaf4f6fdd49f4bab1d6/diff:/var/lib/docker/overlay2/9d537e0a65325e4bf85b26da9828002339f5c442ca85f931b340457a80ec8c94/diff:/var/lib/docker/overlay2/a6f73707ee6a74e948a02d03c4a3f12b57c2eb408dc67da3c39961bb3cefcc97/diff:/var/lib/docker/overlay2/922526c310b066dbb73b9a106eef8bf0064ad7907a8d7d7b353f5307a17a4901/diff:/var/lib/docker/overlay2/a4185854870ebf8d34a4c7e1827dbe3bc461559839301ffb23c5efff5e3c9f14/diff:/var/lib/docker/overlay2/8c02b1fcb9d79f5d7b2ee4d44f6625a692c44a0d18df0a5c01cac0cca0fdf3f3/diff",
	                "MergedDir": "/var/lib/docker/overlay2/d94571e47e569545ea7c101defd143650d23877c940361aa1535ed742bae26c1/merged",
	                "UpperDir": "/var/lib/docker/overlay2/d94571e47e569545ea7c101defd143650d23877c940361aa1535ed742bae26c1/diff",
	                "WorkDir": "/var/lib/docker/overlay2/d94571e47e569545ea7c101defd143650d23877c940361aa1535ed742bae26c1/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "old-k8s-version-20220630210005-9950",
	                "Source": "/var/lib/docker/volumes/old-k8s-version-20220630210005-9950/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "old-k8s-version-20220630210005-9950",
	            "Domainname": "",
	            "User": "root",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e",
	            "Volumes": null,
	            "WorkingDir": "",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "old-k8s-version-20220630210005-9950",
	                "name.minikube.sigs.k8s.io": "old-k8s-version-20220630210005-9950",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "3168ec840ced61e1ecbfc232a8d546bc9db5e4512ce831c13fbe45d1185d859b",
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49432"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49431"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49428"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49430"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49429"
	                    }
	                ]
	            },
	            "SandboxKey": "/var/run/docker/netns/3168ec840ced",
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "old-k8s-version-20220630210005-9950": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.67.2"
	                    },
	                    "Links": null,
	                    "Aliases": [
	                        "1b84433fb68b",
	                        "old-k8s-version-20220630210005-9950"
	                    ],
	                    "NetworkID": "2a33e496d49b578848c27ed72b0172cf6807dc7dbeec46561e901ef8145b93e7",
	                    "EndpointID": "e5ab3ea931a0687d4c2a11a5ee4ff0354548b1e6cef7dae6a9bdd8c529446748",
	                    "Gateway": "192.168.67.1",
	                    "IPAddress": "192.168.67.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "MacAddress": "02:42:c0:a8:43:02",
	                    "DriverOpts": null
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-20220630210005-9950 -n old-k8s-version-20220630210005-9950
helpers_test.go:244: <<< TestStartStop/group/old-k8s-version/serial/SecondStart FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======>  post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: minikube logs <======
helpers_test.go:247: (dbg) Run:  out/minikube-linux-amd64 -p old-k8s-version-20220630210005-9950 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-amd64 -p old-k8s-version-20220630210005-9950 logs -n 25: (1.0783403s)
helpers_test.go:252: TestStartStop/group/old-k8s-version/serial/SecondStart logs: 
-- stdout --
	* 
	* ==> Audit <==
	* |---------|------------------------------------------------------------|----------|---------|---------|---------------------|---------------------|
	| Command |                            Args                            | Profile  |  User   | Version |     Start Time      |      End Time       |
	|---------|------------------------------------------------------------|----------|---------|---------|---------------------|---------------------|
	| start   | -p newest-cni-20220630210514-9950 --memory=2200            | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | --alsologtostderr --wait=apiserver,system_pods,default_sa  |          |         |         |                     |                     |
	|         | --feature-gates ServerSideApply=true --network-plugin=cni  |          |         |         |                     |                     |
	|         | --extra-config=kubeadm.pod-network-cidr=192.168.111.111/16 |          |         |         |                     |                     |
	|         | --driver=docker  --container-runtime=containerd            |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                               |          |         |         |                     |                     |
	| ssh     | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | sudo crictl images -o json                                 |          |         |         |                     |                     |
	| pause   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                     |          |         |         |                     |                     |
	| unpause | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                     |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | disable-driver-mounts-20220630210659-9950                  |          |         |         |                     |                     |
	| start   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC |                     |
	|         | embed-certs-20220630210659-9950                            |          |         |         |                     |                     |
	|         | --memory=2200 --alsologtostderr                            |          |         |         |                     |                     |
	|         | --wait=true --embed-certs                                  |          |         |         |                     |                     |
	|         | --driver=docker                                            |          |         |         |                     |                     |
	|         | --container-runtime=containerd                             |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                               |          |         |         |                     |                     |
	| ssh     | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|         | sudo crictl images -o json                                 |          |         |         |                     |                     |
	| pause   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                     |          |         |         |                     |                     |
	| unpause | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                     |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	| addons  | enable metrics-server -p                                   | minikube | jenkins | v1.26.0 | 30 Jun 22 21:12 UTC | 30 Jun 22 21:12 UTC |
	|         | old-k8s-version-20220630210005-9950                        |          |         |         |                     |                     |
	|         | --images=MetricsServer=k8s.gcr.io/echoserver:1.4           |          |         |         |                     |                     |
	|         | --registries=MetricsServer=fake.domain                     |          |         |         |                     |                     |
	| stop    | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:12 UTC | 30 Jun 22 21:12 UTC |
	|         | old-k8s-version-20220630210005-9950                        |          |         |         |                     |                     |
	|         | --alsologtostderr -v=3                                     |          |         |         |                     |                     |
	| addons  | enable dashboard -p                                        | minikube | jenkins | v1.26.0 | 30 Jun 22 21:12 UTC | 30 Jun 22 21:12 UTC |
	|         | old-k8s-version-20220630210005-9950                        |          |         |         |                     |                     |
	|         | --images=MetricsScraper=k8s.gcr.io/echoserver:1.4          |          |         |         |                     |                     |
	| start   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:12 UTC |                     |
	|         | old-k8s-version-20220630210005-9950                        |          |         |         |                     |                     |
	|         | --memory=2200 --alsologtostderr                            |          |         |         |                     |                     |
	|         | --wait=true --kvm-network=default                          |          |         |         |                     |                     |
	|         | --kvm-qemu-uri=qemu:///system                              |          |         |         |                     |                     |
	|         | --disable-driver-mounts                                    |          |         |         |                     |                     |
	|         | --keep-context=false                                       |          |         |         |                     |                     |
	|         | --driver=docker                                            |          |         |         |                     |                     |
	|         | --container-runtime=containerd                             |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.16.0                               |          |         |         |                     |                     |
	| addons  | enable metrics-server -p                                   | minikube | jenkins | v1.26.0 | 30 Jun 22 21:16 UTC | 30 Jun 22 21:16 UTC |
	|         | default-k8s-different-port-20220630210335-9950             |          |         |         |                     |                     |
	|         | --images=MetricsServer=k8s.gcr.io/echoserver:1.4           |          |         |         |                     |                     |
	|         | --registries=MetricsServer=fake.domain                     |          |         |         |                     |                     |
	| stop    | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:16 UTC | 30 Jun 22 21:16 UTC |
	|         | default-k8s-different-port-20220630210335-9950             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=3                                     |          |         |         |                     |                     |
	| addons  | enable dashboard -p                                        | minikube | jenkins | v1.26.0 | 30 Jun 22 21:16 UTC | 30 Jun 22 21:16 UTC |
	|         | default-k8s-different-port-20220630210335-9950             |          |         |         |                     |                     |
	|         | --images=MetricsScraper=k8s.gcr.io/echoserver:1.4          |          |         |         |                     |                     |
	| start   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:16 UTC |                     |
	|         | default-k8s-different-port-20220630210335-9950             |          |         |         |                     |                     |
	|         | --memory=2200 --alsologtostderr --wait=true                |          |         |         |                     |                     |
	|         | --apiserver-port=8444 --driver=docker                      |          |         |         |                     |                     |
	|         |  --container-runtime=containerd                            |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                               |          |         |         |                     |                     |
	| addons  | enable metrics-server -p                                   | minikube | jenkins | v1.26.0 | 30 Jun 22 21:19 UTC | 30 Jun 22 21:19 UTC |
	|         | embed-certs-20220630210659-9950                            |          |         |         |                     |                     |
	|         | --images=MetricsServer=k8s.gcr.io/echoserver:1.4           |          |         |         |                     |                     |
	|         | --registries=MetricsServer=fake.domain                     |          |         |         |                     |                     |
	| stop    | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:19 UTC | 30 Jun 22 21:20 UTC |
	|         | embed-certs-20220630210659-9950                            |          |         |         |                     |                     |
	|         | --alsologtostderr -v=3                                     |          |         |         |                     |                     |
	| addons  | enable dashboard -p                                        | minikube | jenkins | v1.26.0 | 30 Jun 22 21:20 UTC | 30 Jun 22 21:20 UTC |
	|         | embed-certs-20220630210659-9950                            |          |         |         |                     |                     |
	|         | --images=MetricsScraper=k8s.gcr.io/echoserver:1.4          |          |         |         |                     |                     |
	| start   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:20 UTC |                     |
	|         | embed-certs-20220630210659-9950                            |          |         |         |                     |                     |
	|         | --memory=2200 --alsologtostderr                            |          |         |         |                     |                     |
	|         | --wait=true --embed-certs                                  |          |         |         |                     |                     |
	|         | --driver=docker                                            |          |         |         |                     |                     |
	|         | --container-runtime=containerd                             |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                               |          |         |         |                     |                     |
	|---------|------------------------------------------------------------|----------|---------|---------|---------------------|---------------------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2022/06/30 21:20:03
	Running on machine: ubuntu-20-agent-8
	Binary: Built with gc go1.18.3 for linux/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0630 21:20:03.147328  282690 out.go:296] Setting OutFile to fd 1 ...
	I0630 21:20:03.147439  282690 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 21:20:03.147448  282690 out.go:309] Setting ErrFile to fd 2...
	I0630 21:20:03.147453  282690 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 21:20:03.147898  282690 root.go:329] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/bin
	I0630 21:20:03.148141  282690 out.go:303] Setting JSON to false
	I0630 21:20:03.149531  282690 start.go:115] hostinfo: {"hostname":"ubuntu-20-agent-8","uptime":3755,"bootTime":1656620248,"procs":452,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1012-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0630 21:20:03.149604  282690 start.go:125] virtualization: kvm guest
	I0630 21:20:03.152275  282690 out.go:177] * [embed-certs-20220630210659-9950] minikube v1.26.0 on Ubuntu 20.04 (kvm/amd64)
	I0630 21:20:03.154290  282690 notify.go:193] Checking for updates...
	I0630 21:20:03.154307  282690 out.go:177]   - MINIKUBE_LOCATION=14420
	I0630 21:20:03.156071  282690 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0630 21:20:03.157769  282690 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:20:03.159343  282690 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube
	I0630 21:20:03.160888  282690 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0630 21:20:03.163346  282690 config.go:178] Loaded profile config "embed-certs-20220630210659-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:20:03.163802  282690 driver.go:360] Setting default libvirt URI to qemu:///system
	I0630 21:20:03.205706  282690 docker.go:137] docker version: linux-20.10.17
	I0630 21:20:03.205824  282690 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0630 21:20:03.318551  282690 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:8 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:43 OomKillDisable:true NGoroutines:44 SystemTime:2022-06-30 21:20:03.238323982 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1012-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexServ
erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662451712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-8 Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Client
Info:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
	I0630 21:20:03.318677  282690 docker.go:254] overlay module found
	I0630 21:20:03.322599  282690 out.go:177] * Using the docker driver based on existing profile
	I0630 21:20:03.324114  282690 start.go:284] selected driver: docker
	I0630 21:20:03.324129  282690 start.go:808] validating driver "docker" against &{Name:embed-certs-20220630210659-9950 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:embed-certs-20220630210659-9950 Namespace:d
efault APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[Dashboard:kubernetesui/dashboard:v2.6.0@sha256:4af9580485920635d888efe1eddbd67e12f9d5d84dba87100e93feb4e46636b3 MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddres
s: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 21:20:03.324222  282690 start.go:819] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0630 21:20:03.325145  282690 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0630 21:20:03.438547  282690 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:8 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:43 OomKillDisable:true NGoroutines:44 SystemTime:2022-06-30 21:20:03.358172615 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1012-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexServ
erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662451712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-8 Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Client
Info:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
	I0630 21:20:03.438832  282690 start_flags.go:853] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0630 21:20:03.438854  282690 cni.go:95] Creating CNI manager for ""
	I0630 21:20:03.438863  282690 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:20:03.438877  282690 start_flags.go:310] config:
	{Name:embed-certs-20220630210659-9950 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:embed-certs-20220630210659-9950 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:clus
ter.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[Dashboard:kubernetesui/dashboard:v2.6.0@sha256:4af9580485920635d888efe1eddbd67e12f9d5d84dba87100e93feb4e46636b3 MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0
m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 21:20:03.442075  282690 out.go:177] * Starting control plane node embed-certs-20220630210659-9950 in cluster embed-certs-20220630210659-9950
	I0630 21:20:03.443525  282690 cache.go:120] Beginning downloading kic base image for docker with containerd
	I0630 21:20:03.445355  282690 out.go:177] * Pulling base image ...
	I0630 21:20:03.446826  282690 preload.go:132] Checking if preload exists for k8s version v1.24.2 and runtime containerd
	I0630 21:20:03.446872  282690 preload.go:148] Found local preload: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-containerd-overlay2-amd64.tar.lz4
	I0630 21:20:03.446895  282690 cache.go:57] Caching tarball of preloaded images
	I0630 21:20:03.446927  282690 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e in local docker daemon
	I0630 21:20:03.447161  282690 preload.go:174] Found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-containerd-overlay2-amd64.tar.lz4 in cache, skipping download
	I0630 21:20:03.447178  282690 cache.go:60] Finished verifying existence of preloaded tar for  v1.24.2 on containerd
	I0630 21:20:03.447328  282690 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/config.json ...
	I0630 21:20:03.484347  282690 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e in local docker daemon, skipping pull
	I0630 21:20:03.484373  282690 cache.go:142] gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e exists in daemon, skipping load
	I0630 21:20:03.484390  282690 cache.go:208] Successfully downloaded all kic artifacts
	I0630 21:20:03.484431  282690 start.go:352] acquiring machines lock for embed-certs-20220630210659-9950: {Name:mk6619dbb09b46cdd2b244e5bf2112b3274a30ef Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0630 21:20:03.484542  282690 start.go:356] acquired machines lock for "embed-certs-20220630210659-9950" in 89.652µs
	I0630 21:20:03.484563  282690 start.go:94] Skipping create...Using existing machine configuration
	I0630 21:20:03.484568  282690 fix.go:55] fixHost starting: 
	I0630 21:20:03.484786  282690 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:20:03.518786  282690 fix.go:103] recreateIfNeeded on embed-certs-20220630210659-9950: state=Stopped err=<nil>
	W0630 21:20:03.518832  282690 fix.go:129] unexpected machine state, will restart: <nil>
	I0630 21:20:03.522271  282690 out.go:177] * Restarting existing docker container for "embed-certs-20220630210659-9950" ...
	I0630 21:20:01.182137  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:03.183061  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:02.393449  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:04.893746  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:03.523749  282690 cli_runner.go:164] Run: docker start embed-certs-20220630210659-9950
	I0630 21:20:03.930910  282690 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:20:03.968503  282690 kic.go:416] container "embed-certs-20220630210659-9950" state is running.
	I0630 21:20:03.968961  282690 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-20220630210659-9950
	I0630 21:20:04.005032  282690 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/config.json ...
	I0630 21:20:04.005301  282690 machine.go:88] provisioning docker machine ...
	I0630 21:20:04.005330  282690 ubuntu.go:169] provisioning hostname "embed-certs-20220630210659-9950"
	I0630 21:20:04.005375  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:20:04.043967  282690 main.go:134] libmachine: Using SSH client type: native
	I0630 21:20:04.044205  282690 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil>  [] 0s} 127.0.0.1 49442 <nil> <nil>}
	I0630 21:20:04.044233  282690 main.go:134] libmachine: About to run SSH command:
	sudo hostname embed-certs-20220630210659-9950 && echo "embed-certs-20220630210659-9950" | sudo tee /etc/hostname
	I0630 21:20:04.044882  282690 main.go:134] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:41696->127.0.0.1:49442: read: connection reset by peer
	I0630 21:20:07.174483  282690 main.go:134] libmachine: SSH cmd err, output: <nil>: embed-certs-20220630210659-9950
	
	I0630 21:20:07.174561  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:20:07.210487  282690 main.go:134] libmachine: Using SSH client type: native
	I0630 21:20:07.210668  282690 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil>  [] 0s} 127.0.0.1 49442 <nil> <nil>}
	I0630 21:20:07.210690  282690 main.go:134] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sembed-certs-20220630210659-9950' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 embed-certs-20220630210659-9950/g' /etc/hosts;
				else 
					echo '127.0.1.1 embed-certs-20220630210659-9950' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0630 21:20:07.329184  282690 main.go:134] libmachine: SSH cmd err, output: <nil>: 
	I0630 21:20:07.329234  282690 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube CaCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/c
erts/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube}
	I0630 21:20:07.329264  282690 ubuntu.go:177] setting up certificates
	I0630 21:20:07.329274  282690 provision.go:83] configureAuth start
	I0630 21:20:07.329332  282690 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-20220630210659-9950
	I0630 21:20:07.365729  282690 provision.go:138] copyHostCerts
	I0630 21:20:07.365803  282690 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem, removing ...
	I0630 21:20:07.365816  282690 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem
	I0630 21:20:07.365887  282690 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem (1679 bytes)
	I0630 21:20:07.365984  282690 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem, removing ...
	I0630 21:20:07.365998  282690 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem
	I0630 21:20:07.366039  282690 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem (1082 bytes)
	I0630 21:20:07.366110  282690 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem, removing ...
	I0630 21:20:07.366123  282690 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem
	I0630 21:20:07.366164  282690 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem (1123 bytes)
	I0630 21:20:07.366225  282690 provision.go:112] generating server cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem org=jenkins.embed-certs-20220630210659-9950 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-20220630210659-9950]
	I0630 21:20:07.595656  282690 provision.go:172] copyRemoteCerts
	I0630 21:20:07.595725  282690 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0630 21:20:07.595756  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:20:07.631338  282690 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49442 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:20:07.716832  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
	I0630 21:20:07.735870  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem --> /etc/docker/server.pem (1265 bytes)
	I0630 21:20:07.756354  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0630 21:20:07.775209  282690 provision.go:86] duration metric: configureAuth took 445.919443ms
	I0630 21:20:07.775233  282690 ubuntu.go:193] setting minikube options for container-runtime
	I0630 21:20:07.775399  282690 config.go:178] Loaded profile config "embed-certs-20220630210659-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:20:07.775412  282690 machine.go:91] provisioned docker machine in 3.770097214s
	I0630 21:20:07.775419  282690 start.go:306] post-start starting for "embed-certs-20220630210659-9950" (driver="docker")
	I0630 21:20:07.775425  282690 start.go:316] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0630 21:20:07.775465  282690 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0630 21:20:07.775498  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:20:07.811677  282690 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49442 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:20:07.897450  282690 ssh_runner.go:195] Run: cat /etc/os-release
	I0630 21:20:07.900657  282690 main.go:134] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0630 21:20:07.900688  282690 main.go:134] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0630 21:20:07.900696  282690 main.go:134] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0630 21:20:07.900702  282690 info.go:137] Remote host: Ubuntu 20.04.4 LTS
	I0630 21:20:07.900711  282690 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/addons for local assets ...
	I0630 21:20:07.900762  282690 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files for local assets ...
	I0630 21:20:07.900829  282690 filesync.go:149] local asset: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem -> 99502.pem in /etc/ssl/certs
	I0630 21:20:07.900909  282690 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0630 21:20:07.908065  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem --> /etc/ssl/certs/99502.pem (1708 bytes)
	I0630 21:20:07.926474  282690 start.go:309] post-start completed in 151.040627ms
	I0630 21:20:07.926557  282690 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0630 21:20:07.926600  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:20:07.963198  282690 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49442 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:20:08.045725  282690 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0630 21:20:08.049536  282690 fix.go:57] fixHost completed within 4.564962738s
	I0630 21:20:08.049568  282690 start.go:81] releasing machines lock for "embed-certs-20220630210659-9950", held for 4.56500909s
	I0630 21:20:08.049668  282690 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-20220630210659-9950
	I0630 21:20:08.085452  282690 ssh_runner.go:195] Run: systemctl --version
	I0630 21:20:08.085508  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:20:08.085526  282690 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/
	I0630 21:20:08.085584  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:20:08.125940  282690 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49442 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:20:08.126756  282690 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49442 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:20:05.682082  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:07.682788  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:07.393189  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:09.893794  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:08.209826  282690 ssh_runner.go:195] Run: sudo systemctl stop -f crio
	I0630 21:20:08.240545  282690 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0630 21:20:08.251830  282690 docker.go:179] disabling docker service ...
	I0630 21:20:08.251890  282690 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0630 21:20:08.263344  282690 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0630 21:20:08.272763  282690 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0630 21:20:08.347490  282690 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0630 21:20:08.430323  282690 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0630 21:20:08.439736  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
	image-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0630 21:20:08.453177  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*sandbox_image = .*$|sandbox_image = "k8s.gcr.io/pause:3.7"|' -i /etc/containerd/config.toml"
	I0630 21:20:08.461609  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*restrict_oom_score_adj = .*$|restrict_oom_score_adj = false|' -i /etc/containerd/config.toml"
	I0630 21:20:08.469975  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*SystemdCgroup = .*$|SystemdCgroup = false|' -i /etc/containerd/config.toml"
	I0630 21:20:08.478446  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*conf_dir = .*$|conf_dir = "/etc/cni/net.mk"|' -i /etc/containerd/config.toml"
	I0630 21:20:08.486889  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^# imports|imports = ["/etc/containerd/containerd.conf.d/02-containerd.conf"]|' -i /etc/containerd/config.toml"
	I0630 21:20:08.495251  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc/containerd/containerd.conf.d && printf %!s(MISSING) "dmVyc2lvbiA9IDIK" | base64 -d | sudo tee /etc/containerd/containerd.conf.d/02-containerd.conf"
	I0630 21:20:08.508868  282690 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0630 21:20:08.515626  282690 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0630 21:20:08.522606  282690 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0630 21:20:08.605769  282690 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0630 21:20:08.682128  282690 start.go:447] Will wait 60s for socket path /run/containerd/containerd.sock
	I0630 21:20:08.682202  282690 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
	I0630 21:20:08.686167  282690 start.go:468] Will wait 60s for crictl version
	I0630 21:20:08.686246  282690 ssh_runner.go:195] Run: sudo crictl version
	I0630 21:20:08.713091  282690 retry.go:31] will retry after 11.04660288s: Temporary Error: sudo crictl version: Process exited with status 1
	stdout:
	
	stderr:
	time="2022-06-30T21:20:08Z" level=fatal msg="getting the runtime version: rpc error: code = Unknown desc = server is not initialized yet"
	I0630 21:20:10.182344  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:12.182594  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:12.392956  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:14.393428  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:14.682680  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:17.182245  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:19.182817  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:19.761138  282690 ssh_runner.go:195] Run: sudo crictl version
	I0630 21:20:19.786289  282690 start.go:477] Version:  0.1.0
	RuntimeName:  containerd
	RuntimeVersion:  1.6.6
	RuntimeApiVersion:  v1alpha2
	I0630 21:20:19.786365  282690 ssh_runner.go:195] Run: containerd --version
	I0630 21:20:19.816281  282690 ssh_runner.go:195] Run: containerd --version
	I0630 21:20:19.848226  282690 out.go:177] * Preparing Kubernetes v1.24.2 on containerd 1.6.6 ...
	I0630 21:20:16.893342  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:18.893566  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:19.849919  282690 cli_runner.go:164] Run: docker network inspect embed-certs-20220630210659-9950 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0630 21:20:19.887550  282690 ssh_runner.go:195] Run: grep 192.168.94.1	host.minikube.internal$ /etc/hosts
	I0630 21:20:19.891143  282690 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.94.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0630 21:20:19.900924  282690 preload.go:132] Checking if preload exists for k8s version v1.24.2 and runtime containerd
	I0630 21:20:19.900991  282690 ssh_runner.go:195] Run: sudo crictl images --output json
	I0630 21:20:19.925400  282690 containerd.go:547] all images are preloaded for containerd runtime.
	I0630 21:20:19.925429  282690 containerd.go:461] Images already preloaded, skipping extraction
	I0630 21:20:19.925482  282690 ssh_runner.go:195] Run: sudo crictl images --output json
	I0630 21:20:19.950061  282690 containerd.go:547] all images are preloaded for containerd runtime.
	I0630 21:20:19.950082  282690 cache_images.go:84] Images are preloaded, skipping loading
	I0630 21:20:19.950125  282690 ssh_runner.go:195] Run: sudo crictl info
	I0630 21:20:19.974750  282690 cni.go:95] Creating CNI manager for ""
	I0630 21:20:19.974773  282690 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:20:19.974785  282690 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
	I0630 21:20:19.974799  282690 kubeadm.go:158] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.94.2 APIServerPort:8443 KubernetesVersion:v1.24.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:embed-certs-20220630210659-9950 NodeName:embed-certs-20220630210659-9950 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.94.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.94.2 CgroupDriver:cgroupfs ClientC
AFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}
	I0630 21:20:19.974955  282690 kubeadm.go:162] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.94.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: /run/containerd/containerd.sock
	  name: "embed-certs-20220630210659-9950"
	  kubeletExtraArgs:
	    node-ip: 192.168.94.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.94.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.24.2
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%!"(MISSING)
	  nodefs.inodesFree: "0%!"(MISSING)
	  imagefs.available: "0%!"(MISSING)
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0630 21:20:19.975056  282690 kubeadm.go:961] kubelet [Unit]
	Wants=containerd.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.24.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=embed-certs-20220630210659-9950 --image-service-endpoint=unix:///run/containerd/containerd.sock --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.94.2 --runtime-request-timeout=15m
	
	[Install]
	 config:
	{KubernetesVersion:v1.24.2 ClusterName:embed-certs-20220630210659-9950 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
	I0630 21:20:19.975119  282690 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.24.2
	I0630 21:20:19.982477  282690 binaries.go:44] Found k8s binaries, skipping transfer
	I0630 21:20:19.982537  282690 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0630 21:20:19.989867  282690 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (524 bytes)
	I0630 21:20:20.003413  282690 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0630 21:20:20.016549  282690 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2060 bytes)
	I0630 21:20:20.030557  282690 ssh_runner.go:195] Run: grep 192.168.94.2	control-plane.minikube.internal$ /etc/hosts
	I0630 21:20:20.033673  282690 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.94.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0630 21:20:20.043309  282690 certs.go:54] Setting up /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950 for IP: 192.168.94.2
	I0630 21:20:20.043426  282690 certs.go:182] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.key
	I0630 21:20:20.043474  282690 certs.go:182] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.key
	I0630 21:20:20.043588  282690 certs.go:298] skipping minikube-user signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/client.key
	I0630 21:20:20.043669  282690 certs.go:298] skipping minikube signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.key.ad8e880a
	I0630 21:20:20.043722  282690 certs.go:298] skipping aggregator signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.key
	I0630 21:20:20.043847  282690 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950.pem (1338 bytes)
	W0630 21:20:20.043888  282690 certs.go:384] ignoring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950_empty.pem, impossibly tiny 0 bytes
	I0630 21:20:20.043906  282690 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem (1679 bytes)
	I0630 21:20:20.043944  282690 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem (1082 bytes)
	I0630 21:20:20.043983  282690 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem (1123 bytes)
	I0630 21:20:20.044018  282690 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/key.pem (1679 bytes)
	I0630 21:20:20.044074  282690 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem (1708 bytes)
	I0630 21:20:20.044672  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
	I0630 21:20:20.063809  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I0630 21:20:20.082364  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0630 21:20:20.100953  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
	I0630 21:20:20.119042  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0630 21:20:20.138260  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
	I0630 21:20:20.156455  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0630 21:20:20.175178  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
	I0630 21:20:20.193932  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem --> /usr/share/ca-certificates/99502.pem (1708 bytes)
	I0630 21:20:20.213463  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0630 21:20:20.232837  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950.pem --> /usr/share/ca-certificates/9950.pem (1338 bytes)
	I0630 21:20:20.252510  282690 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0630 21:20:20.267375  282690 ssh_runner.go:195] Run: openssl version
	I0630 21:20:20.273228  282690 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/99502.pem && ln -fs /usr/share/ca-certificates/99502.pem /etc/ssl/certs/99502.pem"
	I0630 21:20:20.281805  282690 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/99502.pem
	I0630 21:20:20.285276  282690 certs.go:431] hashing: -rw-r--r-- 1 root root 1708 Jun 30 20:26 /usr/share/ca-certificates/99502.pem
	I0630 21:20:20.285328  282690 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/99502.pem
	I0630 21:20:20.290565  282690 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/99502.pem /etc/ssl/certs/3ec20f2e.0"
	I0630 21:20:20.298693  282690 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0630 21:20:20.306974  282690 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:20:20.310492  282690 certs.go:431] hashing: -rw-r--r-- 1 root root 1111 Jun 30 20:22 /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:20:20.310555  282690 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:20:20.315748  282690 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0630 21:20:20.323429  282690 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/9950.pem && ln -fs /usr/share/ca-certificates/9950.pem /etc/ssl/certs/9950.pem"
	I0630 21:20:20.331855  282690 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/9950.pem
	I0630 21:20:20.335469  282690 certs.go:431] hashing: -rw-r--r-- 1 root root 1338 Jun 30 20:26 /usr/share/ca-certificates/9950.pem
	I0630 21:20:20.335531  282690 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/9950.pem
	I0630 21:20:20.340482  282690 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/9950.pem /etc/ssl/certs/51391683.0"
	I0630 21:20:20.348339  282690 kubeadm.go:395] StartCluster: {Name:embed-certs-20220630210659-9950 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:embed-certs-20220630210659-9950 Namespace:default APIServerName
:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[Dashboard:kubernetesui/dashboard:v2.6.0@sha256:4af9580485920635d888efe1eddbd67e12f9d5d84dba87100e93feb4e46636b3 MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet:
MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 21:20:20.348468  282690 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
	I0630 21:20:20.348531  282690 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0630 21:20:20.375578  282690 cri.go:87] found id: "6bdce580a9d6963de5c12d9e017d5662e2685851e130abf85abf7ccd2206a8a6"
	I0630 21:20:20.375605  282690 cri.go:87] found id: "8341041be1bdbcf0e0425bd1832777e15b2ed89bf8696d0c78d14301820032c3"
	I0630 21:20:20.375615  282690 cri.go:87] found id: "157c2b0c199b65e53b31cbc33bd298586d30106a66d587ee22f9c486df45d1ba"
	I0630 21:20:20.375624  282690 cri.go:87] found id: "ccc3bef31fe3faba9ff6daab0d5ca071fed6adb37d8cc554c7399ac599691557"
	I0630 21:20:20.375637  282690 cri.go:87] found id: "d56e346d0980d838b9cd42c94d9e084ef84bb0fdeb4316ae2dd5c8a25cc054a1"
	I0630 21:20:20.375652  282690 cri.go:87] found id: "7734f08ca26708ce34ae224077718432c05bc3133a11bb3d600a7d29c4df0045"
	I0630 21:20:20.375660  282690 cri.go:87] found id: ""
	I0630 21:20:20.375709  282690 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
	I0630 21:20:20.388498  282690 cri.go:114] JSON = null
	W0630 21:20:20.388559  282690 kubeadm.go:402] unpause failed: list paused: list returned 0 containers, but ps returned 6
	I0630 21:20:20.388621  282690 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0630 21:20:20.396168  282690 kubeadm.go:410] found existing configuration files, will attempt cluster restart
	I0630 21:20:20.396200  282690 kubeadm.go:626] restartCluster start
	I0630 21:20:20.396246  282690 ssh_runner.go:195] Run: sudo test -d /data/minikube
	I0630 21:20:20.403017  282690 kubeadm.go:127] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:20.403674  282690 kubeconfig.go:116] verify returned: extract IP: "embed-certs-20220630210659-9950" does not appear in /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:20:20.404147  282690 kubeconfig.go:127] "embed-certs-20220630210659-9950" context is missing from /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig - will repair!
	I0630 21:20:20.404911  282690 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig: {Name:mk34e4a4e7b04f624b9adbda4f77ee20b38308ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:20:20.406647  282690 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
	I0630 21:20:20.413413  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:20.413466  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:20.421286  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:20.621671  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:20.621798  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:20.630547  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:20.821858  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:20.821957  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:20.830758  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:21.022078  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:21.022162  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:21.030900  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:21.222204  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:21.222293  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:21.231221  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:21.421485  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:21.421579  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:21.430528  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:21.621730  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:21.621832  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:21.630704  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:21.822018  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:21.822098  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:21.830851  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:22.022202  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:22.022287  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:22.031086  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:22.222404  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:22.222489  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:22.231324  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:22.421567  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:22.421655  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:22.430581  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:22.621941  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:22.622040  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:22.631867  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:22.822177  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:22.822278  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:22.832202  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:23.021427  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:23.021501  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:23.030217  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:21.682805  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:24.182683  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:21.393221  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:23.893682  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:23.221874  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:23.221961  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:23.230645  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:23.421956  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:23.422028  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:23.430894  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:23.430917  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:23.430954  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:23.439029  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:23.439054  282690 kubeadm.go:601] needs reconfigure: apiserver error: timed out waiting for the condition
	I0630 21:20:23.439061  282690 kubeadm.go:1092] stopping kube-system containers ...
	I0630 21:20:23.439074  282690 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name: Namespaces:[kube-system]}
	I0630 21:20:23.439116  282690 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0630 21:20:23.463122  282690 cri.go:87] found id: "6bdce580a9d6963de5c12d9e017d5662e2685851e130abf85abf7ccd2206a8a6"
	I0630 21:20:23.463146  282690 cri.go:87] found id: "8341041be1bdbcf0e0425bd1832777e15b2ed89bf8696d0c78d14301820032c3"
	I0630 21:20:23.463152  282690 cri.go:87] found id: "157c2b0c199b65e53b31cbc33bd298586d30106a66d587ee22f9c486df45d1ba"
	I0630 21:20:23.463158  282690 cri.go:87] found id: "ccc3bef31fe3faba9ff6daab0d5ca071fed6adb37d8cc554c7399ac599691557"
	I0630 21:20:23.463163  282690 cri.go:87] found id: "d56e346d0980d838b9cd42c94d9e084ef84bb0fdeb4316ae2dd5c8a25cc054a1"
	I0630 21:20:23.463170  282690 cri.go:87] found id: "7734f08ca26708ce34ae224077718432c05bc3133a11bb3d600a7d29c4df0045"
	I0630 21:20:23.463175  282690 cri.go:87] found id: ""
	I0630 21:20:23.463180  282690 cri.go:232] Stopping containers: [6bdce580a9d6963de5c12d9e017d5662e2685851e130abf85abf7ccd2206a8a6 8341041be1bdbcf0e0425bd1832777e15b2ed89bf8696d0c78d14301820032c3 157c2b0c199b65e53b31cbc33bd298586d30106a66d587ee22f9c486df45d1ba ccc3bef31fe3faba9ff6daab0d5ca071fed6adb37d8cc554c7399ac599691557 d56e346d0980d838b9cd42c94d9e084ef84bb0fdeb4316ae2dd5c8a25cc054a1 7734f08ca26708ce34ae224077718432c05bc3133a11bb3d600a7d29c4df0045]
	I0630 21:20:23.463219  282690 ssh_runner.go:195] Run: which crictl
	I0630 21:20:23.466097  282690 ssh_runner.go:195] Run: sudo /usr/bin/crictl stop 6bdce580a9d6963de5c12d9e017d5662e2685851e130abf85abf7ccd2206a8a6 8341041be1bdbcf0e0425bd1832777e15b2ed89bf8696d0c78d14301820032c3 157c2b0c199b65e53b31cbc33bd298586d30106a66d587ee22f9c486df45d1ba ccc3bef31fe3faba9ff6daab0d5ca071fed6adb37d8cc554c7399ac599691557 d56e346d0980d838b9cd42c94d9e084ef84bb0fdeb4316ae2dd5c8a25cc054a1 7734f08ca26708ce34ae224077718432c05bc3133a11bb3d600a7d29c4df0045
	I0630 21:20:23.491529  282690 ssh_runner.go:195] Run: sudo systemctl stop kubelet
	I0630 21:20:23.501548  282690 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0630 21:20:23.508513  282690 kubeadm.go:155] found existing configuration files:
	-rw------- 1 root root 5643 Jun 30 21:07 /etc/kubernetes/admin.conf
	-rw------- 1 root root 5652 Jun 30 21:07 /etc/kubernetes/controller-manager.conf
	-rw------- 1 root root 2063 Jun 30 21:07 /etc/kubernetes/kubelet.conf
	-rw------- 1 root root 5600 Jun 30 21:07 /etc/kubernetes/scheduler.conf
	
	I0630 21:20:23.508569  282690 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
	I0630 21:20:23.515331  282690 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
	I0630 21:20:23.522134  282690 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
	I0630 21:20:23.528625  282690 kubeadm.go:166] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:23.528674  282690 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
	I0630 21:20:23.535118  282690 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
	I0630 21:20:23.541759  282690 kubeadm.go:166] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:23.541806  282690 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
	I0630 21:20:23.547839  282690 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0630 21:20:23.554281  282690 kubeadm.go:703] reconfiguring cluster from /var/tmp/minikube/kubeadm.yaml
	I0630 21:20:23.554304  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:20:23.597418  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:20:24.204823  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:20:24.388425  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:20:24.446940  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:20:24.548581  282690 api_server.go:51] waiting for apiserver process to appear ...
	I0630 21:20:24.548652  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 21:20:25.058272  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 21:20:25.558267  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 21:20:25.634820  282690 api_server.go:71] duration metric: took 1.086232371s to wait for apiserver process to appear ...
	I0630 21:20:25.634853  282690 api_server.go:87] waiting for apiserver healthz status ...
	I0630 21:20:25.634866  282690 api_server.go:240] Checking apiserver healthz at https://192.168.94.2:8443/healthz ...
	I0630 21:20:25.635225  282690 api_server.go:256] stopped: https://192.168.94.2:8443/healthz: Get "https://192.168.94.2:8443/healthz": dial tcp 192.168.94.2:8443: connect: connection refused
	I0630 21:20:26.135955  282690 api_server.go:240] Checking apiserver healthz at https://192.168.94.2:8443/healthz ...
	I0630 21:20:26.183141  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:28.683133  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:29.023735  282690 api_server.go:266] https://192.168.94.2:8443/healthz returned 403:
	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
	W0630 21:20:29.023845  282690 api_server.go:102] status: https://192.168.94.2:8443/healthz returned error 403:
	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
	I0630 21:20:29.136115  282690 api_server.go:240] Checking apiserver healthz at https://192.168.94.2:8443/healthz ...
	I0630 21:20:29.142290  282690 api_server.go:266] https://192.168.94.2:8443/healthz returned 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/bootstrap-controller ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[-]poststarthook/apiservice-registration-controller failed: reason withheld
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	W0630 21:20:29.142324  282690 api_server.go:102] status: https://192.168.94.2:8443/healthz returned error 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/bootstrap-controller ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[-]poststarthook/apiservice-registration-controller failed: reason withheld
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	I0630 21:20:29.635779  282690 api_server.go:240] Checking apiserver healthz at https://192.168.94.2:8443/healthz ...
	I0630 21:20:29.641744  282690 api_server.go:266] https://192.168.94.2:8443/healthz returned 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/bootstrap-controller ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-registration-controller ok
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	W0630 21:20:29.641774  282690 api_server.go:102] status: https://192.168.94.2:8443/healthz returned error 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/bootstrap-controller ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-registration-controller ok
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	I0630 21:20:30.135899  282690 api_server.go:240] Checking apiserver healthz at https://192.168.94.2:8443/healthz ...
	I0630 21:20:30.140340  282690 api_server.go:266] https://192.168.94.2:8443/healthz returned 200:
	ok
	I0630 21:20:30.146945  282690 api_server.go:140] control plane version: v1.24.2
	I0630 21:20:30.146967  282690 api_server.go:130] duration metric: took 4.512109627s to wait for apiserver health ...
	I0630 21:20:30.146976  282690 cni.go:95] Creating CNI manager for ""
	I0630 21:20:30.146983  282690 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:20:30.149207  282690 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0630 21:20:26.393339  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:28.893287  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:30.893492  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:30.150766  282690 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0630 21:20:30.154566  282690 cni.go:189] applying CNI manifest using /var/lib/minikube/binaries/v1.24.2/kubectl ...
	I0630 21:20:30.154592  282690 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2429 bytes)
	I0630 21:20:30.168730  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0630 21:20:30.976925  282690 system_pods.go:43] waiting for kube-system pods to appear ...
	I0630 21:20:30.983901  282690 system_pods.go:59] 9 kube-system pods found
	I0630 21:20:30.983933  282690 system_pods.go:61] "coredns-6d4b75cb6d-87dwf" [11e7f3e7-24e8-4e14-b1f6-a7e2b9bcfb74] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.)
	I0630 21:20:30.983941  282690 system_pods.go:61] "etcd-embed-certs-20220630210659-9950" [c7597376-29d8-4a64-a014-1bca6b00b239] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
	I0630 21:20:30.983951  282690 system_pods.go:61] "kindnet-z7fgt" [9d385a59-b071-48be-b547-db80254669bc] Running / Ready:ContainersNotReady (containers with unready status: [kindnet-cni]) / ContainersReady:ContainersNotReady (containers with unready status: [kindnet-cni])
	I0630 21:20:30.983963  282690 system_pods.go:61] "kube-apiserver-embed-certs-20220630210659-9950" [101e1b1d-d8d3-49c5-b250-f9524145064b] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
	I0630 21:20:30.983978  282690 system_pods.go:61] "kube-controller-manager-embed-certs-20220630210659-9950" [f93c4f3d-22de-4c13-a12a-c8ae9d47911c] Running
	I0630 21:20:30.983988  282690 system_pods.go:61] "kube-proxy-jhw4d" [78ec1767-ed48-4f50-ab14-61149fad7e98] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])
	I0630 21:20:30.984003  282690 system_pods.go:61] "kube-scheduler-embed-certs-20220630210659-9950" [727ac744-99fa-4867-9662-83efb2a98b35] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
	I0630 21:20:30.984012  282690 system_pods.go:61] "metrics-server-5c6f97fb75-dvslz" [3a4167d3-f572-4a2c-813a-d2d22e47d17e] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.)
	I0630 21:20:30.984019  282690 system_pods.go:61] "storage-provisioner" [4e574839-6ecb-47ba-b5c4-e45d9b19efc7] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.)
	I0630 21:20:30.984028  282690 system_pods.go:74] duration metric: took 7.077293ms to wait for pod list to return data ...
	I0630 21:20:30.984038  282690 node_conditions.go:102] verifying NodePressure condition ...
	I0630 21:20:30.986718  282690 node_conditions.go:122] node storage ephemeral capacity is 304695084Ki
	I0630 21:20:30.986752  282690 node_conditions.go:123] node cpu capacity is 8
	I0630 21:20:30.986766  282690 node_conditions.go:105] duration metric: took 2.718274ms to run NodePressure ...
	I0630 21:20:30.986786  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:20:31.145954  282690 kubeadm.go:762] waiting for restarted kubelet to initialise ...
	I0630 21:20:31.149839  282690 kubeadm.go:777] kubelet initialised
	I0630 21:20:31.149867  282690 kubeadm.go:778] duration metric: took 3.887979ms waiting for restarted kubelet to initialise ...
	I0630 21:20:31.149877  282690 pod_ready.go:35] extra waiting up to 4m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0630 21:20:31.154561  282690 pod_ready.go:78] waiting up to 4m0s for pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace to be "Ready" ...
	I0630 21:20:30.683577  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:33.182578  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:33.392832  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:35.393314  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:33.160352  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:35.660314  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:35.182728  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:37.682510  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:37.893265  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:39.893463  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:38.160526  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:40.660894  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:39.683375  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:42.182068  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:44.183054  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:42.393015  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:44.893292  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:43.160483  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:45.660796  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:47.660953  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:46.683087  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:49.183229  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:46.893432  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:49.393236  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:50.161308  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:52.660155  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:51.682409  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:53.682570  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:51.393511  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:53.893578  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:54.661629  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:57.159920  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:55.682710  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:58.182130  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:56.393487  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:58.892932  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:00.893465  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:59.160128  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:01.160665  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:00.182447  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:02.182840  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:04.182886  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:03.392696  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:05.393231  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:03.661112  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:06.160443  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:06.682224  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:08.682691  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:07.893418  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:10.392505  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:08.160644  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:10.661019  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:12.661060  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:11.182893  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:13.182991  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:12.393783  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:14.893314  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:15.160327  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:17.660228  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:15.682251  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:17.683152  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:17.393363  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:19.390281  276064 pod_ready.go:81] duration metric: took 4m0.003663432s waiting for pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace to be "Ready" ...
	E0630 21:21:19.390317  276064 pod_ready.go:66] WaitExtra: waitPodCondition: timed out waiting 4m0s for pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace to be "Ready" (will not retry!)
	I0630 21:21:19.390344  276064 pod_ready.go:38] duration metric: took 4m0.009122224s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0630 21:21:19.390376  276064 kubeadm.go:630] restartCluster took 4m11.317474742s
	W0630 21:21:19.390560  276064 out.go:239] ! Unable to restart cluster, will reset it: extra: timed out waiting 4m0s for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready"
	I0630 21:21:19.390595  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm reset --cri-socket /run/containerd/containerd.sock --force"
	I0630 21:21:19.660421  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:22.160264  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:20.183474  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:22.682948  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:21.023971  276064 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm reset --cri-socket /run/containerd/containerd.sock --force": (1.633354294s)
	I0630 21:21:21.024036  276064 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 21:21:21.033944  276064 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0630 21:21:21.041255  276064 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver
	I0630 21:21:21.041307  276064 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0630 21:21:21.048131  276064 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0630 21:21:21.048170  276064 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0630 21:21:24.160315  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:26.660444  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:25.181883  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:27.183120  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:30.433489  276064 out.go:204]   - Generating certificates and keys ...
	I0630 21:21:30.436707  276064 out.go:204]   - Booting up control plane ...
	I0630 21:21:30.439842  276064 out.go:204]   - Configuring RBAC rules ...
	I0630 21:21:30.442245  276064 cni.go:95] Creating CNI manager for ""
	I0630 21:21:30.442271  276064 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:21:30.444232  276064 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0630 21:21:30.446289  276064 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0630 21:21:30.450161  276064 cni.go:189] applying CNI manifest using /var/lib/minikube/binaries/v1.24.2/kubectl ...
	I0630 21:21:30.450180  276064 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2429 bytes)
	I0630 21:21:30.464668  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0630 21:21:28.661012  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:31.160051  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:29.682587  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:31.682697  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:33.683054  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:31.250327  276064 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0630 21:21:31.250457  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:31.250483  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl label nodes minikube.k8s.io/version=v1.26.0 minikube.k8s.io/commit=251ffcec0e4c997cd7732864187747cc579943c9 minikube.k8s.io/name=default-k8s-different-port-20220630210335-9950 minikube.k8s.io/updated_at=2022_06_30T21_21_31_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:31.337104  276064 ops.go:34] apiserver oom_adj: -16
	I0630 21:21:31.337122  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:31.898846  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:32.398504  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:32.898395  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:33.399197  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:33.898224  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:34.399278  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:34.898766  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:35.399106  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:35.898541  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:33.160337  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:35.660572  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:37.660625  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:36.183245  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:38.681927  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:36.399149  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:36.899206  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:37.398969  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:37.898306  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:38.398247  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:38.898685  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:39.399050  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:39.899197  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:40.399284  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:40.898565  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:40.159296  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:42.160359  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:41.398285  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:41.899049  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:42.399136  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:42.898362  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:42.955690  276064 kubeadm.go:1045] duration metric: took 11.705297596s to wait for elevateKubeSystemPrivileges.
	I0630 21:21:42.955725  276064 kubeadm.go:397] StartCluster complete in 4m34.928502204s
	I0630 21:21:42.955749  276064 settings.go:142] acquiring lock: {Name:mkcbd229caa05b60d3551ef0b47eea08424c9b5d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:21:42.955839  276064 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:21:42.956940  276064 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig: {Name:mk34e4a4e7b04f624b9adbda4f77ee20b38308ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:21:43.471460  276064 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "default-k8s-different-port-20220630210335-9950" rescaled to 1
	I0630 21:21:43.471523  276064 start.go:208] Will wait 6m0s for node &{Name: IP:192.168.85.2 Port:8444 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0630 21:21:43.473505  276064 out.go:177] * Verifying Kubernetes components...
	I0630 21:21:43.471586  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0630 21:21:43.471607  276064 addons.go:412] enableAddons start: toEnable=map[dashboard:true metrics-server:true], additional=[]
	I0630 21:21:43.471793  276064 config.go:178] Loaded profile config "default-k8s-different-port-20220630210335-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:21:43.474864  276064 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 21:21:43.474932  276064 addons.go:65] Setting dashboard=true in profile "default-k8s-different-port-20220630210335-9950"
	I0630 21:21:43.474957  276064 addons.go:65] Setting default-storageclass=true in profile "default-k8s-different-port-20220630210335-9950"
	I0630 21:21:43.474976  276064 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "default-k8s-different-port-20220630210335-9950"
	I0630 21:21:43.474962  276064 addons.go:153] Setting addon dashboard=true in "default-k8s-different-port-20220630210335-9950"
	W0630 21:21:43.475061  276064 addons.go:162] addon dashboard should already be in state true
	I0630 21:21:43.475110  276064 host.go:66] Checking if "default-k8s-different-port-20220630210335-9950" exists ...
	I0630 21:21:43.474944  276064 addons.go:65] Setting metrics-server=true in profile "default-k8s-different-port-20220630210335-9950"
	I0630 21:21:43.475161  276064 addons.go:153] Setting addon metrics-server=true in "default-k8s-different-port-20220630210335-9950"
	W0630 21:21:43.475179  276064 addons.go:162] addon metrics-server should already be in state true
	I0630 21:21:43.475224  276064 host.go:66] Checking if "default-k8s-different-port-20220630210335-9950" exists ...
	I0630 21:21:43.474932  276064 addons.go:65] Setting storage-provisioner=true in profile "default-k8s-different-port-20220630210335-9950"
	I0630 21:21:43.475323  276064 cli_runner.go:164] Run: docker container inspect default-k8s-different-port-20220630210335-9950 --format={{.State.Status}}
	I0630 21:21:43.475319  276064 addons.go:153] Setting addon storage-provisioner=true in "default-k8s-different-port-20220630210335-9950"
	W0630 21:21:43.475359  276064 addons.go:162] addon storage-provisioner should already be in state true
	I0630 21:21:43.475407  276064 host.go:66] Checking if "default-k8s-different-port-20220630210335-9950" exists ...
	I0630 21:21:43.475586  276064 cli_runner.go:164] Run: docker container inspect default-k8s-different-port-20220630210335-9950 --format={{.State.Status}}
	I0630 21:21:43.475682  276064 cli_runner.go:164] Run: docker container inspect default-k8s-different-port-20220630210335-9950 --format={{.State.Status}}
	I0630 21:21:43.475805  276064 cli_runner.go:164] Run: docker container inspect default-k8s-different-port-20220630210335-9950 --format={{.State.Status}}
	I0630 21:21:43.525211  276064 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0630 21:21:43.526633  276064 addons.go:345] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 21:21:43.526654  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0630 21:21:43.526703  276064 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	I0630 21:21:43.529674  276064 out.go:177]   - Using image fake.domain/k8s.gcr.io/echoserver:1.4
	I0630 21:21:43.531135  276064 addons.go:345] installing /etc/kubernetes/addons/metrics-apiservice.yaml
	I0630 21:21:43.531154  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
	I0630 21:21:43.532388  276064 out.go:177]   - Using image kubernetesui/dashboard:v2.6.0
	I0630 21:21:43.531211  276064 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	I0630 21:21:43.534873  276064 out.go:177]   - Using image k8s.gcr.io/echoserver:1.4
	I0630 21:21:40.682196  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:42.682640  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:43.536294  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-ns.yaml
	I0630 21:21:43.536318  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
	I0630 21:21:43.535327  276064 addons.go:153] Setting addon default-storageclass=true in "default-k8s-different-port-20220630210335-9950"
	I0630 21:21:43.536373  276064 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	W0630 21:21:43.536390  276064 addons.go:162] addon default-storageclass should already be in state true
	I0630 21:21:43.536436  276064 host.go:66] Checking if "default-k8s-different-port-20220630210335-9950" exists ...
	I0630 21:21:43.536996  276064 cli_runner.go:164] Run: docker container inspect default-k8s-different-port-20220630210335-9950 --format={{.State.Status}}
	I0630 21:21:43.568952  276064 node_ready.go:35] waiting up to 6m0s for node "default-k8s-different-port-20220630210335-9950" to be "Ready" ...
	I0630 21:21:43.569160  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.85.1 host.minikube.internal\n           fallthrough\n        }' | sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0630 21:21:43.573720  276064 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49437 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/default-k8s-different-port-20220630210335-9950/id_rsa Username:docker}
	I0630 21:21:43.585132  276064 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49437 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/default-k8s-different-port-20220630210335-9950/id_rsa Username:docker}
	I0630 21:21:43.585211  276064 addons.go:345] installing /etc/kubernetes/addons/storageclass.yaml
	I0630 21:21:43.585226  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0630 21:21:43.585277  276064 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	I0630 21:21:43.592285  276064 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49437 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/default-k8s-different-port-20220630210335-9950/id_rsa Username:docker}
	I0630 21:21:43.623221  276064 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49437 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/default-k8s-different-port-20220630210335-9950/id_rsa Username:docker}
	I0630 21:21:43.744945  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
	I0630 21:21:43.744974  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
	I0630 21:21:43.747847  276064 addons.go:345] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
	I0630 21:21:43.747873  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1820 bytes)
	I0630 21:21:43.748263  276064 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 21:21:43.924785  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
	I0630 21:21:43.924816  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
	I0630 21:21:43.928618  276064 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0630 21:21:43.940306  276064 addons.go:345] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
	I0630 21:21:43.940338  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
	I0630 21:21:43.950742  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-configmap.yaml
	I0630 21:21:43.950768  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
	I0630 21:21:44.037060  276064 addons.go:345] installing /etc/kubernetes/addons/metrics-server-service.yaml
	I0630 21:21:44.037089  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
	I0630 21:21:44.047010  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-dp.yaml
	I0630 21:21:44.047034  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4196 bytes)
	I0630 21:21:44.135080  276064 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I0630 21:21:44.140888  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-role.yaml
	I0630 21:21:44.140919  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
	I0630 21:21:44.230459  276064 start.go:806] {"host.minikube.internal": 192.168.85.1} host record injected into CoreDNS
	I0630 21:21:44.235255  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
	I0630 21:21:44.235283  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
	I0630 21:21:44.327158  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-sa.yaml
	I0630 21:21:44.327192  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
	I0630 21:21:44.351459  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-secret.yaml
	I0630 21:21:44.351527  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
	I0630 21:21:44.448179  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-svc.yaml
	I0630 21:21:44.448218  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
	I0630 21:21:44.537927  276064 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	I0630 21:21:45.130031  276064 addons.go:383] Verifying addon metrics-server=true in "default-k8s-different-port-20220630210335-9950"
	I0630 21:21:45.539430  276064 out.go:177] * Enabled addons: storage-provisioner, default-storageclass, metrics-server, dashboard
	I0630 21:21:45.540750  276064 addons.go:414] enableAddons completed in 2.0691399s
	I0630 21:21:45.575595  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:21:44.660831  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:47.160149  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:45.182445  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:47.682514  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:47.576330  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:21:49.576407  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:21:49.160793  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:51.660805  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:50.182451  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:52.183083  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:52.076426  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:21:54.076887  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:21:54.161146  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:56.660728  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:54.683102  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:57.182501  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:59.182957  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:56.575738  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:21:58.576604  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:00.577162  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:21:59.160517  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:01.160700  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:01.183043  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:03.682640  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:03.075860  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:05.076679  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:03.661117  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:06.160731  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:05.682843  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:08.182414  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:07.576553  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:10.075989  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:08.660876  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:11.160848  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:10.682414  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:12.682830  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:12.076661  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:14.576273  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:13.660019  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:15.660934  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:15.183230  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:17.681937  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:17.075764  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:19.076352  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:18.160512  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:20.661337  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:19.682685  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:22.182341  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:21.575906  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:24.076044  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:23.159968  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:25.659994  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:27.660386  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:24.682559  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:26.682712  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:28.682765  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:26.076272  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:28.076381  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:30.576589  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:29.660781  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:31.661081  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:31.182114  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:33.182667  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:33.075544  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:35.076859  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:34.160031  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:36.174889  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:35.682410  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:37.682440  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:37.576222  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:40.076094  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:38.660329  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:40.661271  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:39.682506  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:42.182441  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:44.182613  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:42.076569  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:44.575778  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:43.160906  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:45.660687  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:47.660756  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:46.182890  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:48.682065  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:50.184705  271327 node_ready.go:38] duration metric: took 4m0.008399385s waiting for node "old-k8s-version-20220630210005-9950" to be "Ready" ...
	I0630 21:22:50.186899  271327 out.go:177] 
	W0630 21:22:50.188676  271327 out.go:239] X Exiting due to GUEST_START: wait 6m0s for node: waiting for node to be ready: waitNodeCondition: timed out waiting for the condition
	W0630 21:22:50.188714  271327 out.go:239] * 
	W0630 21:22:50.189487  271327 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0630 21:22:50.191389  271327 out.go:177] 
	
	* 
	* ==> container status <==
	* CONTAINER           IMAGE               CREATED              STATE               NAME                      ATTEMPT             POD ID
	4f9dd94adfa30       6fb66cd78abfe       About a minute ago   Running             kindnet-cni               1                   1273bf7fb0caa
	454b40bfbcac1       6fb66cd78abfe       4 minutes ago        Exited              kindnet-cni               0                   1273bf7fb0caa
	21661943a8d48       c21b0c7400f98       4 minutes ago        Running             kube-proxy                0                   cb02ca2270bd9
	4d472dfb5cbc3       b305571ca60a5       4 minutes ago        Running             kube-apiserver            0                   9fa7cfba92b44
	3812d0fe0857b       301ddc62b80b1       4 minutes ago        Running             kube-scheduler            0                   619d41221365d
	331440287c350       b2756210eeabf       4 minutes ago        Running             etcd                      0                   27998a6f37b0a
	765fc80bc943e       06a629a7e51cd       4 minutes ago        Running             kube-controller-manager   0                   32cbcbc6a054b
	
	* 
	* ==> containerd <==
	* -- Logs begin at Thu 2022-06-30 21:12:55 UTC, end at Thu 2022-06-30 21:22:51 UTC. --
	Jun 30 21:18:49 old-k8s-version-20220630210005-9950 containerd[394]: time="2022-06-30T21:18:49.254694359Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
	Jun 30 21:18:49 old-k8s-version-20220630210005-9950 containerd[394]: time="2022-06-30T21:18:49.254734093Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
	Jun 30 21:18:49 old-k8s-version-20220630210005-9950 containerd[394]: time="2022-06-30T21:18:49.255006815Z" level=info msg="starting signal loop" namespace=k8s.io path=/run/containerd/io.containerd.runtime.v2.task/k8s.io/cb02ca2270bd905b9f192fb674bd0e9026766a4828928b0e1da3af82b465fe92 pid=3834 runtime=io.containerd.runc.v2
	Jun 30 21:18:49 old-k8s-version-20220630210005-9950 containerd[394]: time="2022-06-30T21:18:49.259849006Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1
	Jun 30 21:18:49 old-k8s-version-20220630210005-9950 containerd[394]: time="2022-06-30T21:18:49.259954963Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
	Jun 30 21:18:49 old-k8s-version-20220630210005-9950 containerd[394]: time="2022-06-30T21:18:49.259970320Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
	Jun 30 21:18:49 old-k8s-version-20220630210005-9950 containerd[394]: time="2022-06-30T21:18:49.260182193Z" level=info msg="starting signal loop" namespace=k8s.io path=/run/containerd/io.containerd.runtime.v2.task/k8s.io/1273bf7fb0caa4bcdd8ca108e6840479675a95d99e48286d8f8e730189bd641d pid=3849 runtime=io.containerd.runc.v2
	Jun 30 21:18:49 old-k8s-version-20220630210005-9950 containerd[394]: time="2022-06-30T21:18:49.376248981Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kube-proxy-vwp6l,Uid:9b047236-4bab-46f2-b6d8-28c018108a48,Namespace:kube-system,Attempt:0,} returns sandbox id \"cb02ca2270bd905b9f192fb674bd0e9026766a4828928b0e1da3af82b465fe92\""
	Jun 30 21:18:49 old-k8s-version-20220630210005-9950 containerd[394]: time="2022-06-30T21:18:49.379476803Z" level=info msg="CreateContainer within sandbox \"cb02ca2270bd905b9f192fb674bd0e9026766a4828928b0e1da3af82b465fe92\" for container &ContainerMetadata{Name:kube-proxy,Attempt:0,}"
	Jun 30 21:18:49 old-k8s-version-20220630210005-9950 containerd[394]: time="2022-06-30T21:18:49.440164143Z" level=info msg="CreateContainer within sandbox \"cb02ca2270bd905b9f192fb674bd0e9026766a4828928b0e1da3af82b465fe92\" for &ContainerMetadata{Name:kube-proxy,Attempt:0,} returns container id \"21661943a8d48cf903788eaca7389af17a1b11a7e37c19d4eb9c1f3600d42801\""
	Jun 30 21:18:49 old-k8s-version-20220630210005-9950 containerd[394]: time="2022-06-30T21:18:49.440621655Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kindnet-lz24x,Uid:dd1abd4e-af36-4336-9a10-0212fd25fdca,Namespace:kube-system,Attempt:0,} returns sandbox id \"1273bf7fb0caa4bcdd8ca108e6840479675a95d99e48286d8f8e730189bd641d\""
	Jun 30 21:18:49 old-k8s-version-20220630210005-9950 containerd[394]: time="2022-06-30T21:18:49.440841021Z" level=info msg="StartContainer for \"21661943a8d48cf903788eaca7389af17a1b11a7e37c19d4eb9c1f3600d42801\""
	Jun 30 21:18:49 old-k8s-version-20220630210005-9950 containerd[394]: time="2022-06-30T21:18:49.445162096Z" level=info msg="CreateContainer within sandbox \"1273bf7fb0caa4bcdd8ca108e6840479675a95d99e48286d8f8e730189bd641d\" for container &ContainerMetadata{Name:kindnet-cni,Attempt:0,}"
	Jun 30 21:18:49 old-k8s-version-20220630210005-9950 containerd[394]: time="2022-06-30T21:18:49.460022378Z" level=info msg="CreateContainer within sandbox \"1273bf7fb0caa4bcdd8ca108e6840479675a95d99e48286d8f8e730189bd641d\" for &ContainerMetadata{Name:kindnet-cni,Attempt:0,} returns container id \"454b40bfbcac196b43e741f3840736723df552ee910722c17916deaecfd68bce\""
	Jun 30 21:18:49 old-k8s-version-20220630210005-9950 containerd[394]: time="2022-06-30T21:18:49.460764502Z" level=info msg="StartContainer for \"454b40bfbcac196b43e741f3840736723df552ee910722c17916deaecfd68bce\""
	Jun 30 21:18:49 old-k8s-version-20220630210005-9950 containerd[394]: time="2022-06-30T21:18:49.565139684Z" level=info msg="StartContainer for \"21661943a8d48cf903788eaca7389af17a1b11a7e37c19d4eb9c1f3600d42801\" returns successfully"
	Jun 30 21:18:49 old-k8s-version-20220630210005-9950 containerd[394]: time="2022-06-30T21:18:49.740625751Z" level=info msg="StartContainer for \"454b40bfbcac196b43e741f3840736723df552ee910722c17916deaecfd68bce\" returns successfully"
	Jun 30 21:21:30 old-k8s-version-20220630210005-9950 containerd[394]: time="2022-06-30T21:21:30.188916714Z" level=info msg="shim disconnected" id=454b40bfbcac196b43e741f3840736723df552ee910722c17916deaecfd68bce
	Jun 30 21:21:30 old-k8s-version-20220630210005-9950 containerd[394]: time="2022-06-30T21:21:30.188998187Z" level=warning msg="cleaning up after shim disconnected" id=454b40bfbcac196b43e741f3840736723df552ee910722c17916deaecfd68bce namespace=k8s.io
	Jun 30 21:21:30 old-k8s-version-20220630210005-9950 containerd[394]: time="2022-06-30T21:21:30.189015094Z" level=info msg="cleaning up dead shim"
	Jun 30 21:21:30 old-k8s-version-20220630210005-9950 containerd[394]: time="2022-06-30T21:21:30.200890355Z" level=warning msg="cleanup warnings time=\"2022-06-30T21:21:30Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=4696 runtime=io.containerd.runc.v2\n"
	Jun 30 21:21:31 old-k8s-version-20220630210005-9950 containerd[394]: time="2022-06-30T21:21:31.176170671Z" level=info msg="CreateContainer within sandbox \"1273bf7fb0caa4bcdd8ca108e6840479675a95d99e48286d8f8e730189bd641d\" for container &ContainerMetadata{Name:kindnet-cni,Attempt:1,}"
	Jun 30 21:21:31 old-k8s-version-20220630210005-9950 containerd[394]: time="2022-06-30T21:21:31.190969143Z" level=info msg="CreateContainer within sandbox \"1273bf7fb0caa4bcdd8ca108e6840479675a95d99e48286d8f8e730189bd641d\" for &ContainerMetadata{Name:kindnet-cni,Attempt:1,} returns container id \"4f9dd94adfa30343e4c2421831d64434853197db25d1394d119c4cb5ec099f61\""
	Jun 30 21:21:31 old-k8s-version-20220630210005-9950 containerd[394]: time="2022-06-30T21:21:31.191715825Z" level=info msg="StartContainer for \"4f9dd94adfa30343e4c2421831d64434853197db25d1394d119c4cb5ec099f61\""
	Jun 30 21:21:31 old-k8s-version-20220630210005-9950 containerd[394]: time="2022-06-30T21:21:31.427630910Z" level=info msg="StartContainer for \"4f9dd94adfa30343e4c2421831d64434853197db25d1394d119c4cb5ec099f61\" returns successfully"
	
	* 
	* ==> describe nodes <==
	* Name:               old-k8s-version-20220630210005-9950
	Roles:              master
	Labels:             beta.kubernetes.io/arch=amd64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=amd64
	                    kubernetes.io/hostname=old-k8s-version-20220630210005-9950
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=251ffcec0e4c997cd7732864187747cc579943c9
	                    minikube.k8s.io/name=old-k8s-version-20220630210005-9950
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2022_06_30T21_18_34_0700
	                    minikube.k8s.io/version=v1.26.0
	                    node-role.kubernetes.io/master=
	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: /run/containerd/containerd.sock
	                    node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Thu, 30 Jun 2022 21:18:29 +0000
	Taints:             node.kubernetes.io/not-ready:NoExecute
	                    node.kubernetes.io/not-ready:NoSchedule
	Unschedulable:      false
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Thu, 30 Jun 2022 21:22:29 +0000   Thu, 30 Jun 2022 21:18:26 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Thu, 30 Jun 2022 21:22:29 +0000   Thu, 30 Jun 2022 21:18:26 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Thu, 30 Jun 2022 21:22:29 +0000   Thu, 30 Jun 2022 21:18:26 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            False   Thu, 30 Jun 2022 21:22:29 +0000   Thu, 30 Jun 2022 21:18:26 +0000   KubeletNotReady              runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Addresses:
	  InternalIP:  192.168.67.2
	  Hostname:    old-k8s-version-20220630210005-9950
	Capacity:
	 cpu:                8
	 ephemeral-storage:  304695084Ki
	 hugepages-1Gi:      0
	 hugepages-2Mi:      0
	 memory:             32873488Ki
	 pods:               110
	Allocatable:
	 cpu:                8
	 ephemeral-storage:  304695084Ki
	 hugepages-1Gi:      0
	 hugepages-2Mi:      0
	 memory:             32873488Ki
	 pods:               110
	System Info:
	 Machine ID:                 bbe1e1cef6e940328962dca52b3c5731
	 System UUID:                2ca00556-ba1f-4dc3-b97e-bb738f788e2a
	 Boot ID:                    471c4729-f046-4a15-bc49-46f3ad561708
	 Kernel Version:             5.15.0-1012-gcp
	 OS Image:                   Ubuntu 20.04.4 LTS
	 Operating System:           linux
	 Architecture:               amd64
	 Container Runtime Version:  containerd://1.6.6
	 Kubelet Version:            v1.16.0
	 Kube-Proxy Version:         v1.16.0
	PodCIDR:                     10.244.0.0/24
	PodCIDRs:                    10.244.0.0/24
	Non-terminated Pods:         (6 in total)
	  Namespace                  Name                                                           CPU Requests  CPU Limits  Memory Requests  Memory Limits  AGE
	  ---------                  ----                                                           ------------  ----------  ---------------  -------------  ---
	  kube-system                etcd-old-k8s-version-20220630210005-9950                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m
	  kube-system                kindnet-lz24x                                                  100m (1%!)(MISSING)     100m (1%!)(MISSING)   50Mi (0%!)(MISSING)        50Mi (0%!)(MISSING)      4m3s
	  kube-system                kube-apiserver-old-k8s-version-20220630210005-9950             250m (3%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m11s
	  kube-system                kube-controller-manager-old-k8s-version-20220630210005-9950    200m (2%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m6s
	  kube-system                kube-proxy-vwp6l                                               0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m3s
	  kube-system                kube-scheduler-old-k8s-version-20220630210005-9950             100m (1%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m22s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests   Limits
	  --------           --------   ------
	  cpu                650m (8%!)(MISSING)  100m (1%!)(MISSING)
	  memory             50Mi (0%!)(MISSING)  50Mi (0%!)(MISSING)
	  ephemeral-storage  0 (0%!)(MISSING)     0 (0%!)(MISSING)
	Events:
	  Type    Reason                   Age                    From                                             Message
	  ----    ------                   ----                   ----                                             -------
	  Normal  Starting                 4m27s                  kubelet, old-k8s-version-20220630210005-9950     Starting kubelet.
	  Normal  NodeHasSufficientMemory  4m27s (x9 over 4m27s)  kubelet, old-k8s-version-20220630210005-9950     Node old-k8s-version-20220630210005-9950 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    4m27s (x7 over 4m27s)  kubelet, old-k8s-version-20220630210005-9950     Node old-k8s-version-20220630210005-9950 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     4m27s (x7 over 4m27s)  kubelet, old-k8s-version-20220630210005-9950     Node old-k8s-version-20220630210005-9950 status is now: NodeHasSufficientPID
	  Normal  NodeAllocatableEnforced  4m27s                  kubelet, old-k8s-version-20220630210005-9950     Updated Node Allocatable limit across pods
	  Normal  Starting                 4m2s                   kube-proxy, old-k8s-version-20220630210005-9950  Starting kube-proxy.
	
	* 
	* ==> dmesg <==
	* [  +2.939825] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000011] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.027789] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.019913] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[ +21.968090] IPv4: martian destination 127.0.0.11 from 10.244.0.3, dev veth8071d138
	[ +25.445872] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.029436] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.023957] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +2.947695] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[Jun30 21:05] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.023879] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +2.955783] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.011828] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000005] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.027896] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	
	* 
	* ==> etcd [331440287c35035c4e07207114bd03652cbc0ad94f85e5b85fcf8fa49587c5dd] <==
	* 2022-06-30 21:18:25.633161 I | etcdserver: initial cluster = old-k8s-version-20220630210005-9950=https://192.168.67.2:2380
	2022-06-30 21:18:25.636570 I | etcdserver: starting member 8688e899f7831fc7 in cluster 9d8fdeb88b6def78
	2022-06-30 21:18:25.636614 I | raft: 8688e899f7831fc7 became follower at term 0
	2022-06-30 21:18:25.636623 I | raft: newRaft 8688e899f7831fc7 [peers: [], term: 0, commit: 0, applied: 0, lastindex: 0, lastterm: 0]
	2022-06-30 21:18:25.636631 I | raft: 8688e899f7831fc7 became follower at term 1
	2022-06-30 21:18:25.640654 W | auth: simple token is not cryptographically signed
	2022-06-30 21:18:25.649086 I | etcdserver: starting server... [version: 3.3.15, cluster version: to_be_decided]
	2022-06-30 21:18:25.649251 I | etcdserver: 8688e899f7831fc7 as single-node; fast-forwarding 9 ticks (election ticks 10)
	2022-06-30 21:18:25.649834 I | etcdserver/membership: added member 8688e899f7831fc7 [https://192.168.67.2:2380] to cluster 9d8fdeb88b6def78
	2022-06-30 21:18:25.651692 I | embed: ClientTLS: cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, ca = , trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = 
	2022-06-30 21:18:25.651838 I | embed: listening for metrics on http://127.0.0.1:2381
	2022-06-30 21:18:25.651913 I | embed: listening for metrics on http://192.168.67.2:2381
	2022-06-30 21:18:25.837077 I | raft: 8688e899f7831fc7 is starting a new election at term 1
	2022-06-30 21:18:25.837131 I | raft: 8688e899f7831fc7 became candidate at term 2
	2022-06-30 21:18:25.837160 I | raft: 8688e899f7831fc7 received MsgVoteResp from 8688e899f7831fc7 at term 2
	2022-06-30 21:18:25.837191 I | raft: 8688e899f7831fc7 became leader at term 2
	2022-06-30 21:18:25.837208 I | raft: raft.node: 8688e899f7831fc7 elected leader 8688e899f7831fc7 at term 2
	2022-06-30 21:18:25.837551 I | etcdserver: published {Name:old-k8s-version-20220630210005-9950 ClientURLs:[https://192.168.67.2:2379]} to cluster 9d8fdeb88b6def78
	2022-06-30 21:18:25.837611 I | embed: ready to serve client requests
	2022-06-30 21:18:25.837749 I | etcdserver: setting up the initial cluster version to 3.3
	2022-06-30 21:18:25.837829 I | embed: ready to serve client requests
	2022-06-30 21:18:25.838289 N | etcdserver/membership: set the initial cluster version to 3.3
	2022-06-30 21:18:25.838391 I | etcdserver/api: enabled capabilities for version 3.3
	2022-06-30 21:18:25.844856 I | embed: serving client requests on 192.168.67.2:2379
	2022-06-30 21:18:25.846232 I | embed: serving client requests on 127.0.0.1:2379
	
	* 
	* ==> kernel <==
	*  21:22:51 up  1:05,  0 users,  load average: 0.73, 0.64, 1.08
	Linux old-k8s-version-20220630210005-9950 5.15.0-1012-gcp #17~20.04.1-Ubuntu SMP Thu Jun 23 16:10:34 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
	PRETTY_NAME="Ubuntu 20.04.4 LTS"
	
	* 
	* ==> kube-apiserver [4d472dfb5cbc3bcdb49161f3dc6443c4d2267f99d7de41ba7e3aca4e91f39975] <==
	* I0630 21:18:32.109750       1 controller.go:606] quota admission added evaluator for: roles.rbac.authorization.k8s.io
	I0630 21:18:32.389440       1 controller.go:606] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
	W0630 21:18:32.650918       1 lease.go:222] Resetting endpoints for master service "kubernetes" to [192.168.67.2]
	I0630 21:18:32.651641       1 controller.go:606] quota admission added evaluator for: endpoints
	I0630 21:18:33.561798       1 controller.go:606] quota admission added evaluator for: serviceaccounts
	I0630 21:18:34.039035       1 controller.go:606] quota admission added evaluator for: deployments.apps
	I0630 21:18:34.401607       1 controller.go:606] quota admission added evaluator for: daemonsets.apps
	I0630 21:18:48.868583       1 controller.go:606] quota admission added evaluator for: controllerrevisions.apps
	I0630 21:18:48.880970       1 controller.go:606] quota admission added evaluator for: events.events.k8s.io
	I0630 21:18:49.236333       1 controller.go:606] quota admission added evaluator for: replicasets.apps
	I0630 21:18:53.046240       1 controller.go:107] OpenAPI AggregationController: Processing item v1beta1.metrics.k8s.io
	W0630 21:18:53.046415       1 handler_proxy.go:99] no RequestInfo found in the context
	E0630 21:18:53.046506       1 controller.go:114] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
	, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
	I0630 21:18:53.046524       1 controller.go:127] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
	I0630 21:19:53.046745       1 controller.go:107] OpenAPI AggregationController: Processing item v1beta1.metrics.k8s.io
	W0630 21:19:53.046835       1 handler_proxy.go:99] no RequestInfo found in the context
	E0630 21:19:53.046871       1 controller.go:114] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
	, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
	I0630 21:19:53.046885       1 controller.go:127] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
	I0630 21:21:53.047115       1 controller.go:107] OpenAPI AggregationController: Processing item v1beta1.metrics.k8s.io
	W0630 21:21:53.047224       1 handler_proxy.go:99] no RequestInfo found in the context
	E0630 21:21:53.047321       1 controller.go:114] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
	, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
	I0630 21:21:53.047332       1 controller.go:127] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
	
	* 
	* ==> kube-controller-manager [765fc80bc943e9f53d0c41e845cb64f7e927639090ca57a25cf3d208159f4cef] <==
	* I0630 21:18:51.454902       1 event.go:255] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kubernetes-dashboard", Name:"dashboard-metrics-scraper-6b84985989", UID:"eb2adc06-7f24-4370-842a-38e9fe9db2af", APIVersion:"apps/v1", ResourceVersion:"445", FieldPath:""}): type: 'Warning' reason: 'FailedCreate' Error creating: pods "dashboard-metrics-scraper-6b84985989-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found
	E0630 21:18:51.457479       1 replica_set.go:450] Sync "kubernetes-dashboard/kubernetes-dashboard-958c5c65f" failed with pods "kubernetes-dashboard-958c5c65f-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found
	I0630 21:18:51.457478       1 event.go:255] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kubernetes-dashboard", Name:"kubernetes-dashboard-958c5c65f", UID:"b047e449-74ec-410f-b5f2-8657ecf96c16", APIVersion:"apps/v1", ResourceVersion:"451", FieldPath:""}): type: 'Warning' reason: 'FailedCreate' Error creating: pods "kubernetes-dashboard-958c5c65f-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found
	E0630 21:18:51.526136       1 replica_set.go:450] Sync "kubernetes-dashboard/dashboard-metrics-scraper-6b84985989" failed with pods "dashboard-metrics-scraper-6b84985989-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found
	I0630 21:18:51.526155       1 event.go:255] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kubernetes-dashboard", Name:"kubernetes-dashboard-958c5c65f", UID:"b047e449-74ec-410f-b5f2-8657ecf96c16", APIVersion:"apps/v1", ResourceVersion:"451", FieldPath:""}): type: 'Warning' reason: 'FailedCreate' Error creating: pods "kubernetes-dashboard-958c5c65f-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found
	E0630 21:18:51.526136       1 replica_set.go:450] Sync "kubernetes-dashboard/kubernetes-dashboard-958c5c65f" failed with pods "kubernetes-dashboard-958c5c65f-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found
	I0630 21:18:51.526186       1 event.go:255] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kubernetes-dashboard", Name:"dashboard-metrics-scraper-6b84985989", UID:"eb2adc06-7f24-4370-842a-38e9fe9db2af", APIVersion:"apps/v1", ResourceVersion:"445", FieldPath:""}): type: 'Warning' reason: 'FailedCreate' Error creating: pods "dashboard-metrics-scraper-6b84985989-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found
	I0630 21:18:51.549775       1 event.go:255] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kubernetes-dashboard", Name:"kubernetes-dashboard-958c5c65f", UID:"b047e449-74ec-410f-b5f2-8657ecf96c16", APIVersion:"apps/v1", ResourceVersion:"451", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: kubernetes-dashboard-958c5c65f-z5ppk
	I0630 21:18:51.627523       1 event.go:255] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kubernetes-dashboard", Name:"dashboard-metrics-scraper-6b84985989", UID:"eb2adc06-7f24-4370-842a-38e9fe9db2af", APIVersion:"apps/v1", ResourceVersion:"445", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: dashboard-metrics-scraper-6b84985989-mn9fl
	I0630 21:18:52.051328       1 event.go:255] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kube-system", Name:"metrics-server-7958775c", UID:"3dde495c-6a45-4ee4-a63b-6bcc57e0ce37", APIVersion:"apps/v1", ResourceVersion:"411", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: metrics-server-7958775c-cbzqz
	E0630 21:19:19.519315       1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	W0630 21:19:21.268678       1 garbagecollector.go:640] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0630 21:19:49.770804       1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	W0630 21:19:53.270266       1 garbagecollector.go:640] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0630 21:20:20.022637       1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	W0630 21:20:25.272066       1 garbagecollector.go:640] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0630 21:20:50.275490       1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	W0630 21:20:57.273636       1 garbagecollector.go:640] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0630 21:21:20.527363       1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	W0630 21:21:29.275296       1 garbagecollector.go:640] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0630 21:21:50.779080       1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	W0630 21:22:01.277019       1 garbagecollector.go:640] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0630 21:22:21.030623       1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	W0630 21:22:33.278727       1 garbagecollector.go:640] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0630 21:22:51.282184       1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	
	* 
	* ==> kube-proxy [21661943a8d48cf903788eaca7389af17a1b11a7e37c19d4eb9c1f3600d42801] <==
	* W0630 21:18:49.665138       1 server_others.go:329] Flag proxy-mode="" unknown, assuming iptables proxy
	I0630 21:18:49.672583       1 node.go:135] Successfully retrieved node IP: 192.168.67.2
	I0630 21:18:49.672627       1 server_others.go:149] Using iptables Proxier.
	I0630 21:18:49.673147       1 server.go:529] Version: v1.16.0
	I0630 21:18:49.673678       1 config.go:313] Starting service config controller
	I0630 21:18:49.673711       1 shared_informer.go:197] Waiting for caches to sync for service config
	I0630 21:18:49.673745       1 config.go:131] Starting endpoints config controller
	I0630 21:18:49.673785       1 shared_informer.go:197] Waiting for caches to sync for endpoints config
	I0630 21:18:49.773903       1 shared_informer.go:204] Caches are synced for service config 
	I0630 21:18:49.773917       1 shared_informer.go:204] Caches are synced for endpoints config 
	
	* 
	* ==> kube-scheduler [3812d0fe0857bfbb2a03d38fd044dac87dea9f7097280208ff88d8fa17a0692c] <==
	* I0630 21:18:29.435248       1 secure_serving.go:123] Serving securely on 127.0.0.1:10259
	E0630 21:18:29.529005       1 reflector.go:123] k8s.io/kubernetes/cmd/kube-scheduler/app/server.go:236: Failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E0630 21:18:29.531463       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E0630 21:18:29.531531       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E0630 21:18:29.531587       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1beta1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E0630 21:18:29.531647       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E0630 21:18:29.531693       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	E0630 21:18:29.531741       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	E0630 21:18:29.531781       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0630 21:18:29.531851       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	E0630 21:18:29.531905       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	E0630 21:18:29.532856       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	E0630 21:18:30.530234       1 reflector.go:123] k8s.io/kubernetes/cmd/kube-scheduler/app/server.go:236: Failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E0630 21:18:30.532535       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E0630 21:18:30.533773       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E0630 21:18:30.535014       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1beta1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E0630 21:18:30.536244       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E0630 21:18:30.537706       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	E0630 21:18:30.538891       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	E0630 21:18:30.540023       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0630 21:18:30.541375       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	E0630 21:18:30.542285       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	E0630 21:18:30.543489       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	E0630 21:18:51.025531       1 factory.go:585] pod is already present in the activeQ
	E0630 21:18:51.630743       1 factory.go:585] pod is already present in the activeQ
	
	* 
	* ==> kubelet <==
	* -- Logs begin at Thu 2022-06-30 21:12:55 UTC, end at Thu 2022-06-30 21:22:51 UTC. --
	Jun 30 21:20:49 old-k8s-version-20220630210005-9950 kubelet[2979]: E0630 21:20:49.949864    2979 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:20:54 old-k8s-version-20220630210005-9950 kubelet[2979]: E0630 21:20:54.950703    2979 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:20:59 old-k8s-version-20220630210005-9950 kubelet[2979]: E0630 21:20:59.951566    2979 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:21:04 old-k8s-version-20220630210005-9950 kubelet[2979]: E0630 21:21:04.952417    2979 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:21:09 old-k8s-version-20220630210005-9950 kubelet[2979]: E0630 21:21:09.953232    2979 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:21:14 old-k8s-version-20220630210005-9950 kubelet[2979]: E0630 21:21:14.954050    2979 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:21:19 old-k8s-version-20220630210005-9950 kubelet[2979]: E0630 21:21:19.954877    2979 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:21:24 old-k8s-version-20220630210005-9950 kubelet[2979]: E0630 21:21:24.955645    2979 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:21:29 old-k8s-version-20220630210005-9950 kubelet[2979]: E0630 21:21:29.956491    2979 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:21:34 old-k8s-version-20220630210005-9950 kubelet[2979]: E0630 21:21:34.957613    2979 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:21:39 old-k8s-version-20220630210005-9950 kubelet[2979]: E0630 21:21:39.958348    2979 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:21:44 old-k8s-version-20220630210005-9950 kubelet[2979]: E0630 21:21:44.959190    2979 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:21:49 old-k8s-version-20220630210005-9950 kubelet[2979]: E0630 21:21:49.960057    2979 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:21:54 old-k8s-version-20220630210005-9950 kubelet[2979]: E0630 21:21:54.960816    2979 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:21:59 old-k8s-version-20220630210005-9950 kubelet[2979]: E0630 21:21:59.961705    2979 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:22:04 old-k8s-version-20220630210005-9950 kubelet[2979]: E0630 21:22:04.962523    2979 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:22:09 old-k8s-version-20220630210005-9950 kubelet[2979]: E0630 21:22:09.963331    2979 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:22:14 old-k8s-version-20220630210005-9950 kubelet[2979]: E0630 21:22:14.964211    2979 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:22:19 old-k8s-version-20220630210005-9950 kubelet[2979]: E0630 21:22:19.965032    2979 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:22:24 old-k8s-version-20220630210005-9950 kubelet[2979]: E0630 21:22:24.965844    2979 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:22:29 old-k8s-version-20220630210005-9950 kubelet[2979]: E0630 21:22:29.966717    2979 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:22:34 old-k8s-version-20220630210005-9950 kubelet[2979]: E0630 21:22:34.967517    2979 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:22:39 old-k8s-version-20220630210005-9950 kubelet[2979]: E0630 21:22:39.968321    2979 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:22:44 old-k8s-version-20220630210005-9950 kubelet[2979]: E0630 21:22:44.969139    2979 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:22:49 old-k8s-version-20220630210005-9950 kubelet[2979]: E0630 21:22:49.970003    2979 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	

                                                
                                                
-- /stdout --
helpers_test.go:254: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p old-k8s-version-20220630210005-9950 -n old-k8s-version-20220630210005-9950
helpers_test.go:261: (dbg) Run:  kubectl --context old-k8s-version-20220630210005-9950 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:270: non-running pods: coredns-5644d7b6d9-gpdfr metrics-server-7958775c-cbzqz storage-provisioner dashboard-metrics-scraper-6b84985989-mn9fl kubernetes-dashboard-958c5c65f-z5ppk
helpers_test.go:272: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: describe non-running pods <======
helpers_test.go:275: (dbg) Run:  kubectl --context old-k8s-version-20220630210005-9950 describe pod coredns-5644d7b6d9-gpdfr metrics-server-7958775c-cbzqz storage-provisioner dashboard-metrics-scraper-6b84985989-mn9fl kubernetes-dashboard-958c5c65f-z5ppk
helpers_test.go:275: (dbg) Non-zero exit: kubectl --context old-k8s-version-20220630210005-9950 describe pod coredns-5644d7b6d9-gpdfr metrics-server-7958775c-cbzqz storage-provisioner dashboard-metrics-scraper-6b84985989-mn9fl kubernetes-dashboard-958c5c65f-z5ppk: exit status 1 (57.930469ms)

                                                
                                                
** stderr ** 
	Error from server (NotFound): pods "coredns-5644d7b6d9-gpdfr" not found
	Error from server (NotFound): pods "metrics-server-7958775c-cbzqz" not found
	Error from server (NotFound): pods "storage-provisioner" not found
	Error from server (NotFound): pods "dashboard-metrics-scraper-6b84985989-mn9fl" not found
	Error from server (NotFound): pods "kubernetes-dashboard-958c5c65f-z5ppk" not found

                                                
                                                
** /stderr **
helpers_test.go:277: kubectl --context old-k8s-version-20220630210005-9950 describe pod coredns-5644d7b6d9-gpdfr metrics-server-7958775c-cbzqz storage-provisioner dashboard-metrics-scraper-6b84985989-mn9fl kubernetes-dashboard-958c5c65f-z5ppk: exit status 1
--- FAIL: TestStartStop/group/old-k8s-version/serial/SecondStart (597.98s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-different-port/serial/SecondStart (534.77s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-different-port/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-amd64 start -p default-k8s-different-port-20220630210335-9950 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.24.2
E0630 21:18:30.280393    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/functional-20220630202638-9950/client.crt: no such file or directory
E0630 21:18:30.339583    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/no-preload-20220630210237-9950/client.crt: no such file or directory
E0630 21:18:33.253755    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/addons-20220630202117-9950/client.crt: no such file or directory
E0630 21:18:50.204759    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/addons-20220630202117-9950/client.crt: no such file or directory
E0630 21:18:58.022521    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/no-preload-20220630210237-9950/client.crt: no such file or directory

                                                
                                                
=== CONT  TestStartStop/group/default-k8s-different-port/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p default-k8s-different-port-20220630210335-9950 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.24.2: exit status 80 (8m52.689476151s)

                                                
                                                
-- stdout --
	* [default-k8s-different-port-20220630210335-9950] minikube v1.26.0 on Ubuntu 20.04 (kvm/amd64)
	  - MINIKUBE_LOCATION=14420
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-amd64
	* Using the docker driver based on existing profile
	* Starting control plane node default-k8s-different-port-20220630210335-9950 in cluster default-k8s-different-port-20220630210335-9950
	* Pulling base image ...
	* Restarting existing docker container for "default-k8s-different-port-20220630210335-9950" ...
	* Preparing Kubernetes v1.24.2 on containerd 1.6.6 ...
	* Configuring CNI (Container Networking Interface) ...
	  - Generating certificates and keys ...
	  - Booting up control plane ...
	  - Configuring RBAC rules ...
	* Configuring CNI (Container Networking Interface) ...
	* Verifying Kubernetes components...
	  - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	  - Using image fake.domain/k8s.gcr.io/echoserver:1.4
	  - Using image kubernetesui/dashboard:v2.6.0
	  - Using image k8s.gcr.io/echoserver:1.4
	* Enabled addons: storage-provisioner, default-storageclass, metrics-server, dashboard
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0630 21:16:50.966935  276064 out.go:296] Setting OutFile to fd 1 ...
	I0630 21:16:50.967050  276064 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 21:16:50.967058  276064 out.go:309] Setting ErrFile to fd 2...
	I0630 21:16:50.967063  276064 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 21:16:50.967572  276064 root.go:329] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/bin
	I0630 21:16:50.967827  276064 out.go:303] Setting JSON to false
	I0630 21:16:50.969254  276064 start.go:115] hostinfo: {"hostname":"ubuntu-20-agent-8","uptime":3563,"bootTime":1656620248,"procs":364,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1012-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0630 21:16:50.969334  276064 start.go:125] virtualization: kvm guest
	I0630 21:16:50.972514  276064 out.go:177] * [default-k8s-different-port-20220630210335-9950] minikube v1.26.0 on Ubuntu 20.04 (kvm/amd64)
	I0630 21:16:50.974253  276064 notify.go:193] Checking for updates...
	I0630 21:16:50.974279  276064 out.go:177]   - MINIKUBE_LOCATION=14420
	I0630 21:16:50.976279  276064 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0630 21:16:50.977800  276064 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:16:50.979219  276064 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube
	I0630 21:16:50.980678  276064 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0630 21:16:50.982554  276064 config.go:178] Loaded profile config "default-k8s-different-port-20220630210335-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:16:50.982967  276064 driver.go:360] Setting default libvirt URI to qemu:///system
	I0630 21:16:51.027931  276064 docker.go:137] docker version: linux-20.10.17
	I0630 21:16:51.028102  276064 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0630 21:16:51.144684  276064 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:8 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:43 OomKillDisable:true NGoroutines:44 SystemTime:2022-06-30 21:16:51.060686748 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1012-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexServ
erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662451712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-8 Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Client
Info:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
	I0630 21:16:51.144792  276064 docker.go:254] overlay module found
	I0630 21:16:51.147252  276064 out.go:177] * Using the docker driver based on existing profile
	I0630 21:16:51.148837  276064 start.go:284] selected driver: docker
	I0630 21:16:51.148852  276064 start.go:808] validating driver "docker" against &{Name:default-k8s-different-port-20220630210335-9950 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:default-k8s-different-port-
20220630210335-9950 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8444 NodeName:} Nodes:[{Name: IP:192.168.85.2 Port:8444 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[Dashboard:kubernetesui/dashboard:v2.6.0@sha256:4af9580485920635d888efe1eddbd67e12f9d5d84dba87100e93feb4e46636b3 MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<ni
l> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 21:16:51.148978  276064 start.go:819] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0630 21:16:51.149857  276064 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0630 21:16:51.265416  276064 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:8 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:43 OomKillDisable:true NGoroutines:44 SystemTime:2022-06-30 21:16:51.183664679 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1012-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexServ
erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662451712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-8 Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Client
Info:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
	I0630 21:16:51.265705  276064 start_flags.go:853] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0630 21:16:51.265738  276064 cni.go:95] Creating CNI manager for ""
	I0630 21:16:51.265748  276064 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:16:51.265764  276064 start_flags.go:310] config:
	{Name:default-k8s-different-port-20220630210335-9950 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:default-k8s-different-port-20220630210335-9950 Namespace:default APIServerName:minikubeCA APIServerNames:[]
APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8444 NodeName:} Nodes:[{Name: IP:192.168.85.2 Port:8444 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[Dashboard:kubernetesui/dashboard:v2.6.0@sha256:4af9580485920635d888efe1eddbd67e12f9d5d84dba87100e93feb4e46636b3 MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false Extr
aDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 21:16:51.268956  276064 out.go:177] * Starting control plane node default-k8s-different-port-20220630210335-9950 in cluster default-k8s-different-port-20220630210335-9950
	I0630 21:16:51.270454  276064 cache.go:120] Beginning downloading kic base image for docker with containerd
	I0630 21:16:51.272072  276064 out.go:177] * Pulling base image ...
	I0630 21:16:51.273432  276064 preload.go:132] Checking if preload exists for k8s version v1.24.2 and runtime containerd
	I0630 21:16:51.273492  276064 preload.go:148] Found local preload: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-containerd-overlay2-amd64.tar.lz4
	I0630 21:16:51.273512  276064 cache.go:57] Caching tarball of preloaded images
	I0630 21:16:51.273529  276064 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e in local docker daemon
	I0630 21:16:51.273772  276064 preload.go:174] Found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-containerd-overlay2-amd64.tar.lz4 in cache, skipping download
	I0630 21:16:51.273795  276064 cache.go:60] Finished verifying existence of preloaded tar for  v1.24.2 on containerd
	I0630 21:16:51.273980  276064 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950/config.json ...
	I0630 21:16:51.311432  276064 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e in local docker daemon, skipping pull
	I0630 21:16:51.311463  276064 cache.go:142] gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e exists in daemon, skipping load
	I0630 21:16:51.311486  276064 cache.go:208] Successfully downloaded all kic artifacts
	I0630 21:16:51.311527  276064 start.go:352] acquiring machines lock for default-k8s-different-port-20220630210335-9950: {Name:mkd6267dded0280a468a53ba1411e87336e1a91d Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0630 21:16:51.311690  276064 start.go:356] acquired machines lock for "default-k8s-different-port-20220630210335-9950" in 121.686µs
	I0630 21:16:51.311717  276064 start.go:94] Skipping create...Using existing machine configuration
	I0630 21:16:51.311723  276064 fix.go:55] fixHost starting: 
	I0630 21:16:51.312051  276064 cli_runner.go:164] Run: docker container inspect default-k8s-different-port-20220630210335-9950 --format={{.State.Status}}
	I0630 21:16:51.348817  276064 fix.go:103] recreateIfNeeded on default-k8s-different-port-20220630210335-9950: state=Stopped err=<nil>
	W0630 21:16:51.348859  276064 fix.go:129] unexpected machine state, will restart: <nil>
	I0630 21:16:51.351576  276064 out.go:177] * Restarting existing docker container for "default-k8s-different-port-20220630210335-9950" ...
	I0630 21:16:51.353211  276064 cli_runner.go:164] Run: docker start default-k8s-different-port-20220630210335-9950
	I0630 21:16:51.784125  276064 cli_runner.go:164] Run: docker container inspect default-k8s-different-port-20220630210335-9950 --format={{.State.Status}}
	I0630 21:16:51.823431  276064 kic.go:416] container "default-k8s-different-port-20220630210335-9950" state is running.
	I0630 21:16:51.823821  276064 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" default-k8s-different-port-20220630210335-9950
	I0630 21:16:51.864121  276064 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950/config.json ...
	I0630 21:16:51.864335  276064 machine.go:88] provisioning docker machine ...
	I0630 21:16:51.864360  276064 ubuntu.go:169] provisioning hostname "default-k8s-different-port-20220630210335-9950"
	I0630 21:16:51.864403  276064 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	I0630 21:16:51.902321  276064 main.go:134] libmachine: Using SSH client type: native
	I0630 21:16:51.902482  276064 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil>  [] 0s} 127.0.0.1 49437 <nil> <nil>}
	I0630 21:16:51.902498  276064 main.go:134] libmachine: About to run SSH command:
	sudo hostname default-k8s-different-port-20220630210335-9950 && echo "default-k8s-different-port-20220630210335-9950" | sudo tee /etc/hostname
	I0630 21:16:51.903111  276064 main.go:134] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:37264->127.0.0.1:49437: read: connection reset by peer
	I0630 21:16:55.029787  276064 main.go:134] libmachine: SSH cmd err, output: <nil>: default-k8s-different-port-20220630210335-9950
	
	I0630 21:16:55.029873  276064 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	I0630 21:16:55.064739  276064 main.go:134] libmachine: Using SSH client type: native
	I0630 21:16:55.064912  276064 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil>  [] 0s} 127.0.0.1 49437 <nil> <nil>}
	I0630 21:16:55.064939  276064 main.go:134] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sdefault-k8s-different-port-20220630210335-9950' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 default-k8s-different-port-20220630210335-9950/g' /etc/hosts;
				else 
					echo '127.0.1.1 default-k8s-different-port-20220630210335-9950' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0630 21:16:55.180883  276064 main.go:134] libmachine: SSH cmd err, output: <nil>: 
	I0630 21:16:55.180914  276064 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube CaCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/c
erts/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube}
	I0630 21:16:55.180940  276064 ubuntu.go:177] setting up certificates
	I0630 21:16:55.180951  276064 provision.go:83] configureAuth start
	I0630 21:16:55.181011  276064 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" default-k8s-different-port-20220630210335-9950
	I0630 21:16:55.215343  276064 provision.go:138] copyHostCerts
	I0630 21:16:55.215420  276064 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem, removing ...
	I0630 21:16:55.215439  276064 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem
	I0630 21:16:55.215511  276064 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem (1679 bytes)
	I0630 21:16:55.215622  276064 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem, removing ...
	I0630 21:16:55.215634  276064 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem
	I0630 21:16:55.215677  276064 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem (1082 bytes)
	I0630 21:16:55.215759  276064 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem, removing ...
	I0630 21:16:55.215770  276064 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem
	I0630 21:16:55.215809  276064 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem (1123 bytes)
	I0630 21:16:55.215903  276064 provision.go:112] generating server cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem org=jenkins.default-k8s-different-port-20220630210335-9950 san=[192.168.85.2 127.0.0.1 localhost 127.0.0.1 minikube default-k8s-different-port-20220630210335-9950]
	I0630 21:16:55.303627  276064 provision.go:172] copyRemoteCerts
	I0630 21:16:55.303701  276064 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0630 21:16:55.303743  276064 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	I0630 21:16:55.339259  276064 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49437 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/default-k8s-different-port-20220630210335-9950/id_rsa Username:docker}
	I0630 21:16:55.425035  276064 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
	I0630 21:16:55.442972  276064 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem --> /etc/docker/server.pem (1306 bytes)
	I0630 21:16:55.460939  276064 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0630 21:16:55.479535  276064 provision.go:86] duration metric: configureAuth took 298.567386ms
	I0630 21:16:55.479564  276064 ubuntu.go:193] setting minikube options for container-runtime
	I0630 21:16:55.479755  276064 config.go:178] Loaded profile config "default-k8s-different-port-20220630210335-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:16:55.479769  276064 machine.go:91] provisioned docker machine in 3.615419564s
	I0630 21:16:55.479776  276064 start.go:306] post-start starting for "default-k8s-different-port-20220630210335-9950" (driver="docker")
	I0630 21:16:55.479781  276064 start.go:316] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0630 21:16:55.479826  276064 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0630 21:16:55.479856  276064 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	I0630 21:16:55.516445  276064 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49437 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/default-k8s-different-port-20220630210335-9950/id_rsa Username:docker}
	I0630 21:16:55.605006  276064 ssh_runner.go:195] Run: cat /etc/os-release
	I0630 21:16:55.607796  276064 main.go:134] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0630 21:16:55.607819  276064 main.go:134] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0630 21:16:55.607827  276064 main.go:134] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0630 21:16:55.607832  276064 info.go:137] Remote host: Ubuntu 20.04.4 LTS
	I0630 21:16:55.607842  276064 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/addons for local assets ...
	I0630 21:16:55.607887  276064 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files for local assets ...
	I0630 21:16:55.607954  276064 filesync.go:149] local asset: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem -> 99502.pem in /etc/ssl/certs
	I0630 21:16:55.608055  276064 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0630 21:16:55.615374  276064 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem --> /etc/ssl/certs/99502.pem (1708 bytes)
	I0630 21:16:55.632721  276064 start.go:309] post-start completed in 152.929775ms
	I0630 21:16:55.632792  276064 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0630 21:16:55.632840  276064 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	I0630 21:16:55.668667  276064 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49437 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/default-k8s-different-port-20220630210335-9950/id_rsa Username:docker}
	I0630 21:16:55.753554  276064 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0630 21:16:55.757419  276064 fix.go:57] fixHost completed within 4.445691374s
	I0630 21:16:55.757441  276064 start.go:81] releasing machines lock for "default-k8s-different-port-20220630210335-9950", held for 4.445735411s
	I0630 21:16:55.757521  276064 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" default-k8s-different-port-20220630210335-9950
	I0630 21:16:55.792226  276064 ssh_runner.go:195] Run: systemctl --version
	I0630 21:16:55.792274  276064 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	I0630 21:16:55.792285  276064 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/
	I0630 21:16:55.792345  276064 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	I0630 21:16:55.828844  276064 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49437 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/default-k8s-different-port-20220630210335-9950/id_rsa Username:docker}
	I0630 21:16:55.830622  276064 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49437 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/default-k8s-different-port-20220630210335-9950/id_rsa Username:docker}
	I0630 21:16:55.937225  276064 ssh_runner.go:195] Run: sudo systemctl stop -f crio
	I0630 21:16:55.949138  276064 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0630 21:16:55.958414  276064 docker.go:179] disabling docker service ...
	I0630 21:16:55.958460  276064 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0630 21:16:55.968294  276064 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0630 21:16:55.980142  276064 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0630 21:16:56.063123  276064 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0630 21:16:56.138018  276064 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0630 21:16:56.147719  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
	image-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0630 21:16:56.161177  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*sandbox_image = .*$|sandbox_image = "k8s.gcr.io/pause:3.7"|' -i /etc/containerd/config.toml"
	I0630 21:16:56.169502  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*restrict_oom_score_adj = .*$|restrict_oom_score_adj = false|' -i /etc/containerd/config.toml"
	I0630 21:16:56.177922  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*SystemdCgroup = .*$|SystemdCgroup = false|' -i /etc/containerd/config.toml"
	I0630 21:16:56.186445  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*conf_dir = .*$|conf_dir = "/etc/cni/net.mk"|' -i /etc/containerd/config.toml"
	I0630 21:16:56.195374  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^# imports|imports = ["/etc/containerd/containerd.conf.d/02-containerd.conf"]|' -i /etc/containerd/config.toml"
	I0630 21:16:56.203928  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc/containerd/containerd.conf.d && printf %s "dmVyc2lvbiA9IDIK" | base64 -d | sudo tee /etc/containerd/containerd.conf.d/02-containerd.conf"
	I0630 21:16:56.217454  276064 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0630 21:16:56.224869  276064 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0630 21:16:56.231883  276064 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0630 21:16:56.308696  276064 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0630 21:16:56.383126  276064 start.go:447] Will wait 60s for socket path /run/containerd/containerd.sock
	I0630 21:16:56.383218  276064 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
	I0630 21:16:56.386796  276064 start.go:468] Will wait 60s for crictl version
	I0630 21:16:56.386869  276064 ssh_runner.go:195] Run: sudo crictl version
	I0630 21:16:56.414891  276064 retry.go:31] will retry after 11.04660288s: Temporary Error: sudo crictl version: Process exited with status 1
	stdout:
	
	stderr:
	time="2022-06-30T21:16:56Z" level=fatal msg="getting the runtime version: rpc error: code = Unknown desc = server is not initialized yet"
	I0630 21:17:07.461709  276064 ssh_runner.go:195] Run: sudo crictl version
	I0630 21:17:07.486784  276064 start.go:477] Version:  0.1.0
	RuntimeName:  containerd
	RuntimeVersion:  1.6.6
	RuntimeApiVersion:  v1alpha2
	I0630 21:17:07.486852  276064 ssh_runner.go:195] Run: containerd --version
	I0630 21:17:07.518176  276064 ssh_runner.go:195] Run: containerd --version
	I0630 21:17:07.553071  276064 out.go:177] * Preparing Kubernetes v1.24.2 on containerd 1.6.6 ...
	I0630 21:17:07.554517  276064 cli_runner.go:164] Run: docker network inspect default-k8s-different-port-20220630210335-9950 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0630 21:17:07.590707  276064 ssh_runner.go:195] Run: grep 192.168.85.1	host.minikube.internal$ /etc/hosts
	I0630 21:17:07.594132  276064 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.85.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0630 21:17:07.603860  276064 preload.go:132] Checking if preload exists for k8s version v1.24.2 and runtime containerd
	I0630 21:17:07.603916  276064 ssh_runner.go:195] Run: sudo crictl images --output json
	I0630 21:17:07.628574  276064 containerd.go:547] all images are preloaded for containerd runtime.
	I0630 21:17:07.628598  276064 containerd.go:461] Images already preloaded, skipping extraction
	I0630 21:17:07.628640  276064 ssh_runner.go:195] Run: sudo crictl images --output json
	I0630 21:17:07.652928  276064 containerd.go:547] all images are preloaded for containerd runtime.
	I0630 21:17:07.652952  276064 cache_images.go:84] Images are preloaded, skipping loading
	I0630 21:17:07.652995  276064 ssh_runner.go:195] Run: sudo crictl info
	I0630 21:17:07.678461  276064 cni.go:95] Creating CNI manager for ""
	I0630 21:17:07.678485  276064 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:17:07.678497  276064 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
	I0630 21:17:07.678508  276064 kubeadm.go:158] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.85.2 APIServerPort:8444 KubernetesVersion:v1.24.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:default-k8s-different-port-20220630210335-9950 NodeName:default-k8s-different-port-20220630210335-9950 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.85.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.85.2
CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}
	I0630 21:17:07.678640  276064 kubeadm.go:162] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.85.2
	  bindPort: 8444
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: /run/containerd/containerd.sock
	  name: "default-k8s-different-port-20220630210335-9950"
	  kubeletExtraArgs:
	    node-ip: 192.168.85.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.85.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8444
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.24.2
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%"
	  nodefs.inodesFree: "0%"
	  imagefs.available: "0%"
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0630 21:17:07.678737  276064 kubeadm.go:961] kubelet [Unit]
	Wants=containerd.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.24.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=default-k8s-different-port-20220630210335-9950 --image-service-endpoint=unix:///run/containerd/containerd.sock --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.85.2 --runtime-request-timeout=15m
	
	[Install]
	 config:
	{KubernetesVersion:v1.24.2 ClusterName:default-k8s-different-port-20220630210335-9950 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8444 NodeName:}
	I0630 21:17:07.678784  276064 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.24.2
	I0630 21:17:07.686457  276064 binaries.go:44] Found k8s binaries, skipping transfer
	I0630 21:17:07.686529  276064 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0630 21:17:07.693832  276064 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (539 bytes)
	I0630 21:17:07.707636  276064 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0630 21:17:07.721677  276064 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2075 bytes)
	I0630 21:17:07.734937  276064 ssh_runner.go:195] Run: grep 192.168.85.2	control-plane.minikube.internal$ /etc/hosts
	I0630 21:17:07.738005  276064 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.85.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0630 21:17:07.747537  276064 certs.go:54] Setting up /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950 for IP: 192.168.85.2
	I0630 21:17:07.747650  276064 certs.go:182] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.key
	I0630 21:17:07.747694  276064 certs.go:182] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.key
	I0630 21:17:07.747791  276064 certs.go:298] skipping minikube-user signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950/client.key
	I0630 21:17:07.747859  276064 certs.go:298] skipping minikube signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950/apiserver.key.43b9df8c
	I0630 21:17:07.747913  276064 certs.go:298] skipping aggregator signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950/proxy-client.key
	I0630 21:17:07.748040  276064 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950.pem (1338 bytes)
	W0630 21:17:07.748082  276064 certs.go:384] ignoring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950_empty.pem, impossibly tiny 0 bytes
	I0630 21:17:07.748098  276064 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem (1679 bytes)
	I0630 21:17:07.748133  276064 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem (1082 bytes)
	I0630 21:17:07.748167  276064 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem (1123 bytes)
	I0630 21:17:07.748198  276064 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/key.pem (1679 bytes)
	I0630 21:17:07.748264  276064 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem (1708 bytes)
	I0630 21:17:07.749106  276064 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
	I0630 21:17:07.767893  276064 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I0630 21:17:07.785630  276064 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0630 21:17:07.803337  276064 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/default-k8s-different-port-20220630210335-9950/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
	I0630 21:17:07.820730  276064 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0630 21:17:07.838616  276064 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
	I0630 21:17:07.856055  276064 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0630 21:17:07.873512  276064 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
	I0630 21:17:07.890585  276064 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950.pem --> /usr/share/ca-certificates/9950.pem (1338 bytes)
	I0630 21:17:07.907549  276064 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem --> /usr/share/ca-certificates/99502.pem (1708 bytes)
	I0630 21:17:07.924815  276064 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0630 21:17:07.942013  276064 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0630 21:17:07.954570  276064 ssh_runner.go:195] Run: openssl version
	I0630 21:17:07.959418  276064 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/99502.pem && ln -fs /usr/share/ca-certificates/99502.pem /etc/ssl/certs/99502.pem"
	I0630 21:17:07.966969  276064 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/99502.pem
	I0630 21:17:07.970294  276064 certs.go:431] hashing: -rw-r--r-- 1 root root 1708 Jun 30 20:26 /usr/share/ca-certificates/99502.pem
	I0630 21:17:07.970348  276064 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/99502.pem
	I0630 21:17:07.975425  276064 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/99502.pem /etc/ssl/certs/3ec20f2e.0"
	I0630 21:17:07.982570  276064 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0630 21:17:07.990075  276064 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:17:07.993227  276064 certs.go:431] hashing: -rw-r--r-- 1 root root 1111 Jun 30 20:22 /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:17:07.993308  276064 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:17:07.997936  276064 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0630 21:17:08.004870  276064 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/9950.pem && ln -fs /usr/share/ca-certificates/9950.pem /etc/ssl/certs/9950.pem"
	I0630 21:17:08.012388  276064 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/9950.pem
	I0630 21:17:08.015454  276064 certs.go:431] hashing: -rw-r--r-- 1 root root 1338 Jun 30 20:26 /usr/share/ca-certificates/9950.pem
	I0630 21:17:08.015507  276064 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/9950.pem
	I0630 21:17:08.020347  276064 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/9950.pem /etc/ssl/certs/51391683.0"
	I0630 21:17:08.027230  276064 kubeadm.go:395] StartCluster: {Name:default-k8s-different-port-20220630210335-9950 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:default-k8s-different-port-20220630210335-9950
Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8444 NodeName:} Nodes:[{Name: IP:192.168.85.2 Port:8444 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[Dashboard:kubernetesui/dashboard:v2.6.0@sha256:4af9580485920635d888efe1eddbd67e12f9d5d84dba87100e93feb4e46636b3 MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] L
istenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 21:17:08.027336  276064 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
	I0630 21:17:08.027399  276064 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0630 21:17:08.053422  276064 cri.go:87] found id: "8a0d676731abf60921510a3216fa28f73fc776b06a7dd0ee1d1d2654e8b940e0"
	I0630 21:17:08.053446  276064 cri.go:87] found id: "aa0dfccd9a7c940761ea2c4805338d040616ef5e513c23001d346fe07a7c5eff"
	I0630 21:17:08.053454  276064 cri.go:87] found id: "b2e2e7466122cde98a4cb1eba9d3f61be1dc7eb41a6935e6c16b3334125a3df7"
	I0630 21:17:08.053465  276064 cri.go:87] found id: "56c1c7bc165ac17cdfb803f71cd26ff02ab6261448f17c5c4ac7f531a632c67b"
	I0630 21:17:08.053471  276064 cri.go:87] found id: "f0093895eba1080a2212532b5c34b83dc16abf6e2eccfb1bdf732d5e70875609"
	I0630 21:17:08.053477  276064 cri.go:87] found id: "a126cf77f563c9a045eb277d6616e24e487ddda0de594854165897f596aaacb9"
	I0630 21:17:08.053483  276064 cri.go:87] found id: ""
	I0630 21:17:08.053523  276064 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
	I0630 21:17:08.065844  276064 cri.go:114] JSON = null
	W0630 21:17:08.065891  276064 kubeadm.go:402] unpause failed: list paused: list returned 0 containers, but ps returned 6
	I0630 21:17:08.065932  276064 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0630 21:17:08.072868  276064 kubeadm.go:410] found existing configuration files, will attempt cluster restart
	I0630 21:17:08.072896  276064 kubeadm.go:626] restartCluster start
	I0630 21:17:08.072944  276064 ssh_runner.go:195] Run: sudo test -d /data/minikube
	I0630 21:17:08.079338  276064 kubeadm.go:127] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:08.080135  276064 kubeconfig.go:116] verify returned: extract IP: "default-k8s-different-port-20220630210335-9950" does not appear in /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:17:08.080723  276064 kubeconfig.go:127] "default-k8s-different-port-20220630210335-9950" context is missing from /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig - will repair!
	I0630 21:17:08.082722  276064 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig: {Name:mk34e4a4e7b04f624b9adbda4f77ee20b38308ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:17:08.084238  276064 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
	I0630 21:17:08.091015  276064 api_server.go:165] Checking apiserver status ...
	I0630 21:17:08.091128  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:17:08.099254  276064 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:08.299650  276064 api_server.go:165] Checking apiserver status ...
	I0630 21:17:08.299740  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:17:08.308443  276064 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:08.499766  276064 api_server.go:165] Checking apiserver status ...
	I0630 21:17:08.499859  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:17:08.508591  276064 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:08.699887  276064 api_server.go:165] Checking apiserver status ...
	I0630 21:17:08.699956  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:17:08.708853  276064 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:08.900127  276064 api_server.go:165] Checking apiserver status ...
	I0630 21:17:08.900211  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:17:08.908677  276064 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:09.099958  276064 api_server.go:165] Checking apiserver status ...
	I0630 21:17:09.100035  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:17:09.108964  276064 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:09.300024  276064 api_server.go:165] Checking apiserver status ...
	I0630 21:17:09.300118  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:17:09.308631  276064 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:09.499927  276064 api_server.go:165] Checking apiserver status ...
	I0630 21:17:09.500026  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:17:09.508471  276064 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:09.699757  276064 api_server.go:165] Checking apiserver status ...
	I0630 21:17:09.699831  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:17:09.708256  276064 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:09.899494  276064 api_server.go:165] Checking apiserver status ...
	I0630 21:17:09.899570  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:17:09.907971  276064 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:10.100304  276064 api_server.go:165] Checking apiserver status ...
	I0630 21:17:10.100402  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:17:10.109094  276064 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:10.300336  276064 api_server.go:165] Checking apiserver status ...
	I0630 21:17:10.300426  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:17:10.309013  276064 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:10.500327  276064 api_server.go:165] Checking apiserver status ...
	I0630 21:17:10.500416  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:17:10.509116  276064 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:10.699333  276064 api_server.go:165] Checking apiserver status ...
	I0630 21:17:10.699419  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:17:10.708381  276064 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:10.899430  276064 api_server.go:165] Checking apiserver status ...
	I0630 21:17:10.899511  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:17:10.908350  276064 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:11.099965  276064 api_server.go:165] Checking apiserver status ...
	I0630 21:17:11.100038  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:17:11.108876  276064 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:11.108901  276064 api_server.go:165] Checking apiserver status ...
	I0630 21:17:11.108941  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:17:11.116800  276064 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:11.116827  276064 kubeadm.go:601] needs reconfigure: apiserver error: timed out waiting for the condition
	I0630 21:17:11.116834  276064 kubeadm.go:1092] stopping kube-system containers ...
	I0630 21:17:11.116847  276064 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name: Namespaces:[kube-system]}
	I0630 21:17:11.116901  276064 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0630 21:17:11.141421  276064 cri.go:87] found id: "8a0d676731abf60921510a3216fa28f73fc776b06a7dd0ee1d1d2654e8b940e0"
	I0630 21:17:11.141447  276064 cri.go:87] found id: "aa0dfccd9a7c940761ea2c4805338d040616ef5e513c23001d346fe07a7c5eff"
	I0630 21:17:11.141456  276064 cri.go:87] found id: "b2e2e7466122cde98a4cb1eba9d3f61be1dc7eb41a6935e6c16b3334125a3df7"
	I0630 21:17:11.141464  276064 cri.go:87] found id: "56c1c7bc165ac17cdfb803f71cd26ff02ab6261448f17c5c4ac7f531a632c67b"
	I0630 21:17:11.141472  276064 cri.go:87] found id: "f0093895eba1080a2212532b5c34b83dc16abf6e2eccfb1bdf732d5e70875609"
	I0630 21:17:11.141481  276064 cri.go:87] found id: "a126cf77f563c9a045eb277d6616e24e487ddda0de594854165897f596aaacb9"
	I0630 21:17:11.141491  276064 cri.go:87] found id: ""
	I0630 21:17:11.141498  276064 cri.go:232] Stopping containers: [8a0d676731abf60921510a3216fa28f73fc776b06a7dd0ee1d1d2654e8b940e0 aa0dfccd9a7c940761ea2c4805338d040616ef5e513c23001d346fe07a7c5eff b2e2e7466122cde98a4cb1eba9d3f61be1dc7eb41a6935e6c16b3334125a3df7 56c1c7bc165ac17cdfb803f71cd26ff02ab6261448f17c5c4ac7f531a632c67b f0093895eba1080a2212532b5c34b83dc16abf6e2eccfb1bdf732d5e70875609 a126cf77f563c9a045eb277d6616e24e487ddda0de594854165897f596aaacb9]
	I0630 21:17:11.141550  276064 ssh_runner.go:195] Run: which crictl
	I0630 21:17:11.144525  276064 ssh_runner.go:195] Run: sudo /usr/bin/crictl stop 8a0d676731abf60921510a3216fa28f73fc776b06a7dd0ee1d1d2654e8b940e0 aa0dfccd9a7c940761ea2c4805338d040616ef5e513c23001d346fe07a7c5eff b2e2e7466122cde98a4cb1eba9d3f61be1dc7eb41a6935e6c16b3334125a3df7 56c1c7bc165ac17cdfb803f71cd26ff02ab6261448f17c5c4ac7f531a632c67b f0093895eba1080a2212532b5c34b83dc16abf6e2eccfb1bdf732d5e70875609 a126cf77f563c9a045eb277d6616e24e487ddda0de594854165897f596aaacb9
	I0630 21:17:11.169277  276064 ssh_runner.go:195] Run: sudo systemctl stop kubelet
	I0630 21:17:11.179637  276064 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0630 21:17:11.187013  276064 kubeadm.go:155] found existing configuration files:
	-rw------- 1 root root 5643 Jun 30 21:04 /etc/kubernetes/admin.conf
	-rw------- 1 root root 5656 Jun 30 21:04 /etc/kubernetes/controller-manager.conf
	-rw------- 1 root root 2123 Jun 30 21:04 /etc/kubernetes/kubelet.conf
	-rw------- 1 root root 5600 Jun 30 21:04 /etc/kubernetes/scheduler.conf
	
	I0630 21:17:11.187084  276064 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/admin.conf
	I0630 21:17:11.194742  276064 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/kubelet.conf
	I0630 21:17:11.201953  276064 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/controller-manager.conf
	I0630 21:17:11.209038  276064 kubeadm.go:166] "https://control-plane.minikube.internal:8444" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/controller-manager.conf: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:11.209190  276064 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
	I0630 21:17:11.215649  276064 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/scheduler.conf
	I0630 21:17:11.223164  276064 kubeadm.go:166] "https://control-plane.minikube.internal:8444" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/scheduler.conf: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:17:11.223223  276064 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
	I0630 21:17:11.229790  276064 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0630 21:17:11.236785  276064 kubeadm.go:703] reconfiguring cluster from /var/tmp/minikube/kubeadm.yaml
	I0630 21:17:11.236816  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:17:11.281948  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:17:12.032331  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:17:12.230970  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:17:12.282521  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:17:12.364001  276064 api_server.go:51] waiting for apiserver process to appear ...
	I0630 21:17:12.364069  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 21:17:12.928375  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 21:17:13.428055  276064 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 21:17:13.439931  276064 api_server.go:71] duration metric: took 1.075932663s to wait for apiserver process to appear ...
	I0630 21:17:13.439968  276064 api_server.go:87] waiting for apiserver healthz status ...
	I0630 21:17:13.439983  276064 api_server.go:240] Checking apiserver healthz at https://192.168.85.2:8444/healthz ...
	I0630 21:17:13.440396  276064 api_server.go:256] stopped: https://192.168.85.2:8444/healthz: Get "https://192.168.85.2:8444/healthz": dial tcp 192.168.85.2:8444: connect: connection refused
	I0630 21:17:13.941137  276064 api_server.go:240] Checking apiserver healthz at https://192.168.85.2:8444/healthz ...
	I0630 21:17:16.970176  276064 api_server.go:266] https://192.168.85.2:8444/healthz returned 403:
	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
	W0630 21:17:16.970281  276064 api_server.go:102] status: https://192.168.85.2:8444/healthz returned error 403:
	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
	I0630 21:17:17.440596  276064 api_server.go:240] Checking apiserver healthz at https://192.168.85.2:8444/healthz ...
	I0630 21:17:17.445089  276064 api_server.go:266] https://192.168.85.2:8444/healthz returned 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/bootstrap-controller ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-registration-controller ok
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	W0630 21:17:17.445118  276064 api_server.go:102] status: https://192.168.85.2:8444/healthz returned error 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/bootstrap-controller ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-registration-controller ok
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	I0630 21:17:17.940639  276064 api_server.go:240] Checking apiserver healthz at https://192.168.85.2:8444/healthz ...
	I0630 21:17:17.945039  276064 api_server.go:266] https://192.168.85.2:8444/healthz returned 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/bootstrap-controller ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-registration-controller ok
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	W0630 21:17:17.945092  276064 api_server.go:102] status: https://192.168.85.2:8444/healthz returned error 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/bootstrap-controller ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-registration-controller ok
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	I0630 21:17:18.440744  276064 api_server.go:240] Checking apiserver healthz at https://192.168.85.2:8444/healthz ...
	I0630 21:17:18.446044  276064 api_server.go:266] https://192.168.85.2:8444/healthz returned 200:
	ok
	I0630 21:17:18.452561  276064 api_server.go:140] control plane version: v1.24.2
	I0630 21:17:18.452593  276064 api_server.go:130] duration metric: took 5.012617644s to wait for apiserver health ...
	I0630 21:17:18.452606  276064 cni.go:95] Creating CNI manager for ""
	I0630 21:17:18.452614  276064 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:17:18.455712  276064 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0630 21:17:18.457354  276064 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0630 21:17:18.461356  276064 cni.go:189] applying CNI manifest using /var/lib/minikube/binaries/v1.24.2/kubectl ...
	I0630 21:17:18.461384  276064 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2429 bytes)
	I0630 21:17:18.476680  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0630 21:17:19.208419  276064 system_pods.go:43] waiting for kube-system pods to appear ...
	I0630 21:17:19.215629  276064 system_pods.go:59] 9 kube-system pods found
	I0630 21:17:19.215671  276064 system_pods.go:61] "coredns-6d4b75cb6d-cnt2b" [b58df724-5405-4aba-a22f-f4120f8779bc] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.)
	I0630 21:17:19.215688  276064 system_pods.go:61] "etcd-default-k8s-different-port-20220630210335-9950" [8da212f9-02a7-4954-94f5-8077bf78d9fb] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
	I0630 21:17:19.215695  276064 system_pods.go:61] "kindnet-jgsc8" [a63f0d82-ce2a-4e93-8747-604386ef8614] Running
	I0630 21:17:19.215705  276064 system_pods.go:61] "kube-apiserver-default-k8s-different-port-20220630210335-9950" [54b12248-2640-4cf7-871c-4dbef2dc7c9a] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
	I0630 21:17:19.215712  276064 system_pods.go:61] "kube-controller-manager-default-k8s-different-port-20220630210335-9950" [ff13afcf-d2e9-4331-af05-4bd5b381c79f] Running
	I0630 21:17:19.215722  276064 system_pods.go:61] "kube-proxy-jb4cj" [f292d396-44fc-483d-953b-c68f7b577b9b] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])
	I0630 21:17:19.215740  276064 system_pods.go:61] "kube-scheduler-default-k8s-different-port-20220630210335-9950" [5084f0d6-256a-49d8-ad62-a4387b3294e6] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
	I0630 21:17:19.215754  276064 system_pods.go:61] "metrics-server-5c6f97fb75-x6zm5" [a1e08a16-27f2-46e5-b750-2cc850c04f6b] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.)
	I0630 21:17:19.215764  276064 system_pods.go:61] "storage-provisioner" [d81da5a0-3c72-4f2c-809f-765c2a24f394] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.)
	I0630 21:17:19.215777  276064 system_pods.go:74] duration metric: took 7.333478ms to wait for pod list to return data ...
	I0630 21:17:19.215791  276064 node_conditions.go:102] verifying NodePressure condition ...
	I0630 21:17:19.219070  276064 node_conditions.go:122] node storage ephemeral capacity is 304695084Ki
	I0630 21:17:19.219100  276064 node_conditions.go:123] node cpu capacity is 8
	I0630 21:17:19.219117  276064 node_conditions.go:105] duration metric: took 3.314072ms to run NodePressure ...
	I0630 21:17:19.219138  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:17:19.376298  276064 kubeadm.go:762] waiting for restarted kubelet to initialise ...
	I0630 21:17:19.381176  276064 kubeadm.go:777] kubelet initialised
	I0630 21:17:19.381202  276064 kubeadm.go:778] duration metric: took 4.876872ms waiting for restarted kubelet to initialise ...
	I0630 21:17:19.381212  276064 pod_ready.go:35] extra waiting up to 4m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0630 21:17:19.386560  276064 pod_ready.go:78] waiting up to 4m0s for pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace to be "Ready" ...
	I0630 21:17:21.392685  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:23.393750  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:25.893175  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:27.893469  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:29.893499  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:32.393130  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:34.393582  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:36.892837  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:38.893539  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:40.893713  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:43.392717  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:45.393415  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:47.893653  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:50.393622  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:52.893793  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:55.393246  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:57.393362  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:17:59.893210  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:01.893501  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:04.392897  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:06.393131  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:08.393775  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:10.893517  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:13.392641  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:15.393306  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:17.893231  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:20.393182  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:22.394236  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:24.893780  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:27.393787  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:29.893470  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:31.893548  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:33.899294  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:36.392935  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:38.393728  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:40.893778  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:43.393444  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:45.393499  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:47.893388  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:50.393444  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:52.894083  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:55.393258  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:57.393506  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:18:59.893037  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:19:01.893409  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:19:04.393312  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:19:06.393389  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:19:08.893380  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:19:11.394532  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:19:13.893106  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:19:15.893450  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:19:18.393510  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:19:20.893487  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:19:23.393825  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:19:25.892844  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:19:27.893374  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:19:30.393226  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:19:32.893321  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:19:35.393425  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:19:37.893818  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:19:40.393213  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:19:42.393442  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:19:44.393478  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:19:46.893774  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:19:49.393504  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:19:51.393536  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:19:53.893410  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:19:56.392904  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:19:58.393141  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:00.393202  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:02.393449  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:04.893746  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:07.393189  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:09.893794  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:12.392956  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:14.393428  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:16.893342  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:18.893566  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:21.393221  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:23.893682  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:26.393339  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:28.893287  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:30.893492  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:33.392832  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:35.393314  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:37.893265  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:39.893463  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:42.393015  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:44.893292  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:46.893432  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:49.393236  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:51.393511  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:53.893578  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:56.393487  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:58.892932  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:00.893465  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:03.392696  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:05.393231  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:07.893418  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:10.392505  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:12.393783  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:14.893314  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:17.393363  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:19.390281  276064 pod_ready.go:81] duration metric: took 4m0.003663432s waiting for pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace to be "Ready" ...
	E0630 21:21:19.390317  276064 pod_ready.go:66] WaitExtra: waitPodCondition: timed out waiting 4m0s for pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace to be "Ready" (will not retry!)
	I0630 21:21:19.390344  276064 pod_ready.go:38] duration metric: took 4m0.009122224s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0630 21:21:19.390376  276064 kubeadm.go:630] restartCluster took 4m11.317474742s
	W0630 21:21:19.390560  276064 out.go:239] ! Unable to restart cluster, will reset it: extra: timed out waiting 4m0s for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready"
	! Unable to restart cluster, will reset it: extra: timed out waiting 4m0s for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready"
	I0630 21:21:19.390595  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm reset --cri-socket /run/containerd/containerd.sock --force"
	I0630 21:21:21.023971  276064 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm reset --cri-socket /run/containerd/containerd.sock --force": (1.633354294s)
	I0630 21:21:21.024036  276064 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 21:21:21.033944  276064 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0630 21:21:21.041255  276064 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver
	I0630 21:21:21.041307  276064 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0630 21:21:21.048131  276064 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0630 21:21:21.048170  276064 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0630 21:21:30.433489  276064 out.go:204]   - Generating certificates and keys ...
	I0630 21:21:30.436707  276064 out.go:204]   - Booting up control plane ...
	I0630 21:21:30.439842  276064 out.go:204]   - Configuring RBAC rules ...
	I0630 21:21:30.442245  276064 cni.go:95] Creating CNI manager for ""
	I0630 21:21:30.442271  276064 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:21:30.444232  276064 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0630 21:21:30.446289  276064 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0630 21:21:30.450161  276064 cni.go:189] applying CNI manifest using /var/lib/minikube/binaries/v1.24.2/kubectl ...
	I0630 21:21:30.450180  276064 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2429 bytes)
	I0630 21:21:30.464668  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0630 21:21:31.250327  276064 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0630 21:21:31.250457  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:31.250483  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl label nodes minikube.k8s.io/version=v1.26.0 minikube.k8s.io/commit=251ffcec0e4c997cd7732864187747cc579943c9 minikube.k8s.io/name=default-k8s-different-port-20220630210335-9950 minikube.k8s.io/updated_at=2022_06_30T21_21_31_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:31.337104  276064 ops.go:34] apiserver oom_adj: -16
	I0630 21:21:31.337122  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:31.898846  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:32.398504  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:32.898395  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:33.399197  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:33.898224  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:34.399278  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:34.898766  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:35.399106  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:35.898541  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:36.399149  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:36.899206  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:37.398969  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:37.898306  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:38.398247  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:38.898685  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:39.399050  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:39.899197  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:40.399284  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:40.898565  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:41.398285  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:41.899049  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:42.399136  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:42.898362  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:42.955690  276064 kubeadm.go:1045] duration metric: took 11.705297596s to wait for elevateKubeSystemPrivileges.
	I0630 21:21:42.955725  276064 kubeadm.go:397] StartCluster complete in 4m34.928502204s
	I0630 21:21:42.955749  276064 settings.go:142] acquiring lock: {Name:mkcbd229caa05b60d3551ef0b47eea08424c9b5d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:21:42.955839  276064 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:21:42.956940  276064 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig: {Name:mk34e4a4e7b04f624b9adbda4f77ee20b38308ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:21:43.471460  276064 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "default-k8s-different-port-20220630210335-9950" rescaled to 1
	I0630 21:21:43.471523  276064 start.go:208] Will wait 6m0s for node &{Name: IP:192.168.85.2 Port:8444 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0630 21:21:43.473505  276064 out.go:177] * Verifying Kubernetes components...
	I0630 21:21:43.471586  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0630 21:21:43.471607  276064 addons.go:412] enableAddons start: toEnable=map[dashboard:true metrics-server:true], additional=[]
	I0630 21:21:43.471793  276064 config.go:178] Loaded profile config "default-k8s-different-port-20220630210335-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:21:43.474864  276064 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 21:21:43.474932  276064 addons.go:65] Setting dashboard=true in profile "default-k8s-different-port-20220630210335-9950"
	I0630 21:21:43.474957  276064 addons.go:65] Setting default-storageclass=true in profile "default-k8s-different-port-20220630210335-9950"
	I0630 21:21:43.474976  276064 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "default-k8s-different-port-20220630210335-9950"
	I0630 21:21:43.474962  276064 addons.go:153] Setting addon dashboard=true in "default-k8s-different-port-20220630210335-9950"
	W0630 21:21:43.475061  276064 addons.go:162] addon dashboard should already be in state true
	I0630 21:21:43.475110  276064 host.go:66] Checking if "default-k8s-different-port-20220630210335-9950" exists ...
	I0630 21:21:43.474944  276064 addons.go:65] Setting metrics-server=true in profile "default-k8s-different-port-20220630210335-9950"
	I0630 21:21:43.475161  276064 addons.go:153] Setting addon metrics-server=true in "default-k8s-different-port-20220630210335-9950"
	W0630 21:21:43.475179  276064 addons.go:162] addon metrics-server should already be in state true
	I0630 21:21:43.475224  276064 host.go:66] Checking if "default-k8s-different-port-20220630210335-9950" exists ...
	I0630 21:21:43.474932  276064 addons.go:65] Setting storage-provisioner=true in profile "default-k8s-different-port-20220630210335-9950"
	I0630 21:21:43.475323  276064 cli_runner.go:164] Run: docker container inspect default-k8s-different-port-20220630210335-9950 --format={{.State.Status}}
	I0630 21:21:43.475319  276064 addons.go:153] Setting addon storage-provisioner=true in "default-k8s-different-port-20220630210335-9950"
	W0630 21:21:43.475359  276064 addons.go:162] addon storage-provisioner should already be in state true
	I0630 21:21:43.475407  276064 host.go:66] Checking if "default-k8s-different-port-20220630210335-9950" exists ...
	I0630 21:21:43.475586  276064 cli_runner.go:164] Run: docker container inspect default-k8s-different-port-20220630210335-9950 --format={{.State.Status}}
	I0630 21:21:43.475682  276064 cli_runner.go:164] Run: docker container inspect default-k8s-different-port-20220630210335-9950 --format={{.State.Status}}
	I0630 21:21:43.475805  276064 cli_runner.go:164] Run: docker container inspect default-k8s-different-port-20220630210335-9950 --format={{.State.Status}}
	I0630 21:21:43.525211  276064 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0630 21:21:43.526633  276064 addons.go:345] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 21:21:43.526654  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0630 21:21:43.526703  276064 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	I0630 21:21:43.529674  276064 out.go:177]   - Using image fake.domain/k8s.gcr.io/echoserver:1.4
	I0630 21:21:43.531135  276064 addons.go:345] installing /etc/kubernetes/addons/metrics-apiservice.yaml
	I0630 21:21:43.531154  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
	I0630 21:21:43.532388  276064 out.go:177]   - Using image kubernetesui/dashboard:v2.6.0
	I0630 21:21:43.531211  276064 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	I0630 21:21:43.534873  276064 out.go:177]   - Using image k8s.gcr.io/echoserver:1.4
	I0630 21:21:43.536294  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-ns.yaml
	I0630 21:21:43.536318  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
	I0630 21:21:43.535327  276064 addons.go:153] Setting addon default-storageclass=true in "default-k8s-different-port-20220630210335-9950"
	I0630 21:21:43.536373  276064 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	W0630 21:21:43.536390  276064 addons.go:162] addon default-storageclass should already be in state true
	I0630 21:21:43.536436  276064 host.go:66] Checking if "default-k8s-different-port-20220630210335-9950" exists ...
	I0630 21:21:43.536996  276064 cli_runner.go:164] Run: docker container inspect default-k8s-different-port-20220630210335-9950 --format={{.State.Status}}
	I0630 21:21:43.568952  276064 node_ready.go:35] waiting up to 6m0s for node "default-k8s-different-port-20220630210335-9950" to be "Ready" ...
	I0630 21:21:43.569160  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.85.1 host.minikube.internal\n           fallthrough\n        }' | sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0630 21:21:43.573720  276064 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49437 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/default-k8s-different-port-20220630210335-9950/id_rsa Username:docker}
	I0630 21:21:43.585132  276064 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49437 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/default-k8s-different-port-20220630210335-9950/id_rsa Username:docker}
	I0630 21:21:43.585211  276064 addons.go:345] installing /etc/kubernetes/addons/storageclass.yaml
	I0630 21:21:43.585226  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0630 21:21:43.585277  276064 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	I0630 21:21:43.592285  276064 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49437 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/default-k8s-different-port-20220630210335-9950/id_rsa Username:docker}
	I0630 21:21:43.623221  276064 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49437 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/default-k8s-different-port-20220630210335-9950/id_rsa Username:docker}
	I0630 21:21:43.744945  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
	I0630 21:21:43.744974  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
	I0630 21:21:43.747847  276064 addons.go:345] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
	I0630 21:21:43.747873  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1820 bytes)
	I0630 21:21:43.748263  276064 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 21:21:43.924785  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
	I0630 21:21:43.924816  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
	I0630 21:21:43.928618  276064 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0630 21:21:43.940306  276064 addons.go:345] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
	I0630 21:21:43.940338  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
	I0630 21:21:43.950742  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-configmap.yaml
	I0630 21:21:43.950768  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
	I0630 21:21:44.037060  276064 addons.go:345] installing /etc/kubernetes/addons/metrics-server-service.yaml
	I0630 21:21:44.037089  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
	I0630 21:21:44.047010  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-dp.yaml
	I0630 21:21:44.047034  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4196 bytes)
	I0630 21:21:44.135080  276064 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I0630 21:21:44.140888  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-role.yaml
	I0630 21:21:44.140919  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
	I0630 21:21:44.230459  276064 start.go:806] {"host.minikube.internal": 192.168.85.1} host record injected into CoreDNS
	I0630 21:21:44.235255  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
	I0630 21:21:44.235283  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
	I0630 21:21:44.327158  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-sa.yaml
	I0630 21:21:44.327192  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
	I0630 21:21:44.351459  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-secret.yaml
	I0630 21:21:44.351527  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
	I0630 21:21:44.448179  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-svc.yaml
	I0630 21:21:44.448218  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
	I0630 21:21:44.537927  276064 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	I0630 21:21:45.130031  276064 addons.go:383] Verifying addon metrics-server=true in "default-k8s-different-port-20220630210335-9950"
	I0630 21:21:45.539430  276064 out.go:177] * Enabled addons: storage-provisioner, default-storageclass, metrics-server, dashboard
	I0630 21:21:45.540750  276064 addons.go:414] enableAddons completed in 2.0691399s
	I0630 21:21:45.575595  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:21:47.576330  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:21:49.576407  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:21:52.076426  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:21:54.076887  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:21:56.575738  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:21:58.576604  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:00.577162  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:03.075860  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:05.076679  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:07.576553  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:10.075989  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:12.076661  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:14.576273  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:17.075764  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:19.076352  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:21.575906  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:24.076044  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:26.076272  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:28.076381  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:30.576589  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:33.075544  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:35.076859  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:37.576222  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:40.076094  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:42.076569  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:44.575778  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:47.075947  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:49.576265  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:52.075526  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:54.076399  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:56.575822  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:58.576331  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:00.576702  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:03.076469  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:05.576257  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:08.076793  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:10.576173  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:13.075956  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:15.076120  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:17.576068  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:20.076292  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:22.076376  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:24.576689  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:27.075866  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:29.075916  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:31.076034  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:33.076065  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:35.575815  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:38.076264  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:40.076307  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:42.576389  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:45.076289  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:47.576205  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:50.076370  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:52.576483  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:55.076140  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:57.077197  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:59.575847  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:02.076497  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:04.576615  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:07.076328  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:09.076375  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:11.575987  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:13.576105  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:15.576639  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:18.076538  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:20.576354  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:23.076485  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:25.575931  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:28.076238  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:30.076402  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:32.076763  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:34.576381  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:36.576542  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:39.075659  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:41.076287  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:43.076543  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:45.576221  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:48.076060  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:50.575977  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:52.576199  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:54.577462  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:57.076377  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:59.575515  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:01.575803  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:03.576220  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:05.576603  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:08.075989  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:10.576424  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:13.075816  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:15.076512  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:17.575814  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:19.576180  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:22.076523  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:24.076612  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:26.076674  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:28.575901  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:31.076339  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:33.576385  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:36.076191  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:38.576126  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:40.576363  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:43.076600  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:43.577767  276064 node_ready.go:38] duration metric: took 4m0.008779238s waiting for node "default-k8s-different-port-20220630210335-9950" to be "Ready" ...
	I0630 21:25:43.580054  276064 out.go:177] 
	W0630 21:25:43.581406  276064 out.go:239] X Exiting due to GUEST_START: wait 6m0s for node: waiting for node to be ready: waitNodeCondition: timed out waiting for the condition
	X Exiting due to GUEST_START: wait 6m0s for node: waiting for node to be ready: waitNodeCondition: timed out waiting for the condition
	W0630 21:25:43.581422  276064 out.go:239] * 
	* 
	W0630 21:25:43.582123  276064 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0630 21:25:43.583833  276064 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-linux-amd64 start -p default-k8s-different-port-20220630210335-9950 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.24.2": exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestStartStop/group/default-k8s-different-port/serial/SecondStart]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect default-k8s-different-port-20220630210335-9950
helpers_test.go:235: (dbg) docker inspect default-k8s-different-port-20220630210335-9950:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "99f8da15dcfc83187a1db4c0b15dfeb5920d55fd52718f4f99a491d1ec9f59fc",
	        "Created": "2022-06-30T21:03:43.366289202Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 276364,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2022-06-30T21:16:51.775031109Z",
	            "FinishedAt": "2022-06-30T21:16:50.340305297Z"
	        },
	        "Image": "sha256:573e7be5768273a7845baee1ae90fa2e33b83b10a7fbb0f0f41efbf29b53d1f1",
	        "ResolvConfPath": "/var/lib/docker/containers/99f8da15dcfc83187a1db4c0b15dfeb5920d55fd52718f4f99a491d1ec9f59fc/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/99f8da15dcfc83187a1db4c0b15dfeb5920d55fd52718f4f99a491d1ec9f59fc/hostname",
	        "HostsPath": "/var/lib/docker/containers/99f8da15dcfc83187a1db4c0b15dfeb5920d55fd52718f4f99a491d1ec9f59fc/hosts",
	        "LogPath": "/var/lib/docker/containers/99f8da15dcfc83187a1db4c0b15dfeb5920d55fd52718f4f99a491d1ec9f59fc/99f8da15dcfc83187a1db4c0b15dfeb5920d55fd52718f4f99a491d1ec9f59fc-json.log",
	        "Name": "/default-k8s-different-port-20220630210335-9950",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "default-k8s-different-port-20220630210335-9950:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "default-k8s-different-port-20220630210335-9950",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8444/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 2306867200,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": null,
	            "BlkioDeviceWriteBps": null,
	            "BlkioDeviceReadIOps": null,
	            "BlkioDeviceWriteIOps": null,
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "KernelMemory": 0,
	            "KernelMemoryTCP": 0,
	            "MemoryReservation": 0,
	            "MemorySwap": 4613734400,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": null,
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/6cae4fbb3ff06bafae7d678b8be88c46f728f7e162403189e54b6a928eed1dda-init/diff:/var/lib/docker/overlay2/8b88d9f6f12c48be642a133456203e58549a93f1da67d0349744bd0f78917fba/diff:/var/lib/docker/overlay2/2bcbb3b4718a64188802301a25d7f413bb307cb16d077e7e5af799f9152a2970/diff:/var/lib/docker/overlay2/70b0888bf22fcef1c004704b71288ac581cf26a3b3b19fbca3da296ba10d6978/diff:/var/lib/docker/overlay2/7c5332f38fe652f379ef9b6d23e795158e9994317cfb547b581dd2b1fdf1303b/diff:/var/lib/docker/overlay2/0ddb5a3abf433b644a8bfa124e3c87878eed67878faa35493f2befc2b392e9cb/diff:/var/lib/docker/overlay2/3b7cda5fb0232fdeecbec0531ac704a59eb38fe57664c25777193b07e2df0077/diff:/var/lib/docker/overlay2/a14687ada786c65465b9924ae2d77ba27afc07942851cafaade28e80dfe9da16/diff:/var/lib/docker/overlay2/c49a9b7157aa6e8714e192b2849866d035b59e18de462c0ee9b72f898cc5a485/diff:/var/lib/docker/overlay2/efd71a50e3a1044a6d1c4c1a7d4d91d9f070c066e03e51c6c73a5764b778ad72/diff:/var/lib/docker/overlay2/55476a
1c0a20aa4238a0bb0e43c6402c33dcad312938ad48ee81be0160e12a49/diff:/var/lib/docker/overlay2/c48c4a348a797b9a38f01568a6adbcb4b05b4f56f7b986a4bf1b509d8cb00732/diff:/var/lib/docker/overlay2/568e3f354ab0428de5cf82d1fdfb780c3377f5cc55d9f524731c53e39e0ecae7/diff:/var/lib/docker/overlay2/2857943e320cdcdae9af3d8c2acda1fb61e2f142a88b8b902908071cea67816e/diff:/var/lib/docker/overlay2/bdd9a57f0b65e65c5a16395f239425e794c678b0e8db2f4a368e0a9427fe5116/diff:/var/lib/docker/overlay2/b150183f1b73e8c13c751911bcee09fed8ef973478f4dc3cfdb9e509118bf1ea/diff:/var/lib/docker/overlay2/0a053e7c29417cd6feafb351c7944e81342a52898871bc779f7bf61868c78ec4/diff:/var/lib/docker/overlay2/d3c0de3a44d75d0a05acb7843d53deba5ce0457649d6ed757da9b4c532a81e4f/diff:/var/lib/docker/overlay2/53f6170132880e1697dd802b8577382b31c6f1ba144256f8cc62542998842a6b/diff:/var/lib/docker/overlay2/b5c0be6d8efdb1fcb12e73b8f72853f77baa4bc014ac2c1e28b7b972b07f3325/diff:/var/lib/docker/overlay2/36c908f082a1e5388bb25277f1c957eaecf70fcd958080422fa85a3105724fb2/diff:/var/lib/d
ocker/overlay2/b147fe9dce365cfaf9bfeca2e370829e4d87e2671c133a9836ecb02a85422cc7/diff:/var/lib/docker/overlay2/65f488eb9181a721f01b333f5fa0cb91d216abd7842a9ae193bd95316f378721/diff:/var/lib/docker/overlay2/b04269aa247b68912ddc5b1c98ad55d67af4103f576a900eef4069c196b8a263/diff:/var/lib/docker/overlay2/b714c37e15257ae9d0e15d271dd18a330c38ad765901d9b7e7e3feb73e1b03e4/diff:/var/lib/docker/overlay2/3c253b721193edeaade7bba7ce25ff687c889b8fa86e9489c7ee20d5624e6c5b/diff:/var/lib/docker/overlay2/7f67b74e101fa21dd320393c10576eefa4ce1cec2e210bff405784fa45b360f3/diff:/var/lib/docker/overlay2/c3b2adaa63a06a5e6ed966d7b6f20a757aeadd3f25eb09ef3c7e9a66a8904143/diff:/var/lib/docker/overlay2/ddb5d653d19e8cafc4625a8fe9597667d98b277a7f679e532ad84caa2c6da636/diff:/var/lib/docker/overlay2/03eb172b20323ebeee7cb09025726a6e10de6c3dd8661f4f6bbc5a3a3778bad4/diff:/var/lib/docker/overlay2/80ea9bf34d028e95a8a418b3aeb634be72ab3336448946d7855c51ffdf8258d7/diff:/var/lib/docker/overlay2/e28987ea3fb4d431dee111f38cc76814b85f73e86434be3c463c01fdd59
9ad46/diff:/var/lib/docker/overlay2/6f9a46c7c6cf4fd30ce32a1eb08ed9b1e8dd61cb0e42ce54f0f736f06558c306/diff:/var/lib/docker/overlay2/6fc942eb9ccfc09898edc9a5ef3b3d305a6fcb22e8cefb1a9f9c344d10b59b25/diff:/var/lib/docker/overlay2/f6b8c57540e798dc1dfd51fd29c020193c02a4362f31c6d07aa220327bb07b90/diff:/var/lib/docker/overlay2/85d0aa01a3fab8c77262c59d8a7b0809a72673a3da7d33e4e19c04a66db44a11/diff:/var/lib/docker/overlay2/58dcd81a1605641f785ced5aeb38657eec1f02a31b7adfaf4f6fdd49f4bab1d6/diff:/var/lib/docker/overlay2/9d537e0a65325e4bf85b26da9828002339f5c442ca85f931b340457a80ec8c94/diff:/var/lib/docker/overlay2/a6f73707ee6a74e948a02d03c4a3f12b57c2eb408dc67da3c39961bb3cefcc97/diff:/var/lib/docker/overlay2/922526c310b066dbb73b9a106eef8bf0064ad7907a8d7d7b353f5307a17a4901/diff:/var/lib/docker/overlay2/a4185854870ebf8d34a4c7e1827dbe3bc461559839301ffb23c5efff5e3c9f14/diff:/var/lib/docker/overlay2/8c02b1fcb9d79f5d7b2ee4d44f6625a692c44a0d18df0a5c01cac0cca0fdf3f3/diff",
	                "MergedDir": "/var/lib/docker/overlay2/6cae4fbb3ff06bafae7d678b8be88c46f728f7e162403189e54b6a928eed1dda/merged",
	                "UpperDir": "/var/lib/docker/overlay2/6cae4fbb3ff06bafae7d678b8be88c46f728f7e162403189e54b6a928eed1dda/diff",
	                "WorkDir": "/var/lib/docker/overlay2/6cae4fbb3ff06bafae7d678b8be88c46f728f7e162403189e54b6a928eed1dda/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "default-k8s-different-port-20220630210335-9950",
	                "Source": "/var/lib/docker/volumes/default-k8s-different-port-20220630210335-9950/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "default-k8s-different-port-20220630210335-9950",
	            "Domainname": "",
	            "User": "root",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8444/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e",
	            "Volumes": null,
	            "WorkingDir": "",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "default-k8s-different-port-20220630210335-9950",
	                "name.minikube.sigs.k8s.io": "default-k8s-different-port-20220630210335-9950",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "65a752487954fdae16c96429127bfb6a11b41cd67c17fe9a26bf8a7c54ec9b43",
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49437"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49436"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49433"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49435"
	                    }
	                ],
	                "8444/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49434"
	                    }
	                ]
	            },
	            "SandboxKey": "/var/run/docker/netns/65a752487954",
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "default-k8s-different-port-20220630210335-9950": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.85.2"
	                    },
	                    "Links": null,
	                    "Aliases": [
	                        "99f8da15dcfc",
	                        "default-k8s-different-port-20220630210335-9950"
	                    ],
	                    "NetworkID": "88cfda28f4387ea19e39fbebceded21d3930034fa00fca0cacdd2b97de1da8d9",
	                    "EndpointID": "f57b9372f4240b270f9da403706b34104e71d67ac61e471d943d4adae804ca04",
	                    "Gateway": "192.168.85.1",
	                    "IPAddress": "192.168.85.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "MacAddress": "02:42:c0:a8:55:02",
	                    "DriverOpts": null
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p default-k8s-different-port-20220630210335-9950 -n default-k8s-different-port-20220630210335-9950
helpers_test.go:244: <<< TestStartStop/group/default-k8s-different-port/serial/SecondStart FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======>  post-mortem[TestStartStop/group/default-k8s-different-port/serial/SecondStart]: minikube logs <======
helpers_test.go:247: (dbg) Run:  out/minikube-linux-amd64 -p default-k8s-different-port-20220630210335-9950 logs -n 25
helpers_test.go:252: TestStartStop/group/default-k8s-different-port/serial/SecondStart logs: 
-- stdout --
	* 
	* ==> Audit <==
	* |---------|------------------------------------------------------------|----------|---------|---------|---------------------|---------------------|
	| Command |                            Args                            | Profile  |  User   | Version |     Start Time      |      End Time       |
	|---------|------------------------------------------------------------|----------|---------|---------|---------------------|---------------------|
	| start   | -p newest-cni-20220630210514-9950 --memory=2200            | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | --alsologtostderr --wait=apiserver,system_pods,default_sa  |          |         |         |                     |                     |
	|         | --feature-gates ServerSideApply=true --network-plugin=cni  |          |         |         |                     |                     |
	|         | --extra-config=kubeadm.pod-network-cidr=192.168.111.111/16 |          |         |         |                     |                     |
	|         | --driver=docker  --container-runtime=containerd            |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                               |          |         |         |                     |                     |
	| ssh     | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | sudo crictl images -o json                                 |          |         |         |                     |                     |
	| pause   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                     |          |         |         |                     |                     |
	| unpause | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                     |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | disable-driver-mounts-20220630210659-9950                  |          |         |         |                     |                     |
	| start   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC |                     |
	|         | embed-certs-20220630210659-9950                            |          |         |         |                     |                     |
	|         | --memory=2200 --alsologtostderr                            |          |         |         |                     |                     |
	|         | --wait=true --embed-certs                                  |          |         |         |                     |                     |
	|         | --driver=docker                                            |          |         |         |                     |                     |
	|         | --container-runtime=containerd                             |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                               |          |         |         |                     |                     |
	| ssh     | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|         | sudo crictl images -o json                                 |          |         |         |                     |                     |
	| pause   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                     |          |         |         |                     |                     |
	| unpause | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                     |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	| addons  | enable metrics-server -p                                   | minikube | jenkins | v1.26.0 | 30 Jun 22 21:12 UTC | 30 Jun 22 21:12 UTC |
	|         | old-k8s-version-20220630210005-9950                        |          |         |         |                     |                     |
	|         | --images=MetricsServer=k8s.gcr.io/echoserver:1.4           |          |         |         |                     |                     |
	|         | --registries=MetricsServer=fake.domain                     |          |         |         |                     |                     |
	| stop    | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:12 UTC | 30 Jun 22 21:12 UTC |
	|         | old-k8s-version-20220630210005-9950                        |          |         |         |                     |                     |
	|         | --alsologtostderr -v=3                                     |          |         |         |                     |                     |
	| addons  | enable dashboard -p                                        | minikube | jenkins | v1.26.0 | 30 Jun 22 21:12 UTC | 30 Jun 22 21:12 UTC |
	|         | old-k8s-version-20220630210005-9950                        |          |         |         |                     |                     |
	|         | --images=MetricsScraper=k8s.gcr.io/echoserver:1.4          |          |         |         |                     |                     |
	| start   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:12 UTC |                     |
	|         | old-k8s-version-20220630210005-9950                        |          |         |         |                     |                     |
	|         | --memory=2200 --alsologtostderr                            |          |         |         |                     |                     |
	|         | --wait=true --kvm-network=default                          |          |         |         |                     |                     |
	|         | --kvm-qemu-uri=qemu:///system                              |          |         |         |                     |                     |
	|         | --disable-driver-mounts                                    |          |         |         |                     |                     |
	|         | --keep-context=false                                       |          |         |         |                     |                     |
	|         | --driver=docker                                            |          |         |         |                     |                     |
	|         | --container-runtime=containerd                             |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.16.0                               |          |         |         |                     |                     |
	| addons  | enable metrics-server -p                                   | minikube | jenkins | v1.26.0 | 30 Jun 22 21:16 UTC | 30 Jun 22 21:16 UTC |
	|         | default-k8s-different-port-20220630210335-9950             |          |         |         |                     |                     |
	|         | --images=MetricsServer=k8s.gcr.io/echoserver:1.4           |          |         |         |                     |                     |
	|         | --registries=MetricsServer=fake.domain                     |          |         |         |                     |                     |
	| stop    | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:16 UTC | 30 Jun 22 21:16 UTC |
	|         | default-k8s-different-port-20220630210335-9950             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=3                                     |          |         |         |                     |                     |
	| addons  | enable dashboard -p                                        | minikube | jenkins | v1.26.0 | 30 Jun 22 21:16 UTC | 30 Jun 22 21:16 UTC |
	|         | default-k8s-different-port-20220630210335-9950             |          |         |         |                     |                     |
	|         | --images=MetricsScraper=k8s.gcr.io/echoserver:1.4          |          |         |         |                     |                     |
	| start   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:16 UTC |                     |
	|         | default-k8s-different-port-20220630210335-9950             |          |         |         |                     |                     |
	|         | --memory=2200 --alsologtostderr --wait=true                |          |         |         |                     |                     |
	|         | --apiserver-port=8444 --driver=docker                      |          |         |         |                     |                     |
	|         |  --container-runtime=containerd                            |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                               |          |         |         |                     |                     |
	| addons  | enable metrics-server -p                                   | minikube | jenkins | v1.26.0 | 30 Jun 22 21:19 UTC | 30 Jun 22 21:19 UTC |
	|         | embed-certs-20220630210659-9950                            |          |         |         |                     |                     |
	|         | --images=MetricsServer=k8s.gcr.io/echoserver:1.4           |          |         |         |                     |                     |
	|         | --registries=MetricsServer=fake.domain                     |          |         |         |                     |                     |
	| stop    | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:19 UTC | 30 Jun 22 21:20 UTC |
	|         | embed-certs-20220630210659-9950                            |          |         |         |                     |                     |
	|         | --alsologtostderr -v=3                                     |          |         |         |                     |                     |
	| addons  | enable dashboard -p                                        | minikube | jenkins | v1.26.0 | 30 Jun 22 21:20 UTC | 30 Jun 22 21:20 UTC |
	|         | embed-certs-20220630210659-9950                            |          |         |         |                     |                     |
	|         | --images=MetricsScraper=k8s.gcr.io/echoserver:1.4          |          |         |         |                     |                     |
	| start   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:20 UTC |                     |
	|         | embed-certs-20220630210659-9950                            |          |         |         |                     |                     |
	|         | --memory=2200 --alsologtostderr                            |          |         |         |                     |                     |
	|         | --wait=true --embed-certs                                  |          |         |         |                     |                     |
	|         | --driver=docker                                            |          |         |         |                     |                     |
	|         | --container-runtime=containerd                             |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                               |          |         |         |                     |                     |
	|---------|------------------------------------------------------------|----------|---------|---------|---------------------|---------------------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2022/06/30 21:20:03
	Running on machine: ubuntu-20-agent-8
	Binary: Built with gc go1.18.3 for linux/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0630 21:20:03.147328  282690 out.go:296] Setting OutFile to fd 1 ...
	I0630 21:20:03.147439  282690 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 21:20:03.147448  282690 out.go:309] Setting ErrFile to fd 2...
	I0630 21:20:03.147453  282690 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 21:20:03.147898  282690 root.go:329] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/bin
	I0630 21:20:03.148141  282690 out.go:303] Setting JSON to false
	I0630 21:20:03.149531  282690 start.go:115] hostinfo: {"hostname":"ubuntu-20-agent-8","uptime":3755,"bootTime":1656620248,"procs":452,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1012-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0630 21:20:03.149604  282690 start.go:125] virtualization: kvm guest
	I0630 21:20:03.152275  282690 out.go:177] * [embed-certs-20220630210659-9950] minikube v1.26.0 on Ubuntu 20.04 (kvm/amd64)
	I0630 21:20:03.154290  282690 notify.go:193] Checking for updates...
	I0630 21:20:03.154307  282690 out.go:177]   - MINIKUBE_LOCATION=14420
	I0630 21:20:03.156071  282690 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0630 21:20:03.157769  282690 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:20:03.159343  282690 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube
	I0630 21:20:03.160888  282690 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0630 21:20:03.163346  282690 config.go:178] Loaded profile config "embed-certs-20220630210659-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:20:03.163802  282690 driver.go:360] Setting default libvirt URI to qemu:///system
	I0630 21:20:03.205706  282690 docker.go:137] docker version: linux-20.10.17
	I0630 21:20:03.205824  282690 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0630 21:20:03.318551  282690 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:8 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:43 OomKillDisable:true NGoroutines:44 SystemTime:2022-06-30 21:20:03.238323982 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1012-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexServ
erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662451712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-8 Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Client
Info:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
	I0630 21:20:03.318677  282690 docker.go:254] overlay module found
	I0630 21:20:03.322599  282690 out.go:177] * Using the docker driver based on existing profile
	I0630 21:20:03.324114  282690 start.go:284] selected driver: docker
	I0630 21:20:03.324129  282690 start.go:808] validating driver "docker" against &{Name:embed-certs-20220630210659-9950 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:embed-certs-20220630210659-9950 Namespace:d
efault APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[Dashboard:kubernetesui/dashboard:v2.6.0@sha256:4af9580485920635d888efe1eddbd67e12f9d5d84dba87100e93feb4e46636b3 MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddres
s: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 21:20:03.324222  282690 start.go:819] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0630 21:20:03.325145  282690 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0630 21:20:03.438547  282690 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:8 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:43 OomKillDisable:true NGoroutines:44 SystemTime:2022-06-30 21:20:03.358172615 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1012-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexServ
erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662451712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-8 Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Client
Info:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
	I0630 21:20:03.438832  282690 start_flags.go:853] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0630 21:20:03.438854  282690 cni.go:95] Creating CNI manager for ""
	I0630 21:20:03.438863  282690 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:20:03.438877  282690 start_flags.go:310] config:
	{Name:embed-certs-20220630210659-9950 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:embed-certs-20220630210659-9950 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:clus
ter.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[Dashboard:kubernetesui/dashboard:v2.6.0@sha256:4af9580485920635d888efe1eddbd67e12f9d5d84dba87100e93feb4e46636b3 MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0
m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 21:20:03.442075  282690 out.go:177] * Starting control plane node embed-certs-20220630210659-9950 in cluster embed-certs-20220630210659-9950
	I0630 21:20:03.443525  282690 cache.go:120] Beginning downloading kic base image for docker with containerd
	I0630 21:20:03.445355  282690 out.go:177] * Pulling base image ...
	I0630 21:20:03.446826  282690 preload.go:132] Checking if preload exists for k8s version v1.24.2 and runtime containerd
	I0630 21:20:03.446872  282690 preload.go:148] Found local preload: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-containerd-overlay2-amd64.tar.lz4
	I0630 21:20:03.446895  282690 cache.go:57] Caching tarball of preloaded images
	I0630 21:20:03.446927  282690 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e in local docker daemon
	I0630 21:20:03.447161  282690 preload.go:174] Found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-containerd-overlay2-amd64.tar.lz4 in cache, skipping download
	I0630 21:20:03.447178  282690 cache.go:60] Finished verifying existence of preloaded tar for  v1.24.2 on containerd
	I0630 21:20:03.447328  282690 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/config.json ...
	I0630 21:20:03.484347  282690 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e in local docker daemon, skipping pull
	I0630 21:20:03.484373  282690 cache.go:142] gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e exists in daemon, skipping load
	I0630 21:20:03.484390  282690 cache.go:208] Successfully downloaded all kic artifacts
	I0630 21:20:03.484431  282690 start.go:352] acquiring machines lock for embed-certs-20220630210659-9950: {Name:mk6619dbb09b46cdd2b244e5bf2112b3274a30ef Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0630 21:20:03.484542  282690 start.go:356] acquired machines lock for "embed-certs-20220630210659-9950" in 89.652µs
	I0630 21:20:03.484563  282690 start.go:94] Skipping create...Using existing machine configuration
	I0630 21:20:03.484568  282690 fix.go:55] fixHost starting: 
	I0630 21:20:03.484786  282690 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:20:03.518786  282690 fix.go:103] recreateIfNeeded on embed-certs-20220630210659-9950: state=Stopped err=<nil>
	W0630 21:20:03.518832  282690 fix.go:129] unexpected machine state, will restart: <nil>
	I0630 21:20:03.522271  282690 out.go:177] * Restarting existing docker container for "embed-certs-20220630210659-9950" ...
	I0630 21:20:01.182137  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:03.183061  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:02.393449  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:04.893746  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:03.523749  282690 cli_runner.go:164] Run: docker start embed-certs-20220630210659-9950
	I0630 21:20:03.930910  282690 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:20:03.968503  282690 kic.go:416] container "embed-certs-20220630210659-9950" state is running.
	I0630 21:20:03.968961  282690 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-20220630210659-9950
	I0630 21:20:04.005032  282690 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/config.json ...
	I0630 21:20:04.005301  282690 machine.go:88] provisioning docker machine ...
	I0630 21:20:04.005330  282690 ubuntu.go:169] provisioning hostname "embed-certs-20220630210659-9950"
	I0630 21:20:04.005375  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:20:04.043967  282690 main.go:134] libmachine: Using SSH client type: native
	I0630 21:20:04.044205  282690 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil>  [] 0s} 127.0.0.1 49442 <nil> <nil>}
	I0630 21:20:04.044233  282690 main.go:134] libmachine: About to run SSH command:
	sudo hostname embed-certs-20220630210659-9950 && echo "embed-certs-20220630210659-9950" | sudo tee /etc/hostname
	I0630 21:20:04.044882  282690 main.go:134] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:41696->127.0.0.1:49442: read: connection reset by peer
	I0630 21:20:07.174483  282690 main.go:134] libmachine: SSH cmd err, output: <nil>: embed-certs-20220630210659-9950
	
	I0630 21:20:07.174561  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:20:07.210487  282690 main.go:134] libmachine: Using SSH client type: native
	I0630 21:20:07.210668  282690 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil>  [] 0s} 127.0.0.1 49442 <nil> <nil>}
	I0630 21:20:07.210690  282690 main.go:134] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sembed-certs-20220630210659-9950' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 embed-certs-20220630210659-9950/g' /etc/hosts;
				else 
					echo '127.0.1.1 embed-certs-20220630210659-9950' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0630 21:20:07.329184  282690 main.go:134] libmachine: SSH cmd err, output: <nil>: 
	I0630 21:20:07.329234  282690 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube CaCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/c
erts/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube}
	I0630 21:20:07.329264  282690 ubuntu.go:177] setting up certificates
	I0630 21:20:07.329274  282690 provision.go:83] configureAuth start
	I0630 21:20:07.329332  282690 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-20220630210659-9950
	I0630 21:20:07.365729  282690 provision.go:138] copyHostCerts
	I0630 21:20:07.365803  282690 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem, removing ...
	I0630 21:20:07.365816  282690 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem
	I0630 21:20:07.365887  282690 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem (1679 bytes)
	I0630 21:20:07.365984  282690 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem, removing ...
	I0630 21:20:07.365998  282690 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem
	I0630 21:20:07.366039  282690 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem (1082 bytes)
	I0630 21:20:07.366110  282690 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem, removing ...
	I0630 21:20:07.366123  282690 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem
	I0630 21:20:07.366164  282690 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem (1123 bytes)
	I0630 21:20:07.366225  282690 provision.go:112] generating server cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem org=jenkins.embed-certs-20220630210659-9950 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-20220630210659-9950]
	I0630 21:20:07.595656  282690 provision.go:172] copyRemoteCerts
	I0630 21:20:07.595725  282690 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0630 21:20:07.595756  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:20:07.631338  282690 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49442 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:20:07.716832  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
	I0630 21:20:07.735870  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem --> /etc/docker/server.pem (1265 bytes)
	I0630 21:20:07.756354  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0630 21:20:07.775209  282690 provision.go:86] duration metric: configureAuth took 445.919443ms
	I0630 21:20:07.775233  282690 ubuntu.go:193] setting minikube options for container-runtime
	I0630 21:20:07.775399  282690 config.go:178] Loaded profile config "embed-certs-20220630210659-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:20:07.775412  282690 machine.go:91] provisioned docker machine in 3.770097214s
	I0630 21:20:07.775419  282690 start.go:306] post-start starting for "embed-certs-20220630210659-9950" (driver="docker")
	I0630 21:20:07.775425  282690 start.go:316] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0630 21:20:07.775465  282690 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0630 21:20:07.775498  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:20:07.811677  282690 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49442 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:20:07.897450  282690 ssh_runner.go:195] Run: cat /etc/os-release
	I0630 21:20:07.900657  282690 main.go:134] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0630 21:20:07.900688  282690 main.go:134] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0630 21:20:07.900696  282690 main.go:134] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0630 21:20:07.900702  282690 info.go:137] Remote host: Ubuntu 20.04.4 LTS
	I0630 21:20:07.900711  282690 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/addons for local assets ...
	I0630 21:20:07.900762  282690 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files for local assets ...
	I0630 21:20:07.900829  282690 filesync.go:149] local asset: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem -> 99502.pem in /etc/ssl/certs
	I0630 21:20:07.900909  282690 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0630 21:20:07.908065  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem --> /etc/ssl/certs/99502.pem (1708 bytes)
	I0630 21:20:07.926474  282690 start.go:309] post-start completed in 151.040627ms
	I0630 21:20:07.926557  282690 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0630 21:20:07.926600  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:20:07.963198  282690 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49442 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:20:08.045725  282690 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0630 21:20:08.049536  282690 fix.go:57] fixHost completed within 4.564962738s
	I0630 21:20:08.049568  282690 start.go:81] releasing machines lock for "embed-certs-20220630210659-9950", held for 4.56500909s
	I0630 21:20:08.049668  282690 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-20220630210659-9950
	I0630 21:20:08.085452  282690 ssh_runner.go:195] Run: systemctl --version
	I0630 21:20:08.085508  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:20:08.085526  282690 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/
	I0630 21:20:08.085584  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:20:08.125940  282690 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49442 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:20:08.126756  282690 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49442 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:20:05.682082  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:07.682788  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:07.393189  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:09.893794  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:08.209826  282690 ssh_runner.go:195] Run: sudo systemctl stop -f crio
	I0630 21:20:08.240545  282690 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0630 21:20:08.251830  282690 docker.go:179] disabling docker service ...
	I0630 21:20:08.251890  282690 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0630 21:20:08.263344  282690 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0630 21:20:08.272763  282690 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0630 21:20:08.347490  282690 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0630 21:20:08.430323  282690 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0630 21:20:08.439736  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
	image-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0630 21:20:08.453177  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*sandbox_image = .*$|sandbox_image = "k8s.gcr.io/pause:3.7"|' -i /etc/containerd/config.toml"
	I0630 21:20:08.461609  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*restrict_oom_score_adj = .*$|restrict_oom_score_adj = false|' -i /etc/containerd/config.toml"
	I0630 21:20:08.469975  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*SystemdCgroup = .*$|SystemdCgroup = false|' -i /etc/containerd/config.toml"
	I0630 21:20:08.478446  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*conf_dir = .*$|conf_dir = "/etc/cni/net.mk"|' -i /etc/containerd/config.toml"
	I0630 21:20:08.486889  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^# imports|imports = ["/etc/containerd/containerd.conf.d/02-containerd.conf"]|' -i /etc/containerd/config.toml"
	I0630 21:20:08.495251  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc/containerd/containerd.conf.d && printf %!s(MISSING) "dmVyc2lvbiA9IDIK" | base64 -d | sudo tee /etc/containerd/containerd.conf.d/02-containerd.conf"
	I0630 21:20:08.508868  282690 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0630 21:20:08.515626  282690 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0630 21:20:08.522606  282690 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0630 21:20:08.605769  282690 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0630 21:20:08.682128  282690 start.go:447] Will wait 60s for socket path /run/containerd/containerd.sock
	I0630 21:20:08.682202  282690 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
	I0630 21:20:08.686167  282690 start.go:468] Will wait 60s for crictl version
	I0630 21:20:08.686246  282690 ssh_runner.go:195] Run: sudo crictl version
	I0630 21:20:08.713091  282690 retry.go:31] will retry after 11.04660288s: Temporary Error: sudo crictl version: Process exited with status 1
	stdout:
	
	stderr:
	time="2022-06-30T21:20:08Z" level=fatal msg="getting the runtime version: rpc error: code = Unknown desc = server is not initialized yet"
	I0630 21:20:10.182344  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:12.182594  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:12.392956  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:14.393428  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:14.682680  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:17.182245  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:19.182817  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:19.761138  282690 ssh_runner.go:195] Run: sudo crictl version
	I0630 21:20:19.786289  282690 start.go:477] Version:  0.1.0
	RuntimeName:  containerd
	RuntimeVersion:  1.6.6
	RuntimeApiVersion:  v1alpha2
	I0630 21:20:19.786365  282690 ssh_runner.go:195] Run: containerd --version
	I0630 21:20:19.816281  282690 ssh_runner.go:195] Run: containerd --version
	I0630 21:20:19.848226  282690 out.go:177] * Preparing Kubernetes v1.24.2 on containerd 1.6.6 ...
	I0630 21:20:16.893342  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:18.893566  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:19.849919  282690 cli_runner.go:164] Run: docker network inspect embed-certs-20220630210659-9950 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0630 21:20:19.887550  282690 ssh_runner.go:195] Run: grep 192.168.94.1	host.minikube.internal$ /etc/hosts
	I0630 21:20:19.891143  282690 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.94.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0630 21:20:19.900924  282690 preload.go:132] Checking if preload exists for k8s version v1.24.2 and runtime containerd
	I0630 21:20:19.900991  282690 ssh_runner.go:195] Run: sudo crictl images --output json
	I0630 21:20:19.925400  282690 containerd.go:547] all images are preloaded for containerd runtime.
	I0630 21:20:19.925429  282690 containerd.go:461] Images already preloaded, skipping extraction
	I0630 21:20:19.925482  282690 ssh_runner.go:195] Run: sudo crictl images --output json
	I0630 21:20:19.950061  282690 containerd.go:547] all images are preloaded for containerd runtime.
	I0630 21:20:19.950082  282690 cache_images.go:84] Images are preloaded, skipping loading
	I0630 21:20:19.950125  282690 ssh_runner.go:195] Run: sudo crictl info
	I0630 21:20:19.974750  282690 cni.go:95] Creating CNI manager for ""
	I0630 21:20:19.974773  282690 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:20:19.974785  282690 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
	I0630 21:20:19.974799  282690 kubeadm.go:158] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.94.2 APIServerPort:8443 KubernetesVersion:v1.24.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:embed-certs-20220630210659-9950 NodeName:embed-certs-20220630210659-9950 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.94.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.94.2 CgroupDriver:cgroupfs ClientC
AFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}
	I0630 21:20:19.974955  282690 kubeadm.go:162] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.94.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: /run/containerd/containerd.sock
	  name: "embed-certs-20220630210659-9950"
	  kubeletExtraArgs:
	    node-ip: 192.168.94.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.94.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.24.2
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%!"(MISSING)
	  nodefs.inodesFree: "0%!"(MISSING)
	  imagefs.available: "0%!"(MISSING)
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0630 21:20:19.975056  282690 kubeadm.go:961] kubelet [Unit]
	Wants=containerd.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.24.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=embed-certs-20220630210659-9950 --image-service-endpoint=unix:///run/containerd/containerd.sock --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.94.2 --runtime-request-timeout=15m
	
	[Install]
	 config:
	{KubernetesVersion:v1.24.2 ClusterName:embed-certs-20220630210659-9950 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
	I0630 21:20:19.975119  282690 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.24.2
	I0630 21:20:19.982477  282690 binaries.go:44] Found k8s binaries, skipping transfer
	I0630 21:20:19.982537  282690 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0630 21:20:19.989867  282690 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (524 bytes)
	I0630 21:20:20.003413  282690 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0630 21:20:20.016549  282690 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2060 bytes)
	I0630 21:20:20.030557  282690 ssh_runner.go:195] Run: grep 192.168.94.2	control-plane.minikube.internal$ /etc/hosts
	I0630 21:20:20.033673  282690 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.94.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0630 21:20:20.043309  282690 certs.go:54] Setting up /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950 for IP: 192.168.94.2
	I0630 21:20:20.043426  282690 certs.go:182] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.key
	I0630 21:20:20.043474  282690 certs.go:182] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.key
	I0630 21:20:20.043588  282690 certs.go:298] skipping minikube-user signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/client.key
	I0630 21:20:20.043669  282690 certs.go:298] skipping minikube signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.key.ad8e880a
	I0630 21:20:20.043722  282690 certs.go:298] skipping aggregator signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.key
	I0630 21:20:20.043847  282690 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950.pem (1338 bytes)
	W0630 21:20:20.043888  282690 certs.go:384] ignoring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950_empty.pem, impossibly tiny 0 bytes
	I0630 21:20:20.043906  282690 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem (1679 bytes)
	I0630 21:20:20.043944  282690 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem (1082 bytes)
	I0630 21:20:20.043983  282690 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem (1123 bytes)
	I0630 21:20:20.044018  282690 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/key.pem (1679 bytes)
	I0630 21:20:20.044074  282690 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem (1708 bytes)
	I0630 21:20:20.044672  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
	I0630 21:20:20.063809  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I0630 21:20:20.082364  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0630 21:20:20.100953  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
	I0630 21:20:20.119042  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0630 21:20:20.138260  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
	I0630 21:20:20.156455  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0630 21:20:20.175178  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
	I0630 21:20:20.193932  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem --> /usr/share/ca-certificates/99502.pem (1708 bytes)
	I0630 21:20:20.213463  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0630 21:20:20.232837  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950.pem --> /usr/share/ca-certificates/9950.pem (1338 bytes)
	I0630 21:20:20.252510  282690 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0630 21:20:20.267375  282690 ssh_runner.go:195] Run: openssl version
	I0630 21:20:20.273228  282690 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/99502.pem && ln -fs /usr/share/ca-certificates/99502.pem /etc/ssl/certs/99502.pem"
	I0630 21:20:20.281805  282690 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/99502.pem
	I0630 21:20:20.285276  282690 certs.go:431] hashing: -rw-r--r-- 1 root root 1708 Jun 30 20:26 /usr/share/ca-certificates/99502.pem
	I0630 21:20:20.285328  282690 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/99502.pem
	I0630 21:20:20.290565  282690 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/99502.pem /etc/ssl/certs/3ec20f2e.0"
	I0630 21:20:20.298693  282690 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0630 21:20:20.306974  282690 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:20:20.310492  282690 certs.go:431] hashing: -rw-r--r-- 1 root root 1111 Jun 30 20:22 /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:20:20.310555  282690 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:20:20.315748  282690 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0630 21:20:20.323429  282690 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/9950.pem && ln -fs /usr/share/ca-certificates/9950.pem /etc/ssl/certs/9950.pem"
	I0630 21:20:20.331855  282690 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/9950.pem
	I0630 21:20:20.335469  282690 certs.go:431] hashing: -rw-r--r-- 1 root root 1338 Jun 30 20:26 /usr/share/ca-certificates/9950.pem
	I0630 21:20:20.335531  282690 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/9950.pem
	I0630 21:20:20.340482  282690 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/9950.pem /etc/ssl/certs/51391683.0"
	I0630 21:20:20.348339  282690 kubeadm.go:395] StartCluster: {Name:embed-certs-20220630210659-9950 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:embed-certs-20220630210659-9950 Namespace:default APIServerName
:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[Dashboard:kubernetesui/dashboard:v2.6.0@sha256:4af9580485920635d888efe1eddbd67e12f9d5d84dba87100e93feb4e46636b3 MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet:
MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 21:20:20.348468  282690 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
	I0630 21:20:20.348531  282690 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0630 21:20:20.375578  282690 cri.go:87] found id: "6bdce580a9d6963de5c12d9e017d5662e2685851e130abf85abf7ccd2206a8a6"
	I0630 21:20:20.375605  282690 cri.go:87] found id: "8341041be1bdbcf0e0425bd1832777e15b2ed89bf8696d0c78d14301820032c3"
	I0630 21:20:20.375615  282690 cri.go:87] found id: "157c2b0c199b65e53b31cbc33bd298586d30106a66d587ee22f9c486df45d1ba"
	I0630 21:20:20.375624  282690 cri.go:87] found id: "ccc3bef31fe3faba9ff6daab0d5ca071fed6adb37d8cc554c7399ac599691557"
	I0630 21:20:20.375637  282690 cri.go:87] found id: "d56e346d0980d838b9cd42c94d9e084ef84bb0fdeb4316ae2dd5c8a25cc054a1"
	I0630 21:20:20.375652  282690 cri.go:87] found id: "7734f08ca26708ce34ae224077718432c05bc3133a11bb3d600a7d29c4df0045"
	I0630 21:20:20.375660  282690 cri.go:87] found id: ""
	I0630 21:20:20.375709  282690 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
	I0630 21:20:20.388498  282690 cri.go:114] JSON = null
	W0630 21:20:20.388559  282690 kubeadm.go:402] unpause failed: list paused: list returned 0 containers, but ps returned 6
	I0630 21:20:20.388621  282690 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0630 21:20:20.396168  282690 kubeadm.go:410] found existing configuration files, will attempt cluster restart
	I0630 21:20:20.396200  282690 kubeadm.go:626] restartCluster start
	I0630 21:20:20.396246  282690 ssh_runner.go:195] Run: sudo test -d /data/minikube
	I0630 21:20:20.403017  282690 kubeadm.go:127] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:20.403674  282690 kubeconfig.go:116] verify returned: extract IP: "embed-certs-20220630210659-9950" does not appear in /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:20:20.404147  282690 kubeconfig.go:127] "embed-certs-20220630210659-9950" context is missing from /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig - will repair!
	I0630 21:20:20.404911  282690 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig: {Name:mk34e4a4e7b04f624b9adbda4f77ee20b38308ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:20:20.406647  282690 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
	I0630 21:20:20.413413  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:20.413466  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:20.421286  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:20.621671  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:20.621798  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:20.630547  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:20.821858  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:20.821957  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:20.830758  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:21.022078  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:21.022162  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:21.030900  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:21.222204  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:21.222293  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:21.231221  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:21.421485  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:21.421579  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:21.430528  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:21.621730  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:21.621832  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:21.630704  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:21.822018  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:21.822098  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:21.830851  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:22.022202  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:22.022287  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:22.031086  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:22.222404  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:22.222489  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:22.231324  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:22.421567  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:22.421655  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:22.430581  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:22.621941  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:22.622040  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:22.631867  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:22.822177  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:22.822278  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:22.832202  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:23.021427  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:23.021501  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:23.030217  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:21.682805  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:24.182683  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:21.393221  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:23.893682  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:23.221874  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:23.221961  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:23.230645  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:23.421956  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:23.422028  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:23.430894  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:23.430917  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:23.430954  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:23.439029  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:23.439054  282690 kubeadm.go:601] needs reconfigure: apiserver error: timed out waiting for the condition
	I0630 21:20:23.439061  282690 kubeadm.go:1092] stopping kube-system containers ...
	I0630 21:20:23.439074  282690 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name: Namespaces:[kube-system]}
	I0630 21:20:23.439116  282690 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0630 21:20:23.463122  282690 cri.go:87] found id: "6bdce580a9d6963de5c12d9e017d5662e2685851e130abf85abf7ccd2206a8a6"
	I0630 21:20:23.463146  282690 cri.go:87] found id: "8341041be1bdbcf0e0425bd1832777e15b2ed89bf8696d0c78d14301820032c3"
	I0630 21:20:23.463152  282690 cri.go:87] found id: "157c2b0c199b65e53b31cbc33bd298586d30106a66d587ee22f9c486df45d1ba"
	I0630 21:20:23.463158  282690 cri.go:87] found id: "ccc3bef31fe3faba9ff6daab0d5ca071fed6adb37d8cc554c7399ac599691557"
	I0630 21:20:23.463163  282690 cri.go:87] found id: "d56e346d0980d838b9cd42c94d9e084ef84bb0fdeb4316ae2dd5c8a25cc054a1"
	I0630 21:20:23.463170  282690 cri.go:87] found id: "7734f08ca26708ce34ae224077718432c05bc3133a11bb3d600a7d29c4df0045"
	I0630 21:20:23.463175  282690 cri.go:87] found id: ""
	I0630 21:20:23.463180  282690 cri.go:232] Stopping containers: [6bdce580a9d6963de5c12d9e017d5662e2685851e130abf85abf7ccd2206a8a6 8341041be1bdbcf0e0425bd1832777e15b2ed89bf8696d0c78d14301820032c3 157c2b0c199b65e53b31cbc33bd298586d30106a66d587ee22f9c486df45d1ba ccc3bef31fe3faba9ff6daab0d5ca071fed6adb37d8cc554c7399ac599691557 d56e346d0980d838b9cd42c94d9e084ef84bb0fdeb4316ae2dd5c8a25cc054a1 7734f08ca26708ce34ae224077718432c05bc3133a11bb3d600a7d29c4df0045]
	I0630 21:20:23.463219  282690 ssh_runner.go:195] Run: which crictl
	I0630 21:20:23.466097  282690 ssh_runner.go:195] Run: sudo /usr/bin/crictl stop 6bdce580a9d6963de5c12d9e017d5662e2685851e130abf85abf7ccd2206a8a6 8341041be1bdbcf0e0425bd1832777e15b2ed89bf8696d0c78d14301820032c3 157c2b0c199b65e53b31cbc33bd298586d30106a66d587ee22f9c486df45d1ba ccc3bef31fe3faba9ff6daab0d5ca071fed6adb37d8cc554c7399ac599691557 d56e346d0980d838b9cd42c94d9e084ef84bb0fdeb4316ae2dd5c8a25cc054a1 7734f08ca26708ce34ae224077718432c05bc3133a11bb3d600a7d29c4df0045
	I0630 21:20:23.491529  282690 ssh_runner.go:195] Run: sudo systemctl stop kubelet
	I0630 21:20:23.501548  282690 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0630 21:20:23.508513  282690 kubeadm.go:155] found existing configuration files:
	-rw------- 1 root root 5643 Jun 30 21:07 /etc/kubernetes/admin.conf
	-rw------- 1 root root 5652 Jun 30 21:07 /etc/kubernetes/controller-manager.conf
	-rw------- 1 root root 2063 Jun 30 21:07 /etc/kubernetes/kubelet.conf
	-rw------- 1 root root 5600 Jun 30 21:07 /etc/kubernetes/scheduler.conf
	
	I0630 21:20:23.508569  282690 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
	I0630 21:20:23.515331  282690 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
	I0630 21:20:23.522134  282690 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
	I0630 21:20:23.528625  282690 kubeadm.go:166] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:23.528674  282690 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
	I0630 21:20:23.535118  282690 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
	I0630 21:20:23.541759  282690 kubeadm.go:166] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:23.541806  282690 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
	I0630 21:20:23.547839  282690 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0630 21:20:23.554281  282690 kubeadm.go:703] reconfiguring cluster from /var/tmp/minikube/kubeadm.yaml
	I0630 21:20:23.554304  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:20:23.597418  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:20:24.204823  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:20:24.388425  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:20:24.446940  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:20:24.548581  282690 api_server.go:51] waiting for apiserver process to appear ...
	I0630 21:20:24.548652  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 21:20:25.058272  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 21:20:25.558267  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 21:20:25.634820  282690 api_server.go:71] duration metric: took 1.086232371s to wait for apiserver process to appear ...
	I0630 21:20:25.634853  282690 api_server.go:87] waiting for apiserver healthz status ...
	I0630 21:20:25.634866  282690 api_server.go:240] Checking apiserver healthz at https://192.168.94.2:8443/healthz ...
	I0630 21:20:25.635225  282690 api_server.go:256] stopped: https://192.168.94.2:8443/healthz: Get "https://192.168.94.2:8443/healthz": dial tcp 192.168.94.2:8443: connect: connection refused
	I0630 21:20:26.135955  282690 api_server.go:240] Checking apiserver healthz at https://192.168.94.2:8443/healthz ...
	I0630 21:20:26.183141  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:28.683133  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:29.023735  282690 api_server.go:266] https://192.168.94.2:8443/healthz returned 403:
	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
	W0630 21:20:29.023845  282690 api_server.go:102] status: https://192.168.94.2:8443/healthz returned error 403:
	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
	I0630 21:20:29.136115  282690 api_server.go:240] Checking apiserver healthz at https://192.168.94.2:8443/healthz ...
	I0630 21:20:29.142290  282690 api_server.go:266] https://192.168.94.2:8443/healthz returned 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/bootstrap-controller ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[-]poststarthook/apiservice-registration-controller failed: reason withheld
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	W0630 21:20:29.142324  282690 api_server.go:102] status: https://192.168.94.2:8443/healthz returned error 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/bootstrap-controller ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[-]poststarthook/apiservice-registration-controller failed: reason withheld
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	I0630 21:20:29.635779  282690 api_server.go:240] Checking apiserver healthz at https://192.168.94.2:8443/healthz ...
	I0630 21:20:29.641744  282690 api_server.go:266] https://192.168.94.2:8443/healthz returned 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/bootstrap-controller ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-registration-controller ok
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	W0630 21:20:29.641774  282690 api_server.go:102] status: https://192.168.94.2:8443/healthz returned error 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/bootstrap-controller ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-registration-controller ok
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	I0630 21:20:30.135899  282690 api_server.go:240] Checking apiserver healthz at https://192.168.94.2:8443/healthz ...
	I0630 21:20:30.140340  282690 api_server.go:266] https://192.168.94.2:8443/healthz returned 200:
	ok
	I0630 21:20:30.146945  282690 api_server.go:140] control plane version: v1.24.2
	I0630 21:20:30.146967  282690 api_server.go:130] duration metric: took 4.512109627s to wait for apiserver health ...
	I0630 21:20:30.146976  282690 cni.go:95] Creating CNI manager for ""
	I0630 21:20:30.146983  282690 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:20:30.149207  282690 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0630 21:20:26.393339  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:28.893287  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:30.893492  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:30.150766  282690 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0630 21:20:30.154566  282690 cni.go:189] applying CNI manifest using /var/lib/minikube/binaries/v1.24.2/kubectl ...
	I0630 21:20:30.154592  282690 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2429 bytes)
	I0630 21:20:30.168730  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0630 21:20:30.976925  282690 system_pods.go:43] waiting for kube-system pods to appear ...
	I0630 21:20:30.983901  282690 system_pods.go:59] 9 kube-system pods found
	I0630 21:20:30.983933  282690 system_pods.go:61] "coredns-6d4b75cb6d-87dwf" [11e7f3e7-24e8-4e14-b1f6-a7e2b9bcfb74] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.)
	I0630 21:20:30.983941  282690 system_pods.go:61] "etcd-embed-certs-20220630210659-9950" [c7597376-29d8-4a64-a014-1bca6b00b239] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
	I0630 21:20:30.983951  282690 system_pods.go:61] "kindnet-z7fgt" [9d385a59-b071-48be-b547-db80254669bc] Running / Ready:ContainersNotReady (containers with unready status: [kindnet-cni]) / ContainersReady:ContainersNotReady (containers with unready status: [kindnet-cni])
	I0630 21:20:30.983963  282690 system_pods.go:61] "kube-apiserver-embed-certs-20220630210659-9950" [101e1b1d-d8d3-49c5-b250-f9524145064b] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
	I0630 21:20:30.983978  282690 system_pods.go:61] "kube-controller-manager-embed-certs-20220630210659-9950" [f93c4f3d-22de-4c13-a12a-c8ae9d47911c] Running
	I0630 21:20:30.983988  282690 system_pods.go:61] "kube-proxy-jhw4d" [78ec1767-ed48-4f50-ab14-61149fad7e98] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])
	I0630 21:20:30.984003  282690 system_pods.go:61] "kube-scheduler-embed-certs-20220630210659-9950" [727ac744-99fa-4867-9662-83efb2a98b35] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
	I0630 21:20:30.984012  282690 system_pods.go:61] "metrics-server-5c6f97fb75-dvslz" [3a4167d3-f572-4a2c-813a-d2d22e47d17e] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.)
	I0630 21:20:30.984019  282690 system_pods.go:61] "storage-provisioner" [4e574839-6ecb-47ba-b5c4-e45d9b19efc7] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.)
	I0630 21:20:30.984028  282690 system_pods.go:74] duration metric: took 7.077293ms to wait for pod list to return data ...
	I0630 21:20:30.984038  282690 node_conditions.go:102] verifying NodePressure condition ...
	I0630 21:20:30.986718  282690 node_conditions.go:122] node storage ephemeral capacity is 304695084Ki
	I0630 21:20:30.986752  282690 node_conditions.go:123] node cpu capacity is 8
	I0630 21:20:30.986766  282690 node_conditions.go:105] duration metric: took 2.718274ms to run NodePressure ...
	I0630 21:20:30.986786  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:20:31.145954  282690 kubeadm.go:762] waiting for restarted kubelet to initialise ...
	I0630 21:20:31.149839  282690 kubeadm.go:777] kubelet initialised
	I0630 21:20:31.149867  282690 kubeadm.go:778] duration metric: took 3.887979ms waiting for restarted kubelet to initialise ...
	I0630 21:20:31.149877  282690 pod_ready.go:35] extra waiting up to 4m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0630 21:20:31.154561  282690 pod_ready.go:78] waiting up to 4m0s for pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace to be "Ready" ...
	I0630 21:20:30.683577  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:33.182578  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:33.392832  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:35.393314  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:33.160352  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:35.660314  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:35.182728  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:37.682510  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:37.893265  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:39.893463  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:38.160526  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:40.660894  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:39.683375  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:42.182068  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:44.183054  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:42.393015  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:44.893292  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:43.160483  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:45.660796  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:47.660953  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:46.683087  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:49.183229  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:46.893432  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:49.393236  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:50.161308  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:52.660155  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:51.682409  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:53.682570  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:51.393511  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:53.893578  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:54.661629  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:57.159920  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:55.682710  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:58.182130  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:56.393487  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:58.892932  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:00.893465  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:59.160128  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:01.160665  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:00.182447  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:02.182840  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:04.182886  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:03.392696  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:05.393231  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:03.661112  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:06.160443  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:06.682224  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:08.682691  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:07.893418  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:10.392505  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:08.160644  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:10.661019  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:12.661060  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:11.182893  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:13.182991  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:12.393783  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:14.893314  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:15.160327  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:17.660228  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:15.682251  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:17.683152  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:17.393363  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:19.390281  276064 pod_ready.go:81] duration metric: took 4m0.003663432s waiting for pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace to be "Ready" ...
	E0630 21:21:19.390317  276064 pod_ready.go:66] WaitExtra: waitPodCondition: timed out waiting 4m0s for pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace to be "Ready" (will not retry!)
	I0630 21:21:19.390344  276064 pod_ready.go:38] duration metric: took 4m0.009122224s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0630 21:21:19.390376  276064 kubeadm.go:630] restartCluster took 4m11.317474742s
	W0630 21:21:19.390560  276064 out.go:239] ! Unable to restart cluster, will reset it: extra: timed out waiting 4m0s for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready"
	I0630 21:21:19.390595  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm reset --cri-socket /run/containerd/containerd.sock --force"
	I0630 21:21:19.660421  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:22.160264  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:20.183474  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:22.682948  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:21.023971  276064 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm reset --cri-socket /run/containerd/containerd.sock --force": (1.633354294s)
	I0630 21:21:21.024036  276064 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 21:21:21.033944  276064 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0630 21:21:21.041255  276064 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver
	I0630 21:21:21.041307  276064 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0630 21:21:21.048131  276064 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0630 21:21:21.048170  276064 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0630 21:21:24.160315  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:26.660444  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:25.181883  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:27.183120  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:30.433489  276064 out.go:204]   - Generating certificates and keys ...
	I0630 21:21:30.436707  276064 out.go:204]   - Booting up control plane ...
	I0630 21:21:30.439842  276064 out.go:204]   - Configuring RBAC rules ...
	I0630 21:21:30.442245  276064 cni.go:95] Creating CNI manager for ""
	I0630 21:21:30.442271  276064 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:21:30.444232  276064 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0630 21:21:30.446289  276064 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0630 21:21:30.450161  276064 cni.go:189] applying CNI manifest using /var/lib/minikube/binaries/v1.24.2/kubectl ...
	I0630 21:21:30.450180  276064 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2429 bytes)
	I0630 21:21:30.464668  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0630 21:21:28.661012  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:31.160051  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:29.682587  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:31.682697  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:33.683054  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:31.250327  276064 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0630 21:21:31.250457  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:31.250483  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl label nodes minikube.k8s.io/version=v1.26.0 minikube.k8s.io/commit=251ffcec0e4c997cd7732864187747cc579943c9 minikube.k8s.io/name=default-k8s-different-port-20220630210335-9950 minikube.k8s.io/updated_at=2022_06_30T21_21_31_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:31.337104  276064 ops.go:34] apiserver oom_adj: -16
	I0630 21:21:31.337122  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:31.898846  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:32.398504  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:32.898395  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:33.399197  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:33.898224  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:34.399278  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:34.898766  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:35.399106  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:35.898541  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:33.160337  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:35.660572  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:37.660625  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:36.183245  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:38.681927  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:36.399149  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:36.899206  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:37.398969  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:37.898306  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:38.398247  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:38.898685  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:39.399050  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:39.899197  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:40.399284  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:40.898565  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:40.159296  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:42.160359  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:41.398285  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:41.899049  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:42.399136  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:42.898362  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:42.955690  276064 kubeadm.go:1045] duration metric: took 11.705297596s to wait for elevateKubeSystemPrivileges.
	I0630 21:21:42.955725  276064 kubeadm.go:397] StartCluster complete in 4m34.928502204s
	I0630 21:21:42.955749  276064 settings.go:142] acquiring lock: {Name:mkcbd229caa05b60d3551ef0b47eea08424c9b5d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:21:42.955839  276064 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:21:42.956940  276064 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig: {Name:mk34e4a4e7b04f624b9adbda4f77ee20b38308ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:21:43.471460  276064 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "default-k8s-different-port-20220630210335-9950" rescaled to 1
	I0630 21:21:43.471523  276064 start.go:208] Will wait 6m0s for node &{Name: IP:192.168.85.2 Port:8444 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0630 21:21:43.473505  276064 out.go:177] * Verifying Kubernetes components...
	I0630 21:21:43.471586  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0630 21:21:43.471607  276064 addons.go:412] enableAddons start: toEnable=map[dashboard:true metrics-server:true], additional=[]
	I0630 21:21:43.471793  276064 config.go:178] Loaded profile config "default-k8s-different-port-20220630210335-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:21:43.474864  276064 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 21:21:43.474932  276064 addons.go:65] Setting dashboard=true in profile "default-k8s-different-port-20220630210335-9950"
	I0630 21:21:43.474957  276064 addons.go:65] Setting default-storageclass=true in profile "default-k8s-different-port-20220630210335-9950"
	I0630 21:21:43.474976  276064 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "default-k8s-different-port-20220630210335-9950"
	I0630 21:21:43.474962  276064 addons.go:153] Setting addon dashboard=true in "default-k8s-different-port-20220630210335-9950"
	W0630 21:21:43.475061  276064 addons.go:162] addon dashboard should already be in state true
	I0630 21:21:43.475110  276064 host.go:66] Checking if "default-k8s-different-port-20220630210335-9950" exists ...
	I0630 21:21:43.474944  276064 addons.go:65] Setting metrics-server=true in profile "default-k8s-different-port-20220630210335-9950"
	I0630 21:21:43.475161  276064 addons.go:153] Setting addon metrics-server=true in "default-k8s-different-port-20220630210335-9950"
	W0630 21:21:43.475179  276064 addons.go:162] addon metrics-server should already be in state true
	I0630 21:21:43.475224  276064 host.go:66] Checking if "default-k8s-different-port-20220630210335-9950" exists ...
	I0630 21:21:43.474932  276064 addons.go:65] Setting storage-provisioner=true in profile "default-k8s-different-port-20220630210335-9950"
	I0630 21:21:43.475323  276064 cli_runner.go:164] Run: docker container inspect default-k8s-different-port-20220630210335-9950 --format={{.State.Status}}
	I0630 21:21:43.475319  276064 addons.go:153] Setting addon storage-provisioner=true in "default-k8s-different-port-20220630210335-9950"
	W0630 21:21:43.475359  276064 addons.go:162] addon storage-provisioner should already be in state true
	I0630 21:21:43.475407  276064 host.go:66] Checking if "default-k8s-different-port-20220630210335-9950" exists ...
	I0630 21:21:43.475586  276064 cli_runner.go:164] Run: docker container inspect default-k8s-different-port-20220630210335-9950 --format={{.State.Status}}
	I0630 21:21:43.475682  276064 cli_runner.go:164] Run: docker container inspect default-k8s-different-port-20220630210335-9950 --format={{.State.Status}}
	I0630 21:21:43.475805  276064 cli_runner.go:164] Run: docker container inspect default-k8s-different-port-20220630210335-9950 --format={{.State.Status}}
	I0630 21:21:43.525211  276064 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0630 21:21:43.526633  276064 addons.go:345] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 21:21:43.526654  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0630 21:21:43.526703  276064 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	I0630 21:21:43.529674  276064 out.go:177]   - Using image fake.domain/k8s.gcr.io/echoserver:1.4
	I0630 21:21:43.531135  276064 addons.go:345] installing /etc/kubernetes/addons/metrics-apiservice.yaml
	I0630 21:21:43.531154  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
	I0630 21:21:43.532388  276064 out.go:177]   - Using image kubernetesui/dashboard:v2.6.0
	I0630 21:21:43.531211  276064 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	I0630 21:21:43.534873  276064 out.go:177]   - Using image k8s.gcr.io/echoserver:1.4
	I0630 21:21:40.682196  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:42.682640  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:43.536294  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-ns.yaml
	I0630 21:21:43.536318  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
	I0630 21:21:43.535327  276064 addons.go:153] Setting addon default-storageclass=true in "default-k8s-different-port-20220630210335-9950"
	I0630 21:21:43.536373  276064 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	W0630 21:21:43.536390  276064 addons.go:162] addon default-storageclass should already be in state true
	I0630 21:21:43.536436  276064 host.go:66] Checking if "default-k8s-different-port-20220630210335-9950" exists ...
	I0630 21:21:43.536996  276064 cli_runner.go:164] Run: docker container inspect default-k8s-different-port-20220630210335-9950 --format={{.State.Status}}
	I0630 21:21:43.568952  276064 node_ready.go:35] waiting up to 6m0s for node "default-k8s-different-port-20220630210335-9950" to be "Ready" ...
	I0630 21:21:43.569160  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.85.1 host.minikube.internal\n           fallthrough\n        }' | sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0630 21:21:43.573720  276064 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49437 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/default-k8s-different-port-20220630210335-9950/id_rsa Username:docker}
	I0630 21:21:43.585132  276064 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49437 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/default-k8s-different-port-20220630210335-9950/id_rsa Username:docker}
	I0630 21:21:43.585211  276064 addons.go:345] installing /etc/kubernetes/addons/storageclass.yaml
	I0630 21:21:43.585226  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0630 21:21:43.585277  276064 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	I0630 21:21:43.592285  276064 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49437 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/default-k8s-different-port-20220630210335-9950/id_rsa Username:docker}
	I0630 21:21:43.623221  276064 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49437 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/default-k8s-different-port-20220630210335-9950/id_rsa Username:docker}
	I0630 21:21:43.744945  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
	I0630 21:21:43.744974  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
	I0630 21:21:43.747847  276064 addons.go:345] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
	I0630 21:21:43.747873  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1820 bytes)
	I0630 21:21:43.748263  276064 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 21:21:43.924785  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
	I0630 21:21:43.924816  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
	I0630 21:21:43.928618  276064 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0630 21:21:43.940306  276064 addons.go:345] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
	I0630 21:21:43.940338  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
	I0630 21:21:43.950742  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-configmap.yaml
	I0630 21:21:43.950768  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
	I0630 21:21:44.037060  276064 addons.go:345] installing /etc/kubernetes/addons/metrics-server-service.yaml
	I0630 21:21:44.037089  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
	I0630 21:21:44.047010  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-dp.yaml
	I0630 21:21:44.047034  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4196 bytes)
	I0630 21:21:44.135080  276064 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I0630 21:21:44.140888  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-role.yaml
	I0630 21:21:44.140919  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
	I0630 21:21:44.230459  276064 start.go:806] {"host.minikube.internal": 192.168.85.1} host record injected into CoreDNS
	I0630 21:21:44.235255  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
	I0630 21:21:44.235283  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
	I0630 21:21:44.327158  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-sa.yaml
	I0630 21:21:44.327192  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
	I0630 21:21:44.351459  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-secret.yaml
	I0630 21:21:44.351527  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
	I0630 21:21:44.448179  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-svc.yaml
	I0630 21:21:44.448218  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
	I0630 21:21:44.537927  276064 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	I0630 21:21:45.130031  276064 addons.go:383] Verifying addon metrics-server=true in "default-k8s-different-port-20220630210335-9950"
	I0630 21:21:45.539430  276064 out.go:177] * Enabled addons: storage-provisioner, default-storageclass, metrics-server, dashboard
	I0630 21:21:45.540750  276064 addons.go:414] enableAddons completed in 2.0691399s
	I0630 21:21:45.575595  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:21:44.660831  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:47.160149  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:45.182445  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:47.682514  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:47.576330  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:21:49.576407  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:21:49.160793  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:51.660805  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:50.182451  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:52.183083  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:52.076426  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:21:54.076887  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:21:54.161146  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:56.660728  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:54.683102  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:57.182501  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:59.182957  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:56.575738  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:21:58.576604  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:00.577162  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:21:59.160517  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:01.160700  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:01.183043  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:03.682640  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:03.075860  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:05.076679  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:03.661117  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:06.160731  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:05.682843  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:08.182414  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:07.576553  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:10.075989  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:08.660876  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:11.160848  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:10.682414  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:12.682830  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:12.076661  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:14.576273  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:13.660019  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:15.660934  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:15.183230  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:17.681937  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:17.075764  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:19.076352  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:18.160512  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:20.661337  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:19.682685  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:22.182341  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:21.575906  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:24.076044  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:23.159968  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:25.659994  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:27.660386  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:24.682559  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:26.682712  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:28.682765  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:26.076272  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:28.076381  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:30.576589  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:29.660781  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:31.661081  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:31.182114  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:33.182667  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:33.075544  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:35.076859  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:34.160031  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:36.174889  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:35.682410  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:37.682440  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:37.576222  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:40.076094  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:38.660329  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:40.661271  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:39.682506  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:42.182441  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:44.182613  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:42.076569  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:44.575778  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:43.160906  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:45.660687  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:47.660756  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:46.182890  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:48.682065  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:50.184705  271327 node_ready.go:38] duration metric: took 4m0.008399385s waiting for node "old-k8s-version-20220630210005-9950" to be "Ready" ...
	I0630 21:22:50.186899  271327 out.go:177] 
	W0630 21:22:50.188676  271327 out.go:239] X Exiting due to GUEST_START: wait 6m0s for node: waiting for node to be ready: waitNodeCondition: timed out waiting for the condition
	W0630 21:22:50.188714  271327 out.go:239] * 
	W0630 21:22:50.189487  271327 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0630 21:22:50.191389  271327 out.go:177] 
	I0630 21:22:47.075947  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:49.576265  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:50.159356  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:52.163951  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:52.075526  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:54.076399  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:54.660447  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:57.160029  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:56.575822  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:58.576331  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:00.576702  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:59.160433  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:01.660547  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:03.076469  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:05.576257  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:03.660907  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:06.160339  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:08.076793  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:10.576173  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:08.160593  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:10.660347  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:12.660595  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:13.075956  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:15.076120  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:15.160070  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:17.660236  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:17.576068  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:20.076292  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:20.159819  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:22.159969  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:22.076376  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:24.576689  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:24.160202  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:26.160569  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:27.075866  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:29.075916  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:28.660765  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:30.661044  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:31.076034  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:33.076065  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:35.575815  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:33.160787  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:35.660078  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:37.660223  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:38.076264  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:40.076307  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:39.661253  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:42.160767  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:42.576389  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:45.076289  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:44.660279  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:46.660767  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:47.576205  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:50.076370  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:49.159959  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:51.160087  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:52.576483  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:55.076140  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:53.160885  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:55.660365  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:57.077197  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:59.575847  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:58.160601  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:00.660863  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:02.076497  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:04.576615  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:03.160979  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:05.661301  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:07.076328  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:09.076375  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:08.160501  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:10.661257  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:11.575987  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:13.576105  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:15.576639  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:13.160653  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:15.660136  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:18.076538  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:20.576354  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:18.160271  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:20.660902  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:23.076485  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:25.575931  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:23.160075  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:25.160311  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:27.660413  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:28.076238  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:30.076402  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:30.159564  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:31.157632  282690 pod_ready.go:81] duration metric: took 4m0.003038156s waiting for pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace to be "Ready" ...
	E0630 21:24:31.157659  282690 pod_ready.go:66] WaitExtra: waitPodCondition: timed out waiting 4m0s for pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace to be "Ready" (will not retry!)
	I0630 21:24:31.157707  282690 pod_ready.go:38] duration metric: took 4m0.007820375s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0630 21:24:31.157735  282690 kubeadm.go:630] restartCluster took 4m10.761529656s
	W0630 21:24:31.157891  282690 out.go:239] ! Unable to restart cluster, will reset it: extra: timed out waiting 4m0s for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready"
	I0630 21:24:31.157919  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm reset --cri-socket /run/containerd/containerd.sock --force"
	I0630 21:24:32.851642  282690 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm reset --cri-socket /run/containerd/containerd.sock --force": (1.693695416s)
	I0630 21:24:32.851727  282690 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 21:24:32.861758  282690 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0630 21:24:32.869625  282690 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver
	I0630 21:24:32.869693  282690 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0630 21:24:32.876878  282690 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0630 21:24:32.876929  282690 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0630 21:24:32.076763  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:34.576381  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:36.576542  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:39.075659  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:41.836005  282690 out.go:204]   - Generating certificates and keys ...
	I0630 21:24:41.839508  282690 out.go:204]   - Booting up control plane ...
	I0630 21:24:41.842351  282690 out.go:204]   - Configuring RBAC rules ...
	I0630 21:24:41.844644  282690 cni.go:95] Creating CNI manager for ""
	I0630 21:24:41.844675  282690 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:24:41.846424  282690 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0630 21:24:41.847990  282690 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0630 21:24:41.853099  282690 cni.go:189] applying CNI manifest using /var/lib/minikube/binaries/v1.24.2/kubectl ...
	I0630 21:24:41.853126  282690 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2429 bytes)
	I0630 21:24:41.932756  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0630 21:24:42.729823  282690 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0630 21:24:42.729895  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:42.729926  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl label nodes minikube.k8s.io/version=v1.26.0 minikube.k8s.io/commit=251ffcec0e4c997cd7732864187747cc579943c9 minikube.k8s.io/name=embed-certs-20220630210659-9950 minikube.k8s.io/updated_at=2022_06_30T21_24_42_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:42.738247  282690 ops.go:34] apiserver oom_adj: -16
	I0630 21:24:42.834211  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:41.076287  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:43.076543  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:45.576221  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:43.427269  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:43.927268  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:44.426722  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:44.926851  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:45.427106  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:45.927276  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:46.427354  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:46.926751  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:47.426882  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:47.927284  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:48.076060  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:50.575977  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:48.427353  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:48.927037  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:49.426521  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:49.926695  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:50.426914  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:50.927459  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:51.427334  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:51.927468  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:52.427189  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:52.927285  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:53.426965  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:53.926595  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:53.987285  282690 kubeadm.go:1045] duration metric: took 11.25744575s to wait for elevateKubeSystemPrivileges.
	I0630 21:24:53.987312  282690 kubeadm.go:397] StartCluster complete in 4m33.638985641s
	I0630 21:24:53.987328  282690 settings.go:142] acquiring lock: {Name:mkcbd229caa05b60d3551ef0b47eea08424c9b5d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:24:53.987411  282690 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:24:53.988694  282690 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig: {Name:mk34e4a4e7b04f624b9adbda4f77ee20b38308ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:24:54.505472  282690 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "embed-certs-20220630210659-9950" rescaled to 1
	I0630 21:24:54.505546  282690 start.go:208] Will wait 6m0s for node &{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0630 21:24:54.505581  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0630 21:24:54.507434  282690 out.go:177] * Verifying Kubernetes components...
	I0630 21:24:54.505671  282690 addons.go:412] enableAddons start: toEnable=map[dashboard:true metrics-server:true], additional=[]
	I0630 21:24:54.507512  282690 addons.go:65] Setting storage-provisioner=true in profile "embed-certs-20220630210659-9950"
	I0630 21:24:54.507530  282690 addons.go:153] Setting addon storage-provisioner=true in "embed-certs-20220630210659-9950"
	I0630 21:24:54.505785  282690 config.go:178] Loaded profile config "embed-certs-20220630210659-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:24:54.508995  282690 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 21:24:54.507534  282690 addons.go:65] Setting dashboard=true in profile "embed-certs-20220630210659-9950"
	I0630 21:24:54.509033  282690 addons.go:153] Setting addon dashboard=true in "embed-certs-20220630210659-9950"
	W0630 21:24:54.509043  282690 addons.go:162] addon dashboard should already be in state true
	I0630 21:24:54.507547  282690 addons.go:65] Setting default-storageclass=true in profile "embed-certs-20220630210659-9950"
	I0630 21:24:54.509118  282690 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "embed-certs-20220630210659-9950"
	I0630 21:24:54.507548  282690 addons.go:65] Setting metrics-server=true in profile "embed-certs-20220630210659-9950"
	W0630 21:24:54.507573  282690 addons.go:162] addon storage-provisioner should already be in state true
	I0630 21:24:54.509134  282690 host.go:66] Checking if "embed-certs-20220630210659-9950" exists ...
	I0630 21:24:54.509177  282690 host.go:66] Checking if "embed-certs-20220630210659-9950" exists ...
	I0630 21:24:54.509200  282690 addons.go:153] Setting addon metrics-server=true in "embed-certs-20220630210659-9950"
	W0630 21:24:54.509223  282690 addons.go:162] addon metrics-server should already be in state true
	I0630 21:24:54.509308  282690 host.go:66] Checking if "embed-certs-20220630210659-9950" exists ...
	I0630 21:24:54.509462  282690 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:24:54.509581  282690 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:24:54.509613  282690 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:24:54.509797  282690 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:24:54.560813  282690 out.go:177]   - Using image fake.domain/k8s.gcr.io/echoserver:1.4
	I0630 21:24:54.562228  282690 addons.go:345] installing /etc/kubernetes/addons/metrics-apiservice.yaml
	I0630 21:24:54.562250  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
	I0630 21:24:54.566558  282690 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0630 21:24:54.563422  282690 addons.go:153] Setting addon default-storageclass=true in "embed-certs-20220630210659-9950"
	I0630 21:24:54.564610  282690 out.go:177]   - Using image kubernetesui/dashboard:v2.6.0
	I0630 21:24:54.564664  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	W0630 21:24:54.566619  282690 addons.go:162] addon default-storageclass should already be in state true
	I0630 21:24:54.568042  282690 addons.go:345] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 21:24:54.568076  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0630 21:24:54.568138  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:24:54.568049  282690 host.go:66] Checking if "embed-certs-20220630210659-9950" exists ...
	I0630 21:24:54.568896  282690 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:24:54.571125  282690 out.go:177]   - Using image k8s.gcr.io/echoserver:1.4
	I0630 21:24:52.576199  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:54.577462  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:54.573220  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-ns.yaml
	I0630 21:24:54.573240  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
	I0630 21:24:54.573296  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:24:54.596761  282690 node_ready.go:35] waiting up to 6m0s for node "embed-certs-20220630210659-9950" to be "Ready" ...
	I0630 21:24:54.596796  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.94.1 host.minikube.internal\n           fallthrough\n        }' | sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0630 21:24:54.622285  282690 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49442 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:24:54.625192  282690 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49442 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:24:54.629199  282690 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49442 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:24:54.632573  282690 addons.go:345] installing /etc/kubernetes/addons/storageclass.yaml
	I0630 21:24:54.632600  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0630 21:24:54.632654  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:24:54.674915  282690 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49442 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:24:54.846449  282690 addons.go:345] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
	I0630 21:24:54.846481  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1820 bytes)
	I0630 21:24:54.938792  282690 addons.go:345] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
	I0630 21:24:54.938872  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
	I0630 21:24:54.943079  282690 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0630 21:24:54.947159  282690 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 21:24:54.947675  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
	I0630 21:24:54.947698  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
	I0630 21:24:55.026994  282690 addons.go:345] installing /etc/kubernetes/addons/metrics-server-service.yaml
	I0630 21:24:55.027031  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
	I0630 21:24:55.035197  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
	I0630 21:24:55.035232  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
	I0630 21:24:55.053605  282690 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I0630 21:24:55.126653  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-configmap.yaml
	I0630 21:24:55.126705  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
	I0630 21:24:55.146581  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-dp.yaml
	I0630 21:24:55.146621  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4196 bytes)
	I0630 21:24:55.327942  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-role.yaml
	I0630 21:24:55.328024  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
	I0630 21:24:55.343459  282690 start.go:806] {"host.minikube.internal": 192.168.94.1} host record injected into CoreDNS
	I0630 21:24:55.432902  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
	I0630 21:24:55.432936  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
	I0630 21:24:55.449659  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-sa.yaml
	I0630 21:24:55.449700  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
	I0630 21:24:55.535585  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-secret.yaml
	I0630 21:24:55.535622  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
	I0630 21:24:55.637082  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-svc.yaml
	I0630 21:24:55.637110  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
	I0630 21:24:55.654090  282690 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	I0630 21:24:56.256357  282690 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (1.202695189s)
	I0630 21:24:56.256419  282690 addons.go:383] Verifying addon metrics-server=true in "embed-certs-20220630210659-9950"
	I0630 21:24:56.635370  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:24:57.057755  282690 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (1.403598153s)
	I0630 21:24:57.059648  282690 out.go:177] * Enabled addons: default-storageclass, storage-provisioner, metrics-server, dashboard
	I0630 21:24:57.061353  282690 addons.go:414] enableAddons completed in 2.555682965s
	I0630 21:24:57.076377  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:59.575515  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:59.133305  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:01.133976  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:01.575803  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:03.576220  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:05.576603  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:03.633140  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:05.633312  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:07.633508  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:08.075989  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:10.576424  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:09.633916  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:12.134025  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:13.075816  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:15.076512  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:14.134148  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:16.633590  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:17.575814  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:19.576180  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:19.133861  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:21.634052  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:22.076523  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:24.076612  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:23.634100  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:26.133369  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:28.133752  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:26.076674  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:28.575901  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:30.134009  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:32.633645  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:31.076339  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:33.576385  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:34.633970  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:37.133998  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:36.076191  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:38.576126  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:40.576363  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:39.633552  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:42.133635  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:43.076600  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:43.577767  276064 node_ready.go:38] duration metric: took 4m0.008779238s waiting for node "default-k8s-different-port-20220630210335-9950" to be "Ready" ...
	I0630 21:25:43.580054  276064 out.go:177] 
	W0630 21:25:43.581406  276064 out.go:239] X Exiting due to GUEST_START: wait 6m0s for node: waiting for node to be ready: waitNodeCondition: timed out waiting for the condition
	W0630 21:25:43.581422  276064 out.go:239] * 
	W0630 21:25:43.582123  276064 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0630 21:25:43.583833  276064 out.go:177] 
	
	* 
	* ==> container status <==
	* CONTAINER           IMAGE               CREATED              STATE               NAME                      ATTEMPT             POD ID
	4443c9b814060       6fb66cd78abfe       About a minute ago   Running             kindnet-cni               1                   876e5b9119df9
	e8ebd443f41a4       6fb66cd78abfe       3 minutes ago        Exited              kindnet-cni               0                   876e5b9119df9
	d47f6a5df5e9b       a634548d10b03       4 minutes ago        Running             kube-proxy                0                   cd72e6783bb1f
	0adbc36a43397       5d725196c1f47       4 minutes ago        Running             kube-scheduler            2                   dc38f884e8b32
	3083b721cff99       aebe758cef4cd       4 minutes ago        Running             etcd                      2                   c5dfb9627bf22
	ade2cb7ba62f5       d3377ffb7177c       4 minutes ago        Running             kube-apiserver            2                   d121049ea110c
	af7e649d4589c       34cdf99b1bb3b       4 minutes ago        Running             kube-controller-manager   2                   9e70ab11adf3c
	
	* 
	* ==> containerd <==
	* -- Logs begin at Thu 2022-06-30 21:16:52 UTC, end at Thu 2022-06-30 21:25:44 UTC. --
	Jun 30 21:21:44 default-k8s-different-port-20220630210335-9950 containerd[394]: time="2022-06-30T21:21:44.333904291Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
	Jun 30 21:21:44 default-k8s-different-port-20220630210335-9950 containerd[394]: time="2022-06-30T21:21:44.333922675Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
	Jun 30 21:21:44 default-k8s-different-port-20220630210335-9950 containerd[394]: time="2022-06-30T21:21:44.334187465Z" level=info msg="starting signal loop" namespace=k8s.io path=/run/containerd/io.containerd.runtime.v2.task/k8s.io/876e5b9119df9849592e6a00db07791a256acd949bd98804a0a82c03338fb66e pid=3586 runtime=io.containerd.runc.v2
	Jun 30 21:21:44 default-k8s-different-port-20220630210335-9950 containerd[394]: time="2022-06-30T21:21:44.546690110Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kube-proxy-pwz8s,Uid:d5605519-9054-47ca-b120-d5021ff7a829,Namespace:kube-system,Attempt:0,} returns sandbox id \"cd72e6783bb1ffac179c76f88a63ece5ffca82695d89c5cb67e04ed088eb73f8\""
	Jun 30 21:21:44 default-k8s-different-port-20220630210335-9950 containerd[394]: time="2022-06-30T21:21:44.625910102Z" level=info msg="CreateContainer within sandbox \"cd72e6783bb1ffac179c76f88a63ece5ffca82695d89c5cb67e04ed088eb73f8\" for container &ContainerMetadata{Name:kube-proxy,Attempt:0,}"
	Jun 30 21:21:44 default-k8s-different-port-20220630210335-9950 containerd[394]: time="2022-06-30T21:21:44.643254453Z" level=info msg="CreateContainer within sandbox \"cd72e6783bb1ffac179c76f88a63ece5ffca82695d89c5cb67e04ed088eb73f8\" for &ContainerMetadata{Name:kube-proxy,Attempt:0,} returns container id \"d47f6a5df5e9b26d2438fb390d864ae4ba3f8bbe2309e09681a299f41991dd9b\""
	Jun 30 21:21:44 default-k8s-different-port-20220630210335-9950 containerd[394]: time="2022-06-30T21:21:44.644401384Z" level=info msg="StartContainer for \"d47f6a5df5e9b26d2438fb390d864ae4ba3f8bbe2309e09681a299f41991dd9b\""
	Jun 30 21:21:44 default-k8s-different-port-20220630210335-9950 containerd[394]: time="2022-06-30T21:21:44.831384012Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kindnet-pt7lb,Uid:32dbc267-fce9-4d77-96b8-5521b9a88f87,Namespace:kube-system,Attempt:0,} returns sandbox id \"876e5b9119df9849592e6a00db07791a256acd949bd98804a0a82c03338fb66e\""
	Jun 30 21:21:44 default-k8s-different-port-20220630210335-9950 containerd[394]: time="2022-06-30T21:21:44.842767640Z" level=info msg="CreateContainer within sandbox \"876e5b9119df9849592e6a00db07791a256acd949bd98804a0a82c03338fb66e\" for container &ContainerMetadata{Name:kindnet-cni,Attempt:0,}"
	Jun 30 21:21:44 default-k8s-different-port-20220630210335-9950 containerd[394]: time="2022-06-30T21:21:44.929442912Z" level=info msg="CreateContainer within sandbox \"876e5b9119df9849592e6a00db07791a256acd949bd98804a0a82c03338fb66e\" for &ContainerMetadata{Name:kindnet-cni,Attempt:0,} returns container id \"e8ebd443f41a48f9dd19d3ad11b8b72c1e0e6c274746e99732dddedf4cbae04b\""
	Jun 30 21:21:44 default-k8s-different-port-20220630210335-9950 containerd[394]: time="2022-06-30T21:21:44.932719497Z" level=info msg="StartContainer for \"e8ebd443f41a48f9dd19d3ad11b8b72c1e0e6c274746e99732dddedf4cbae04b\""
	Jun 30 21:21:45 default-k8s-different-port-20220630210335-9950 containerd[394]: time="2022-06-30T21:21:45.023397106Z" level=info msg="StartContainer for \"d47f6a5df5e9b26d2438fb390d864ae4ba3f8bbe2309e09681a299f41991dd9b\" returns successfully"
	Jun 30 21:21:45 default-k8s-different-port-20220630210335-9950 containerd[394]: time="2022-06-30T21:21:45.151476542Z" level=info msg="StartContainer for \"e8ebd443f41a48f9dd19d3ad11b8b72c1e0e6c274746e99732dddedf4cbae04b\" returns successfully"
	Jun 30 21:22:30 default-k8s-different-port-20220630210335-9950 containerd[394]: time="2022-06-30T21:22:30.261445948Z" level=error msg="ContainerStatus for \"0732e40c20df6624e23652864fd7fe122a3fd641f87fef9a802c75ef4aac96c5\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find container \"0732e40c20df6624e23652864fd7fe122a3fd641f87fef9a802c75ef4aac96c5\": not found"
	Jun 30 21:22:30 default-k8s-different-port-20220630210335-9950 containerd[394]: time="2022-06-30T21:22:30.262001326Z" level=error msg="ContainerStatus for \"ce2f727640f2fabfc43b4c08a77d9e53550c31aba78548079a50ed0f149e2ee9\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find container \"ce2f727640f2fabfc43b4c08a77d9e53550c31aba78548079a50ed0f149e2ee9\": not found"
	Jun 30 21:22:30 default-k8s-different-port-20220630210335-9950 containerd[394]: time="2022-06-30T21:22:30.262449527Z" level=error msg="ContainerStatus for \"68b13c309f2b605b948e91049c7d50b7dabc768fc0f6698599deda8839405259\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find container \"68b13c309f2b605b948e91049c7d50b7dabc768fc0f6698599deda8839405259\": not found"
	Jun 30 21:22:30 default-k8s-different-port-20220630210335-9950 containerd[394]: time="2022-06-30T21:22:30.262866639Z" level=error msg="ContainerStatus for \"aa0dfccd9a7c940761ea2c4805338d040616ef5e513c23001d346fe07a7c5eff\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find container \"aa0dfccd9a7c940761ea2c4805338d040616ef5e513c23001d346fe07a7c5eff\": not found"
	Jun 30 21:24:25 default-k8s-different-port-20220630210335-9950 containerd[394]: time="2022-06-30T21:24:25.682024631Z" level=info msg="shim disconnected" id=e8ebd443f41a48f9dd19d3ad11b8b72c1e0e6c274746e99732dddedf4cbae04b
	Jun 30 21:24:25 default-k8s-different-port-20220630210335-9950 containerd[394]: time="2022-06-30T21:24:25.682095803Z" level=warning msg="cleaning up after shim disconnected" id=e8ebd443f41a48f9dd19d3ad11b8b72c1e0e6c274746e99732dddedf4cbae04b namespace=k8s.io
	Jun 30 21:24:25 default-k8s-different-port-20220630210335-9950 containerd[394]: time="2022-06-30T21:24:25.682501831Z" level=info msg="cleaning up dead shim"
	Jun 30 21:24:25 default-k8s-different-port-20220630210335-9950 containerd[394]: time="2022-06-30T21:24:25.694031492Z" level=warning msg="cleanup warnings time=\"2022-06-30T21:24:25Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=3916 runtime=io.containerd.runc.v2\n"
	Jun 30 21:24:25 default-k8s-different-port-20220630210335-9950 containerd[394]: time="2022-06-30T21:24:25.840399460Z" level=info msg="CreateContainer within sandbox \"876e5b9119df9849592e6a00db07791a256acd949bd98804a0a82c03338fb66e\" for container &ContainerMetadata{Name:kindnet-cni,Attempt:1,}"
	Jun 30 21:24:25 default-k8s-different-port-20220630210335-9950 containerd[394]: time="2022-06-30T21:24:25.852844032Z" level=info msg="CreateContainer within sandbox \"876e5b9119df9849592e6a00db07791a256acd949bd98804a0a82c03338fb66e\" for &ContainerMetadata{Name:kindnet-cni,Attempt:1,} returns container id \"4443c9b8140601692cfb05660640a781fea18055b410ee8102fcfc6fac406e94\""
	Jun 30 21:24:25 default-k8s-different-port-20220630210335-9950 containerd[394]: time="2022-06-30T21:24:25.853505701Z" level=info msg="StartContainer for \"4443c9b8140601692cfb05660640a781fea18055b410ee8102fcfc6fac406e94\""
	Jun 30 21:24:26 default-k8s-different-port-20220630210335-9950 containerd[394]: time="2022-06-30T21:24:26.027403001Z" level=info msg="StartContainer for \"4443c9b8140601692cfb05660640a781fea18055b410ee8102fcfc6fac406e94\" returns successfully"
	
	* 
	* ==> describe nodes <==
	* Name:               default-k8s-different-port-20220630210335-9950
	Roles:              control-plane
	Labels:             beta.kubernetes.io/arch=amd64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=amd64
	                    kubernetes.io/hostname=default-k8s-different-port-20220630210335-9950
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=251ffcec0e4c997cd7732864187747cc579943c9
	                    minikube.k8s.io/name=default-k8s-different-port-20220630210335-9950
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2022_06_30T21_21_31_0700
	                    minikube.k8s.io/version=v1.26.0
	                    node-role.kubernetes.io/control-plane=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///run/containerd/containerd.sock
	                    node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Thu, 30 Jun 2022 21:21:27 +0000
	Taints:             node.kubernetes.io/not-ready:NoExecute
	                    node.kubernetes.io/not-ready:NoSchedule
	Unschedulable:      false
	Lease:
	  HolderIdentity:  default-k8s-different-port-20220630210335-9950
	  AcquireTime:     <unset>
	  RenewTime:       Thu, 30 Jun 2022 21:25:35 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Thu, 30 Jun 2022 21:21:40 +0000   Thu, 30 Jun 2022 21:21:24 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Thu, 30 Jun 2022 21:21:40 +0000   Thu, 30 Jun 2022 21:21:24 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Thu, 30 Jun 2022 21:21:40 +0000   Thu, 30 Jun 2022 21:21:24 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            False   Thu, 30 Jun 2022 21:21:40 +0000   Thu, 30 Jun 2022 21:21:24 +0000   KubeletNotReady              container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Addresses:
	  InternalIP:  192.168.85.2
	  Hostname:    default-k8s-different-port-20220630210335-9950
	Capacity:
	  cpu:                8
	  ephemeral-storage:  304695084Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32873488Ki
	  pods:               110
	Allocatable:
	  cpu:                8
	  ephemeral-storage:  304695084Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32873488Ki
	  pods:               110
	System Info:
	  Machine ID:                 bbe1e1cef6e940328962dca52b3c5731
	  System UUID:                f0807fcb-4145-441b-8a5a-5dbf32733249
	  Boot ID:                    471c4729-f046-4a15-bc49-46f3ad561708
	  Kernel Version:             5.15.0-1012-gcp
	  OS Image:                   Ubuntu 20.04.4 LTS
	  Operating System:           linux
	  Architecture:               amd64
	  Container Runtime Version:  containerd://1.6.6
	  Kubelet Version:            v1.24.2
	  Kube-Proxy Version:         v1.24.2
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (6 in total)
	  Namespace                   Name                                                                      CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                                                      ------------  ----------  ---------------  -------------  ---
	  kube-system                 etcd-default-k8s-different-port-20220630210335-9950                       100m (1%!)(MISSING)     0 (0%!)(MISSING)      100Mi (0%!)(MISSING)       0 (0%!)(MISSING)         4m14s
	  kube-system                 kindnet-pt7lb                                                             100m (1%!)(MISSING)     100m (1%!)(MISSING)   50Mi (0%!)(MISSING)        50Mi (0%!)(MISSING)      4m1s
	  kube-system                 kube-apiserver-default-k8s-different-port-20220630210335-9950             250m (3%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m14s
	  kube-system                 kube-controller-manager-default-k8s-different-port-20220630210335-9950    200m (2%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m14s
	  kube-system                 kube-proxy-pwz8s                                                          0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m1s
	  kube-system                 kube-scheduler-default-k8s-different-port-20220630210335-9950             100m (1%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m14s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                750m (9%!)(MISSING)   100m (1%!)(MISSING)
	  memory             150Mi (0%!)(MISSING)  50Mi (0%!)(MISSING)
	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	Events:
	  Type    Reason                   Age    From             Message
	  ----    ------                   ----   ----             -------
	  Normal  Starting                 3m59s  kube-proxy       
	  Normal  Starting                 4m14s  kubelet          Starting kubelet.
	  Normal  NodeHasSufficientMemory  4m14s  kubelet          Node default-k8s-different-port-20220630210335-9950 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    4m14s  kubelet          Node default-k8s-different-port-20220630210335-9950 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     4m14s  kubelet          Node default-k8s-different-port-20220630210335-9950 status is now: NodeHasSufficientPID
	  Normal  NodeAllocatableEnforced  4m14s  kubelet          Updated Node Allocatable limit across pods
	  Normal  RegisteredNode           4m2s   node-controller  Node default-k8s-different-port-20220630210335-9950 event: Registered Node default-k8s-different-port-20220630210335-9950 in Controller
	
	* 
	* ==> dmesg <==
	* [  +2.939825] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000011] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.027789] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.019913] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[ +21.968090] IPv4: martian destination 127.0.0.11 from 10.244.0.3, dev veth8071d138
	[ +25.445872] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.029436] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.023957] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +2.947695] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[Jun30 21:05] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.023879] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +2.955783] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.011828] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000005] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.027896] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	
	* 
	* ==> etcd [3083b721cff99d67d84ed589eadc4c2e61265cef0e7da855dd486e67d6be5953] <==
	* {"level":"info","ts":"2022-06-30T21:21:23.827Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"9f0758e1c58a86ed switched to configuration voters=(11459225503572592365)"}
	{"level":"info","ts":"2022-06-30T21:21:23.827Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"68eaea490fab4e05","local-member-id":"9f0758e1c58a86ed","added-peer-id":"9f0758e1c58a86ed","added-peer-peer-urls":["https://192.168.85.2:2380"]}
	{"level":"info","ts":"2022-06-30T21:21:23.828Z","caller":"embed/etcd.go:688","msg":"starting with client TLS","tls-info":"cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, client-cert=, client-key=, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = ","cipher-suites":[]}
	{"level":"info","ts":"2022-06-30T21:21:23.829Z","caller":"embed/etcd.go:581","msg":"serving peer traffic","address":"192.168.85.2:2380"}
	{"level":"info","ts":"2022-06-30T21:21:23.829Z","caller":"embed/etcd.go:553","msg":"cmux::serve","address":"192.168.85.2:2380"}
	{"level":"info","ts":"2022-06-30T21:21:23.829Z","caller":"embed/etcd.go:277","msg":"now serving peer/client/metrics","local-member-id":"9f0758e1c58a86ed","initial-advertise-peer-urls":["https://192.168.85.2:2380"],"listen-peer-urls":["https://192.168.85.2:2380"],"advertise-client-urls":["https://192.168.85.2:2379"],"listen-client-urls":["https://127.0.0.1:2379","https://192.168.85.2:2379"],"listen-metrics-urls":["http://127.0.0.1:2381"]}
	{"level":"info","ts":"2022-06-30T21:21:23.829Z","caller":"embed/etcd.go:763","msg":"serving metrics","address":"http://127.0.0.1:2381"}
	{"level":"info","ts":"2022-06-30T21:21:24.357Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"9f0758e1c58a86ed is starting a new election at term 1"}
	{"level":"info","ts":"2022-06-30T21:21:24.357Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"9f0758e1c58a86ed became pre-candidate at term 1"}
	{"level":"info","ts":"2022-06-30T21:21:24.357Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"9f0758e1c58a86ed received MsgPreVoteResp from 9f0758e1c58a86ed at term 1"}
	{"level":"info","ts":"2022-06-30T21:21:24.357Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"9f0758e1c58a86ed became candidate at term 2"}
	{"level":"info","ts":"2022-06-30T21:21:24.357Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"9f0758e1c58a86ed received MsgVoteResp from 9f0758e1c58a86ed at term 2"}
	{"level":"info","ts":"2022-06-30T21:21:24.357Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"9f0758e1c58a86ed became leader at term 2"}
	{"level":"info","ts":"2022-06-30T21:21:24.357Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: 9f0758e1c58a86ed elected leader 9f0758e1c58a86ed at term 2"}
	{"level":"info","ts":"2022-06-30T21:21:24.357Z","caller":"etcdserver/server.go:2507","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}
	{"level":"info","ts":"2022-06-30T21:21:24.358Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"68eaea490fab4e05","local-member-id":"9f0758e1c58a86ed","cluster-version":"3.5"}
	{"level":"info","ts":"2022-06-30T21:21:24.358Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
	{"level":"info","ts":"2022-06-30T21:21:24.358Z","caller":"etcdserver/server.go:2042","msg":"published local member to cluster through raft","local-member-id":"9f0758e1c58a86ed","local-member-attributes":"{Name:default-k8s-different-port-20220630210335-9950 ClientURLs:[https://192.168.85.2:2379]}","request-path":"/0/members/9f0758e1c58a86ed/attributes","cluster-id":"68eaea490fab4e05","publish-timeout":"7s"}
	{"level":"info","ts":"2022-06-30T21:21:24.358Z","caller":"etcdserver/server.go:2531","msg":"cluster version is updated","cluster-version":"3.5"}
	{"level":"info","ts":"2022-06-30T21:21:24.358Z","caller":"embed/serve.go:98","msg":"ready to serve client requests"}
	{"level":"info","ts":"2022-06-30T21:21:24.358Z","caller":"embed/serve.go:98","msg":"ready to serve client requests"}
	{"level":"info","ts":"2022-06-30T21:21:24.359Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
	{"level":"info","ts":"2022-06-30T21:21:24.359Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
	{"level":"info","ts":"2022-06-30T21:21:24.360Z","caller":"embed/serve.go:188","msg":"serving client traffic securely","address":"192.168.85.2:2379"}
	{"level":"info","ts":"2022-06-30T21:21:24.360Z","caller":"embed/serve.go:188","msg":"serving client traffic securely","address":"127.0.0.1:2379"}
	
	* 
	* ==> kernel <==
	*  21:25:44 up  1:08,  0 users,  load average: 0.94, 0.77, 1.05
	Linux default-k8s-different-port-20220630210335-9950 5.15.0-1012-gcp #17~20.04.1-Ubuntu SMP Thu Jun 23 16:10:34 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
	PRETTY_NAME="Ubuntu 20.04.4 LTS"
	
	* 
	* ==> kube-apiserver [ade2cb7ba62f5944399cb66c2f872cdd8fc48a3620be8eeaa0500bd0967b4e9f] <==
	* I0630 21:21:45.057170       1 alloc.go:327] "allocated clusterIPs" service="kube-system/metrics-server" clusterIPs=map[IPv4:10.110.66.159]
	I0630 21:21:45.237994       1 controller.go:611] quota admission added evaluator for: events.events.k8s.io
	I0630 21:21:45.453317       1 alloc.go:327] "allocated clusterIPs" service="kubernetes-dashboard/kubernetes-dashboard" clusterIPs=map[IPv4:10.103.11.21]
	I0630 21:21:45.529161       1 alloc.go:327] "allocated clusterIPs" service="kubernetes-dashboard/dashboard-metrics-scraper" clusterIPs=map[IPv4:10.107.128.87]
	W0630 21:21:45.840339       1 handler_proxy.go:102] no RequestInfo found in the context
	W0630 21:21:45.840339       1 handler_proxy.go:102] no RequestInfo found in the context
	E0630 21:21:45.840391       1 controller.go:113] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: Error, could not get list of group versions for APIService
	I0630 21:21:45.840401       1 controller.go:126] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
	E0630 21:21:45.840447       1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
	, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
	I0630 21:21:45.841585       1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
	W0630 21:22:45.840883       1 handler_proxy.go:102] no RequestInfo found in the context
	E0630 21:22:45.840955       1 controller.go:113] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: Error, could not get list of group versions for APIService
	I0630 21:22:45.840963       1 controller.go:126] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
	W0630 21:22:45.841936       1 handler_proxy.go:102] no RequestInfo found in the context
	E0630 21:22:45.841992       1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
	, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
	I0630 21:22:45.842006       1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
	W0630 21:24:45.841863       1 handler_proxy.go:102] no RequestInfo found in the context
	E0630 21:24:45.841919       1 controller.go:113] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: Error, could not get list of group versions for APIService
	I0630 21:24:45.841927       1 controller.go:126] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
	W0630 21:24:45.843056       1 handler_proxy.go:102] no RequestInfo found in the context
	E0630 21:24:45.843124       1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
	, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
	I0630 21:24:45.843139       1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
	
	* 
	* ==> kube-controller-manager [af7e649d4589c7d448c2c06a361ca79a6b23d90fa8eae302f2c0e0e495ad5240] <==
	* I0630 21:21:45.332916       1 event.go:294] "Event occurred" object="kubernetes-dashboard/dashboard-metrics-scraper-dffd48c4c" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Warning" reason="FailedCreate" message="Error creating: pods \"dashboard-metrics-scraper-dffd48c4c-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found"
	E0630 21:21:45.338625       1 replica_set.go:550] sync "kubernetes-dashboard/kubernetes-dashboard-5fd5574d9f" failed with pods "kubernetes-dashboard-5fd5574d9f-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found
	I0630 21:21:45.338937       1 event.go:294] "Event occurred" object="kubernetes-dashboard/kubernetes-dashboard-5fd5574d9f" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Warning" reason="FailedCreate" message="Error creating: pods \"kubernetes-dashboard-5fd5574d9f-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found"
	E0630 21:21:45.339835       1 replica_set.go:550] sync "kubernetes-dashboard/dashboard-metrics-scraper-dffd48c4c" failed with pods "dashboard-metrics-scraper-dffd48c4c-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found
	I0630 21:21:45.339890       1 event.go:294] "Event occurred" object="kubernetes-dashboard/dashboard-metrics-scraper-dffd48c4c" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Warning" reason="FailedCreate" message="Error creating: pods \"dashboard-metrics-scraper-dffd48c4c-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found"
	I0630 21:21:45.343575       1 event.go:294] "Event occurred" object="kubernetes-dashboard/kubernetes-dashboard-5fd5574d9f" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Warning" reason="FailedCreate" message="Error creating: pods \"kubernetes-dashboard-5fd5574d9f-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found"
	E0630 21:21:45.343579       1 replica_set.go:550] sync "kubernetes-dashboard/kubernetes-dashboard-5fd5574d9f" failed with pods "kubernetes-dashboard-5fd5574d9f-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found
	I0630 21:21:45.348054       1 event.go:294] "Event occurred" object="kubernetes-dashboard/dashboard-metrics-scraper-dffd48c4c" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: dashboard-metrics-scraper-dffd48c4c-k46b6"
	I0630 21:21:45.353138       1 event.go:294] "Event occurred" object="kubernetes-dashboard/kubernetes-dashboard-5fd5574d9f" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kubernetes-dashboard-5fd5574d9f-2wm9p"
	E0630 21:22:13.011323       1 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	W0630 21:22:13.431624       1 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0630 21:22:43.028505       1 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	W0630 21:22:43.446638       1 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0630 21:23:13.044918       1 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	W0630 21:23:13.462092       1 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0630 21:23:43.063926       1 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	W0630 21:23:43.477454       1 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0630 21:24:13.083696       1 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	W0630 21:24:13.492385       1 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0630 21:24:43.100571       1 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	W0630 21:24:43.511248       1 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0630 21:25:13.117954       1 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	W0630 21:25:13.526364       1 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0630 21:25:43.134359       1 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	W0630 21:25:43.540568       1 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	
	* 
	* ==> kube-proxy [d47f6a5df5e9b26d2438fb390d864ae4ba3f8bbe2309e09681a299f41991dd9b] <==
	* I0630 21:21:45.143403       1 node.go:163] Successfully retrieved node IP: 192.168.85.2
	I0630 21:21:45.143482       1 server_others.go:138] "Detected node IP" address="192.168.85.2"
	I0630 21:21:45.143523       1 server_others.go:578] "Unknown proxy mode, assuming iptables proxy" proxyMode=""
	I0630 21:21:45.234187       1 server_others.go:206] "Using iptables Proxier"
	I0630 21:21:45.234242       1 server_others.go:213] "kube-proxy running in dual-stack mode" ipFamily=IPv4
	I0630 21:21:45.234255       1 server_others.go:214] "Creating dualStackProxier for iptables"
	I0630 21:21:45.234274       1 server_others.go:501] "Detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, , defaulting to no-op detect-local for IPv6"
	I0630 21:21:45.234306       1 proxier.go:259] "Setting route_localnet=1, use nodePortAddresses to filter loopback addresses for NodePorts to skip it https://issues.k8s.io/90259"
	I0630 21:21:45.234498       1 proxier.go:259] "Setting route_localnet=1, use nodePortAddresses to filter loopback addresses for NodePorts to skip it https://issues.k8s.io/90259"
	I0630 21:21:45.234850       1 server.go:661] "Version info" version="v1.24.2"
	I0630 21:21:45.234871       1 server.go:663] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
	I0630 21:21:45.235711       1 config.go:444] "Starting node config controller"
	I0630 21:21:45.235737       1 shared_informer.go:255] Waiting for caches to sync for node config
	I0630 21:21:45.236027       1 config.go:317] "Starting service config controller"
	I0630 21:21:45.236044       1 shared_informer.go:255] Waiting for caches to sync for service config
	I0630 21:21:45.236101       1 config.go:226] "Starting endpoint slice config controller"
	I0630 21:21:45.236108       1 shared_informer.go:255] Waiting for caches to sync for endpoint slice config
	I0630 21:21:45.336288       1 shared_informer.go:262] Caches are synced for node config
	I0630 21:21:45.336316       1 shared_informer.go:262] Caches are synced for endpoint slice config
	I0630 21:21:45.336348       1 shared_informer.go:262] Caches are synced for service config
	
	* 
	* ==> kube-scheduler [0adbc36a43397fe388bed72d2f08645e829158e14a3f25808074ca99d9eac410] <==
	* W0630 21:21:27.145923       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	E0630 21:21:27.145953       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	W0630 21:21:27.146055       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
	E0630 21:21:27.146078       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
	W0630 21:21:27.146224       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	E0630 21:21:27.146248       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	W0630 21:21:27.146756       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E0630 21:21:27.146832       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	W0630 21:21:28.044993       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	W0630 21:21:28.044994       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
	E0630 21:21:28.045032       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E0630 21:21:28.045084       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
	W0630 21:21:28.047263       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0630 21:21:28.047313       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	W0630 21:21:28.171939       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E0630 21:21:28.171994       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	W0630 21:21:28.183387       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	E0630 21:21:28.183431       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	W0630 21:21:28.274358       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E0630 21:21:28.274408       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	W0630 21:21:28.280575       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E0630 21:21:28.280613       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	W0630 21:21:28.460364       1 reflector.go:324] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	E0630 21:21:28.460407       1 reflector.go:138] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	I0630 21:21:31.143202       1 shared_informer.go:262] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	
	* 
	* ==> kubelet <==
	* -- Logs begin at Thu 2022-06-30 21:16:52 UTC, end at Thu 2022-06-30 21:25:45 UTC. --
	Jun 30 21:23:45 default-k8s-different-port-20220630210335-9950 kubelet[3063]: E0630 21:23:45.596015    3063 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:23:50 default-k8s-different-port-20220630210335-9950 kubelet[3063]: E0630 21:23:50.597307    3063 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:23:55 default-k8s-different-port-20220630210335-9950 kubelet[3063]: E0630 21:23:55.598122    3063 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:24:00 default-k8s-different-port-20220630210335-9950 kubelet[3063]: E0630 21:24:00.598971    3063 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:24:05 default-k8s-different-port-20220630210335-9950 kubelet[3063]: E0630 21:24:05.599719    3063 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:24:10 default-k8s-different-port-20220630210335-9950 kubelet[3063]: E0630 21:24:10.601566    3063 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:24:15 default-k8s-different-port-20220630210335-9950 kubelet[3063]: E0630 21:24:15.603160    3063 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:24:20 default-k8s-different-port-20220630210335-9950 kubelet[3063]: E0630 21:24:20.604496    3063 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:24:25 default-k8s-different-port-20220630210335-9950 kubelet[3063]: E0630 21:24:25.605310    3063 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:24:25 default-k8s-different-port-20220630210335-9950 kubelet[3063]: I0630 21:24:25.838124    3063 scope.go:110] "RemoveContainer" containerID="e8ebd443f41a48f9dd19d3ad11b8b72c1e0e6c274746e99732dddedf4cbae04b"
	Jun 30 21:24:30 default-k8s-different-port-20220630210335-9950 kubelet[3063]: E0630 21:24:30.606935    3063 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:24:35 default-k8s-different-port-20220630210335-9950 kubelet[3063]: E0630 21:24:35.608640    3063 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:24:40 default-k8s-different-port-20220630210335-9950 kubelet[3063]: E0630 21:24:40.610110    3063 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:24:45 default-k8s-different-port-20220630210335-9950 kubelet[3063]: E0630 21:24:45.611887    3063 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:24:50 default-k8s-different-port-20220630210335-9950 kubelet[3063]: E0630 21:24:50.613374    3063 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:24:55 default-k8s-different-port-20220630210335-9950 kubelet[3063]: E0630 21:24:55.615137    3063 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:25:00 default-k8s-different-port-20220630210335-9950 kubelet[3063]: E0630 21:25:00.616172    3063 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:25:05 default-k8s-different-port-20220630210335-9950 kubelet[3063]: E0630 21:25:05.617853    3063 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:25:10 default-k8s-different-port-20220630210335-9950 kubelet[3063]: E0630 21:25:10.618960    3063 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:25:15 default-k8s-different-port-20220630210335-9950 kubelet[3063]: E0630 21:25:15.620035    3063 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:25:20 default-k8s-different-port-20220630210335-9950 kubelet[3063]: E0630 21:25:20.621216    3063 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:25:25 default-k8s-different-port-20220630210335-9950 kubelet[3063]: E0630 21:25:25.622161    3063 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:25:30 default-k8s-different-port-20220630210335-9950 kubelet[3063]: E0630 21:25:30.623894    3063 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:25:35 default-k8s-different-port-20220630210335-9950 kubelet[3063]: E0630 21:25:35.624636    3063 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:25:40 default-k8s-different-port-20220630210335-9950 kubelet[3063]: E0630 21:25:40.625608    3063 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	

                                                
                                                
-- /stdout --
helpers_test.go:254: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p default-k8s-different-port-20220630210335-9950 -n default-k8s-different-port-20220630210335-9950
helpers_test.go:261: (dbg) Run:  kubectl --context default-k8s-different-port-20220630210335-9950 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:270: non-running pods: coredns-6d4b75cb6d-xpj4r metrics-server-5c6f97fb75-485k9 storage-provisioner dashboard-metrics-scraper-dffd48c4c-k46b6 kubernetes-dashboard-5fd5574d9f-2wm9p
helpers_test.go:272: ======> post-mortem[TestStartStop/group/default-k8s-different-port/serial/SecondStart]: describe non-running pods <======
helpers_test.go:275: (dbg) Run:  kubectl --context default-k8s-different-port-20220630210335-9950 describe pod coredns-6d4b75cb6d-xpj4r metrics-server-5c6f97fb75-485k9 storage-provisioner dashboard-metrics-scraper-dffd48c4c-k46b6 kubernetes-dashboard-5fd5574d9f-2wm9p
helpers_test.go:275: (dbg) Non-zero exit: kubectl --context default-k8s-different-port-20220630210335-9950 describe pod coredns-6d4b75cb6d-xpj4r metrics-server-5c6f97fb75-485k9 storage-provisioner dashboard-metrics-scraper-dffd48c4c-k46b6 kubernetes-dashboard-5fd5574d9f-2wm9p: exit status 1 (59.469054ms)

                                                
                                                
** stderr ** 
	Error from server (NotFound): pods "coredns-6d4b75cb6d-xpj4r" not found
	Error from server (NotFound): pods "metrics-server-5c6f97fb75-485k9" not found
	Error from server (NotFound): pods "storage-provisioner" not found
	Error from server (NotFound): pods "dashboard-metrics-scraper-dffd48c4c-k46b6" not found
	Error from server (NotFound): pods "kubernetes-dashboard-5fd5574d9f-2wm9p" not found

                                                
                                                
** /stderr **
helpers_test.go:277: kubectl --context default-k8s-different-port-20220630210335-9950 describe pod coredns-6d4b75cb6d-xpj4r metrics-server-5c6f97fb75-485k9 storage-provisioner dashboard-metrics-scraper-dffd48c4c-k46b6 kubernetes-dashboard-5fd5574d9f-2wm9p: exit status 1
--- FAIL: TestStartStop/group/default-k8s-different-port/serial/SecondStart (534.77s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/SecondStart (533.65s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-amd64 start -p embed-certs-20220630210659-9950 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=containerd --kubernetes-version=v1.24.2
E0630 21:20:25.850782    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/cilium-20220630204859-9950/client.crt: no such file or directory
E0630 21:20:47.269171    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/ingress-addon-legacy-20220630202923-9950/client.crt: no such file or directory
E0630 21:21:27.108086    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/bridge-20220630204858-9950/client.crt: no such file or directory
E0630 21:22:50.155592    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/bridge-20220630204858-9950/client.crt: no such file or directory

                                                
                                                
=== CONT  TestStartStop/group/embed-certs/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p embed-certs-20220630210659-9950 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=containerd --kubernetes-version=v1.24.2: exit status 80 (8m51.56129432s)

                                                
                                                
-- stdout --
	* [embed-certs-20220630210659-9950] minikube v1.26.0 on Ubuntu 20.04 (kvm/amd64)
	  - MINIKUBE_LOCATION=14420
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-amd64
	* Using the docker driver based on existing profile
	* Starting control plane node embed-certs-20220630210659-9950 in cluster embed-certs-20220630210659-9950
	* Pulling base image ...
	* Restarting existing docker container for "embed-certs-20220630210659-9950" ...
	* Preparing Kubernetes v1.24.2 on containerd 1.6.6 ...
	* Configuring CNI (Container Networking Interface) ...
	  - Generating certificates and keys ...
	  - Booting up control plane ...
	  - Configuring RBAC rules ...
	* Configuring CNI (Container Networking Interface) ...
	* Verifying Kubernetes components...
	  - Using image fake.domain/k8s.gcr.io/echoserver:1.4
	  - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	  - Using image kubernetesui/dashboard:v2.6.0
	  - Using image k8s.gcr.io/echoserver:1.4
	* Enabled addons: default-storageclass, storage-provisioner, metrics-server, dashboard
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0630 21:20:03.147328  282690 out.go:296] Setting OutFile to fd 1 ...
	I0630 21:20:03.147439  282690 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 21:20:03.147448  282690 out.go:309] Setting ErrFile to fd 2...
	I0630 21:20:03.147453  282690 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 21:20:03.147898  282690 root.go:329] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/bin
	I0630 21:20:03.148141  282690 out.go:303] Setting JSON to false
	I0630 21:20:03.149531  282690 start.go:115] hostinfo: {"hostname":"ubuntu-20-agent-8","uptime":3755,"bootTime":1656620248,"procs":452,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1012-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0630 21:20:03.149604  282690 start.go:125] virtualization: kvm guest
	I0630 21:20:03.152275  282690 out.go:177] * [embed-certs-20220630210659-9950] minikube v1.26.0 on Ubuntu 20.04 (kvm/amd64)
	I0630 21:20:03.154290  282690 notify.go:193] Checking for updates...
	I0630 21:20:03.154307  282690 out.go:177]   - MINIKUBE_LOCATION=14420
	I0630 21:20:03.156071  282690 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0630 21:20:03.157769  282690 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:20:03.159343  282690 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube
	I0630 21:20:03.160888  282690 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0630 21:20:03.163346  282690 config.go:178] Loaded profile config "embed-certs-20220630210659-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:20:03.163802  282690 driver.go:360] Setting default libvirt URI to qemu:///system
	I0630 21:20:03.205706  282690 docker.go:137] docker version: linux-20.10.17
	I0630 21:20:03.205824  282690 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0630 21:20:03.318551  282690 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:8 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:43 OomKillDisable:true NGoroutines:44 SystemTime:2022-06-30 21:20:03.238323982 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1012-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexServ
erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662451712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-8 Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Client
Info:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
	I0630 21:20:03.318677  282690 docker.go:254] overlay module found
	I0630 21:20:03.322599  282690 out.go:177] * Using the docker driver based on existing profile
	I0630 21:20:03.324114  282690 start.go:284] selected driver: docker
	I0630 21:20:03.324129  282690 start.go:808] validating driver "docker" against &{Name:embed-certs-20220630210659-9950 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:embed-certs-20220630210659-9950 Namespace:d
efault APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[Dashboard:kubernetesui/dashboard:v2.6.0@sha256:4af9580485920635d888efe1eddbd67e12f9d5d84dba87100e93feb4e46636b3 MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddres
s: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 21:20:03.324222  282690 start.go:819] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0630 21:20:03.325145  282690 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0630 21:20:03.438547  282690 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:8 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:43 OomKillDisable:true NGoroutines:44 SystemTime:2022-06-30 21:20:03.358172615 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1012-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexServ
erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662451712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-8 Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Client
Info:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
	I0630 21:20:03.438832  282690 start_flags.go:853] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0630 21:20:03.438854  282690 cni.go:95] Creating CNI manager for ""
	I0630 21:20:03.438863  282690 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:20:03.438877  282690 start_flags.go:310] config:
	{Name:embed-certs-20220630210659-9950 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:embed-certs-20220630210659-9950 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:clus
ter.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[Dashboard:kubernetesui/dashboard:v2.6.0@sha256:4af9580485920635d888efe1eddbd67e12f9d5d84dba87100e93feb4e46636b3 MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0
m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 21:20:03.442075  282690 out.go:177] * Starting control plane node embed-certs-20220630210659-9950 in cluster embed-certs-20220630210659-9950
	I0630 21:20:03.443525  282690 cache.go:120] Beginning downloading kic base image for docker with containerd
	I0630 21:20:03.445355  282690 out.go:177] * Pulling base image ...
	I0630 21:20:03.446826  282690 preload.go:132] Checking if preload exists for k8s version v1.24.2 and runtime containerd
	I0630 21:20:03.446872  282690 preload.go:148] Found local preload: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-containerd-overlay2-amd64.tar.lz4
	I0630 21:20:03.446895  282690 cache.go:57] Caching tarball of preloaded images
	I0630 21:20:03.446927  282690 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e in local docker daemon
	I0630 21:20:03.447161  282690 preload.go:174] Found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-containerd-overlay2-amd64.tar.lz4 in cache, skipping download
	I0630 21:20:03.447178  282690 cache.go:60] Finished verifying existence of preloaded tar for  v1.24.2 on containerd
	I0630 21:20:03.447328  282690 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/config.json ...
	I0630 21:20:03.484347  282690 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e in local docker daemon, skipping pull
	I0630 21:20:03.484373  282690 cache.go:142] gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e exists in daemon, skipping load
	I0630 21:20:03.484390  282690 cache.go:208] Successfully downloaded all kic artifacts
	I0630 21:20:03.484431  282690 start.go:352] acquiring machines lock for embed-certs-20220630210659-9950: {Name:mk6619dbb09b46cdd2b244e5bf2112b3274a30ef Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0630 21:20:03.484542  282690 start.go:356] acquired machines lock for "embed-certs-20220630210659-9950" in 89.652µs
	I0630 21:20:03.484563  282690 start.go:94] Skipping create...Using existing machine configuration
	I0630 21:20:03.484568  282690 fix.go:55] fixHost starting: 
	I0630 21:20:03.484786  282690 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:20:03.518786  282690 fix.go:103] recreateIfNeeded on embed-certs-20220630210659-9950: state=Stopped err=<nil>
	W0630 21:20:03.518832  282690 fix.go:129] unexpected machine state, will restart: <nil>
	I0630 21:20:03.522271  282690 out.go:177] * Restarting existing docker container for "embed-certs-20220630210659-9950" ...
	I0630 21:20:03.523749  282690 cli_runner.go:164] Run: docker start embed-certs-20220630210659-9950
	I0630 21:20:03.930910  282690 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:20:03.968503  282690 kic.go:416] container "embed-certs-20220630210659-9950" state is running.
	I0630 21:20:03.968961  282690 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-20220630210659-9950
	I0630 21:20:04.005032  282690 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/config.json ...
	I0630 21:20:04.005301  282690 machine.go:88] provisioning docker machine ...
	I0630 21:20:04.005330  282690 ubuntu.go:169] provisioning hostname "embed-certs-20220630210659-9950"
	I0630 21:20:04.005375  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:20:04.043967  282690 main.go:134] libmachine: Using SSH client type: native
	I0630 21:20:04.044205  282690 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil>  [] 0s} 127.0.0.1 49442 <nil> <nil>}
	I0630 21:20:04.044233  282690 main.go:134] libmachine: About to run SSH command:
	sudo hostname embed-certs-20220630210659-9950 && echo "embed-certs-20220630210659-9950" | sudo tee /etc/hostname
	I0630 21:20:04.044882  282690 main.go:134] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:41696->127.0.0.1:49442: read: connection reset by peer
	I0630 21:20:07.174483  282690 main.go:134] libmachine: SSH cmd err, output: <nil>: embed-certs-20220630210659-9950
	
	I0630 21:20:07.174561  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:20:07.210487  282690 main.go:134] libmachine: Using SSH client type: native
	I0630 21:20:07.210668  282690 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil>  [] 0s} 127.0.0.1 49442 <nil> <nil>}
	I0630 21:20:07.210690  282690 main.go:134] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sembed-certs-20220630210659-9950' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 embed-certs-20220630210659-9950/g' /etc/hosts;
				else 
					echo '127.0.1.1 embed-certs-20220630210659-9950' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0630 21:20:07.329184  282690 main.go:134] libmachine: SSH cmd err, output: <nil>: 
	I0630 21:20:07.329234  282690 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube CaCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/c
erts/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube}
	I0630 21:20:07.329264  282690 ubuntu.go:177] setting up certificates
	I0630 21:20:07.329274  282690 provision.go:83] configureAuth start
	I0630 21:20:07.329332  282690 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-20220630210659-9950
	I0630 21:20:07.365729  282690 provision.go:138] copyHostCerts
	I0630 21:20:07.365803  282690 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem, removing ...
	I0630 21:20:07.365816  282690 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem
	I0630 21:20:07.365887  282690 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem (1679 bytes)
	I0630 21:20:07.365984  282690 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem, removing ...
	I0630 21:20:07.365998  282690 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem
	I0630 21:20:07.366039  282690 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem (1082 bytes)
	I0630 21:20:07.366110  282690 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem, removing ...
	I0630 21:20:07.366123  282690 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem
	I0630 21:20:07.366164  282690 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem (1123 bytes)
	I0630 21:20:07.366225  282690 provision.go:112] generating server cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem org=jenkins.embed-certs-20220630210659-9950 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-20220630210659-9950]
	I0630 21:20:07.595656  282690 provision.go:172] copyRemoteCerts
	I0630 21:20:07.595725  282690 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0630 21:20:07.595756  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:20:07.631338  282690 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49442 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:20:07.716832  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
	I0630 21:20:07.735870  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem --> /etc/docker/server.pem (1265 bytes)
	I0630 21:20:07.756354  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0630 21:20:07.775209  282690 provision.go:86] duration metric: configureAuth took 445.919443ms
	I0630 21:20:07.775233  282690 ubuntu.go:193] setting minikube options for container-runtime
	I0630 21:20:07.775399  282690 config.go:178] Loaded profile config "embed-certs-20220630210659-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:20:07.775412  282690 machine.go:91] provisioned docker machine in 3.770097214s
	I0630 21:20:07.775419  282690 start.go:306] post-start starting for "embed-certs-20220630210659-9950" (driver="docker")
	I0630 21:20:07.775425  282690 start.go:316] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0630 21:20:07.775465  282690 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0630 21:20:07.775498  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:20:07.811677  282690 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49442 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:20:07.897450  282690 ssh_runner.go:195] Run: cat /etc/os-release
	I0630 21:20:07.900657  282690 main.go:134] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0630 21:20:07.900688  282690 main.go:134] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0630 21:20:07.900696  282690 main.go:134] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0630 21:20:07.900702  282690 info.go:137] Remote host: Ubuntu 20.04.4 LTS
	I0630 21:20:07.900711  282690 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/addons for local assets ...
	I0630 21:20:07.900762  282690 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files for local assets ...
	I0630 21:20:07.900829  282690 filesync.go:149] local asset: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem -> 99502.pem in /etc/ssl/certs
	I0630 21:20:07.900909  282690 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0630 21:20:07.908065  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem --> /etc/ssl/certs/99502.pem (1708 bytes)
	I0630 21:20:07.926474  282690 start.go:309] post-start completed in 151.040627ms
	I0630 21:20:07.926557  282690 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0630 21:20:07.926600  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:20:07.963198  282690 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49442 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:20:08.045725  282690 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0630 21:20:08.049536  282690 fix.go:57] fixHost completed within 4.564962738s
	I0630 21:20:08.049568  282690 start.go:81] releasing machines lock for "embed-certs-20220630210659-9950", held for 4.56500909s
	I0630 21:20:08.049668  282690 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-20220630210659-9950
	I0630 21:20:08.085452  282690 ssh_runner.go:195] Run: systemctl --version
	I0630 21:20:08.085508  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:20:08.085526  282690 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/
	I0630 21:20:08.085584  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:20:08.125940  282690 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49442 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:20:08.126756  282690 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49442 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:20:08.209826  282690 ssh_runner.go:195] Run: sudo systemctl stop -f crio
	I0630 21:20:08.240545  282690 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0630 21:20:08.251830  282690 docker.go:179] disabling docker service ...
	I0630 21:20:08.251890  282690 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0630 21:20:08.263344  282690 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0630 21:20:08.272763  282690 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0630 21:20:08.347490  282690 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0630 21:20:08.430323  282690 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0630 21:20:08.439736  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
	image-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0630 21:20:08.453177  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*sandbox_image = .*$|sandbox_image = "k8s.gcr.io/pause:3.7"|' -i /etc/containerd/config.toml"
	I0630 21:20:08.461609  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*restrict_oom_score_adj = .*$|restrict_oom_score_adj = false|' -i /etc/containerd/config.toml"
	I0630 21:20:08.469975  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*SystemdCgroup = .*$|SystemdCgroup = false|' -i /etc/containerd/config.toml"
	I0630 21:20:08.478446  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*conf_dir = .*$|conf_dir = "/etc/cni/net.mk"|' -i /etc/containerd/config.toml"
	I0630 21:20:08.486889  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^# imports|imports = ["/etc/containerd/containerd.conf.d/02-containerd.conf"]|' -i /etc/containerd/config.toml"
	I0630 21:20:08.495251  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc/containerd/containerd.conf.d && printf %s "dmVyc2lvbiA9IDIK" | base64 -d | sudo tee /etc/containerd/containerd.conf.d/02-containerd.conf"
	I0630 21:20:08.508868  282690 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0630 21:20:08.515626  282690 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0630 21:20:08.522606  282690 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0630 21:20:08.605769  282690 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0630 21:20:08.682128  282690 start.go:447] Will wait 60s for socket path /run/containerd/containerd.sock
	I0630 21:20:08.682202  282690 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
	I0630 21:20:08.686167  282690 start.go:468] Will wait 60s for crictl version
	I0630 21:20:08.686246  282690 ssh_runner.go:195] Run: sudo crictl version
	I0630 21:20:08.713091  282690 retry.go:31] will retry after 11.04660288s: Temporary Error: sudo crictl version: Process exited with status 1
	stdout:
	
	stderr:
	time="2022-06-30T21:20:08Z" level=fatal msg="getting the runtime version: rpc error: code = Unknown desc = server is not initialized yet"
	I0630 21:20:19.761138  282690 ssh_runner.go:195] Run: sudo crictl version
	I0630 21:20:19.786289  282690 start.go:477] Version:  0.1.0
	RuntimeName:  containerd
	RuntimeVersion:  1.6.6
	RuntimeApiVersion:  v1alpha2
	I0630 21:20:19.786365  282690 ssh_runner.go:195] Run: containerd --version
	I0630 21:20:19.816281  282690 ssh_runner.go:195] Run: containerd --version
	I0630 21:20:19.848226  282690 out.go:177] * Preparing Kubernetes v1.24.2 on containerd 1.6.6 ...
	I0630 21:20:19.849919  282690 cli_runner.go:164] Run: docker network inspect embed-certs-20220630210659-9950 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0630 21:20:19.887550  282690 ssh_runner.go:195] Run: grep 192.168.94.1	host.minikube.internal$ /etc/hosts
	I0630 21:20:19.891143  282690 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.94.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0630 21:20:19.900924  282690 preload.go:132] Checking if preload exists for k8s version v1.24.2 and runtime containerd
	I0630 21:20:19.900991  282690 ssh_runner.go:195] Run: sudo crictl images --output json
	I0630 21:20:19.925400  282690 containerd.go:547] all images are preloaded for containerd runtime.
	I0630 21:20:19.925429  282690 containerd.go:461] Images already preloaded, skipping extraction
	I0630 21:20:19.925482  282690 ssh_runner.go:195] Run: sudo crictl images --output json
	I0630 21:20:19.950061  282690 containerd.go:547] all images are preloaded for containerd runtime.
	I0630 21:20:19.950082  282690 cache_images.go:84] Images are preloaded, skipping loading
	I0630 21:20:19.950125  282690 ssh_runner.go:195] Run: sudo crictl info
	I0630 21:20:19.974750  282690 cni.go:95] Creating CNI manager for ""
	I0630 21:20:19.974773  282690 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:20:19.974785  282690 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
	I0630 21:20:19.974799  282690 kubeadm.go:158] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.94.2 APIServerPort:8443 KubernetesVersion:v1.24.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:embed-certs-20220630210659-9950 NodeName:embed-certs-20220630210659-9950 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.94.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.94.2 CgroupDriver:cgroupfs ClientC
AFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}
	I0630 21:20:19.974955  282690 kubeadm.go:162] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.94.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: /run/containerd/containerd.sock
	  name: "embed-certs-20220630210659-9950"
	  kubeletExtraArgs:
	    node-ip: 192.168.94.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.94.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.24.2
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%"
	  nodefs.inodesFree: "0%"
	  imagefs.available: "0%"
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0630 21:20:19.975056  282690 kubeadm.go:961] kubelet [Unit]
	Wants=containerd.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.24.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=embed-certs-20220630210659-9950 --image-service-endpoint=unix:///run/containerd/containerd.sock --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.94.2 --runtime-request-timeout=15m
	
	[Install]
	 config:
	{KubernetesVersion:v1.24.2 ClusterName:embed-certs-20220630210659-9950 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
	I0630 21:20:19.975119  282690 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.24.2
	I0630 21:20:19.982477  282690 binaries.go:44] Found k8s binaries, skipping transfer
	I0630 21:20:19.982537  282690 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0630 21:20:19.989867  282690 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (524 bytes)
	I0630 21:20:20.003413  282690 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0630 21:20:20.016549  282690 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2060 bytes)
	I0630 21:20:20.030557  282690 ssh_runner.go:195] Run: grep 192.168.94.2	control-plane.minikube.internal$ /etc/hosts
	I0630 21:20:20.033673  282690 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.94.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0630 21:20:20.043309  282690 certs.go:54] Setting up /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950 for IP: 192.168.94.2
	I0630 21:20:20.043426  282690 certs.go:182] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.key
	I0630 21:20:20.043474  282690 certs.go:182] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.key
	I0630 21:20:20.043588  282690 certs.go:298] skipping minikube-user signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/client.key
	I0630 21:20:20.043669  282690 certs.go:298] skipping minikube signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.key.ad8e880a
	I0630 21:20:20.043722  282690 certs.go:298] skipping aggregator signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.key
	I0630 21:20:20.043847  282690 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950.pem (1338 bytes)
	W0630 21:20:20.043888  282690 certs.go:384] ignoring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950_empty.pem, impossibly tiny 0 bytes
	I0630 21:20:20.043906  282690 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem (1679 bytes)
	I0630 21:20:20.043944  282690 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem (1082 bytes)
	I0630 21:20:20.043983  282690 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem (1123 bytes)
	I0630 21:20:20.044018  282690 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/key.pem (1679 bytes)
	I0630 21:20:20.044074  282690 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem (1708 bytes)
	I0630 21:20:20.044672  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
	I0630 21:20:20.063809  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I0630 21:20:20.082364  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0630 21:20:20.100953  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
	I0630 21:20:20.119042  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0630 21:20:20.138260  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
	I0630 21:20:20.156455  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0630 21:20:20.175178  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
	I0630 21:20:20.193932  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem --> /usr/share/ca-certificates/99502.pem (1708 bytes)
	I0630 21:20:20.213463  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0630 21:20:20.232837  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950.pem --> /usr/share/ca-certificates/9950.pem (1338 bytes)
	I0630 21:20:20.252510  282690 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0630 21:20:20.267375  282690 ssh_runner.go:195] Run: openssl version
	I0630 21:20:20.273228  282690 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/99502.pem && ln -fs /usr/share/ca-certificates/99502.pem /etc/ssl/certs/99502.pem"
	I0630 21:20:20.281805  282690 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/99502.pem
	I0630 21:20:20.285276  282690 certs.go:431] hashing: -rw-r--r-- 1 root root 1708 Jun 30 20:26 /usr/share/ca-certificates/99502.pem
	I0630 21:20:20.285328  282690 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/99502.pem
	I0630 21:20:20.290565  282690 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/99502.pem /etc/ssl/certs/3ec20f2e.0"
	I0630 21:20:20.298693  282690 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0630 21:20:20.306974  282690 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:20:20.310492  282690 certs.go:431] hashing: -rw-r--r-- 1 root root 1111 Jun 30 20:22 /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:20:20.310555  282690 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:20:20.315748  282690 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0630 21:20:20.323429  282690 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/9950.pem && ln -fs /usr/share/ca-certificates/9950.pem /etc/ssl/certs/9950.pem"
	I0630 21:20:20.331855  282690 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/9950.pem
	I0630 21:20:20.335469  282690 certs.go:431] hashing: -rw-r--r-- 1 root root 1338 Jun 30 20:26 /usr/share/ca-certificates/9950.pem
	I0630 21:20:20.335531  282690 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/9950.pem
	I0630 21:20:20.340482  282690 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/9950.pem /etc/ssl/certs/51391683.0"
	I0630 21:20:20.348339  282690 kubeadm.go:395] StartCluster: {Name:embed-certs-20220630210659-9950 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:embed-certs-20220630210659-9950 Namespace:default APIServerName
:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[Dashboard:kubernetesui/dashboard:v2.6.0@sha256:4af9580485920635d888efe1eddbd67e12f9d5d84dba87100e93feb4e46636b3 MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet:
MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 21:20:20.348468  282690 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
	I0630 21:20:20.348531  282690 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0630 21:20:20.375578  282690 cri.go:87] found id: "6bdce580a9d6963de5c12d9e017d5662e2685851e130abf85abf7ccd2206a8a6"
	I0630 21:20:20.375605  282690 cri.go:87] found id: "8341041be1bdbcf0e0425bd1832777e15b2ed89bf8696d0c78d14301820032c3"
	I0630 21:20:20.375615  282690 cri.go:87] found id: "157c2b0c199b65e53b31cbc33bd298586d30106a66d587ee22f9c486df45d1ba"
	I0630 21:20:20.375624  282690 cri.go:87] found id: "ccc3bef31fe3faba9ff6daab0d5ca071fed6adb37d8cc554c7399ac599691557"
	I0630 21:20:20.375637  282690 cri.go:87] found id: "d56e346d0980d838b9cd42c94d9e084ef84bb0fdeb4316ae2dd5c8a25cc054a1"
	I0630 21:20:20.375652  282690 cri.go:87] found id: "7734f08ca26708ce34ae224077718432c05bc3133a11bb3d600a7d29c4df0045"
	I0630 21:20:20.375660  282690 cri.go:87] found id: ""
	I0630 21:20:20.375709  282690 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
	I0630 21:20:20.388498  282690 cri.go:114] JSON = null
	W0630 21:20:20.388559  282690 kubeadm.go:402] unpause failed: list paused: list returned 0 containers, but ps returned 6
	I0630 21:20:20.388621  282690 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0630 21:20:20.396168  282690 kubeadm.go:410] found existing configuration files, will attempt cluster restart
	I0630 21:20:20.396200  282690 kubeadm.go:626] restartCluster start
	I0630 21:20:20.396246  282690 ssh_runner.go:195] Run: sudo test -d /data/minikube
	I0630 21:20:20.403017  282690 kubeadm.go:127] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:20.403674  282690 kubeconfig.go:116] verify returned: extract IP: "embed-certs-20220630210659-9950" does not appear in /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:20:20.404147  282690 kubeconfig.go:127] "embed-certs-20220630210659-9950" context is missing from /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig - will repair!
	I0630 21:20:20.404911  282690 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig: {Name:mk34e4a4e7b04f624b9adbda4f77ee20b38308ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:20:20.406647  282690 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
	I0630 21:20:20.413413  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:20.413466  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:20.421286  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:20.621671  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:20.621798  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:20.630547  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:20.821858  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:20.821957  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:20.830758  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:21.022078  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:21.022162  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:21.030900  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:21.222204  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:21.222293  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:21.231221  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:21.421485  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:21.421579  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:21.430528  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:21.621730  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:21.621832  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:21.630704  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:21.822018  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:21.822098  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:21.830851  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:22.022202  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:22.022287  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:22.031086  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:22.222404  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:22.222489  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:22.231324  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:22.421567  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:22.421655  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:22.430581  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:22.621941  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:22.622040  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:22.631867  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:22.822177  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:22.822278  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:22.832202  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:23.021427  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:23.021501  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:23.030217  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:23.221874  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:23.221961  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:23.230645  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:23.421956  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:23.422028  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:23.430894  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:23.430917  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:23.430954  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:23.439029  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:23.439054  282690 kubeadm.go:601] needs reconfigure: apiserver error: timed out waiting for the condition
	I0630 21:20:23.439061  282690 kubeadm.go:1092] stopping kube-system containers ...
	I0630 21:20:23.439074  282690 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name: Namespaces:[kube-system]}
	I0630 21:20:23.439116  282690 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0630 21:20:23.463122  282690 cri.go:87] found id: "6bdce580a9d6963de5c12d9e017d5662e2685851e130abf85abf7ccd2206a8a6"
	I0630 21:20:23.463146  282690 cri.go:87] found id: "8341041be1bdbcf0e0425bd1832777e15b2ed89bf8696d0c78d14301820032c3"
	I0630 21:20:23.463152  282690 cri.go:87] found id: "157c2b0c199b65e53b31cbc33bd298586d30106a66d587ee22f9c486df45d1ba"
	I0630 21:20:23.463158  282690 cri.go:87] found id: "ccc3bef31fe3faba9ff6daab0d5ca071fed6adb37d8cc554c7399ac599691557"
	I0630 21:20:23.463163  282690 cri.go:87] found id: "d56e346d0980d838b9cd42c94d9e084ef84bb0fdeb4316ae2dd5c8a25cc054a1"
	I0630 21:20:23.463170  282690 cri.go:87] found id: "7734f08ca26708ce34ae224077718432c05bc3133a11bb3d600a7d29c4df0045"
	I0630 21:20:23.463175  282690 cri.go:87] found id: ""
	I0630 21:20:23.463180  282690 cri.go:232] Stopping containers: [6bdce580a9d6963de5c12d9e017d5662e2685851e130abf85abf7ccd2206a8a6 8341041be1bdbcf0e0425bd1832777e15b2ed89bf8696d0c78d14301820032c3 157c2b0c199b65e53b31cbc33bd298586d30106a66d587ee22f9c486df45d1ba ccc3bef31fe3faba9ff6daab0d5ca071fed6adb37d8cc554c7399ac599691557 d56e346d0980d838b9cd42c94d9e084ef84bb0fdeb4316ae2dd5c8a25cc054a1 7734f08ca26708ce34ae224077718432c05bc3133a11bb3d600a7d29c4df0045]
	I0630 21:20:23.463219  282690 ssh_runner.go:195] Run: which crictl
	I0630 21:20:23.466097  282690 ssh_runner.go:195] Run: sudo /usr/bin/crictl stop 6bdce580a9d6963de5c12d9e017d5662e2685851e130abf85abf7ccd2206a8a6 8341041be1bdbcf0e0425bd1832777e15b2ed89bf8696d0c78d14301820032c3 157c2b0c199b65e53b31cbc33bd298586d30106a66d587ee22f9c486df45d1ba ccc3bef31fe3faba9ff6daab0d5ca071fed6adb37d8cc554c7399ac599691557 d56e346d0980d838b9cd42c94d9e084ef84bb0fdeb4316ae2dd5c8a25cc054a1 7734f08ca26708ce34ae224077718432c05bc3133a11bb3d600a7d29c4df0045
	I0630 21:20:23.491529  282690 ssh_runner.go:195] Run: sudo systemctl stop kubelet
	I0630 21:20:23.501548  282690 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0630 21:20:23.508513  282690 kubeadm.go:155] found existing configuration files:
	-rw------- 1 root root 5643 Jun 30 21:07 /etc/kubernetes/admin.conf
	-rw------- 1 root root 5652 Jun 30 21:07 /etc/kubernetes/controller-manager.conf
	-rw------- 1 root root 2063 Jun 30 21:07 /etc/kubernetes/kubelet.conf
	-rw------- 1 root root 5600 Jun 30 21:07 /etc/kubernetes/scheduler.conf
	
	I0630 21:20:23.508569  282690 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
	I0630 21:20:23.515331  282690 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
	I0630 21:20:23.522134  282690 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
	I0630 21:20:23.528625  282690 kubeadm.go:166] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:23.528674  282690 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
	I0630 21:20:23.535118  282690 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
	I0630 21:20:23.541759  282690 kubeadm.go:166] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:23.541806  282690 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
	I0630 21:20:23.547839  282690 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0630 21:20:23.554281  282690 kubeadm.go:703] reconfiguring cluster from /var/tmp/minikube/kubeadm.yaml
	I0630 21:20:23.554304  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:20:23.597418  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:20:24.204823  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:20:24.388425  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:20:24.446940  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:20:24.548581  282690 api_server.go:51] waiting for apiserver process to appear ...
	I0630 21:20:24.548652  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 21:20:25.058272  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 21:20:25.558267  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 21:20:25.634820  282690 api_server.go:71] duration metric: took 1.086232371s to wait for apiserver process to appear ...
	I0630 21:20:25.634853  282690 api_server.go:87] waiting for apiserver healthz status ...
	I0630 21:20:25.634866  282690 api_server.go:240] Checking apiserver healthz at https://192.168.94.2:8443/healthz ...
	I0630 21:20:25.635225  282690 api_server.go:256] stopped: https://192.168.94.2:8443/healthz: Get "https://192.168.94.2:8443/healthz": dial tcp 192.168.94.2:8443: connect: connection refused
	I0630 21:20:26.135955  282690 api_server.go:240] Checking apiserver healthz at https://192.168.94.2:8443/healthz ...
	I0630 21:20:29.023735  282690 api_server.go:266] https://192.168.94.2:8443/healthz returned 403:
	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
	W0630 21:20:29.023845  282690 api_server.go:102] status: https://192.168.94.2:8443/healthz returned error 403:
	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
	I0630 21:20:29.136115  282690 api_server.go:240] Checking apiserver healthz at https://192.168.94.2:8443/healthz ...
	I0630 21:20:29.142290  282690 api_server.go:266] https://192.168.94.2:8443/healthz returned 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/bootstrap-controller ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[-]poststarthook/apiservice-registration-controller failed: reason withheld
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	W0630 21:20:29.142324  282690 api_server.go:102] status: https://192.168.94.2:8443/healthz returned error 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/bootstrap-controller ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[-]poststarthook/apiservice-registration-controller failed: reason withheld
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	I0630 21:20:29.635779  282690 api_server.go:240] Checking apiserver healthz at https://192.168.94.2:8443/healthz ...
	I0630 21:20:29.641744  282690 api_server.go:266] https://192.168.94.2:8443/healthz returned 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/bootstrap-controller ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-registration-controller ok
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	W0630 21:20:29.641774  282690 api_server.go:102] status: https://192.168.94.2:8443/healthz returned error 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/bootstrap-controller ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-registration-controller ok
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	I0630 21:20:30.135899  282690 api_server.go:240] Checking apiserver healthz at https://192.168.94.2:8443/healthz ...
	I0630 21:20:30.140340  282690 api_server.go:266] https://192.168.94.2:8443/healthz returned 200:
	ok
	I0630 21:20:30.146945  282690 api_server.go:140] control plane version: v1.24.2
	I0630 21:20:30.146967  282690 api_server.go:130] duration metric: took 4.512109627s to wait for apiserver health ...
	I0630 21:20:30.146976  282690 cni.go:95] Creating CNI manager for ""
	I0630 21:20:30.146983  282690 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:20:30.149207  282690 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0630 21:20:30.150766  282690 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0630 21:20:30.154566  282690 cni.go:189] applying CNI manifest using /var/lib/minikube/binaries/v1.24.2/kubectl ...
	I0630 21:20:30.154592  282690 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2429 bytes)
	I0630 21:20:30.168730  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0630 21:20:30.976925  282690 system_pods.go:43] waiting for kube-system pods to appear ...
	I0630 21:20:30.983901  282690 system_pods.go:59] 9 kube-system pods found
	I0630 21:20:30.983933  282690 system_pods.go:61] "coredns-6d4b75cb6d-87dwf" [11e7f3e7-24e8-4e14-b1f6-a7e2b9bcfb74] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.)
	I0630 21:20:30.983941  282690 system_pods.go:61] "etcd-embed-certs-20220630210659-9950" [c7597376-29d8-4a64-a014-1bca6b00b239] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
	I0630 21:20:30.983951  282690 system_pods.go:61] "kindnet-z7fgt" [9d385a59-b071-48be-b547-db80254669bc] Running / Ready:ContainersNotReady (containers with unready status: [kindnet-cni]) / ContainersReady:ContainersNotReady (containers with unready status: [kindnet-cni])
	I0630 21:20:30.983963  282690 system_pods.go:61] "kube-apiserver-embed-certs-20220630210659-9950" [101e1b1d-d8d3-49c5-b250-f9524145064b] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
	I0630 21:20:30.983978  282690 system_pods.go:61] "kube-controller-manager-embed-certs-20220630210659-9950" [f93c4f3d-22de-4c13-a12a-c8ae9d47911c] Running
	I0630 21:20:30.983988  282690 system_pods.go:61] "kube-proxy-jhw4d" [78ec1767-ed48-4f50-ab14-61149fad7e98] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])
	I0630 21:20:30.984003  282690 system_pods.go:61] "kube-scheduler-embed-certs-20220630210659-9950" [727ac744-99fa-4867-9662-83efb2a98b35] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
	I0630 21:20:30.984012  282690 system_pods.go:61] "metrics-server-5c6f97fb75-dvslz" [3a4167d3-f572-4a2c-813a-d2d22e47d17e] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.)
	I0630 21:20:30.984019  282690 system_pods.go:61] "storage-provisioner" [4e574839-6ecb-47ba-b5c4-e45d9b19efc7] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.)
	I0630 21:20:30.984028  282690 system_pods.go:74] duration metric: took 7.077293ms to wait for pod list to return data ...
	I0630 21:20:30.984038  282690 node_conditions.go:102] verifying NodePressure condition ...
	I0630 21:20:30.986718  282690 node_conditions.go:122] node storage ephemeral capacity is 304695084Ki
	I0630 21:20:30.986752  282690 node_conditions.go:123] node cpu capacity is 8
	I0630 21:20:30.986766  282690 node_conditions.go:105] duration metric: took 2.718274ms to run NodePressure ...
	I0630 21:20:30.986786  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:20:31.145954  282690 kubeadm.go:762] waiting for restarted kubelet to initialise ...
	I0630 21:20:31.149839  282690 kubeadm.go:777] kubelet initialised
	I0630 21:20:31.149867  282690 kubeadm.go:778] duration metric: took 3.887979ms waiting for restarted kubelet to initialise ...
	I0630 21:20:31.149877  282690 pod_ready.go:35] extra waiting up to 4m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0630 21:20:31.154561  282690 pod_ready.go:78] waiting up to 4m0s for pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace to be "Ready" ...
	I0630 21:20:33.160352  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:35.660314  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:38.160526  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:40.660894  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:43.160483  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:45.660796  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:47.660953  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:50.161308  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:52.660155  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:54.661629  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:57.159920  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:59.160128  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:01.160665  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:03.661112  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:06.160443  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:08.160644  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:10.661019  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:12.661060  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:15.160327  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:17.660228  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:19.660421  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:22.160264  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:24.160315  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:26.660444  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:28.661012  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:31.160051  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:33.160337  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:35.660572  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:37.660625  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:40.159296  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:42.160359  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:44.660831  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:47.160149  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:49.160793  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:51.660805  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:54.161146  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:56.660728  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:59.160517  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:01.160700  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:03.661117  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:06.160731  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:08.660876  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:11.160848  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:13.660019  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:15.660934  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:18.160512  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:20.661337  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:23.159968  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:25.659994  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:27.660386  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:29.660781  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:31.661081  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:34.160031  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:36.174889  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:38.660329  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:40.661271  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:43.160906  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:45.660687  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:47.660756  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:50.159356  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:52.163951  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:54.660447  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:57.160029  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:59.160433  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:01.660547  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:03.660907  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:06.160339  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:08.160593  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:10.660347  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:12.660595  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:15.160070  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:17.660236  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:20.159819  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:22.159969  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:24.160202  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:26.160569  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:28.660765  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:30.661044  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:33.160787  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:35.660078  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:37.660223  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:39.661253  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:42.160767  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:44.660279  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:46.660767  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:49.159959  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:51.160087  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:53.160885  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:55.660365  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:58.160601  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:00.660863  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:03.160979  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:05.661301  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:08.160501  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:10.661257  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:13.160653  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:15.660136  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:18.160271  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:20.660902  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:23.160075  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:25.160311  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:27.660413  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:30.159564  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:31.157632  282690 pod_ready.go:81] duration metric: took 4m0.003038156s waiting for pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace to be "Ready" ...
	E0630 21:24:31.157659  282690 pod_ready.go:66] WaitExtra: waitPodCondition: timed out waiting 4m0s for pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace to be "Ready" (will not retry!)
	I0630 21:24:31.157707  282690 pod_ready.go:38] duration metric: took 4m0.007820375s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0630 21:24:31.157735  282690 kubeadm.go:630] restartCluster took 4m10.761529656s
	W0630 21:24:31.157891  282690 out.go:239] ! Unable to restart cluster, will reset it: extra: timed out waiting 4m0s for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready"
	! Unable to restart cluster, will reset it: extra: timed out waiting 4m0s for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready"
	I0630 21:24:31.157919  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm reset --cri-socket /run/containerd/containerd.sock --force"
	I0630 21:24:32.851642  282690 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm reset --cri-socket /run/containerd/containerd.sock --force": (1.693695416s)
	I0630 21:24:32.851727  282690 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 21:24:32.861758  282690 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0630 21:24:32.869625  282690 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver
	I0630 21:24:32.869693  282690 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0630 21:24:32.876878  282690 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0630 21:24:32.876929  282690 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0630 21:24:41.836005  282690 out.go:204]   - Generating certificates and keys ...
	I0630 21:24:41.839508  282690 out.go:204]   - Booting up control plane ...
	I0630 21:24:41.842351  282690 out.go:204]   - Configuring RBAC rules ...
	I0630 21:24:41.844644  282690 cni.go:95] Creating CNI manager for ""
	I0630 21:24:41.844675  282690 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:24:41.846424  282690 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0630 21:24:41.847990  282690 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0630 21:24:41.853099  282690 cni.go:189] applying CNI manifest using /var/lib/minikube/binaries/v1.24.2/kubectl ...
	I0630 21:24:41.853126  282690 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2429 bytes)
	I0630 21:24:41.932756  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0630 21:24:42.729823  282690 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0630 21:24:42.729895  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:42.729926  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl label nodes minikube.k8s.io/version=v1.26.0 minikube.k8s.io/commit=251ffcec0e4c997cd7732864187747cc579943c9 minikube.k8s.io/name=embed-certs-20220630210659-9950 minikube.k8s.io/updated_at=2022_06_30T21_24_42_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:42.738247  282690 ops.go:34] apiserver oom_adj: -16
	I0630 21:24:42.834211  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:43.427269  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:43.927268  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:44.426722  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:44.926851  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:45.427106  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:45.927276  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:46.427354  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:46.926751  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:47.426882  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:47.927284  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:48.427353  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:48.927037  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:49.426521  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:49.926695  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:50.426914  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:50.927459  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:51.427334  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:51.927468  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:52.427189  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:52.927285  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:53.426965  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:53.926595  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:53.987285  282690 kubeadm.go:1045] duration metric: took 11.25744575s to wait for elevateKubeSystemPrivileges.
	I0630 21:24:53.987312  282690 kubeadm.go:397] StartCluster complete in 4m33.638985641s
	I0630 21:24:53.987328  282690 settings.go:142] acquiring lock: {Name:mkcbd229caa05b60d3551ef0b47eea08424c9b5d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:24:53.987411  282690 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:24:53.988694  282690 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig: {Name:mk34e4a4e7b04f624b9adbda4f77ee20b38308ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:24:54.505472  282690 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "embed-certs-20220630210659-9950" rescaled to 1
	I0630 21:24:54.505546  282690 start.go:208] Will wait 6m0s for node &{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0630 21:24:54.505581  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0630 21:24:54.507434  282690 out.go:177] * Verifying Kubernetes components...
	I0630 21:24:54.505671  282690 addons.go:412] enableAddons start: toEnable=map[dashboard:true metrics-server:true], additional=[]
	I0630 21:24:54.507512  282690 addons.go:65] Setting storage-provisioner=true in profile "embed-certs-20220630210659-9950"
	I0630 21:24:54.507530  282690 addons.go:153] Setting addon storage-provisioner=true in "embed-certs-20220630210659-9950"
	I0630 21:24:54.505785  282690 config.go:178] Loaded profile config "embed-certs-20220630210659-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:24:54.508995  282690 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 21:24:54.507534  282690 addons.go:65] Setting dashboard=true in profile "embed-certs-20220630210659-9950"
	I0630 21:24:54.509033  282690 addons.go:153] Setting addon dashboard=true in "embed-certs-20220630210659-9950"
	W0630 21:24:54.509043  282690 addons.go:162] addon dashboard should already be in state true
	I0630 21:24:54.507547  282690 addons.go:65] Setting default-storageclass=true in profile "embed-certs-20220630210659-9950"
	I0630 21:24:54.509118  282690 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "embed-certs-20220630210659-9950"
	I0630 21:24:54.507548  282690 addons.go:65] Setting metrics-server=true in profile "embed-certs-20220630210659-9950"
	W0630 21:24:54.507573  282690 addons.go:162] addon storage-provisioner should already be in state true
	I0630 21:24:54.509134  282690 host.go:66] Checking if "embed-certs-20220630210659-9950" exists ...
	I0630 21:24:54.509177  282690 host.go:66] Checking if "embed-certs-20220630210659-9950" exists ...
	I0630 21:24:54.509200  282690 addons.go:153] Setting addon metrics-server=true in "embed-certs-20220630210659-9950"
	W0630 21:24:54.509223  282690 addons.go:162] addon metrics-server should already be in state true
	I0630 21:24:54.509308  282690 host.go:66] Checking if "embed-certs-20220630210659-9950" exists ...
	I0630 21:24:54.509462  282690 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:24:54.509581  282690 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:24:54.509613  282690 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:24:54.509797  282690 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:24:54.560813  282690 out.go:177]   - Using image fake.domain/k8s.gcr.io/echoserver:1.4
	I0630 21:24:54.562228  282690 addons.go:345] installing /etc/kubernetes/addons/metrics-apiservice.yaml
	I0630 21:24:54.562250  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
	I0630 21:24:54.566558  282690 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0630 21:24:54.563422  282690 addons.go:153] Setting addon default-storageclass=true in "embed-certs-20220630210659-9950"
	I0630 21:24:54.564610  282690 out.go:177]   - Using image kubernetesui/dashboard:v2.6.0
	I0630 21:24:54.564664  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	W0630 21:24:54.566619  282690 addons.go:162] addon default-storageclass should already be in state true
	I0630 21:24:54.568042  282690 addons.go:345] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 21:24:54.568076  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0630 21:24:54.568138  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:24:54.568049  282690 host.go:66] Checking if "embed-certs-20220630210659-9950" exists ...
	I0630 21:24:54.568896  282690 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:24:54.571125  282690 out.go:177]   - Using image k8s.gcr.io/echoserver:1.4
	I0630 21:24:54.573220  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-ns.yaml
	I0630 21:24:54.573240  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
	I0630 21:24:54.573296  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:24:54.596761  282690 node_ready.go:35] waiting up to 6m0s for node "embed-certs-20220630210659-9950" to be "Ready" ...
	I0630 21:24:54.596796  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.94.1 host.minikube.internal\n           fallthrough\n        }' | sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0630 21:24:54.622285  282690 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49442 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:24:54.625192  282690 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49442 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:24:54.629199  282690 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49442 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:24:54.632573  282690 addons.go:345] installing /etc/kubernetes/addons/storageclass.yaml
	I0630 21:24:54.632600  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0630 21:24:54.632654  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:24:54.674915  282690 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49442 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:24:54.846449  282690 addons.go:345] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
	I0630 21:24:54.846481  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1820 bytes)
	I0630 21:24:54.938792  282690 addons.go:345] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
	I0630 21:24:54.938872  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
	I0630 21:24:54.943079  282690 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0630 21:24:54.947159  282690 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 21:24:54.947675  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
	I0630 21:24:54.947698  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
	I0630 21:24:55.026994  282690 addons.go:345] installing /etc/kubernetes/addons/metrics-server-service.yaml
	I0630 21:24:55.027031  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
	I0630 21:24:55.035197  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
	I0630 21:24:55.035232  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
	I0630 21:24:55.053605  282690 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I0630 21:24:55.126653  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-configmap.yaml
	I0630 21:24:55.126705  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
	I0630 21:24:55.146581  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-dp.yaml
	I0630 21:24:55.146621  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4196 bytes)
	I0630 21:24:55.327942  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-role.yaml
	I0630 21:24:55.328024  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
	I0630 21:24:55.343459  282690 start.go:806] {"host.minikube.internal": 192.168.94.1} host record injected into CoreDNS
	I0630 21:24:55.432902  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
	I0630 21:24:55.432936  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
	I0630 21:24:55.449659  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-sa.yaml
	I0630 21:24:55.449700  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
	I0630 21:24:55.535585  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-secret.yaml
	I0630 21:24:55.535622  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
	I0630 21:24:55.637082  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-svc.yaml
	I0630 21:24:55.637110  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
	I0630 21:24:55.654090  282690 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	I0630 21:24:56.256357  282690 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (1.202695189s)
	I0630 21:24:56.256419  282690 addons.go:383] Verifying addon metrics-server=true in "embed-certs-20220630210659-9950"
	I0630 21:24:56.635370  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:24:57.057755  282690 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (1.403598153s)
	I0630 21:24:57.059648  282690 out.go:177] * Enabled addons: default-storageclass, storage-provisioner, metrics-server, dashboard
	I0630 21:24:57.061353  282690 addons.go:414] enableAddons completed in 2.555682965s
	I0630 21:24:59.133305  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:01.133976  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:03.633140  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:05.633312  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:07.633508  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:09.633916  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:12.134025  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:14.134148  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:16.633590  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:19.133861  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:21.634052  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:23.634100  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:26.133369  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:28.133752  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:30.134009  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:32.633645  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:34.633970  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:37.133998  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:39.633552  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:42.133635  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:44.133850  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:46.633832  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:48.633923  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:51.133282  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:53.134021  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:55.134340  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:57.633598  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:59.633912  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:01.634030  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:04.134240  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:06.634341  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:09.134132  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:11.633755  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:13.633838  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:16.134412  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:18.634048  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:21.133258  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:23.134085  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:25.633525  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:27.633880  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:29.634672  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:32.133127  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:34.133922  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:36.134141  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:38.635943  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:41.134059  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:43.634129  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:46.133833  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:48.634266  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:51.133583  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:53.633861  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:55.634000  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:57.634221  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:00.134428  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:02.634184  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:04.634236  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:07.133392  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:09.133620  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:11.133918  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:13.633511  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:15.634578  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:18.134059  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:20.633162  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:22.634065  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:25.133441  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:27.133812  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:29.634200  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:32.133633  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:34.634090  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:37.134098  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:39.634528  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:42.134216  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:44.633646  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:46.633772  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:49.133433  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:51.633343  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:54.133271  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:56.133890  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:58.633874  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:01.133490  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:03.634155  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:06.133638  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:08.134014  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:10.633584  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:12.633988  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:15.133284  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:17.633303  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:19.633472  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:21.633579  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:24.133628  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:26.633535  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:29.133336  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:31.134181  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:33.633631  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:35.634122  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:38.134153  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:40.634086  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:43.134075  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:45.633956  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:47.634182  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:50.133652  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:52.633744  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:54.635658  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:54.635684  282690 node_ready.go:38] duration metric: took 4m0.038888758s waiting for node "embed-certs-20220630210659-9950" to be "Ready" ...
	I0630 21:28:54.638083  282690 out.go:177] 
	W0630 21:28:54.639729  282690 out.go:239] X Exiting due to GUEST_START: wait 6m0s for node: waiting for node to be ready: waitNodeCondition: timed out waiting for the condition
	X Exiting due to GUEST_START: wait 6m0s for node: waiting for node to be ready: waitNodeCondition: timed out waiting for the condition
	W0630 21:28:54.639748  282690 out.go:239] * 
	* 
	W0630 21:28:54.640518  282690 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0630 21:28:54.642114  282690 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-linux-amd64 start -p embed-certs-20220630210659-9950 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=containerd --kubernetes-version=v1.24.2": exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestStartStop/group/embed-certs/serial/SecondStart]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect embed-certs-20220630210659-9950
helpers_test.go:235: (dbg) docker inspect embed-certs-20220630210659-9950:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "8d43dca0a5ff56a08f5b0493d261e7c5d2aa00d085ae1a1182a97b5635cc1304",
	        "Created": "2022-06-30T21:07:07.545531471Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 282997,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2022-06-30T21:20:03.922267815Z",
	            "FinishedAt": "2022-06-30T21:20:02.548966491Z"
	        },
	        "Image": "sha256:573e7be5768273a7845baee1ae90fa2e33b83b10a7fbb0f0f41efbf29b53d1f1",
	        "ResolvConfPath": "/var/lib/docker/containers/8d43dca0a5ff56a08f5b0493d261e7c5d2aa00d085ae1a1182a97b5635cc1304/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/8d43dca0a5ff56a08f5b0493d261e7c5d2aa00d085ae1a1182a97b5635cc1304/hostname",
	        "HostsPath": "/var/lib/docker/containers/8d43dca0a5ff56a08f5b0493d261e7c5d2aa00d085ae1a1182a97b5635cc1304/hosts",
	        "LogPath": "/var/lib/docker/containers/8d43dca0a5ff56a08f5b0493d261e7c5d2aa00d085ae1a1182a97b5635cc1304/8d43dca0a5ff56a08f5b0493d261e7c5d2aa00d085ae1a1182a97b5635cc1304-json.log",
	        "Name": "/embed-certs-20220630210659-9950",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "embed-certs-20220630210659-9950:/var",
	                "/lib/modules:/lib/modules:ro"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "embed-certs-20220630210659-9950",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 2306867200,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": null,
	            "BlkioDeviceWriteBps": null,
	            "BlkioDeviceReadIOps": null,
	            "BlkioDeviceWriteIOps": null,
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "KernelMemory": 0,
	            "KernelMemoryTCP": 0,
	            "MemoryReservation": 0,
	            "MemorySwap": 4613734400,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": null,
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/9c28feead8af894b180999110a5cc0d8344ae5c74789cd8dc72d94ee221f8e10-init/diff:/var/lib/docker/overlay2/8b88d9f6f12c48be642a133456203e58549a93f1da67d0349744bd0f78917fba/diff:/var/lib/docker/overlay2/2bcbb3b4718a64188802301a25d7f413bb307cb16d077e7e5af799f9152a2970/diff:/var/lib/docker/overlay2/70b0888bf22fcef1c004704b71288ac581cf26a3b3b19fbca3da296ba10d6978/diff:/var/lib/docker/overlay2/7c5332f38fe652f379ef9b6d23e795158e9994317cfb547b581dd2b1fdf1303b/diff:/var/lib/docker/overlay2/0ddb5a3abf433b644a8bfa124e3c87878eed67878faa35493f2befc2b392e9cb/diff:/var/lib/docker/overlay2/3b7cda5fb0232fdeecbec0531ac704a59eb38fe57664c25777193b07e2df0077/diff:/var/lib/docker/overlay2/a14687ada786c65465b9924ae2d77ba27afc07942851cafaade28e80dfe9da16/diff:/var/lib/docker/overlay2/c49a9b7157aa6e8714e192b2849866d035b59e18de462c0ee9b72f898cc5a485/diff:/var/lib/docker/overlay2/efd71a50e3a1044a6d1c4c1a7d4d91d9f070c066e03e51c6c73a5764b778ad72/diff:/var/lib/docker/overlay2/55476a
1c0a20aa4238a0bb0e43c6402c33dcad312938ad48ee81be0160e12a49/diff:/var/lib/docker/overlay2/c48c4a348a797b9a38f01568a6adbcb4b05b4f56f7b986a4bf1b509d8cb00732/diff:/var/lib/docker/overlay2/568e3f354ab0428de5cf82d1fdfb780c3377f5cc55d9f524731c53e39e0ecae7/diff:/var/lib/docker/overlay2/2857943e320cdcdae9af3d8c2acda1fb61e2f142a88b8b902908071cea67816e/diff:/var/lib/docker/overlay2/bdd9a57f0b65e65c5a16395f239425e794c678b0e8db2f4a368e0a9427fe5116/diff:/var/lib/docker/overlay2/b150183f1b73e8c13c751911bcee09fed8ef973478f4dc3cfdb9e509118bf1ea/diff:/var/lib/docker/overlay2/0a053e7c29417cd6feafb351c7944e81342a52898871bc779f7bf61868c78ec4/diff:/var/lib/docker/overlay2/d3c0de3a44d75d0a05acb7843d53deba5ce0457649d6ed757da9b4c532a81e4f/diff:/var/lib/docker/overlay2/53f6170132880e1697dd802b8577382b31c6f1ba144256f8cc62542998842a6b/diff:/var/lib/docker/overlay2/b5c0be6d8efdb1fcb12e73b8f72853f77baa4bc014ac2c1e28b7b972b07f3325/diff:/var/lib/docker/overlay2/36c908f082a1e5388bb25277f1c957eaecf70fcd958080422fa85a3105724fb2/diff:/var/lib/d
ocker/overlay2/b147fe9dce365cfaf9bfeca2e370829e4d87e2671c133a9836ecb02a85422cc7/diff:/var/lib/docker/overlay2/65f488eb9181a721f01b333f5fa0cb91d216abd7842a9ae193bd95316f378721/diff:/var/lib/docker/overlay2/b04269aa247b68912ddc5b1c98ad55d67af4103f576a900eef4069c196b8a263/diff:/var/lib/docker/overlay2/b714c37e15257ae9d0e15d271dd18a330c38ad765901d9b7e7e3feb73e1b03e4/diff:/var/lib/docker/overlay2/3c253b721193edeaade7bba7ce25ff687c889b8fa86e9489c7ee20d5624e6c5b/diff:/var/lib/docker/overlay2/7f67b74e101fa21dd320393c10576eefa4ce1cec2e210bff405784fa45b360f3/diff:/var/lib/docker/overlay2/c3b2adaa63a06a5e6ed966d7b6f20a757aeadd3f25eb09ef3c7e9a66a8904143/diff:/var/lib/docker/overlay2/ddb5d653d19e8cafc4625a8fe9597667d98b277a7f679e532ad84caa2c6da636/diff:/var/lib/docker/overlay2/03eb172b20323ebeee7cb09025726a6e10de6c3dd8661f4f6bbc5a3a3778bad4/diff:/var/lib/docker/overlay2/80ea9bf34d028e95a8a418b3aeb634be72ab3336448946d7855c51ffdf8258d7/diff:/var/lib/docker/overlay2/e28987ea3fb4d431dee111f38cc76814b85f73e86434be3c463c01fdd59
9ad46/diff:/var/lib/docker/overlay2/6f9a46c7c6cf4fd30ce32a1eb08ed9b1e8dd61cb0e42ce54f0f736f06558c306/diff:/var/lib/docker/overlay2/6fc942eb9ccfc09898edc9a5ef3b3d305a6fcb22e8cefb1a9f9c344d10b59b25/diff:/var/lib/docker/overlay2/f6b8c57540e798dc1dfd51fd29c020193c02a4362f31c6d07aa220327bb07b90/diff:/var/lib/docker/overlay2/85d0aa01a3fab8c77262c59d8a7b0809a72673a3da7d33e4e19c04a66db44a11/diff:/var/lib/docker/overlay2/58dcd81a1605641f785ced5aeb38657eec1f02a31b7adfaf4f6fdd49f4bab1d6/diff:/var/lib/docker/overlay2/9d537e0a65325e4bf85b26da9828002339f5c442ca85f931b340457a80ec8c94/diff:/var/lib/docker/overlay2/a6f73707ee6a74e948a02d03c4a3f12b57c2eb408dc67da3c39961bb3cefcc97/diff:/var/lib/docker/overlay2/922526c310b066dbb73b9a106eef8bf0064ad7907a8d7d7b353f5307a17a4901/diff:/var/lib/docker/overlay2/a4185854870ebf8d34a4c7e1827dbe3bc461559839301ffb23c5efff5e3c9f14/diff:/var/lib/docker/overlay2/8c02b1fcb9d79f5d7b2ee4d44f6625a692c44a0d18df0a5c01cac0cca0fdf3f3/diff",
	                "MergedDir": "/var/lib/docker/overlay2/9c28feead8af894b180999110a5cc0d8344ae5c74789cd8dc72d94ee221f8e10/merged",
	                "UpperDir": "/var/lib/docker/overlay2/9c28feead8af894b180999110a5cc0d8344ae5c74789cd8dc72d94ee221f8e10/diff",
	                "WorkDir": "/var/lib/docker/overlay2/9c28feead8af894b180999110a5cc0d8344ae5c74789cd8dc72d94ee221f8e10/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "volume",
	                "Name": "embed-certs-20220630210659-9950",
	                "Source": "/var/lib/docker/volumes/embed-certs-20220630210659-9950/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            },
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            }
	        ],
	        "Config": {
	            "Hostname": "embed-certs-20220630210659-9950",
	            "Domainname": "",
	            "User": "root",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e",
	            "Volumes": null,
	            "WorkingDir": "",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "embed-certs-20220630210659-9950",
	                "name.minikube.sigs.k8s.io": "embed-certs-20220630210659-9950",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "ba5b884b6e56db06325cda7b5cff38a7d1995cc679a9436ca69f5c1ff4958e9c",
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49442"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49441"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49438"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49440"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49439"
	                    }
	                ]
	            },
	            "SandboxKey": "/var/run/docker/netns/ba5b884b6e56",
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "embed-certs-20220630210659-9950": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.94.2"
	                    },
	                    "Links": null,
	                    "Aliases": [
	                        "8d43dca0a5ff",
	                        "embed-certs-20220630210659-9950"
	                    ],
	                    "NetworkID": "a762009b1f738e8867dc868c38a8f04b91d930fa90f85eb117025e337ab9ed89",
	                    "EndpointID": "dddeec6fd3923e176e3a8b445351ecb95a49f42067ff168fddafe1aa887acccd",
	                    "Gateway": "192.168.94.1",
	                    "IPAddress": "192.168.94.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "MacAddress": "02:42:c0:a8:5e:02",
	                    "DriverOpts": null
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-20220630210659-9950 -n embed-certs-20220630210659-9950
helpers_test.go:244: <<< TestStartStop/group/embed-certs/serial/SecondStart FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======>  post-mortem[TestStartStop/group/embed-certs/serial/SecondStart]: minikube logs <======
helpers_test.go:247: (dbg) Run:  out/minikube-linux-amd64 -p embed-certs-20220630210659-9950 logs -n 25
helpers_test.go:252: TestStartStop/group/embed-certs/serial/SecondStart logs: 
-- stdout --
	* 
	* ==> Audit <==
	* |---------|------------------------------------------------------------|----------|---------|---------|---------------------|---------------------|
	| Command |                            Args                            | Profile  |  User   | Version |     Start Time      |      End Time       |
	|---------|------------------------------------------------------------|----------|---------|---------|---------------------|---------------------|
	| start   | -p newest-cni-20220630210514-9950 --memory=2200            | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | --alsologtostderr --wait=apiserver,system_pods,default_sa  |          |         |         |                     |                     |
	|         | --feature-gates ServerSideApply=true --network-plugin=cni  |          |         |         |                     |                     |
	|         | --extra-config=kubeadm.pod-network-cidr=192.168.111.111/16 |          |         |         |                     |                     |
	|         | --driver=docker  --container-runtime=containerd            |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                               |          |         |         |                     |                     |
	| ssh     | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | sudo crictl images -o json                                 |          |         |         |                     |                     |
	| pause   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                     |          |         |         |                     |                     |
	| unpause | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                     |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | disable-driver-mounts-20220630210659-9950                  |          |         |         |                     |                     |
	| start   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC |                     |
	|         | embed-certs-20220630210659-9950                            |          |         |         |                     |                     |
	|         | --memory=2200 --alsologtostderr                            |          |         |         |                     |                     |
	|         | --wait=true --embed-certs                                  |          |         |         |                     |                     |
	|         | --driver=docker                                            |          |         |         |                     |                     |
	|         | --container-runtime=containerd                             |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                               |          |         |         |                     |                     |
	| ssh     | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|         | sudo crictl images -o json                                 |          |         |         |                     |                     |
	| pause   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                     |          |         |         |                     |                     |
	| unpause | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                     |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	| addons  | enable metrics-server -p                                   | minikube | jenkins | v1.26.0 | 30 Jun 22 21:12 UTC | 30 Jun 22 21:12 UTC |
	|         | old-k8s-version-20220630210005-9950                        |          |         |         |                     |                     |
	|         | --images=MetricsServer=k8s.gcr.io/echoserver:1.4           |          |         |         |                     |                     |
	|         | --registries=MetricsServer=fake.domain                     |          |         |         |                     |                     |
	| stop    | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:12 UTC | 30 Jun 22 21:12 UTC |
	|         | old-k8s-version-20220630210005-9950                        |          |         |         |                     |                     |
	|         | --alsologtostderr -v=3                                     |          |         |         |                     |                     |
	| addons  | enable dashboard -p                                        | minikube | jenkins | v1.26.0 | 30 Jun 22 21:12 UTC | 30 Jun 22 21:12 UTC |
	|         | old-k8s-version-20220630210005-9950                        |          |         |         |                     |                     |
	|         | --images=MetricsScraper=k8s.gcr.io/echoserver:1.4          |          |         |         |                     |                     |
	| start   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:12 UTC |                     |
	|         | old-k8s-version-20220630210005-9950                        |          |         |         |                     |                     |
	|         | --memory=2200 --alsologtostderr                            |          |         |         |                     |                     |
	|         | --wait=true --kvm-network=default                          |          |         |         |                     |                     |
	|         | --kvm-qemu-uri=qemu:///system                              |          |         |         |                     |                     |
	|         | --disable-driver-mounts                                    |          |         |         |                     |                     |
	|         | --keep-context=false                                       |          |         |         |                     |                     |
	|         | --driver=docker                                            |          |         |         |                     |                     |
	|         | --container-runtime=containerd                             |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.16.0                               |          |         |         |                     |                     |
	| addons  | enable metrics-server -p                                   | minikube | jenkins | v1.26.0 | 30 Jun 22 21:16 UTC | 30 Jun 22 21:16 UTC |
	|         | default-k8s-different-port-20220630210335-9950             |          |         |         |                     |                     |
	|         | --images=MetricsServer=k8s.gcr.io/echoserver:1.4           |          |         |         |                     |                     |
	|         | --registries=MetricsServer=fake.domain                     |          |         |         |                     |                     |
	| stop    | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:16 UTC | 30 Jun 22 21:16 UTC |
	|         | default-k8s-different-port-20220630210335-9950             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=3                                     |          |         |         |                     |                     |
	| addons  | enable dashboard -p                                        | minikube | jenkins | v1.26.0 | 30 Jun 22 21:16 UTC | 30 Jun 22 21:16 UTC |
	|         | default-k8s-different-port-20220630210335-9950             |          |         |         |                     |                     |
	|         | --images=MetricsScraper=k8s.gcr.io/echoserver:1.4          |          |         |         |                     |                     |
	| start   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:16 UTC |                     |
	|         | default-k8s-different-port-20220630210335-9950             |          |         |         |                     |                     |
	|         | --memory=2200 --alsologtostderr --wait=true                |          |         |         |                     |                     |
	|         | --apiserver-port=8444 --driver=docker                      |          |         |         |                     |                     |
	|         |  --container-runtime=containerd                            |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                               |          |         |         |                     |                     |
	| addons  | enable metrics-server -p                                   | minikube | jenkins | v1.26.0 | 30 Jun 22 21:19 UTC | 30 Jun 22 21:19 UTC |
	|         | embed-certs-20220630210659-9950                            |          |         |         |                     |                     |
	|         | --images=MetricsServer=k8s.gcr.io/echoserver:1.4           |          |         |         |                     |                     |
	|         | --registries=MetricsServer=fake.domain                     |          |         |         |                     |                     |
	| stop    | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:19 UTC | 30 Jun 22 21:20 UTC |
	|         | embed-certs-20220630210659-9950                            |          |         |         |                     |                     |
	|         | --alsologtostderr -v=3                                     |          |         |         |                     |                     |
	| addons  | enable dashboard -p                                        | minikube | jenkins | v1.26.0 | 30 Jun 22 21:20 UTC | 30 Jun 22 21:20 UTC |
	|         | embed-certs-20220630210659-9950                            |          |         |         |                     |                     |
	|         | --images=MetricsScraper=k8s.gcr.io/echoserver:1.4          |          |         |         |                     |                     |
	| start   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:20 UTC |                     |
	|         | embed-certs-20220630210659-9950                            |          |         |         |                     |                     |
	|         | --memory=2200 --alsologtostderr                            |          |         |         |                     |                     |
	|         | --wait=true --embed-certs                                  |          |         |         |                     |                     |
	|         | --driver=docker                                            |          |         |         |                     |                     |
	|         | --container-runtime=containerd                             |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                               |          |         |         |                     |                     |
	|---------|------------------------------------------------------------|----------|---------|---------|---------------------|---------------------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2022/06/30 21:20:03
	Running on machine: ubuntu-20-agent-8
	Binary: Built with gc go1.18.3 for linux/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0630 21:20:03.147328  282690 out.go:296] Setting OutFile to fd 1 ...
	I0630 21:20:03.147439  282690 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 21:20:03.147448  282690 out.go:309] Setting ErrFile to fd 2...
	I0630 21:20:03.147453  282690 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 21:20:03.147898  282690 root.go:329] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/bin
	I0630 21:20:03.148141  282690 out.go:303] Setting JSON to false
	I0630 21:20:03.149531  282690 start.go:115] hostinfo: {"hostname":"ubuntu-20-agent-8","uptime":3755,"bootTime":1656620248,"procs":452,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1012-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0630 21:20:03.149604  282690 start.go:125] virtualization: kvm guest
	I0630 21:20:03.152275  282690 out.go:177] * [embed-certs-20220630210659-9950] minikube v1.26.0 on Ubuntu 20.04 (kvm/amd64)
	I0630 21:20:03.154290  282690 notify.go:193] Checking for updates...
	I0630 21:20:03.154307  282690 out.go:177]   - MINIKUBE_LOCATION=14420
	I0630 21:20:03.156071  282690 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0630 21:20:03.157769  282690 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:20:03.159343  282690 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube
	I0630 21:20:03.160888  282690 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0630 21:20:03.163346  282690 config.go:178] Loaded profile config "embed-certs-20220630210659-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:20:03.163802  282690 driver.go:360] Setting default libvirt URI to qemu:///system
	I0630 21:20:03.205706  282690 docker.go:137] docker version: linux-20.10.17
	I0630 21:20:03.205824  282690 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0630 21:20:03.318551  282690 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:8 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:43 OomKillDisable:true NGoroutines:44 SystemTime:2022-06-30 21:20:03.238323982 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1012-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexServ
erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662451712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-8 Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Client
Info:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
	I0630 21:20:03.318677  282690 docker.go:254] overlay module found
	I0630 21:20:03.322599  282690 out.go:177] * Using the docker driver based on existing profile
	I0630 21:20:03.324114  282690 start.go:284] selected driver: docker
	I0630 21:20:03.324129  282690 start.go:808] validating driver "docker" against &{Name:embed-certs-20220630210659-9950 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:embed-certs-20220630210659-9950 Namespace:d
efault APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[Dashboard:kubernetesui/dashboard:v2.6.0@sha256:4af9580485920635d888efe1eddbd67e12f9d5d84dba87100e93feb4e46636b3 MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddres
s: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 21:20:03.324222  282690 start.go:819] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0630 21:20:03.325145  282690 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0630 21:20:03.438547  282690 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:8 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:43 OomKillDisable:true NGoroutines:44 SystemTime:2022-06-30 21:20:03.358172615 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1012-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexServ
erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662451712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-8 Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Client
Info:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
	I0630 21:20:03.438832  282690 start_flags.go:853] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0630 21:20:03.438854  282690 cni.go:95] Creating CNI manager for ""
	I0630 21:20:03.438863  282690 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:20:03.438877  282690 start_flags.go:310] config:
	{Name:embed-certs-20220630210659-9950 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:embed-certs-20220630210659-9950 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:clus
ter.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[Dashboard:kubernetesui/dashboard:v2.6.0@sha256:4af9580485920635d888efe1eddbd67e12f9d5d84dba87100e93feb4e46636b3 MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0
m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 21:20:03.442075  282690 out.go:177] * Starting control plane node embed-certs-20220630210659-9950 in cluster embed-certs-20220630210659-9950
	I0630 21:20:03.443525  282690 cache.go:120] Beginning downloading kic base image for docker with containerd
	I0630 21:20:03.445355  282690 out.go:177] * Pulling base image ...
	I0630 21:20:03.446826  282690 preload.go:132] Checking if preload exists for k8s version v1.24.2 and runtime containerd
	I0630 21:20:03.446872  282690 preload.go:148] Found local preload: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-containerd-overlay2-amd64.tar.lz4
	I0630 21:20:03.446895  282690 cache.go:57] Caching tarball of preloaded images
	I0630 21:20:03.446927  282690 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e in local docker daemon
	I0630 21:20:03.447161  282690 preload.go:174] Found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-containerd-overlay2-amd64.tar.lz4 in cache, skipping download
	I0630 21:20:03.447178  282690 cache.go:60] Finished verifying existence of preloaded tar for  v1.24.2 on containerd
	I0630 21:20:03.447328  282690 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/config.json ...
	I0630 21:20:03.484347  282690 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e in local docker daemon, skipping pull
	I0630 21:20:03.484373  282690 cache.go:142] gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e exists in daemon, skipping load
	I0630 21:20:03.484390  282690 cache.go:208] Successfully downloaded all kic artifacts
	I0630 21:20:03.484431  282690 start.go:352] acquiring machines lock for embed-certs-20220630210659-9950: {Name:mk6619dbb09b46cdd2b244e5bf2112b3274a30ef Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0630 21:20:03.484542  282690 start.go:356] acquired machines lock for "embed-certs-20220630210659-9950" in 89.652µs
	I0630 21:20:03.484563  282690 start.go:94] Skipping create...Using existing machine configuration
	I0630 21:20:03.484568  282690 fix.go:55] fixHost starting: 
	I0630 21:20:03.484786  282690 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:20:03.518786  282690 fix.go:103] recreateIfNeeded on embed-certs-20220630210659-9950: state=Stopped err=<nil>
	W0630 21:20:03.518832  282690 fix.go:129] unexpected machine state, will restart: <nil>
	I0630 21:20:03.522271  282690 out.go:177] * Restarting existing docker container for "embed-certs-20220630210659-9950" ...
	I0630 21:20:01.182137  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:03.183061  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:02.393449  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:04.893746  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:03.523749  282690 cli_runner.go:164] Run: docker start embed-certs-20220630210659-9950
	I0630 21:20:03.930910  282690 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:20:03.968503  282690 kic.go:416] container "embed-certs-20220630210659-9950" state is running.
	I0630 21:20:03.968961  282690 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-20220630210659-9950
	I0630 21:20:04.005032  282690 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/config.json ...
	I0630 21:20:04.005301  282690 machine.go:88] provisioning docker machine ...
	I0630 21:20:04.005330  282690 ubuntu.go:169] provisioning hostname "embed-certs-20220630210659-9950"
	I0630 21:20:04.005375  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:20:04.043967  282690 main.go:134] libmachine: Using SSH client type: native
	I0630 21:20:04.044205  282690 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil>  [] 0s} 127.0.0.1 49442 <nil> <nil>}
	I0630 21:20:04.044233  282690 main.go:134] libmachine: About to run SSH command:
	sudo hostname embed-certs-20220630210659-9950 && echo "embed-certs-20220630210659-9950" | sudo tee /etc/hostname
	I0630 21:20:04.044882  282690 main.go:134] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:41696->127.0.0.1:49442: read: connection reset by peer
	I0630 21:20:07.174483  282690 main.go:134] libmachine: SSH cmd err, output: <nil>: embed-certs-20220630210659-9950
	
	I0630 21:20:07.174561  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:20:07.210487  282690 main.go:134] libmachine: Using SSH client type: native
	I0630 21:20:07.210668  282690 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil>  [] 0s} 127.0.0.1 49442 <nil> <nil>}
	I0630 21:20:07.210690  282690 main.go:134] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sembed-certs-20220630210659-9950' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 embed-certs-20220630210659-9950/g' /etc/hosts;
				else 
					echo '127.0.1.1 embed-certs-20220630210659-9950' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0630 21:20:07.329184  282690 main.go:134] libmachine: SSH cmd err, output: <nil>: 
	I0630 21:20:07.329234  282690 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube CaCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/c
erts/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube}
	I0630 21:20:07.329264  282690 ubuntu.go:177] setting up certificates
	I0630 21:20:07.329274  282690 provision.go:83] configureAuth start
	I0630 21:20:07.329332  282690 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-20220630210659-9950
	I0630 21:20:07.365729  282690 provision.go:138] copyHostCerts
	I0630 21:20:07.365803  282690 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem, removing ...
	I0630 21:20:07.365816  282690 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem
	I0630 21:20:07.365887  282690 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem (1679 bytes)
	I0630 21:20:07.365984  282690 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem, removing ...
	I0630 21:20:07.365998  282690 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem
	I0630 21:20:07.366039  282690 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem (1082 bytes)
	I0630 21:20:07.366110  282690 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem, removing ...
	I0630 21:20:07.366123  282690 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem
	I0630 21:20:07.366164  282690 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem (1123 bytes)
	I0630 21:20:07.366225  282690 provision.go:112] generating server cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem org=jenkins.embed-certs-20220630210659-9950 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-20220630210659-9950]
	I0630 21:20:07.595656  282690 provision.go:172] copyRemoteCerts
	I0630 21:20:07.595725  282690 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0630 21:20:07.595756  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:20:07.631338  282690 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49442 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:20:07.716832  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
	I0630 21:20:07.735870  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem --> /etc/docker/server.pem (1265 bytes)
	I0630 21:20:07.756354  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0630 21:20:07.775209  282690 provision.go:86] duration metric: configureAuth took 445.919443ms
	I0630 21:20:07.775233  282690 ubuntu.go:193] setting minikube options for container-runtime
	I0630 21:20:07.775399  282690 config.go:178] Loaded profile config "embed-certs-20220630210659-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:20:07.775412  282690 machine.go:91] provisioned docker machine in 3.770097214s
	I0630 21:20:07.775419  282690 start.go:306] post-start starting for "embed-certs-20220630210659-9950" (driver="docker")
	I0630 21:20:07.775425  282690 start.go:316] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0630 21:20:07.775465  282690 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0630 21:20:07.775498  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:20:07.811677  282690 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49442 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:20:07.897450  282690 ssh_runner.go:195] Run: cat /etc/os-release
	I0630 21:20:07.900657  282690 main.go:134] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0630 21:20:07.900688  282690 main.go:134] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0630 21:20:07.900696  282690 main.go:134] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0630 21:20:07.900702  282690 info.go:137] Remote host: Ubuntu 20.04.4 LTS
	I0630 21:20:07.900711  282690 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/addons for local assets ...
	I0630 21:20:07.900762  282690 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files for local assets ...
	I0630 21:20:07.900829  282690 filesync.go:149] local asset: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem -> 99502.pem in /etc/ssl/certs
	I0630 21:20:07.900909  282690 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0630 21:20:07.908065  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem --> /etc/ssl/certs/99502.pem (1708 bytes)
	I0630 21:20:07.926474  282690 start.go:309] post-start completed in 151.040627ms
	I0630 21:20:07.926557  282690 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0630 21:20:07.926600  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:20:07.963198  282690 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49442 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:20:08.045725  282690 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0630 21:20:08.049536  282690 fix.go:57] fixHost completed within 4.564962738s
	I0630 21:20:08.049568  282690 start.go:81] releasing machines lock for "embed-certs-20220630210659-9950", held for 4.56500909s
	I0630 21:20:08.049668  282690 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-20220630210659-9950
	I0630 21:20:08.085452  282690 ssh_runner.go:195] Run: systemctl --version
	I0630 21:20:08.085508  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:20:08.085526  282690 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/
	I0630 21:20:08.085584  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:20:08.125940  282690 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49442 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:20:08.126756  282690 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49442 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:20:05.682082  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:07.682788  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:07.393189  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:09.893794  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:08.209826  282690 ssh_runner.go:195] Run: sudo systemctl stop -f crio
	I0630 21:20:08.240545  282690 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0630 21:20:08.251830  282690 docker.go:179] disabling docker service ...
	I0630 21:20:08.251890  282690 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0630 21:20:08.263344  282690 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0630 21:20:08.272763  282690 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0630 21:20:08.347490  282690 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0630 21:20:08.430323  282690 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0630 21:20:08.439736  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
	image-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0630 21:20:08.453177  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*sandbox_image = .*$|sandbox_image = "k8s.gcr.io/pause:3.7"|' -i /etc/containerd/config.toml"
	I0630 21:20:08.461609  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*restrict_oom_score_adj = .*$|restrict_oom_score_adj = false|' -i /etc/containerd/config.toml"
	I0630 21:20:08.469975  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*SystemdCgroup = .*$|SystemdCgroup = false|' -i /etc/containerd/config.toml"
	I0630 21:20:08.478446  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*conf_dir = .*$|conf_dir = "/etc/cni/net.mk"|' -i /etc/containerd/config.toml"
	I0630 21:20:08.486889  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^# imports|imports = ["/etc/containerd/containerd.conf.d/02-containerd.conf"]|' -i /etc/containerd/config.toml"
	I0630 21:20:08.495251  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc/containerd/containerd.conf.d && printf %!s(MISSING) "dmVyc2lvbiA9IDIK" | base64 -d | sudo tee /etc/containerd/containerd.conf.d/02-containerd.conf"
	I0630 21:20:08.508868  282690 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0630 21:20:08.515626  282690 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0630 21:20:08.522606  282690 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0630 21:20:08.605769  282690 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0630 21:20:08.682128  282690 start.go:447] Will wait 60s for socket path /run/containerd/containerd.sock
	I0630 21:20:08.682202  282690 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
	I0630 21:20:08.686167  282690 start.go:468] Will wait 60s for crictl version
	I0630 21:20:08.686246  282690 ssh_runner.go:195] Run: sudo crictl version
	I0630 21:20:08.713091  282690 retry.go:31] will retry after 11.04660288s: Temporary Error: sudo crictl version: Process exited with status 1
	stdout:
	
	stderr:
	time="2022-06-30T21:20:08Z" level=fatal msg="getting the runtime version: rpc error: code = Unknown desc = server is not initialized yet"
	I0630 21:20:10.182344  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:12.182594  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:12.392956  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:14.393428  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:14.682680  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:17.182245  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:19.182817  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:19.761138  282690 ssh_runner.go:195] Run: sudo crictl version
	I0630 21:20:19.786289  282690 start.go:477] Version:  0.1.0
	RuntimeName:  containerd
	RuntimeVersion:  1.6.6
	RuntimeApiVersion:  v1alpha2
	I0630 21:20:19.786365  282690 ssh_runner.go:195] Run: containerd --version
	I0630 21:20:19.816281  282690 ssh_runner.go:195] Run: containerd --version
	I0630 21:20:19.848226  282690 out.go:177] * Preparing Kubernetes v1.24.2 on containerd 1.6.6 ...
	I0630 21:20:16.893342  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:18.893566  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:19.849919  282690 cli_runner.go:164] Run: docker network inspect embed-certs-20220630210659-9950 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0630 21:20:19.887550  282690 ssh_runner.go:195] Run: grep 192.168.94.1	host.minikube.internal$ /etc/hosts
	I0630 21:20:19.891143  282690 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.94.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0630 21:20:19.900924  282690 preload.go:132] Checking if preload exists for k8s version v1.24.2 and runtime containerd
	I0630 21:20:19.900991  282690 ssh_runner.go:195] Run: sudo crictl images --output json
	I0630 21:20:19.925400  282690 containerd.go:547] all images are preloaded for containerd runtime.
	I0630 21:20:19.925429  282690 containerd.go:461] Images already preloaded, skipping extraction
	I0630 21:20:19.925482  282690 ssh_runner.go:195] Run: sudo crictl images --output json
	I0630 21:20:19.950061  282690 containerd.go:547] all images are preloaded for containerd runtime.
	I0630 21:20:19.950082  282690 cache_images.go:84] Images are preloaded, skipping loading
	I0630 21:20:19.950125  282690 ssh_runner.go:195] Run: sudo crictl info
	I0630 21:20:19.974750  282690 cni.go:95] Creating CNI manager for ""
	I0630 21:20:19.974773  282690 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:20:19.974785  282690 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
	I0630 21:20:19.974799  282690 kubeadm.go:158] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.94.2 APIServerPort:8443 KubernetesVersion:v1.24.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:embed-certs-20220630210659-9950 NodeName:embed-certs-20220630210659-9950 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.94.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.94.2 CgroupDriver:cgroupfs ClientC
AFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}
	I0630 21:20:19.974955  282690 kubeadm.go:162] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.94.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: /run/containerd/containerd.sock
	  name: "embed-certs-20220630210659-9950"
	  kubeletExtraArgs:
	    node-ip: 192.168.94.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.94.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.24.2
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%!"(MISSING)
	  nodefs.inodesFree: "0%!"(MISSING)
	  imagefs.available: "0%!"(MISSING)
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0630 21:20:19.975056  282690 kubeadm.go:961] kubelet [Unit]
	Wants=containerd.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.24.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=embed-certs-20220630210659-9950 --image-service-endpoint=unix:///run/containerd/containerd.sock --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.94.2 --runtime-request-timeout=15m
	
	[Install]
	 config:
	{KubernetesVersion:v1.24.2 ClusterName:embed-certs-20220630210659-9950 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
	I0630 21:20:19.975119  282690 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.24.2
	I0630 21:20:19.982477  282690 binaries.go:44] Found k8s binaries, skipping transfer
	I0630 21:20:19.982537  282690 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0630 21:20:19.989867  282690 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (524 bytes)
	I0630 21:20:20.003413  282690 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0630 21:20:20.016549  282690 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2060 bytes)
	I0630 21:20:20.030557  282690 ssh_runner.go:195] Run: grep 192.168.94.2	control-plane.minikube.internal$ /etc/hosts
	I0630 21:20:20.033673  282690 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.94.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0630 21:20:20.043309  282690 certs.go:54] Setting up /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950 for IP: 192.168.94.2
	I0630 21:20:20.043426  282690 certs.go:182] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.key
	I0630 21:20:20.043474  282690 certs.go:182] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.key
	I0630 21:20:20.043588  282690 certs.go:298] skipping minikube-user signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/client.key
	I0630 21:20:20.043669  282690 certs.go:298] skipping minikube signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.key.ad8e880a
	I0630 21:20:20.043722  282690 certs.go:298] skipping aggregator signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.key
	I0630 21:20:20.043847  282690 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950.pem (1338 bytes)
	W0630 21:20:20.043888  282690 certs.go:384] ignoring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950_empty.pem, impossibly tiny 0 bytes
	I0630 21:20:20.043906  282690 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem (1679 bytes)
	I0630 21:20:20.043944  282690 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem (1082 bytes)
	I0630 21:20:20.043983  282690 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem (1123 bytes)
	I0630 21:20:20.044018  282690 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/key.pem (1679 bytes)
	I0630 21:20:20.044074  282690 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem (1708 bytes)
	I0630 21:20:20.044672  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
	I0630 21:20:20.063809  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I0630 21:20:20.082364  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0630 21:20:20.100953  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
	I0630 21:20:20.119042  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0630 21:20:20.138260  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
	I0630 21:20:20.156455  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0630 21:20:20.175178  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
	I0630 21:20:20.193932  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem --> /usr/share/ca-certificates/99502.pem (1708 bytes)
	I0630 21:20:20.213463  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0630 21:20:20.232837  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950.pem --> /usr/share/ca-certificates/9950.pem (1338 bytes)
	I0630 21:20:20.252510  282690 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0630 21:20:20.267375  282690 ssh_runner.go:195] Run: openssl version
	I0630 21:20:20.273228  282690 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/99502.pem && ln -fs /usr/share/ca-certificates/99502.pem /etc/ssl/certs/99502.pem"
	I0630 21:20:20.281805  282690 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/99502.pem
	I0630 21:20:20.285276  282690 certs.go:431] hashing: -rw-r--r-- 1 root root 1708 Jun 30 20:26 /usr/share/ca-certificates/99502.pem
	I0630 21:20:20.285328  282690 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/99502.pem
	I0630 21:20:20.290565  282690 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/99502.pem /etc/ssl/certs/3ec20f2e.0"
	I0630 21:20:20.298693  282690 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0630 21:20:20.306974  282690 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:20:20.310492  282690 certs.go:431] hashing: -rw-r--r-- 1 root root 1111 Jun 30 20:22 /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:20:20.310555  282690 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:20:20.315748  282690 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0630 21:20:20.323429  282690 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/9950.pem && ln -fs /usr/share/ca-certificates/9950.pem /etc/ssl/certs/9950.pem"
	I0630 21:20:20.331855  282690 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/9950.pem
	I0630 21:20:20.335469  282690 certs.go:431] hashing: -rw-r--r-- 1 root root 1338 Jun 30 20:26 /usr/share/ca-certificates/9950.pem
	I0630 21:20:20.335531  282690 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/9950.pem
	I0630 21:20:20.340482  282690 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/9950.pem /etc/ssl/certs/51391683.0"
	I0630 21:20:20.348339  282690 kubeadm.go:395] StartCluster: {Name:embed-certs-20220630210659-9950 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:embed-certs-20220630210659-9950 Namespace:default APIServerName
:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[Dashboard:kubernetesui/dashboard:v2.6.0@sha256:4af9580485920635d888efe1eddbd67e12f9d5d84dba87100e93feb4e46636b3 MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet:
MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 21:20:20.348468  282690 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
	I0630 21:20:20.348531  282690 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0630 21:20:20.375578  282690 cri.go:87] found id: "6bdce580a9d6963de5c12d9e017d5662e2685851e130abf85abf7ccd2206a8a6"
	I0630 21:20:20.375605  282690 cri.go:87] found id: "8341041be1bdbcf0e0425bd1832777e15b2ed89bf8696d0c78d14301820032c3"
	I0630 21:20:20.375615  282690 cri.go:87] found id: "157c2b0c199b65e53b31cbc33bd298586d30106a66d587ee22f9c486df45d1ba"
	I0630 21:20:20.375624  282690 cri.go:87] found id: "ccc3bef31fe3faba9ff6daab0d5ca071fed6adb37d8cc554c7399ac599691557"
	I0630 21:20:20.375637  282690 cri.go:87] found id: "d56e346d0980d838b9cd42c94d9e084ef84bb0fdeb4316ae2dd5c8a25cc054a1"
	I0630 21:20:20.375652  282690 cri.go:87] found id: "7734f08ca26708ce34ae224077718432c05bc3133a11bb3d600a7d29c4df0045"
	I0630 21:20:20.375660  282690 cri.go:87] found id: ""
	I0630 21:20:20.375709  282690 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
	I0630 21:20:20.388498  282690 cri.go:114] JSON = null
	W0630 21:20:20.388559  282690 kubeadm.go:402] unpause failed: list paused: list returned 0 containers, but ps returned 6
	I0630 21:20:20.388621  282690 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0630 21:20:20.396168  282690 kubeadm.go:410] found existing configuration files, will attempt cluster restart
	I0630 21:20:20.396200  282690 kubeadm.go:626] restartCluster start
	I0630 21:20:20.396246  282690 ssh_runner.go:195] Run: sudo test -d /data/minikube
	I0630 21:20:20.403017  282690 kubeadm.go:127] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:20.403674  282690 kubeconfig.go:116] verify returned: extract IP: "embed-certs-20220630210659-9950" does not appear in /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:20:20.404147  282690 kubeconfig.go:127] "embed-certs-20220630210659-9950" context is missing from /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig - will repair!
	I0630 21:20:20.404911  282690 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig: {Name:mk34e4a4e7b04f624b9adbda4f77ee20b38308ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:20:20.406647  282690 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
	I0630 21:20:20.413413  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:20.413466  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:20.421286  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:20.621671  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:20.621798  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:20.630547  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:20.821858  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:20.821957  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:20.830758  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:21.022078  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:21.022162  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:21.030900  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:21.222204  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:21.222293  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:21.231221  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:21.421485  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:21.421579  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:21.430528  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:21.621730  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:21.621832  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:21.630704  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:21.822018  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:21.822098  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:21.830851  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:22.022202  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:22.022287  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:22.031086  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:22.222404  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:22.222489  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:22.231324  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:22.421567  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:22.421655  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:22.430581  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:22.621941  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:22.622040  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:22.631867  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:22.822177  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:22.822278  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:22.832202  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:23.021427  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:23.021501  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:23.030217  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:21.682805  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:24.182683  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:21.393221  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:23.893682  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:23.221874  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:23.221961  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:23.230645  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:23.421956  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:23.422028  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:23.430894  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:23.430917  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:23.430954  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:23.439029  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:23.439054  282690 kubeadm.go:601] needs reconfigure: apiserver error: timed out waiting for the condition
	I0630 21:20:23.439061  282690 kubeadm.go:1092] stopping kube-system containers ...
	I0630 21:20:23.439074  282690 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name: Namespaces:[kube-system]}
	I0630 21:20:23.439116  282690 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0630 21:20:23.463122  282690 cri.go:87] found id: "6bdce580a9d6963de5c12d9e017d5662e2685851e130abf85abf7ccd2206a8a6"
	I0630 21:20:23.463146  282690 cri.go:87] found id: "8341041be1bdbcf0e0425bd1832777e15b2ed89bf8696d0c78d14301820032c3"
	I0630 21:20:23.463152  282690 cri.go:87] found id: "157c2b0c199b65e53b31cbc33bd298586d30106a66d587ee22f9c486df45d1ba"
	I0630 21:20:23.463158  282690 cri.go:87] found id: "ccc3bef31fe3faba9ff6daab0d5ca071fed6adb37d8cc554c7399ac599691557"
	I0630 21:20:23.463163  282690 cri.go:87] found id: "d56e346d0980d838b9cd42c94d9e084ef84bb0fdeb4316ae2dd5c8a25cc054a1"
	I0630 21:20:23.463170  282690 cri.go:87] found id: "7734f08ca26708ce34ae224077718432c05bc3133a11bb3d600a7d29c4df0045"
	I0630 21:20:23.463175  282690 cri.go:87] found id: ""
	I0630 21:20:23.463180  282690 cri.go:232] Stopping containers: [6bdce580a9d6963de5c12d9e017d5662e2685851e130abf85abf7ccd2206a8a6 8341041be1bdbcf0e0425bd1832777e15b2ed89bf8696d0c78d14301820032c3 157c2b0c199b65e53b31cbc33bd298586d30106a66d587ee22f9c486df45d1ba ccc3bef31fe3faba9ff6daab0d5ca071fed6adb37d8cc554c7399ac599691557 d56e346d0980d838b9cd42c94d9e084ef84bb0fdeb4316ae2dd5c8a25cc054a1 7734f08ca26708ce34ae224077718432c05bc3133a11bb3d600a7d29c4df0045]
	I0630 21:20:23.463219  282690 ssh_runner.go:195] Run: which crictl
	I0630 21:20:23.466097  282690 ssh_runner.go:195] Run: sudo /usr/bin/crictl stop 6bdce580a9d6963de5c12d9e017d5662e2685851e130abf85abf7ccd2206a8a6 8341041be1bdbcf0e0425bd1832777e15b2ed89bf8696d0c78d14301820032c3 157c2b0c199b65e53b31cbc33bd298586d30106a66d587ee22f9c486df45d1ba ccc3bef31fe3faba9ff6daab0d5ca071fed6adb37d8cc554c7399ac599691557 d56e346d0980d838b9cd42c94d9e084ef84bb0fdeb4316ae2dd5c8a25cc054a1 7734f08ca26708ce34ae224077718432c05bc3133a11bb3d600a7d29c4df0045
	I0630 21:20:23.491529  282690 ssh_runner.go:195] Run: sudo systemctl stop kubelet
	I0630 21:20:23.501548  282690 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0630 21:20:23.508513  282690 kubeadm.go:155] found existing configuration files:
	-rw------- 1 root root 5643 Jun 30 21:07 /etc/kubernetes/admin.conf
	-rw------- 1 root root 5652 Jun 30 21:07 /etc/kubernetes/controller-manager.conf
	-rw------- 1 root root 2063 Jun 30 21:07 /etc/kubernetes/kubelet.conf
	-rw------- 1 root root 5600 Jun 30 21:07 /etc/kubernetes/scheduler.conf
	
	I0630 21:20:23.508569  282690 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
	I0630 21:20:23.515331  282690 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
	I0630 21:20:23.522134  282690 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
	I0630 21:20:23.528625  282690 kubeadm.go:166] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:23.528674  282690 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
	I0630 21:20:23.535118  282690 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
	I0630 21:20:23.541759  282690 kubeadm.go:166] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:23.541806  282690 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
	I0630 21:20:23.547839  282690 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0630 21:20:23.554281  282690 kubeadm.go:703] reconfiguring cluster from /var/tmp/minikube/kubeadm.yaml
	I0630 21:20:23.554304  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:20:23.597418  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:20:24.204823  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:20:24.388425  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:20:24.446940  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:20:24.548581  282690 api_server.go:51] waiting for apiserver process to appear ...
	I0630 21:20:24.548652  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 21:20:25.058272  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 21:20:25.558267  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 21:20:25.634820  282690 api_server.go:71] duration metric: took 1.086232371s to wait for apiserver process to appear ...
	I0630 21:20:25.634853  282690 api_server.go:87] waiting for apiserver healthz status ...
	I0630 21:20:25.634866  282690 api_server.go:240] Checking apiserver healthz at https://192.168.94.2:8443/healthz ...
	I0630 21:20:25.635225  282690 api_server.go:256] stopped: https://192.168.94.2:8443/healthz: Get "https://192.168.94.2:8443/healthz": dial tcp 192.168.94.2:8443: connect: connection refused
	I0630 21:20:26.135955  282690 api_server.go:240] Checking apiserver healthz at https://192.168.94.2:8443/healthz ...
	I0630 21:20:26.183141  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:28.683133  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:29.023735  282690 api_server.go:266] https://192.168.94.2:8443/healthz returned 403:
	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
	W0630 21:20:29.023845  282690 api_server.go:102] status: https://192.168.94.2:8443/healthz returned error 403:
	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
	I0630 21:20:29.136115  282690 api_server.go:240] Checking apiserver healthz at https://192.168.94.2:8443/healthz ...
	I0630 21:20:29.142290  282690 api_server.go:266] https://192.168.94.2:8443/healthz returned 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/bootstrap-controller ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[-]poststarthook/apiservice-registration-controller failed: reason withheld
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	W0630 21:20:29.142324  282690 api_server.go:102] status: https://192.168.94.2:8443/healthz returned error 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/bootstrap-controller ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[-]poststarthook/apiservice-registration-controller failed: reason withheld
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	I0630 21:20:29.635779  282690 api_server.go:240] Checking apiserver healthz at https://192.168.94.2:8443/healthz ...
	I0630 21:20:29.641744  282690 api_server.go:266] https://192.168.94.2:8443/healthz returned 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/bootstrap-controller ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-registration-controller ok
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	W0630 21:20:29.641774  282690 api_server.go:102] status: https://192.168.94.2:8443/healthz returned error 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/bootstrap-controller ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-registration-controller ok
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	I0630 21:20:30.135899  282690 api_server.go:240] Checking apiserver healthz at https://192.168.94.2:8443/healthz ...
	I0630 21:20:30.140340  282690 api_server.go:266] https://192.168.94.2:8443/healthz returned 200:
	ok
	I0630 21:20:30.146945  282690 api_server.go:140] control plane version: v1.24.2
	I0630 21:20:30.146967  282690 api_server.go:130] duration metric: took 4.512109627s to wait for apiserver health ...
	I0630 21:20:30.146976  282690 cni.go:95] Creating CNI manager for ""
	I0630 21:20:30.146983  282690 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:20:30.149207  282690 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0630 21:20:26.393339  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:28.893287  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:30.893492  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:30.150766  282690 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0630 21:20:30.154566  282690 cni.go:189] applying CNI manifest using /var/lib/minikube/binaries/v1.24.2/kubectl ...
	I0630 21:20:30.154592  282690 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2429 bytes)
	I0630 21:20:30.168730  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0630 21:20:30.976925  282690 system_pods.go:43] waiting for kube-system pods to appear ...
	I0630 21:20:30.983901  282690 system_pods.go:59] 9 kube-system pods found
	I0630 21:20:30.983933  282690 system_pods.go:61] "coredns-6d4b75cb6d-87dwf" [11e7f3e7-24e8-4e14-b1f6-a7e2b9bcfb74] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.)
	I0630 21:20:30.983941  282690 system_pods.go:61] "etcd-embed-certs-20220630210659-9950" [c7597376-29d8-4a64-a014-1bca6b00b239] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
	I0630 21:20:30.983951  282690 system_pods.go:61] "kindnet-z7fgt" [9d385a59-b071-48be-b547-db80254669bc] Running / Ready:ContainersNotReady (containers with unready status: [kindnet-cni]) / ContainersReady:ContainersNotReady (containers with unready status: [kindnet-cni])
	I0630 21:20:30.983963  282690 system_pods.go:61] "kube-apiserver-embed-certs-20220630210659-9950" [101e1b1d-d8d3-49c5-b250-f9524145064b] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
	I0630 21:20:30.983978  282690 system_pods.go:61] "kube-controller-manager-embed-certs-20220630210659-9950" [f93c4f3d-22de-4c13-a12a-c8ae9d47911c] Running
	I0630 21:20:30.983988  282690 system_pods.go:61] "kube-proxy-jhw4d" [78ec1767-ed48-4f50-ab14-61149fad7e98] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])
	I0630 21:20:30.984003  282690 system_pods.go:61] "kube-scheduler-embed-certs-20220630210659-9950" [727ac744-99fa-4867-9662-83efb2a98b35] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
	I0630 21:20:30.984012  282690 system_pods.go:61] "metrics-server-5c6f97fb75-dvslz" [3a4167d3-f572-4a2c-813a-d2d22e47d17e] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.)
	I0630 21:20:30.984019  282690 system_pods.go:61] "storage-provisioner" [4e574839-6ecb-47ba-b5c4-e45d9b19efc7] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.)
	I0630 21:20:30.984028  282690 system_pods.go:74] duration metric: took 7.077293ms to wait for pod list to return data ...
	I0630 21:20:30.984038  282690 node_conditions.go:102] verifying NodePressure condition ...
	I0630 21:20:30.986718  282690 node_conditions.go:122] node storage ephemeral capacity is 304695084Ki
	I0630 21:20:30.986752  282690 node_conditions.go:123] node cpu capacity is 8
	I0630 21:20:30.986766  282690 node_conditions.go:105] duration metric: took 2.718274ms to run NodePressure ...
	I0630 21:20:30.986786  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:20:31.145954  282690 kubeadm.go:762] waiting for restarted kubelet to initialise ...
	I0630 21:20:31.149839  282690 kubeadm.go:777] kubelet initialised
	I0630 21:20:31.149867  282690 kubeadm.go:778] duration metric: took 3.887979ms waiting for restarted kubelet to initialise ...
	I0630 21:20:31.149877  282690 pod_ready.go:35] extra waiting up to 4m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0630 21:20:31.154561  282690 pod_ready.go:78] waiting up to 4m0s for pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace to be "Ready" ...
	I0630 21:20:30.683577  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:33.182578  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:33.392832  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:35.393314  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:33.160352  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:35.660314  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:35.182728  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:37.682510  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:37.893265  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:39.893463  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:38.160526  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:40.660894  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:39.683375  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:42.182068  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:44.183054  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:42.393015  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:44.893292  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:43.160483  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:45.660796  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:47.660953  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:46.683087  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:49.183229  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:46.893432  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:49.393236  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:50.161308  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:52.660155  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:51.682409  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:53.682570  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:51.393511  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:53.893578  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:54.661629  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:57.159920  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:55.682710  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:58.182130  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:56.393487  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:58.892932  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:00.893465  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:59.160128  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:01.160665  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:00.182447  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:02.182840  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:04.182886  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:03.392696  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:05.393231  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:03.661112  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:06.160443  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:06.682224  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:08.682691  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:07.893418  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:10.392505  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:08.160644  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:10.661019  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:12.661060  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:11.182893  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:13.182991  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:12.393783  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:14.893314  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:15.160327  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:17.660228  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:15.682251  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:17.683152  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:17.393363  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:19.390281  276064 pod_ready.go:81] duration metric: took 4m0.003663432s waiting for pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace to be "Ready" ...
	E0630 21:21:19.390317  276064 pod_ready.go:66] WaitExtra: waitPodCondition: timed out waiting 4m0s for pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace to be "Ready" (will not retry!)
	I0630 21:21:19.390344  276064 pod_ready.go:38] duration metric: took 4m0.009122224s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0630 21:21:19.390376  276064 kubeadm.go:630] restartCluster took 4m11.317474742s
	W0630 21:21:19.390560  276064 out.go:239] ! Unable to restart cluster, will reset it: extra: timed out waiting 4m0s for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready"
	I0630 21:21:19.390595  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm reset --cri-socket /run/containerd/containerd.sock --force"
	I0630 21:21:19.660421  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:22.160264  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:20.183474  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:22.682948  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:21.023971  276064 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm reset --cri-socket /run/containerd/containerd.sock --force": (1.633354294s)
	I0630 21:21:21.024036  276064 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 21:21:21.033944  276064 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0630 21:21:21.041255  276064 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver
	I0630 21:21:21.041307  276064 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0630 21:21:21.048131  276064 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0630 21:21:21.048170  276064 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0630 21:21:24.160315  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:26.660444  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:25.181883  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:27.183120  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:30.433489  276064 out.go:204]   - Generating certificates and keys ...
	I0630 21:21:30.436707  276064 out.go:204]   - Booting up control plane ...
	I0630 21:21:30.439842  276064 out.go:204]   - Configuring RBAC rules ...
	I0630 21:21:30.442245  276064 cni.go:95] Creating CNI manager for ""
	I0630 21:21:30.442271  276064 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:21:30.444232  276064 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0630 21:21:30.446289  276064 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0630 21:21:30.450161  276064 cni.go:189] applying CNI manifest using /var/lib/minikube/binaries/v1.24.2/kubectl ...
	I0630 21:21:30.450180  276064 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2429 bytes)
	I0630 21:21:30.464668  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0630 21:21:28.661012  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:31.160051  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:29.682587  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:31.682697  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:33.683054  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:31.250327  276064 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0630 21:21:31.250457  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:31.250483  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl label nodes minikube.k8s.io/version=v1.26.0 minikube.k8s.io/commit=251ffcec0e4c997cd7732864187747cc579943c9 minikube.k8s.io/name=default-k8s-different-port-20220630210335-9950 minikube.k8s.io/updated_at=2022_06_30T21_21_31_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:31.337104  276064 ops.go:34] apiserver oom_adj: -16
	I0630 21:21:31.337122  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:31.898846  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:32.398504  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:32.898395  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:33.399197  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:33.898224  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:34.399278  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:34.898766  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:35.399106  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:35.898541  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:33.160337  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:35.660572  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:37.660625  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:36.183245  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:38.681927  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:36.399149  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:36.899206  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:37.398969  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:37.898306  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:38.398247  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:38.898685  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:39.399050  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:39.899197  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:40.399284  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:40.898565  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:40.159296  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:42.160359  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:41.398285  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:41.899049  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:42.399136  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:42.898362  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:42.955690  276064 kubeadm.go:1045] duration metric: took 11.705297596s to wait for elevateKubeSystemPrivileges.
	I0630 21:21:42.955725  276064 kubeadm.go:397] StartCluster complete in 4m34.928502204s
	I0630 21:21:42.955749  276064 settings.go:142] acquiring lock: {Name:mkcbd229caa05b60d3551ef0b47eea08424c9b5d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:21:42.955839  276064 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:21:42.956940  276064 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig: {Name:mk34e4a4e7b04f624b9adbda4f77ee20b38308ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:21:43.471460  276064 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "default-k8s-different-port-20220630210335-9950" rescaled to 1
	I0630 21:21:43.471523  276064 start.go:208] Will wait 6m0s for node &{Name: IP:192.168.85.2 Port:8444 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0630 21:21:43.473505  276064 out.go:177] * Verifying Kubernetes components...
	I0630 21:21:43.471586  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0630 21:21:43.471607  276064 addons.go:412] enableAddons start: toEnable=map[dashboard:true metrics-server:true], additional=[]
	I0630 21:21:43.471793  276064 config.go:178] Loaded profile config "default-k8s-different-port-20220630210335-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:21:43.474864  276064 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 21:21:43.474932  276064 addons.go:65] Setting dashboard=true in profile "default-k8s-different-port-20220630210335-9950"
	I0630 21:21:43.474957  276064 addons.go:65] Setting default-storageclass=true in profile "default-k8s-different-port-20220630210335-9950"
	I0630 21:21:43.474976  276064 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "default-k8s-different-port-20220630210335-9950"
	I0630 21:21:43.474962  276064 addons.go:153] Setting addon dashboard=true in "default-k8s-different-port-20220630210335-9950"
	W0630 21:21:43.475061  276064 addons.go:162] addon dashboard should already be in state true
	I0630 21:21:43.475110  276064 host.go:66] Checking if "default-k8s-different-port-20220630210335-9950" exists ...
	I0630 21:21:43.474944  276064 addons.go:65] Setting metrics-server=true in profile "default-k8s-different-port-20220630210335-9950"
	I0630 21:21:43.475161  276064 addons.go:153] Setting addon metrics-server=true in "default-k8s-different-port-20220630210335-9950"
	W0630 21:21:43.475179  276064 addons.go:162] addon metrics-server should already be in state true
	I0630 21:21:43.475224  276064 host.go:66] Checking if "default-k8s-different-port-20220630210335-9950" exists ...
	I0630 21:21:43.474932  276064 addons.go:65] Setting storage-provisioner=true in profile "default-k8s-different-port-20220630210335-9950"
	I0630 21:21:43.475323  276064 cli_runner.go:164] Run: docker container inspect default-k8s-different-port-20220630210335-9950 --format={{.State.Status}}
	I0630 21:21:43.475319  276064 addons.go:153] Setting addon storage-provisioner=true in "default-k8s-different-port-20220630210335-9950"
	W0630 21:21:43.475359  276064 addons.go:162] addon storage-provisioner should already be in state true
	I0630 21:21:43.475407  276064 host.go:66] Checking if "default-k8s-different-port-20220630210335-9950" exists ...
	I0630 21:21:43.475586  276064 cli_runner.go:164] Run: docker container inspect default-k8s-different-port-20220630210335-9950 --format={{.State.Status}}
	I0630 21:21:43.475682  276064 cli_runner.go:164] Run: docker container inspect default-k8s-different-port-20220630210335-9950 --format={{.State.Status}}
	I0630 21:21:43.475805  276064 cli_runner.go:164] Run: docker container inspect default-k8s-different-port-20220630210335-9950 --format={{.State.Status}}
	I0630 21:21:43.525211  276064 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0630 21:21:43.526633  276064 addons.go:345] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 21:21:43.526654  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0630 21:21:43.526703  276064 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	I0630 21:21:43.529674  276064 out.go:177]   - Using image fake.domain/k8s.gcr.io/echoserver:1.4
	I0630 21:21:43.531135  276064 addons.go:345] installing /etc/kubernetes/addons/metrics-apiservice.yaml
	I0630 21:21:43.531154  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
	I0630 21:21:43.532388  276064 out.go:177]   - Using image kubernetesui/dashboard:v2.6.0
	I0630 21:21:43.531211  276064 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	I0630 21:21:43.534873  276064 out.go:177]   - Using image k8s.gcr.io/echoserver:1.4
	I0630 21:21:40.682196  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:42.682640  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:43.536294  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-ns.yaml
	I0630 21:21:43.536318  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
	I0630 21:21:43.535327  276064 addons.go:153] Setting addon default-storageclass=true in "default-k8s-different-port-20220630210335-9950"
	I0630 21:21:43.536373  276064 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	W0630 21:21:43.536390  276064 addons.go:162] addon default-storageclass should already be in state true
	I0630 21:21:43.536436  276064 host.go:66] Checking if "default-k8s-different-port-20220630210335-9950" exists ...
	I0630 21:21:43.536996  276064 cli_runner.go:164] Run: docker container inspect default-k8s-different-port-20220630210335-9950 --format={{.State.Status}}
	I0630 21:21:43.568952  276064 node_ready.go:35] waiting up to 6m0s for node "default-k8s-different-port-20220630210335-9950" to be "Ready" ...
	I0630 21:21:43.569160  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.85.1 host.minikube.internal\n           fallthrough\n        }' | sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0630 21:21:43.573720  276064 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49437 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/default-k8s-different-port-20220630210335-9950/id_rsa Username:docker}
	I0630 21:21:43.585132  276064 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49437 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/default-k8s-different-port-20220630210335-9950/id_rsa Username:docker}
	I0630 21:21:43.585211  276064 addons.go:345] installing /etc/kubernetes/addons/storageclass.yaml
	I0630 21:21:43.585226  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0630 21:21:43.585277  276064 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	I0630 21:21:43.592285  276064 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49437 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/default-k8s-different-port-20220630210335-9950/id_rsa Username:docker}
	I0630 21:21:43.623221  276064 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49437 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/default-k8s-different-port-20220630210335-9950/id_rsa Username:docker}
	I0630 21:21:43.744945  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
	I0630 21:21:43.744974  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
	I0630 21:21:43.747847  276064 addons.go:345] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
	I0630 21:21:43.747873  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1820 bytes)
	I0630 21:21:43.748263  276064 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 21:21:43.924785  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
	I0630 21:21:43.924816  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
	I0630 21:21:43.928618  276064 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0630 21:21:43.940306  276064 addons.go:345] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
	I0630 21:21:43.940338  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
	I0630 21:21:43.950742  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-configmap.yaml
	I0630 21:21:43.950768  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
	I0630 21:21:44.037060  276064 addons.go:345] installing /etc/kubernetes/addons/metrics-server-service.yaml
	I0630 21:21:44.037089  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
	I0630 21:21:44.047010  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-dp.yaml
	I0630 21:21:44.047034  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4196 bytes)
	I0630 21:21:44.135080  276064 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I0630 21:21:44.140888  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-role.yaml
	I0630 21:21:44.140919  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
	I0630 21:21:44.230459  276064 start.go:806] {"host.minikube.internal": 192.168.85.1} host record injected into CoreDNS
	I0630 21:21:44.235255  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
	I0630 21:21:44.235283  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
	I0630 21:21:44.327158  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-sa.yaml
	I0630 21:21:44.327192  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
	I0630 21:21:44.351459  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-secret.yaml
	I0630 21:21:44.351527  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
	I0630 21:21:44.448179  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-svc.yaml
	I0630 21:21:44.448218  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
	I0630 21:21:44.537927  276064 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	I0630 21:21:45.130031  276064 addons.go:383] Verifying addon metrics-server=true in "default-k8s-different-port-20220630210335-9950"
	I0630 21:21:45.539430  276064 out.go:177] * Enabled addons: storage-provisioner, default-storageclass, metrics-server, dashboard
	I0630 21:21:45.540750  276064 addons.go:414] enableAddons completed in 2.0691399s
	I0630 21:21:45.575595  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:21:44.660831  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:47.160149  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:45.182445  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:47.682514  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:47.576330  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:21:49.576407  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:21:49.160793  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:51.660805  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:50.182451  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:52.183083  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:52.076426  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:21:54.076887  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:21:54.161146  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:56.660728  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:54.683102  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:57.182501  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:59.182957  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:56.575738  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:21:58.576604  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:00.577162  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:21:59.160517  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:01.160700  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:01.183043  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:03.682640  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:03.075860  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:05.076679  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:03.661117  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:06.160731  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:05.682843  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:08.182414  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:07.576553  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:10.075989  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:08.660876  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:11.160848  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:10.682414  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:12.682830  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:12.076661  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:14.576273  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:13.660019  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:15.660934  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:15.183230  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:17.681937  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:17.075764  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:19.076352  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:18.160512  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:20.661337  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:19.682685  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:22.182341  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:21.575906  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:24.076044  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:23.159968  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:25.659994  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:27.660386  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:24.682559  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:26.682712  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:28.682765  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:26.076272  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:28.076381  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:30.576589  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:29.660781  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:31.661081  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:31.182114  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:33.182667  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:33.075544  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:35.076859  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:34.160031  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:36.174889  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:35.682410  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:37.682440  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:37.576222  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:40.076094  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:38.660329  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:40.661271  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:39.682506  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:42.182441  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:44.182613  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:42.076569  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:44.575778  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:43.160906  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:45.660687  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:47.660756  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:46.182890  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:48.682065  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:50.184705  271327 node_ready.go:38] duration metric: took 4m0.008399385s waiting for node "old-k8s-version-20220630210005-9950" to be "Ready" ...
	I0630 21:22:50.186899  271327 out.go:177] 
	W0630 21:22:50.188676  271327 out.go:239] X Exiting due to GUEST_START: wait 6m0s for node: waiting for node to be ready: waitNodeCondition: timed out waiting for the condition
	W0630 21:22:50.188714  271327 out.go:239] * 
	W0630 21:22:50.189487  271327 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0630 21:22:50.191389  271327 out.go:177] 
	I0630 21:22:47.075947  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:49.576265  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:50.159356  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:52.163951  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:52.075526  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:54.076399  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:54.660447  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:57.160029  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:56.575822  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:58.576331  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:00.576702  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:59.160433  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:01.660547  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:03.076469  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:05.576257  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:03.660907  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:06.160339  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:08.076793  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:10.576173  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:08.160593  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:10.660347  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:12.660595  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:13.075956  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:15.076120  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:15.160070  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:17.660236  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:17.576068  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:20.076292  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:20.159819  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:22.159969  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:22.076376  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:24.576689  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:24.160202  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:26.160569  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:27.075866  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:29.075916  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:28.660765  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:30.661044  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:31.076034  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:33.076065  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:35.575815  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:33.160787  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:35.660078  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:37.660223  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:38.076264  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:40.076307  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:39.661253  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:42.160767  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:42.576389  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:45.076289  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:44.660279  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:46.660767  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:47.576205  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:50.076370  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:49.159959  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:51.160087  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:52.576483  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:55.076140  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:53.160885  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:55.660365  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:57.077197  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:59.575847  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:58.160601  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:00.660863  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:02.076497  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:04.576615  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:03.160979  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:05.661301  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:07.076328  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:09.076375  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:08.160501  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:10.661257  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:11.575987  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:13.576105  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:15.576639  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:13.160653  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:15.660136  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:18.076538  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:20.576354  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:18.160271  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:20.660902  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:23.076485  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:25.575931  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:23.160075  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:25.160311  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:27.660413  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:28.076238  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:30.076402  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:30.159564  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:31.157632  282690 pod_ready.go:81] duration metric: took 4m0.003038156s waiting for pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace to be "Ready" ...
	E0630 21:24:31.157659  282690 pod_ready.go:66] WaitExtra: waitPodCondition: timed out waiting 4m0s for pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace to be "Ready" (will not retry!)
	I0630 21:24:31.157707  282690 pod_ready.go:38] duration metric: took 4m0.007820375s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0630 21:24:31.157735  282690 kubeadm.go:630] restartCluster took 4m10.761529656s
	W0630 21:24:31.157891  282690 out.go:239] ! Unable to restart cluster, will reset it: extra: timed out waiting 4m0s for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready"
	I0630 21:24:31.157919  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm reset --cri-socket /run/containerd/containerd.sock --force"
	I0630 21:24:32.851642  282690 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm reset --cri-socket /run/containerd/containerd.sock --force": (1.693695416s)
	I0630 21:24:32.851727  282690 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 21:24:32.861758  282690 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0630 21:24:32.869625  282690 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver
	I0630 21:24:32.869693  282690 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0630 21:24:32.876878  282690 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0630 21:24:32.876929  282690 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0630 21:24:32.076763  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:34.576381  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:36.576542  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:39.075659  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:41.836005  282690 out.go:204]   - Generating certificates and keys ...
	I0630 21:24:41.839508  282690 out.go:204]   - Booting up control plane ...
	I0630 21:24:41.842351  282690 out.go:204]   - Configuring RBAC rules ...
	I0630 21:24:41.844644  282690 cni.go:95] Creating CNI manager for ""
	I0630 21:24:41.844675  282690 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:24:41.846424  282690 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0630 21:24:41.847990  282690 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0630 21:24:41.853099  282690 cni.go:189] applying CNI manifest using /var/lib/minikube/binaries/v1.24.2/kubectl ...
	I0630 21:24:41.853126  282690 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2429 bytes)
	I0630 21:24:41.932756  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0630 21:24:42.729823  282690 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0630 21:24:42.729895  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:42.729926  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl label nodes minikube.k8s.io/version=v1.26.0 minikube.k8s.io/commit=251ffcec0e4c997cd7732864187747cc579943c9 minikube.k8s.io/name=embed-certs-20220630210659-9950 minikube.k8s.io/updated_at=2022_06_30T21_24_42_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:42.738247  282690 ops.go:34] apiserver oom_adj: -16
	I0630 21:24:42.834211  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:41.076287  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:43.076543  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:45.576221  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:43.427269  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:43.927268  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:44.426722  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:44.926851  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:45.427106  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:45.927276  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:46.427354  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:46.926751  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:47.426882  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:47.927284  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:48.076060  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:50.575977  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:48.427353  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:48.927037  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:49.426521  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:49.926695  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:50.426914  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:50.927459  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:51.427334  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:51.927468  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:52.427189  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:52.927285  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:53.426965  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:53.926595  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:53.987285  282690 kubeadm.go:1045] duration metric: took 11.25744575s to wait for elevateKubeSystemPrivileges.
	I0630 21:24:53.987312  282690 kubeadm.go:397] StartCluster complete in 4m33.638985641s
	I0630 21:24:53.987328  282690 settings.go:142] acquiring lock: {Name:mkcbd229caa05b60d3551ef0b47eea08424c9b5d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:24:53.987411  282690 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:24:53.988694  282690 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig: {Name:mk34e4a4e7b04f624b9adbda4f77ee20b38308ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:24:54.505472  282690 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "embed-certs-20220630210659-9950" rescaled to 1
	I0630 21:24:54.505546  282690 start.go:208] Will wait 6m0s for node &{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0630 21:24:54.505581  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0630 21:24:54.507434  282690 out.go:177] * Verifying Kubernetes components...
	I0630 21:24:54.505671  282690 addons.go:412] enableAddons start: toEnable=map[dashboard:true metrics-server:true], additional=[]
	I0630 21:24:54.507512  282690 addons.go:65] Setting storage-provisioner=true in profile "embed-certs-20220630210659-9950"
	I0630 21:24:54.507530  282690 addons.go:153] Setting addon storage-provisioner=true in "embed-certs-20220630210659-9950"
	I0630 21:24:54.505785  282690 config.go:178] Loaded profile config "embed-certs-20220630210659-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:24:54.508995  282690 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 21:24:54.507534  282690 addons.go:65] Setting dashboard=true in profile "embed-certs-20220630210659-9950"
	I0630 21:24:54.509033  282690 addons.go:153] Setting addon dashboard=true in "embed-certs-20220630210659-9950"
	W0630 21:24:54.509043  282690 addons.go:162] addon dashboard should already be in state true
	I0630 21:24:54.507547  282690 addons.go:65] Setting default-storageclass=true in profile "embed-certs-20220630210659-9950"
	I0630 21:24:54.509118  282690 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "embed-certs-20220630210659-9950"
	I0630 21:24:54.507548  282690 addons.go:65] Setting metrics-server=true in profile "embed-certs-20220630210659-9950"
	W0630 21:24:54.507573  282690 addons.go:162] addon storage-provisioner should already be in state true
	I0630 21:24:54.509134  282690 host.go:66] Checking if "embed-certs-20220630210659-9950" exists ...
	I0630 21:24:54.509177  282690 host.go:66] Checking if "embed-certs-20220630210659-9950" exists ...
	I0630 21:24:54.509200  282690 addons.go:153] Setting addon metrics-server=true in "embed-certs-20220630210659-9950"
	W0630 21:24:54.509223  282690 addons.go:162] addon metrics-server should already be in state true
	I0630 21:24:54.509308  282690 host.go:66] Checking if "embed-certs-20220630210659-9950" exists ...
	I0630 21:24:54.509462  282690 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:24:54.509581  282690 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:24:54.509613  282690 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:24:54.509797  282690 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:24:54.560813  282690 out.go:177]   - Using image fake.domain/k8s.gcr.io/echoserver:1.4
	I0630 21:24:54.562228  282690 addons.go:345] installing /etc/kubernetes/addons/metrics-apiservice.yaml
	I0630 21:24:54.562250  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
	I0630 21:24:54.566558  282690 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0630 21:24:54.563422  282690 addons.go:153] Setting addon default-storageclass=true in "embed-certs-20220630210659-9950"
	I0630 21:24:54.564610  282690 out.go:177]   - Using image kubernetesui/dashboard:v2.6.0
	I0630 21:24:54.564664  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	W0630 21:24:54.566619  282690 addons.go:162] addon default-storageclass should already be in state true
	I0630 21:24:54.568042  282690 addons.go:345] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 21:24:54.568076  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0630 21:24:54.568138  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:24:54.568049  282690 host.go:66] Checking if "embed-certs-20220630210659-9950" exists ...
	I0630 21:24:54.568896  282690 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:24:54.571125  282690 out.go:177]   - Using image k8s.gcr.io/echoserver:1.4
	I0630 21:24:52.576199  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:54.577462  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:54.573220  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-ns.yaml
	I0630 21:24:54.573240  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
	I0630 21:24:54.573296  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:24:54.596761  282690 node_ready.go:35] waiting up to 6m0s for node "embed-certs-20220630210659-9950" to be "Ready" ...
	I0630 21:24:54.596796  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.94.1 host.minikube.internal\n           fallthrough\n        }' | sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0630 21:24:54.622285  282690 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49442 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:24:54.625192  282690 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49442 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:24:54.629199  282690 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49442 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:24:54.632573  282690 addons.go:345] installing /etc/kubernetes/addons/storageclass.yaml
	I0630 21:24:54.632600  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0630 21:24:54.632654  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:24:54.674915  282690 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49442 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:24:54.846449  282690 addons.go:345] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
	I0630 21:24:54.846481  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1820 bytes)
	I0630 21:24:54.938792  282690 addons.go:345] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
	I0630 21:24:54.938872  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
	I0630 21:24:54.943079  282690 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0630 21:24:54.947159  282690 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 21:24:54.947675  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
	I0630 21:24:54.947698  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
	I0630 21:24:55.026994  282690 addons.go:345] installing /etc/kubernetes/addons/metrics-server-service.yaml
	I0630 21:24:55.027031  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
	I0630 21:24:55.035197  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
	I0630 21:24:55.035232  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
	I0630 21:24:55.053605  282690 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I0630 21:24:55.126653  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-configmap.yaml
	I0630 21:24:55.126705  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
	I0630 21:24:55.146581  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-dp.yaml
	I0630 21:24:55.146621  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4196 bytes)
	I0630 21:24:55.327942  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-role.yaml
	I0630 21:24:55.328024  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
	I0630 21:24:55.343459  282690 start.go:806] {"host.minikube.internal": 192.168.94.1} host record injected into CoreDNS
	I0630 21:24:55.432902  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
	I0630 21:24:55.432936  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
	I0630 21:24:55.449659  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-sa.yaml
	I0630 21:24:55.449700  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
	I0630 21:24:55.535585  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-secret.yaml
	I0630 21:24:55.535622  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
	I0630 21:24:55.637082  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-svc.yaml
	I0630 21:24:55.637110  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
	I0630 21:24:55.654090  282690 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	I0630 21:24:56.256357  282690 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (1.202695189s)
	I0630 21:24:56.256419  282690 addons.go:383] Verifying addon metrics-server=true in "embed-certs-20220630210659-9950"
	I0630 21:24:56.635370  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:24:57.057755  282690 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (1.403598153s)
	I0630 21:24:57.059648  282690 out.go:177] * Enabled addons: default-storageclass, storage-provisioner, metrics-server, dashboard
	I0630 21:24:57.061353  282690 addons.go:414] enableAddons completed in 2.555682965s
	I0630 21:24:57.076377  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:59.575515  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:59.133305  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:01.133976  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:01.575803  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:03.576220  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:05.576603  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:03.633140  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:05.633312  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:07.633508  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:08.075989  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:10.576424  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:09.633916  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:12.134025  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:13.075816  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:15.076512  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:14.134148  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:16.633590  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:17.575814  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:19.576180  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:19.133861  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:21.634052  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:22.076523  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:24.076612  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:23.634100  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:26.133369  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:28.133752  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:26.076674  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:28.575901  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:30.134009  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:32.633645  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:31.076339  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:33.576385  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:34.633970  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:37.133998  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:36.076191  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:38.576126  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:40.576363  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:39.633552  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:42.133635  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:43.076600  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:43.577767  276064 node_ready.go:38] duration metric: took 4m0.008779238s waiting for node "default-k8s-different-port-20220630210335-9950" to be "Ready" ...
	I0630 21:25:43.580054  276064 out.go:177] 
	W0630 21:25:43.581406  276064 out.go:239] X Exiting due to GUEST_START: wait 6m0s for node: waiting for node to be ready: waitNodeCondition: timed out waiting for the condition
	W0630 21:25:43.581422  276064 out.go:239] * 
	W0630 21:25:43.582123  276064 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0630 21:25:43.583833  276064 out.go:177] 
	I0630 21:25:44.133850  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:46.633832  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:48.633923  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:51.133282  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:53.134021  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:55.134340  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:57.633598  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:59.633912  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:01.634030  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:04.134240  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:06.634341  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:09.134132  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:11.633755  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:13.633838  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:16.134412  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:18.634048  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:21.133258  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:23.134085  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:25.633525  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:27.633880  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:29.634672  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:32.133127  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:34.133922  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:36.134141  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:38.635943  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:41.134059  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:43.634129  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:46.133833  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:48.634266  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:51.133583  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:53.633861  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:55.634000  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:57.634221  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:00.134428  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:02.634184  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:04.634236  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:07.133392  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:09.133620  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:11.133918  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:13.633511  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:15.634578  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:18.134059  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:20.633162  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:22.634065  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:25.133441  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:27.133812  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:29.634200  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:32.133633  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:34.634090  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:37.134098  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:39.634528  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:42.134216  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:44.633646  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:46.633772  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:49.133433  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:51.633343  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:54.133271  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:56.133890  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:58.633874  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:01.133490  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:03.634155  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:06.133638  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:08.134014  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:10.633584  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:12.633988  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:15.133284  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:17.633303  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:19.633472  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:21.633579  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:24.133628  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:26.633535  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:29.133336  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:31.134181  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:33.633631  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:35.634122  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:38.134153  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:40.634086  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:43.134075  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:45.633956  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:47.634182  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:50.133652  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:52.633744  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:54.635658  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:54.635684  282690 node_ready.go:38] duration metric: took 4m0.038888758s waiting for node "embed-certs-20220630210659-9950" to be "Ready" ...
	I0630 21:28:54.638083  282690 out.go:177] 
	W0630 21:28:54.639729  282690 out.go:239] X Exiting due to GUEST_START: wait 6m0s for node: waiting for node to be ready: waitNodeCondition: timed out waiting for the condition
	W0630 21:28:54.639748  282690 out.go:239] * 
	W0630 21:28:54.640518  282690 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0630 21:28:54.642114  282690 out.go:177] 
	
	* 
	* ==> container status <==
	* CONTAINER           IMAGE               CREATED              STATE               NAME                      ATTEMPT             POD ID
	56df5b1d8f1d2       6fb66cd78abfe       About a minute ago   Running             kindnet-cni               1                   0fdc2f54e5621
	fb26d581a951b       6fb66cd78abfe       4 minutes ago        Exited              kindnet-cni               0                   0fdc2f54e5621
	833b51196bf62       a634548d10b03       4 minutes ago        Running             kube-proxy                0                   3b04b654bf293
	9cb12a28b2ecb       5d725196c1f47       4 minutes ago        Running             kube-scheduler            2                   2452657082377
	c50613e594499       aebe758cef4cd       4 minutes ago        Running             etcd                      2                   5a17cc10edf6f
	a254fdd241c22       34cdf99b1bb3b       4 minutes ago        Running             kube-controller-manager   2                   961a7ff8eb8e6
	a37e0a712134d       d3377ffb7177c       4 minutes ago        Running             kube-apiserver            2                   41b7abf9937c8
	
	* 
	* ==> containerd <==
	* -- Logs begin at Thu 2022-06-30 21:20:04 UTC, end at Thu 2022-06-30 21:28:55 UTC. --
	Jun 30 21:24:55 embed-certs-20220630210659-9950 containerd[394]: time="2022-06-30T21:24:55.132601001Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
	Jun 30 21:24:55 embed-certs-20220630210659-9950 containerd[394]: time="2022-06-30T21:24:55.132618215Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
	Jun 30 21:24:55 embed-certs-20220630210659-9950 containerd[394]: time="2022-06-30T21:24:55.133002506Z" level=info msg="starting signal loop" namespace=k8s.io path=/run/containerd/io.containerd.runtime.v2.task/k8s.io/3b04b654bf293cc0fe38e87e04194bb1f5a14c8f2baecc609ad0f9f174e0b636 pid=3550 runtime=io.containerd.runc.v2
	Jun 30 21:24:55 embed-certs-20220630210659-9950 containerd[394]: time="2022-06-30T21:24:55.341514209Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kube-proxy-nxxvt,Uid:743abf78-bfa0-408d-b324-4a41ad824bf3,Namespace:kube-system,Attempt:0,} returns sandbox id \"3b04b654bf293cc0fe38e87e04194bb1f5a14c8f2baecc609ad0f9f174e0b636\""
	Jun 30 21:24:55 embed-certs-20220630210659-9950 containerd[394]: time="2022-06-30T21:24:55.348848796Z" level=info msg="CreateContainer within sandbox \"3b04b654bf293cc0fe38e87e04194bb1f5a14c8f2baecc609ad0f9f174e0b636\" for container &ContainerMetadata{Name:kube-proxy,Attempt:0,}"
	Jun 30 21:24:55 embed-certs-20220630210659-9950 containerd[394]: time="2022-06-30T21:24:55.451697596Z" level=info msg="CreateContainer within sandbox \"3b04b654bf293cc0fe38e87e04194bb1f5a14c8f2baecc609ad0f9f174e0b636\" for &ContainerMetadata{Name:kube-proxy,Attempt:0,} returns container id \"833b51196bf62aa4ed19c53acaf7f95c975063aa5bc7935e710ce263a3a20450\""
	Jun 30 21:24:55 embed-certs-20220630210659-9950 containerd[394]: time="2022-06-30T21:24:55.452593848Z" level=info msg="StartContainer for \"833b51196bf62aa4ed19c53acaf7f95c975063aa5bc7935e710ce263a3a20450\""
	Jun 30 21:24:55 embed-certs-20220630210659-9950 containerd[394]: time="2022-06-30T21:24:55.551811260Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kindnet-4rws6,Uid:8af2153a-93ed-458a-ab7f-8fac1d943717,Namespace:kube-system,Attempt:0,} returns sandbox id \"0fdc2f54e56211eb72ecd16663f2a1841191ec9d15bc94e17422e429ac47ecde\""
	Jun 30 21:24:55 embed-certs-20220630210659-9950 containerd[394]: time="2022-06-30T21:24:55.626056019Z" level=info msg="CreateContainer within sandbox \"0fdc2f54e56211eb72ecd16663f2a1841191ec9d15bc94e17422e429ac47ecde\" for container &ContainerMetadata{Name:kindnet-cni,Attempt:0,}"
	Jun 30 21:24:55 embed-certs-20220630210659-9950 containerd[394]: time="2022-06-30T21:24:55.647565506Z" level=info msg="CreateContainer within sandbox \"0fdc2f54e56211eb72ecd16663f2a1841191ec9d15bc94e17422e429ac47ecde\" for &ContainerMetadata{Name:kindnet-cni,Attempt:0,} returns container id \"fb26d581a951b28cf7fcfe4779356fc56c2ce4d8fb92d06b1dbec14f32a9b083\""
	Jun 30 21:24:55 embed-certs-20220630210659-9950 containerd[394]: time="2022-06-30T21:24:55.724176090Z" level=info msg="StartContainer for \"fb26d581a951b28cf7fcfe4779356fc56c2ce4d8fb92d06b1dbec14f32a9b083\""
	Jun 30 21:24:55 embed-certs-20220630210659-9950 containerd[394]: time="2022-06-30T21:24:55.748449685Z" level=info msg="StartContainer for \"833b51196bf62aa4ed19c53acaf7f95c975063aa5bc7935e710ce263a3a20450\" returns successfully"
	Jun 30 21:24:56 embed-certs-20220630210659-9950 containerd[394]: time="2022-06-30T21:24:56.134540888Z" level=info msg="StartContainer for \"fb26d581a951b28cf7fcfe4779356fc56c2ce4d8fb92d06b1dbec14f32a9b083\" returns successfully"
	Jun 30 21:25:41 embed-certs-20220630210659-9950 containerd[394]: time="2022-06-30T21:25:41.692015675Z" level=error msg="ContainerStatus for \"2fa64a7851d26526b33d6f27ef3e21fd4b7946080355046262c668005d558596\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find container \"2fa64a7851d26526b33d6f27ef3e21fd4b7946080355046262c668005d558596\": not found"
	Jun 30 21:25:41 embed-certs-20220630210659-9950 containerd[394]: time="2022-06-30T21:25:41.692634211Z" level=error msg="ContainerStatus for \"a4173b6789a12a4a3f445bc48312b40e279c253314d01e7cbb963a19bb1d034e\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find container \"a4173b6789a12a4a3f445bc48312b40e279c253314d01e7cbb963a19bb1d034e\": not found"
	Jun 30 21:25:41 embed-certs-20220630210659-9950 containerd[394]: time="2022-06-30T21:25:41.693175494Z" level=error msg="ContainerStatus for \"8341041be1bdbcf0e0425bd1832777e15b2ed89bf8696d0c78d14301820032c3\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find container \"8341041be1bdbcf0e0425bd1832777e15b2ed89bf8696d0c78d14301820032c3\": not found"
	Jun 30 21:25:41 embed-certs-20220630210659-9950 containerd[394]: time="2022-06-30T21:25:41.693699780Z" level=error msg="ContainerStatus for \"9b4de6e0c2fe4debff92502e627a183013cc09807303d66c7f946cf282a66ea5\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find container \"9b4de6e0c2fe4debff92502e627a183013cc09807303d66c7f946cf282a66ea5\": not found"
	Jun 30 21:27:36 embed-certs-20220630210659-9950 containerd[394]: time="2022-06-30T21:27:36.581443845Z" level=info msg="shim disconnected" id=fb26d581a951b28cf7fcfe4779356fc56c2ce4d8fb92d06b1dbec14f32a9b083
	Jun 30 21:27:36 embed-certs-20220630210659-9950 containerd[394]: time="2022-06-30T21:27:36.581511283Z" level=warning msg="cleaning up after shim disconnected" id=fb26d581a951b28cf7fcfe4779356fc56c2ce4d8fb92d06b1dbec14f32a9b083 namespace=k8s.io
	Jun 30 21:27:36 embed-certs-20220630210659-9950 containerd[394]: time="2022-06-30T21:27:36.581531052Z" level=info msg="cleaning up dead shim"
	Jun 30 21:27:36 embed-certs-20220630210659-9950 containerd[394]: time="2022-06-30T21:27:36.590401153Z" level=warning msg="cleanup warnings time=\"2022-06-30T21:27:36Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=3908 runtime=io.containerd.runc.v2\n"
	Jun 30 21:27:37 embed-certs-20220630210659-9950 containerd[394]: time="2022-06-30T21:27:37.329661747Z" level=info msg="CreateContainer within sandbox \"0fdc2f54e56211eb72ecd16663f2a1841191ec9d15bc94e17422e429ac47ecde\" for container &ContainerMetadata{Name:kindnet-cni,Attempt:1,}"
	Jun 30 21:27:37 embed-certs-20220630210659-9950 containerd[394]: time="2022-06-30T21:27:37.342352813Z" level=info msg="CreateContainer within sandbox \"0fdc2f54e56211eb72ecd16663f2a1841191ec9d15bc94e17422e429ac47ecde\" for &ContainerMetadata{Name:kindnet-cni,Attempt:1,} returns container id \"56df5b1d8f1d27837d4ba419c2ee21f7ec4691704b7b4a8cf374e1658312deee\""
	Jun 30 21:27:37 embed-certs-20220630210659-9950 containerd[394]: time="2022-06-30T21:27:37.342969245Z" level=info msg="StartContainer for \"56df5b1d8f1d27837d4ba419c2ee21f7ec4691704b7b4a8cf374e1658312deee\""
	Jun 30 21:27:37 embed-certs-20220630210659-9950 containerd[394]: time="2022-06-30T21:27:37.527843265Z" level=info msg="StartContainer for \"56df5b1d8f1d27837d4ba419c2ee21f7ec4691704b7b4a8cf374e1658312deee\" returns successfully"
	
	* 
	* ==> describe nodes <==
	* Name:               embed-certs-20220630210659-9950
	Roles:              control-plane
	Labels:             beta.kubernetes.io/arch=amd64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=amd64
	                    kubernetes.io/hostname=embed-certs-20220630210659-9950
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=251ffcec0e4c997cd7732864187747cc579943c9
	                    minikube.k8s.io/name=embed-certs-20220630210659-9950
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2022_06_30T21_24_42_0700
	                    minikube.k8s.io/version=v1.26.0
	                    node-role.kubernetes.io/control-plane=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///run/containerd/containerd.sock
	                    node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Thu, 30 Jun 2022 21:24:38 +0000
	Taints:             node.kubernetes.io/not-ready:NoSchedule
	Unschedulable:      false
	Lease:
	  HolderIdentity:  embed-certs-20220630210659-9950
	  AcquireTime:     <unset>
	  RenewTime:       Thu, 30 Jun 2022 21:28:46 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Thu, 30 Jun 2022 21:24:52 +0000   Thu, 30 Jun 2022 21:24:35 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Thu, 30 Jun 2022 21:24:52 +0000   Thu, 30 Jun 2022 21:24:35 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Thu, 30 Jun 2022 21:24:52 +0000   Thu, 30 Jun 2022 21:24:35 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            False   Thu, 30 Jun 2022 21:24:52 +0000   Thu, 30 Jun 2022 21:24:35 +0000   KubeletNotReady              container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Addresses:
	  InternalIP:  192.168.94.2
	  Hostname:    embed-certs-20220630210659-9950
	Capacity:
	  cpu:                8
	  ephemeral-storage:  304695084Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32873488Ki
	  pods:               110
	Allocatable:
	  cpu:                8
	  ephemeral-storage:  304695084Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32873488Ki
	  pods:               110
	System Info:
	  Machine ID:                 bbe1e1cef6e940328962dca52b3c5731
	  System UUID:                e149cbc8-bbc1-4888-b53f-97553d30d981
	  Boot ID:                    471c4729-f046-4a15-bc49-46f3ad561708
	  Kernel Version:             5.15.0-1012-gcp
	  OS Image:                   Ubuntu 20.04.4 LTS
	  Operating System:           linux
	  Architecture:               amd64
	  Container Runtime Version:  containerd://1.6.6
	  Kubelet Version:            v1.24.2
	  Kube-Proxy Version:         v1.24.2
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (6 in total)
	  Namespace                   Name                                                       CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                                       ------------  ----------  ---------------  -------------  ---
	  kube-system                 etcd-embed-certs-20220630210659-9950                       100m (1%!)(MISSING)     0 (0%!)(MISSING)      100Mi (0%!)(MISSING)       0 (0%!)(MISSING)         4m13s
	  kube-system                 kindnet-4rws6                                              100m (1%!)(MISSING)     100m (1%!)(MISSING)   50Mi (0%!)(MISSING)        50Mi (0%!)(MISSING)      4m1s
	  kube-system                 kube-apiserver-embed-certs-20220630210659-9950             250m (3%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m14s
	  kube-system                 kube-controller-manager-embed-certs-20220630210659-9950    200m (2%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m13s
	  kube-system                 kube-proxy-nxxvt                                           0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m1s
	  kube-system                 kube-scheduler-embed-certs-20220630210659-9950             100m (1%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m14s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                750m (9%!)(MISSING)   100m (1%!)(MISSING)
	  memory             150Mi (0%!)(MISSING)  50Mi (0%!)(MISSING)
	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	Events:
	  Type    Reason                   Age                    From             Message
	  ----    ------                   ----                   ----             -------
	  Normal  Starting                 3m59s                  kube-proxy       
	  Normal  NodeHasSufficientMemory  4m21s (x5 over 4m21s)  kubelet          Node embed-certs-20220630210659-9950 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    4m21s (x5 over 4m21s)  kubelet          Node embed-certs-20220630210659-9950 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     4m21s (x3 over 4m21s)  kubelet          Node embed-certs-20220630210659-9950 status is now: NodeHasSufficientPID
	  Normal  NodeHasNoDiskPressure    4m14s                  kubelet          Node embed-certs-20220630210659-9950 status is now: NodeHasNoDiskPressure
	  Normal  Starting                 4m14s                  kubelet          Starting kubelet.
	  Normal  NodeHasSufficientMemory  4m14s                  kubelet          Node embed-certs-20220630210659-9950 status is now: NodeHasSufficientMemory
	  Normal  NodeHasSufficientPID     4m14s                  kubelet          Node embed-certs-20220630210659-9950 status is now: NodeHasSufficientPID
	  Normal  NodeAllocatableEnforced  4m13s                  kubelet          Updated Node Allocatable limit across pods
	  Normal  RegisteredNode           4m2s                   node-controller  Node embed-certs-20220630210659-9950 event: Registered Node embed-certs-20220630210659-9950 in Controller
	
	* 
	* ==> dmesg <==
	* [  +2.939825] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000011] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.027789] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.019913] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[ +21.968090] IPv4: martian destination 127.0.0.11 from 10.244.0.3, dev veth8071d138
	[ +25.445872] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.029436] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.023957] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +2.947695] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[Jun30 21:05] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.023879] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +2.955783] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.011828] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000005] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.027896] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	
	* 
	* ==> etcd [c50613e594499cee812306fd3c897ca03098f8f388e6ac0945c96b39297cb862] <==
	* {"level":"info","ts":"2022-06-30T21:24:35.430Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"dfc97eb0aae75b33 switched to configuration voters=(16125559238023404339)"}
	{"level":"info","ts":"2022-06-30T21:24:35.430Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"da400bbece288f5a","local-member-id":"dfc97eb0aae75b33","added-peer-id":"dfc97eb0aae75b33","added-peer-peer-urls":["https://192.168.94.2:2380"]}
	{"level":"info","ts":"2022-06-30T21:24:35.432Z","caller":"embed/etcd.go:688","msg":"starting with client TLS","tls-info":"cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, client-cert=, client-key=, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = ","cipher-suites":[]}
	{"level":"info","ts":"2022-06-30T21:24:35.432Z","caller":"embed/etcd.go:581","msg":"serving peer traffic","address":"192.168.94.2:2380"}
	{"level":"info","ts":"2022-06-30T21:24:35.432Z","caller":"embed/etcd.go:553","msg":"cmux::serve","address":"192.168.94.2:2380"}
	{"level":"info","ts":"2022-06-30T21:24:35.432Z","caller":"embed/etcd.go:277","msg":"now serving peer/client/metrics","local-member-id":"dfc97eb0aae75b33","initial-advertise-peer-urls":["https://192.168.94.2:2380"],"listen-peer-urls":["https://192.168.94.2:2380"],"advertise-client-urls":["https://192.168.94.2:2379"],"listen-client-urls":["https://127.0.0.1:2379","https://192.168.94.2:2379"],"listen-metrics-urls":["http://127.0.0.1:2381"]}
	{"level":"info","ts":"2022-06-30T21:24:35.432Z","caller":"embed/etcd.go:763","msg":"serving metrics","address":"http://127.0.0.1:2381"}
	{"level":"info","ts":"2022-06-30T21:24:35.853Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"dfc97eb0aae75b33 is starting a new election at term 1"}
	{"level":"info","ts":"2022-06-30T21:24:35.854Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"dfc97eb0aae75b33 became pre-candidate at term 1"}
	{"level":"info","ts":"2022-06-30T21:24:35.854Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"dfc97eb0aae75b33 received MsgPreVoteResp from dfc97eb0aae75b33 at term 1"}
	{"level":"info","ts":"2022-06-30T21:24:35.854Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"dfc97eb0aae75b33 became candidate at term 2"}
	{"level":"info","ts":"2022-06-30T21:24:35.854Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"dfc97eb0aae75b33 received MsgVoteResp from dfc97eb0aae75b33 at term 2"}
	{"level":"info","ts":"2022-06-30T21:24:35.854Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"dfc97eb0aae75b33 became leader at term 2"}
	{"level":"info","ts":"2022-06-30T21:24:35.854Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: dfc97eb0aae75b33 elected leader dfc97eb0aae75b33 at term 2"}
	{"level":"info","ts":"2022-06-30T21:24:35.854Z","caller":"etcdserver/server.go:2507","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}
	{"level":"info","ts":"2022-06-30T21:24:35.855Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"da400bbece288f5a","local-member-id":"dfc97eb0aae75b33","cluster-version":"3.5"}
	{"level":"info","ts":"2022-06-30T21:24:35.855Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
	{"level":"info","ts":"2022-06-30T21:24:35.855Z","caller":"etcdserver/server.go:2531","msg":"cluster version is updated","cluster-version":"3.5"}
	{"level":"info","ts":"2022-06-30T21:24:35.855Z","caller":"etcdserver/server.go:2042","msg":"published local member to cluster through raft","local-member-id":"dfc97eb0aae75b33","local-member-attributes":"{Name:embed-certs-20220630210659-9950 ClientURLs:[https://192.168.94.2:2379]}","request-path":"/0/members/dfc97eb0aae75b33/attributes","cluster-id":"da400bbece288f5a","publish-timeout":"7s"}
	{"level":"info","ts":"2022-06-30T21:24:35.855Z","caller":"embed/serve.go:98","msg":"ready to serve client requests"}
	{"level":"info","ts":"2022-06-30T21:24:35.855Z","caller":"embed/serve.go:98","msg":"ready to serve client requests"}
	{"level":"info","ts":"2022-06-30T21:24:35.855Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
	{"level":"info","ts":"2022-06-30T21:24:35.855Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
	{"level":"info","ts":"2022-06-30T21:24:35.857Z","caller":"embed/serve.go:188","msg":"serving client traffic securely","address":"127.0.0.1:2379"}
	{"level":"info","ts":"2022-06-30T21:24:35.857Z","caller":"embed/serve.go:188","msg":"serving client traffic securely","address":"192.168.94.2:2379"}
	
	* 
	* ==> kernel <==
	*  21:28:55 up  1:11,  0 users,  load average: 0.29, 0.54, 0.90
	Linux embed-certs-20220630210659-9950 5.15.0-1012-gcp #17~20.04.1-Ubuntu SMP Thu Jun 23 16:10:34 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
	PRETTY_NAME="Ubuntu 20.04.4 LTS"
	
	* 
	* ==> kube-apiserver [a37e0a712134dba6b38cc4dcb6d1f5d6148318183800ad5f951ca37f88666208] <==
	* I0630 21:24:56.247082       1 alloc.go:327] "allocated clusterIPs" service="kube-system/metrics-server" clusterIPs=map[IPv4:10.104.220.102]
	I0630 21:24:56.328546       1 controller.go:611] quota admission added evaluator for: events.events.k8s.io
	W0630 21:24:56.943610       1 handler_proxy.go:102] no RequestInfo found in the context
	E0630 21:24:56.943681       1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
	, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
	I0630 21:24:56.943694       1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
	W0630 21:24:56.943724       1 handler_proxy.go:102] no RequestInfo found in the context
	E0630 21:24:56.943774       1 controller.go:113] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: Error, could not get list of group versions for APIService
	I0630 21:24:56.944881       1 controller.go:126] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
	I0630 21:24:57.034175       1 alloc.go:327] "allocated clusterIPs" service="kubernetes-dashboard/kubernetes-dashboard" clusterIPs=map[IPv4:10.103.186.182]
	I0630 21:24:57.051448       1 alloc.go:327] "allocated clusterIPs" service="kubernetes-dashboard/dashboard-metrics-scraper" clusterIPs=map[IPv4:10.109.60.113]
	W0630 21:25:56.944810       1 handler_proxy.go:102] no RequestInfo found in the context
	E0630 21:25:56.944877       1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
	, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
	I0630 21:25:56.944886       1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
	W0630 21:25:56.945001       1 handler_proxy.go:102] no RequestInfo found in the context
	E0630 21:25:56.945034       1 controller.go:113] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: Error, could not get list of group versions for APIService
	I0630 21:25:56.947009       1 controller.go:126] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
	W0630 21:27:56.945989       1 handler_proxy.go:102] no RequestInfo found in the context
	E0630 21:27:56.946070       1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
	, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
	I0630 21:27:56.946081       1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
	W0630 21:27:56.948136       1 handler_proxy.go:102] no RequestInfo found in the context
	E0630 21:27:56.948170       1 controller.go:113] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: Error, could not get list of group versions for APIService
	I0630 21:27:56.948186       1 controller.go:126] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
	
	* 
	* ==> kube-controller-manager [a254fdd241c2240c0286acf2197722ad7a3a4cf36dd663e20d37c69ef814f7c4] <==
	* E0630 21:24:56.924886       1 replica_set.go:550] sync "kubernetes-dashboard/kubernetes-dashboard-5fd5574d9f" failed with pods "kubernetes-dashboard-5fd5574d9f-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found
	I0630 21:24:56.924879       1 event.go:294] "Event occurred" object="kubernetes-dashboard/dashboard-metrics-scraper-dffd48c4c" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Warning" reason="FailedCreate" message="Error creating: pods \"dashboard-metrics-scraper-dffd48c4c-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found"
	I0630 21:24:56.924931       1 event.go:294] "Event occurred" object="kubernetes-dashboard/kubernetes-dashboard-5fd5574d9f" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Warning" reason="FailedCreate" message="Error creating: pods \"kubernetes-dashboard-5fd5574d9f-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found"
	I0630 21:24:56.930141       1 event.go:294] "Event occurred" object="kubernetes-dashboard/kubernetes-dashboard-5fd5574d9f" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Warning" reason="FailedCreate" message="Error creating: pods \"kubernetes-dashboard-5fd5574d9f-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found"
	I0630 21:24:56.930185       1 event.go:294] "Event occurred" object="kubernetes-dashboard/dashboard-metrics-scraper-dffd48c4c" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Warning" reason="FailedCreate" message="Error creating: pods \"dashboard-metrics-scraper-dffd48c4c-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found"
	E0630 21:24:56.930142       1 replica_set.go:550] sync "kubernetes-dashboard/kubernetes-dashboard-5fd5574d9f" failed with pods "kubernetes-dashboard-5fd5574d9f-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found
	E0630 21:24:56.930151       1 replica_set.go:550] sync "kubernetes-dashboard/dashboard-metrics-scraper-dffd48c4c" failed with pods "dashboard-metrics-scraper-dffd48c4c-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found
	I0630 21:24:56.940079       1 event.go:294] "Event occurred" object="kubernetes-dashboard/kubernetes-dashboard-5fd5574d9f" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kubernetes-dashboard-5fd5574d9f-gfm2q"
	I0630 21:24:56.951858       1 event.go:294] "Event occurred" object="kubernetes-dashboard/dashboard-metrics-scraper-dffd48c4c" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: dashboard-metrics-scraper-dffd48c4c-pplc5"
	E0630 21:25:23.906650       1 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	W0630 21:25:24.339841       1 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0630 21:25:53.921617       1 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	W0630 21:25:54.353820       1 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0630 21:26:23.937908       1 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	W0630 21:26:24.369437       1 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0630 21:26:53.953700       1 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	W0630 21:26:54.383792       1 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0630 21:27:23.970155       1 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	W0630 21:27:24.400514       1 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0630 21:27:53.987085       1 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	W0630 21:27:54.414856       1 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0630 21:28:24.002340       1 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	W0630 21:28:24.429993       1 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0630 21:28:54.017169       1 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	W0630 21:28:54.445461       1 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	
	* 
	* ==> kube-proxy [833b51196bf62aa4ed19c53acaf7f95c975063aa5bc7935e710ce263a3a20450] <==
	* I0630 21:24:56.145662       1 node.go:163] Successfully retrieved node IP: 192.168.94.2
	I0630 21:24:56.145735       1 server_others.go:138] "Detected node IP" address="192.168.94.2"
	I0630 21:24:56.145823       1 server_others.go:578] "Unknown proxy mode, assuming iptables proxy" proxyMode=""
	I0630 21:24:56.325338       1 server_others.go:206] "Using iptables Proxier"
	I0630 21:24:56.325381       1 server_others.go:213] "kube-proxy running in dual-stack mode" ipFamily=IPv4
	I0630 21:24:56.325390       1 server_others.go:214] "Creating dualStackProxier for iptables"
	I0630 21:24:56.325407       1 server_others.go:501] "Detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, , defaulting to no-op detect-local for IPv6"
	I0630 21:24:56.325438       1 proxier.go:259] "Setting route_localnet=1, use nodePortAddresses to filter loopback addresses for NodePorts to skip it https://issues.k8s.io/90259"
	I0630 21:24:56.325595       1 proxier.go:259] "Setting route_localnet=1, use nodePortAddresses to filter loopback addresses for NodePorts to skip it https://issues.k8s.io/90259"
	I0630 21:24:56.325909       1 server.go:661] "Version info" version="v1.24.2"
	I0630 21:24:56.325929       1 server.go:663] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
	I0630 21:24:56.326455       1 config.go:317] "Starting service config controller"
	I0630 21:24:56.326482       1 config.go:226] "Starting endpoint slice config controller"
	I0630 21:24:56.326498       1 shared_informer.go:255] Waiting for caches to sync for service config
	I0630 21:24:56.326499       1 shared_informer.go:255] Waiting for caches to sync for endpoint slice config
	I0630 21:24:56.326820       1 config.go:444] "Starting node config controller"
	I0630 21:24:56.326890       1 shared_informer.go:255] Waiting for caches to sync for node config
	I0630 21:24:56.427061       1 shared_informer.go:262] Caches are synced for node config
	I0630 21:24:56.427076       1 shared_informer.go:262] Caches are synced for service config
	I0630 21:24:56.427142       1 shared_informer.go:262] Caches are synced for endpoint slice config
	
	* 
	* ==> kube-scheduler [9cb12a28b2ecb262dbd3bee9a62bbfee084db1d07c795697fc796e09724dafef] <==
	* W0630 21:24:38.738670       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0630 21:24:38.738699       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	W0630 21:24:38.738962       1 reflector.go:324] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	E0630 21:24:38.738987       1 reflector.go:138] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	W0630 21:24:38.739254       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	W0630 21:24:38.739278       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
	E0630 21:24:38.739297       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
	E0630 21:24:38.739283       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	W0630 21:24:38.739328       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	E0630 21:24:38.739338       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	W0630 21:24:38.739652       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E0630 21:24:38.739686       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	W0630 21:24:38.740039       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	E0630 21:24:38.740072       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	W0630 21:24:39.641302       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E0630 21:24:39.641341       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	W0630 21:24:39.673518       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
	E0630 21:24:39.673560       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
	W0630 21:24:39.759368       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
	E0630 21:24:39.759417       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
	W0630 21:24:39.769596       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E0630 21:24:39.769636       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	W0630 21:24:39.785898       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	E0630 21:24:39.785939       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	I0630 21:24:40.234799       1 shared_informer.go:262] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	
	* 
	* ==> kubelet <==
	* -- Logs begin at Thu 2022-06-30 21:20:04 UTC, end at Thu 2022-06-30 21:28:56 UTC. --
	Jun 30 21:26:57 embed-certs-20220630210659-9950 kubelet[3064]: E0630 21:26:57.092205    3064 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:27:02 embed-certs-20220630210659-9950 kubelet[3064]: E0630 21:27:02.093712    3064 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:27:07 embed-certs-20220630210659-9950 kubelet[3064]: E0630 21:27:07.095355    3064 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:27:12 embed-certs-20220630210659-9950 kubelet[3064]: E0630 21:27:12.096117    3064 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:27:17 embed-certs-20220630210659-9950 kubelet[3064]: E0630 21:27:17.096971    3064 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:27:22 embed-certs-20220630210659-9950 kubelet[3064]: E0630 21:27:22.098460    3064 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:27:27 embed-certs-20220630210659-9950 kubelet[3064]: E0630 21:27:27.099391    3064 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:27:32 embed-certs-20220630210659-9950 kubelet[3064]: E0630 21:27:32.100959    3064 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:27:37 embed-certs-20220630210659-9950 kubelet[3064]: E0630 21:27:37.101979    3064 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:27:37 embed-certs-20220630210659-9950 kubelet[3064]: I0630 21:27:37.327399    3064 scope.go:110] "RemoveContainer" containerID="fb26d581a951b28cf7fcfe4779356fc56c2ce4d8fb92d06b1dbec14f32a9b083"
	Jun 30 21:27:42 embed-certs-20220630210659-9950 kubelet[3064]: E0630 21:27:42.102959    3064 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:27:47 embed-certs-20220630210659-9950 kubelet[3064]: E0630 21:27:47.104708    3064 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:27:52 embed-certs-20220630210659-9950 kubelet[3064]: E0630 21:27:52.106448    3064 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:27:57 embed-certs-20220630210659-9950 kubelet[3064]: E0630 21:27:57.107374    3064 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:28:02 embed-certs-20220630210659-9950 kubelet[3064]: E0630 21:28:02.108618    3064 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:28:07 embed-certs-20220630210659-9950 kubelet[3064]: E0630 21:28:07.110117    3064 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:28:12 embed-certs-20220630210659-9950 kubelet[3064]: E0630 21:28:12.111714    3064 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:28:17 embed-certs-20220630210659-9950 kubelet[3064]: E0630 21:28:17.113206    3064 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:28:22 embed-certs-20220630210659-9950 kubelet[3064]: E0630 21:28:22.114735    3064 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:28:27 embed-certs-20220630210659-9950 kubelet[3064]: E0630 21:28:27.116109    3064 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:28:32 embed-certs-20220630210659-9950 kubelet[3064]: E0630 21:28:32.117696    3064 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:28:37 embed-certs-20220630210659-9950 kubelet[3064]: E0630 21:28:37.119342    3064 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:28:42 embed-certs-20220630210659-9950 kubelet[3064]: E0630 21:28:42.120751    3064 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:28:47 embed-certs-20220630210659-9950 kubelet[3064]: E0630 21:28:47.121600    3064 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:28:52 embed-certs-20220630210659-9950 kubelet[3064]: E0630 21:28:52.123311    3064 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	

                                                
                                                
-- /stdout --
helpers_test.go:254: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p embed-certs-20220630210659-9950 -n embed-certs-20220630210659-9950
helpers_test.go:261: (dbg) Run:  kubectl --context embed-certs-20220630210659-9950 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:270: non-running pods: coredns-6d4b75cb6d-pb4bz metrics-server-5c6f97fb75-fgsb4 storage-provisioner dashboard-metrics-scraper-dffd48c4c-pplc5 kubernetes-dashboard-5fd5574d9f-gfm2q
helpers_test.go:272: ======> post-mortem[TestStartStop/group/embed-certs/serial/SecondStart]: describe non-running pods <======
helpers_test.go:275: (dbg) Run:  kubectl --context embed-certs-20220630210659-9950 describe pod coredns-6d4b75cb6d-pb4bz metrics-server-5c6f97fb75-fgsb4 storage-provisioner dashboard-metrics-scraper-dffd48c4c-pplc5 kubernetes-dashboard-5fd5574d9f-gfm2q
helpers_test.go:275: (dbg) Non-zero exit: kubectl --context embed-certs-20220630210659-9950 describe pod coredns-6d4b75cb6d-pb4bz metrics-server-5c6f97fb75-fgsb4 storage-provisioner dashboard-metrics-scraper-dffd48c4c-pplc5 kubernetes-dashboard-5fd5574d9f-gfm2q: exit status 1 (64.422448ms)

                                                
                                                
** stderr ** 
	Error from server (NotFound): pods "coredns-6d4b75cb6d-pb4bz" not found
	Error from server (NotFound): pods "metrics-server-5c6f97fb75-fgsb4" not found
	Error from server (NotFound): pods "storage-provisioner" not found
	Error from server (NotFound): pods "dashboard-metrics-scraper-dffd48c4c-pplc5" not found
	Error from server (NotFound): pods "kubernetes-dashboard-5fd5574d9f-gfm2q" not found

                                                
                                                
** /stderr **
helpers_test.go:277: kubectl --context embed-certs-20220630210659-9950 describe pod coredns-6d4b75cb6d-pb4bz metrics-server-5c6f97fb75-fgsb4 storage-provisioner dashboard-metrics-scraper-dffd48c4c-pplc5 kubernetes-dashboard-5fd5574d9f-gfm2q: exit status 1
--- FAIL: TestStartStop/group/embed-certs/serial/SecondStart (533.65s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (542.52s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:342: "kubernetes-dashboard-958c5c65f-z5ppk" [c0f32571-a360-4494-b2c2-f0a5a5b7ba8b] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.)
E0630 21:23:13.326410    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/functional-20220630202638-9950/client.crt: no such file or directory
E0630 21:23:30.280178    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/functional-20220630202638-9950/client.crt: no such file or directory
E0630 21:23:30.340496    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/no-preload-20220630210237-9950/client.crt: no such file or directory
E0630 21:23:50.204900    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/addons-20220630202117-9950/client.crt: no such file or directory
E0630 21:24:37.807065    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/auto-20220630204858-9950/client.crt: no such file or directory
E0630 21:24:41.441785    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/kindnet-20220630204858-9950/client.crt: no such file or directory
E0630 21:25:01.427587    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/enable-default-cni-20220630204858-9950/client.crt: no such file or directory
E0630 21:25:25.850574    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/cilium-20220630204859-9950/client.crt: no such file or directory
E0630 21:25:30.314813    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/ingress-addon-legacy-20220630202923-9950/client.crt: no such file or directory

                                                
                                                
=== CONT  TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
E0630 21:30:25.850665    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/cilium-20220630204859-9950/client.crt: no such file or directory
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
E0630 21:30:47.268592    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/ingress-addon-legacy-20220630202923-9950/client.crt: no such file or directory
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
E0630 21:31:27.108767    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/bridge-20220630204858-9950/client.crt: no such file or directory
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
start_stop_delete_test.go:274: ***** TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: pod "k8s-app=kubernetes-dashboard" failed to start within 9m0s: timed out waiting for the condition ****
start_stop_delete_test.go:274: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p old-k8s-version-20220630210005-9950 -n old-k8s-version-20220630210005-9950
start_stop_delete_test.go:274: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: showing logs for failed pods as of 2022-06-30 21:31:52.805215903 +0000 UTC m=+4261.044354151
start_stop_delete_test.go:274: (dbg) Run:  kubectl --context old-k8s-version-20220630210005-9950 describe po kubernetes-dashboard-958c5c65f-z5ppk -n kubernetes-dashboard
start_stop_delete_test.go:274: (dbg) Non-zero exit: kubectl --context old-k8s-version-20220630210005-9950 describe po kubernetes-dashboard-958c5c65f-z5ppk -n kubernetes-dashboard: context deadline exceeded (1.293µs)
start_stop_delete_test.go:274: kubectl --context old-k8s-version-20220630210005-9950 describe po kubernetes-dashboard-958c5c65f-z5ppk -n kubernetes-dashboard: context deadline exceeded
start_stop_delete_test.go:274: (dbg) Run:  kubectl --context old-k8s-version-20220630210005-9950 logs kubernetes-dashboard-958c5c65f-z5ppk -n kubernetes-dashboard
start_stop_delete_test.go:274: (dbg) Non-zero exit: kubectl --context old-k8s-version-20220630210005-9950 logs kubernetes-dashboard-958c5c65f-z5ppk -n kubernetes-dashboard: context deadline exceeded (170ns)
start_stop_delete_test.go:274: kubectl --context old-k8s-version-20220630210005-9950 logs kubernetes-dashboard-958c5c65f-z5ppk -n kubernetes-dashboard: context deadline exceeded
start_stop_delete_test.go:275: failed waiting for 'addon dashboard' pod post-stop-start: k8s-app=kubernetes-dashboard within 9m0s: timed out waiting for the condition
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect old-k8s-version-20220630210005-9950
helpers_test.go:235: (dbg) docker inspect old-k8s-version-20220630210005-9950:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "1b84433fb68bbf2bd151038738e402e5c525e45c0c466b954c0a2fc61a335d66",
	        "Created": "2022-06-30T21:00:13.927977074Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 271627,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2022-06-30T21:12:55.219965216Z",
	            "FinishedAt": "2022-06-30T21:12:53.417533807Z"
	        },
	        "Image": "sha256:573e7be5768273a7845baee1ae90fa2e33b83b10a7fbb0f0f41efbf29b53d1f1",
	        "ResolvConfPath": "/var/lib/docker/containers/1b84433fb68bbf2bd151038738e402e5c525e45c0c466b954c0a2fc61a335d66/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/1b84433fb68bbf2bd151038738e402e5c525e45c0c466b954c0a2fc61a335d66/hostname",
	        "HostsPath": "/var/lib/docker/containers/1b84433fb68bbf2bd151038738e402e5c525e45c0c466b954c0a2fc61a335d66/hosts",
	        "LogPath": "/var/lib/docker/containers/1b84433fb68bbf2bd151038738e402e5c525e45c0c466b954c0a2fc61a335d66/1b84433fb68bbf2bd151038738e402e5c525e45c0c466b954c0a2fc61a335d66-json.log",
	        "Name": "/old-k8s-version-20220630210005-9950",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "old-k8s-version-20220630210005-9950:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "old-k8s-version-20220630210005-9950",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 2306867200,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": null,
	            "BlkioDeviceWriteBps": null,
	            "BlkioDeviceReadIOps": null,
	            "BlkioDeviceWriteIOps": null,
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "KernelMemory": 0,
	            "KernelMemoryTCP": 0,
	            "MemoryReservation": 0,
	            "MemorySwap": 4613734400,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": null,
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/d94571e47e569545ea7c101defd143650d23877c940361aa1535ed742bae26c1-init/diff:/var/lib/docker/overlay2/8b88d9f6f12c48be642a133456203e58549a93f1da67d0349744bd0f78917fba/diff:/var/lib/docker/overlay2/2bcbb3b4718a64188802301a25d7f413bb307cb16d077e7e5af799f9152a2970/diff:/var/lib/docker/overlay2/70b0888bf22fcef1c004704b71288ac581cf26a3b3b19fbca3da296ba10d6978/diff:/var/lib/docker/overlay2/7c5332f38fe652f379ef9b6d23e795158e9994317cfb547b581dd2b1fdf1303b/diff:/var/lib/docker/overlay2/0ddb5a3abf433b644a8bfa124e3c87878eed67878faa35493f2befc2b392e9cb/diff:/var/lib/docker/overlay2/3b7cda5fb0232fdeecbec0531ac704a59eb38fe57664c25777193b07e2df0077/diff:/var/lib/docker/overlay2/a14687ada786c65465b9924ae2d77ba27afc07942851cafaade28e80dfe9da16/diff:/var/lib/docker/overlay2/c49a9b7157aa6e8714e192b2849866d035b59e18de462c0ee9b72f898cc5a485/diff:/var/lib/docker/overlay2/efd71a50e3a1044a6d1c4c1a7d4d91d9f070c066e03e51c6c73a5764b778ad72/diff:/var/lib/docker/overlay2/55476a
1c0a20aa4238a0bb0e43c6402c33dcad312938ad48ee81be0160e12a49/diff:/var/lib/docker/overlay2/c48c4a348a797b9a38f01568a6adbcb4b05b4f56f7b986a4bf1b509d8cb00732/diff:/var/lib/docker/overlay2/568e3f354ab0428de5cf82d1fdfb780c3377f5cc55d9f524731c53e39e0ecae7/diff:/var/lib/docker/overlay2/2857943e320cdcdae9af3d8c2acda1fb61e2f142a88b8b902908071cea67816e/diff:/var/lib/docker/overlay2/bdd9a57f0b65e65c5a16395f239425e794c678b0e8db2f4a368e0a9427fe5116/diff:/var/lib/docker/overlay2/b150183f1b73e8c13c751911bcee09fed8ef973478f4dc3cfdb9e509118bf1ea/diff:/var/lib/docker/overlay2/0a053e7c29417cd6feafb351c7944e81342a52898871bc779f7bf61868c78ec4/diff:/var/lib/docker/overlay2/d3c0de3a44d75d0a05acb7843d53deba5ce0457649d6ed757da9b4c532a81e4f/diff:/var/lib/docker/overlay2/53f6170132880e1697dd802b8577382b31c6f1ba144256f8cc62542998842a6b/diff:/var/lib/docker/overlay2/b5c0be6d8efdb1fcb12e73b8f72853f77baa4bc014ac2c1e28b7b972b07f3325/diff:/var/lib/docker/overlay2/36c908f082a1e5388bb25277f1c957eaecf70fcd958080422fa85a3105724fb2/diff:/var/lib/d
ocker/overlay2/b147fe9dce365cfaf9bfeca2e370829e4d87e2671c133a9836ecb02a85422cc7/diff:/var/lib/docker/overlay2/65f488eb9181a721f01b333f5fa0cb91d216abd7842a9ae193bd95316f378721/diff:/var/lib/docker/overlay2/b04269aa247b68912ddc5b1c98ad55d67af4103f576a900eef4069c196b8a263/diff:/var/lib/docker/overlay2/b714c37e15257ae9d0e15d271dd18a330c38ad765901d9b7e7e3feb73e1b03e4/diff:/var/lib/docker/overlay2/3c253b721193edeaade7bba7ce25ff687c889b8fa86e9489c7ee20d5624e6c5b/diff:/var/lib/docker/overlay2/7f67b74e101fa21dd320393c10576eefa4ce1cec2e210bff405784fa45b360f3/diff:/var/lib/docker/overlay2/c3b2adaa63a06a5e6ed966d7b6f20a757aeadd3f25eb09ef3c7e9a66a8904143/diff:/var/lib/docker/overlay2/ddb5d653d19e8cafc4625a8fe9597667d98b277a7f679e532ad84caa2c6da636/diff:/var/lib/docker/overlay2/03eb172b20323ebeee7cb09025726a6e10de6c3dd8661f4f6bbc5a3a3778bad4/diff:/var/lib/docker/overlay2/80ea9bf34d028e95a8a418b3aeb634be72ab3336448946d7855c51ffdf8258d7/diff:/var/lib/docker/overlay2/e28987ea3fb4d431dee111f38cc76814b85f73e86434be3c463c01fdd59
9ad46/diff:/var/lib/docker/overlay2/6f9a46c7c6cf4fd30ce32a1eb08ed9b1e8dd61cb0e42ce54f0f736f06558c306/diff:/var/lib/docker/overlay2/6fc942eb9ccfc09898edc9a5ef3b3d305a6fcb22e8cefb1a9f9c344d10b59b25/diff:/var/lib/docker/overlay2/f6b8c57540e798dc1dfd51fd29c020193c02a4362f31c6d07aa220327bb07b90/diff:/var/lib/docker/overlay2/85d0aa01a3fab8c77262c59d8a7b0809a72673a3da7d33e4e19c04a66db44a11/diff:/var/lib/docker/overlay2/58dcd81a1605641f785ced5aeb38657eec1f02a31b7adfaf4f6fdd49f4bab1d6/diff:/var/lib/docker/overlay2/9d537e0a65325e4bf85b26da9828002339f5c442ca85f931b340457a80ec8c94/diff:/var/lib/docker/overlay2/a6f73707ee6a74e948a02d03c4a3f12b57c2eb408dc67da3c39961bb3cefcc97/diff:/var/lib/docker/overlay2/922526c310b066dbb73b9a106eef8bf0064ad7907a8d7d7b353f5307a17a4901/diff:/var/lib/docker/overlay2/a4185854870ebf8d34a4c7e1827dbe3bc461559839301ffb23c5efff5e3c9f14/diff:/var/lib/docker/overlay2/8c02b1fcb9d79f5d7b2ee4d44f6625a692c44a0d18df0a5c01cac0cca0fdf3f3/diff",
	                "MergedDir": "/var/lib/docker/overlay2/d94571e47e569545ea7c101defd143650d23877c940361aa1535ed742bae26c1/merged",
	                "UpperDir": "/var/lib/docker/overlay2/d94571e47e569545ea7c101defd143650d23877c940361aa1535ed742bae26c1/diff",
	                "WorkDir": "/var/lib/docker/overlay2/d94571e47e569545ea7c101defd143650d23877c940361aa1535ed742bae26c1/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "old-k8s-version-20220630210005-9950",
	                "Source": "/var/lib/docker/volumes/old-k8s-version-20220630210005-9950/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "old-k8s-version-20220630210005-9950",
	            "Domainname": "",
	            "User": "root",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e",
	            "Volumes": null,
	            "WorkingDir": "",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "old-k8s-version-20220630210005-9950",
	                "name.minikube.sigs.k8s.io": "old-k8s-version-20220630210005-9950",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "3168ec840ced61e1ecbfc232a8d546bc9db5e4512ce831c13fbe45d1185d859b",
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49432"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49431"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49428"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49430"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49429"
	                    }
	                ]
	            },
	            "SandboxKey": "/var/run/docker/netns/3168ec840ced",
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "old-k8s-version-20220630210005-9950": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.67.2"
	                    },
	                    "Links": null,
	                    "Aliases": [
	                        "1b84433fb68b",
	                        "old-k8s-version-20220630210005-9950"
	                    ],
	                    "NetworkID": "2a33e496d49b578848c27ed72b0172cf6807dc7dbeec46561e901ef8145b93e7",
	                    "EndpointID": "e5ab3ea931a0687d4c2a11a5ee4ff0354548b1e6cef7dae6a9bdd8c529446748",
	                    "Gateway": "192.168.67.1",
	                    "IPAddress": "192.168.67.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "MacAddress": "02:42:c0:a8:43:02",
	                    "DriverOpts": null
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-20220630210005-9950 -n old-k8s-version-20220630210005-9950
helpers_test.go:244: <<< TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======>  post-mortem[TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop]: minikube logs <======
helpers_test.go:247: (dbg) Run:  out/minikube-linux-amd64 -p old-k8s-version-20220630210005-9950 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-amd64 -p old-k8s-version-20220630210005-9950 logs -n 25: (1.002326133s)
helpers_test.go:252: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop logs: 
-- stdout --
	* 
	* ==> Audit <==
	* |---------|------------------------------------------------------------|----------|---------|---------|---------------------|---------------------|
	| Command |                            Args                            | Profile  |  User   | Version |     Start Time      |      End Time       |
	|---------|------------------------------------------------------------|----------|---------|---------|---------------------|---------------------|
	| start   | -p newest-cni-20220630210514-9950 --memory=2200            | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | --alsologtostderr --wait=apiserver,system_pods,default_sa  |          |         |         |                     |                     |
	|         | --feature-gates ServerSideApply=true --network-plugin=cni  |          |         |         |                     |                     |
	|         | --extra-config=kubeadm.pod-network-cidr=192.168.111.111/16 |          |         |         |                     |                     |
	|         | --driver=docker  --container-runtime=containerd            |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                               |          |         |         |                     |                     |
	| ssh     | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | sudo crictl images -o json                                 |          |         |         |                     |                     |
	| pause   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                     |          |         |         |                     |                     |
	| unpause | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                     |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                             |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | disable-driver-mounts-20220630210659-9950                  |          |         |         |                     |                     |
	| start   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC |                     |
	|         | embed-certs-20220630210659-9950                            |          |         |         |                     |                     |
	|         | --memory=2200 --alsologtostderr                            |          |         |         |                     |                     |
	|         | --wait=true --embed-certs                                  |          |         |         |                     |                     |
	|         | --driver=docker                                            |          |         |         |                     |                     |
	|         | --container-runtime=containerd                             |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                               |          |         |         |                     |                     |
	| ssh     | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|         | sudo crictl images -o json                                 |          |         |         |                     |                     |
	| pause   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                     |          |         |         |                     |                     |
	| unpause | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                     |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	| delete  | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                             |          |         |         |                     |                     |
	| addons  | enable metrics-server -p                                   | minikube | jenkins | v1.26.0 | 30 Jun 22 21:12 UTC | 30 Jun 22 21:12 UTC |
	|         | old-k8s-version-20220630210005-9950                        |          |         |         |                     |                     |
	|         | --images=MetricsServer=k8s.gcr.io/echoserver:1.4           |          |         |         |                     |                     |
	|         | --registries=MetricsServer=fake.domain                     |          |         |         |                     |                     |
	| stop    | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:12 UTC | 30 Jun 22 21:12 UTC |
	|         | old-k8s-version-20220630210005-9950                        |          |         |         |                     |                     |
	|         | --alsologtostderr -v=3                                     |          |         |         |                     |                     |
	| addons  | enable dashboard -p                                        | minikube | jenkins | v1.26.0 | 30 Jun 22 21:12 UTC | 30 Jun 22 21:12 UTC |
	|         | old-k8s-version-20220630210005-9950                        |          |         |         |                     |                     |
	|         | --images=MetricsScraper=k8s.gcr.io/echoserver:1.4          |          |         |         |                     |                     |
	| start   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:12 UTC |                     |
	|         | old-k8s-version-20220630210005-9950                        |          |         |         |                     |                     |
	|         | --memory=2200 --alsologtostderr                            |          |         |         |                     |                     |
	|         | --wait=true --kvm-network=default                          |          |         |         |                     |                     |
	|         | --kvm-qemu-uri=qemu:///system                              |          |         |         |                     |                     |
	|         | --disable-driver-mounts                                    |          |         |         |                     |                     |
	|         | --keep-context=false                                       |          |         |         |                     |                     |
	|         | --driver=docker                                            |          |         |         |                     |                     |
	|         | --container-runtime=containerd                             |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.16.0                               |          |         |         |                     |                     |
	| addons  | enable metrics-server -p                                   | minikube | jenkins | v1.26.0 | 30 Jun 22 21:16 UTC | 30 Jun 22 21:16 UTC |
	|         | default-k8s-different-port-20220630210335-9950             |          |         |         |                     |                     |
	|         | --images=MetricsServer=k8s.gcr.io/echoserver:1.4           |          |         |         |                     |                     |
	|         | --registries=MetricsServer=fake.domain                     |          |         |         |                     |                     |
	| stop    | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:16 UTC | 30 Jun 22 21:16 UTC |
	|         | default-k8s-different-port-20220630210335-9950             |          |         |         |                     |                     |
	|         | --alsologtostderr -v=3                                     |          |         |         |                     |                     |
	| addons  | enable dashboard -p                                        | minikube | jenkins | v1.26.0 | 30 Jun 22 21:16 UTC | 30 Jun 22 21:16 UTC |
	|         | default-k8s-different-port-20220630210335-9950             |          |         |         |                     |                     |
	|         | --images=MetricsScraper=k8s.gcr.io/echoserver:1.4          |          |         |         |                     |                     |
	| start   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:16 UTC |                     |
	|         | default-k8s-different-port-20220630210335-9950             |          |         |         |                     |                     |
	|         | --memory=2200 --alsologtostderr --wait=true                |          |         |         |                     |                     |
	|         | --apiserver-port=8444 --driver=docker                      |          |         |         |                     |                     |
	|         |  --container-runtime=containerd                            |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                               |          |         |         |                     |                     |
	| addons  | enable metrics-server -p                                   | minikube | jenkins | v1.26.0 | 30 Jun 22 21:19 UTC | 30 Jun 22 21:19 UTC |
	|         | embed-certs-20220630210659-9950                            |          |         |         |                     |                     |
	|         | --images=MetricsServer=k8s.gcr.io/echoserver:1.4           |          |         |         |                     |                     |
	|         | --registries=MetricsServer=fake.domain                     |          |         |         |                     |                     |
	| stop    | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:19 UTC | 30 Jun 22 21:20 UTC |
	|         | embed-certs-20220630210659-9950                            |          |         |         |                     |                     |
	|         | --alsologtostderr -v=3                                     |          |         |         |                     |                     |
	| addons  | enable dashboard -p                                        | minikube | jenkins | v1.26.0 | 30 Jun 22 21:20 UTC | 30 Jun 22 21:20 UTC |
	|         | embed-certs-20220630210659-9950                            |          |         |         |                     |                     |
	|         | --images=MetricsScraper=k8s.gcr.io/echoserver:1.4          |          |         |         |                     |                     |
	| start   | -p                                                         | minikube | jenkins | v1.26.0 | 30 Jun 22 21:20 UTC |                     |
	|         | embed-certs-20220630210659-9950                            |          |         |         |                     |                     |
	|         | --memory=2200 --alsologtostderr                            |          |         |         |                     |                     |
	|         | --wait=true --embed-certs                                  |          |         |         |                     |                     |
	|         | --driver=docker                                            |          |         |         |                     |                     |
	|         | --container-runtime=containerd                             |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                               |          |         |         |                     |                     |
	|---------|------------------------------------------------------------|----------|---------|---------|---------------------|---------------------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2022/06/30 21:20:03
	Running on machine: ubuntu-20-agent-8
	Binary: Built with gc go1.18.3 for linux/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0630 21:20:03.147328  282690 out.go:296] Setting OutFile to fd 1 ...
	I0630 21:20:03.147439  282690 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 21:20:03.147448  282690 out.go:309] Setting ErrFile to fd 2...
	I0630 21:20:03.147453  282690 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 21:20:03.147898  282690 root.go:329] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/bin
	I0630 21:20:03.148141  282690 out.go:303] Setting JSON to false
	I0630 21:20:03.149531  282690 start.go:115] hostinfo: {"hostname":"ubuntu-20-agent-8","uptime":3755,"bootTime":1656620248,"procs":452,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1012-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0630 21:20:03.149604  282690 start.go:125] virtualization: kvm guest
	I0630 21:20:03.152275  282690 out.go:177] * [embed-certs-20220630210659-9950] minikube v1.26.0 on Ubuntu 20.04 (kvm/amd64)
	I0630 21:20:03.154290  282690 notify.go:193] Checking for updates...
	I0630 21:20:03.154307  282690 out.go:177]   - MINIKUBE_LOCATION=14420
	I0630 21:20:03.156071  282690 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0630 21:20:03.157769  282690 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:20:03.159343  282690 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube
	I0630 21:20:03.160888  282690 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0630 21:20:03.163346  282690 config.go:178] Loaded profile config "embed-certs-20220630210659-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:20:03.163802  282690 driver.go:360] Setting default libvirt URI to qemu:///system
	I0630 21:20:03.205706  282690 docker.go:137] docker version: linux-20.10.17
	I0630 21:20:03.205824  282690 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0630 21:20:03.318551  282690 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:8 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:43 OomKillDisable:true NGoroutines:44 SystemTime:2022-06-30 21:20:03.238323982 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1012-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexServ
erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662451712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-8 Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Client
Info:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
	I0630 21:20:03.318677  282690 docker.go:254] overlay module found
	I0630 21:20:03.322599  282690 out.go:177] * Using the docker driver based on existing profile
	I0630 21:20:03.324114  282690 start.go:284] selected driver: docker
	I0630 21:20:03.324129  282690 start.go:808] validating driver "docker" against &{Name:embed-certs-20220630210659-9950 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:embed-certs-20220630210659-9950 Namespace:d
efault APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[Dashboard:kubernetesui/dashboard:v2.6.0@sha256:4af9580485920635d888efe1eddbd67e12f9d5d84dba87100e93feb4e46636b3 MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddres
s: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 21:20:03.324222  282690 start.go:819] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0630 21:20:03.325145  282690 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0630 21:20:03.438547  282690 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:8 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:43 OomKillDisable:true NGoroutines:44 SystemTime:2022-06-30 21:20:03.358172615 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1012-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexServ
erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662451712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-8 Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Client
Info:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
	I0630 21:20:03.438832  282690 start_flags.go:853] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0630 21:20:03.438854  282690 cni.go:95] Creating CNI manager for ""
	I0630 21:20:03.438863  282690 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:20:03.438877  282690 start_flags.go:310] config:
	{Name:embed-certs-20220630210659-9950 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:embed-certs-20220630210659-9950 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:clus
ter.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[Dashboard:kubernetesui/dashboard:v2.6.0@sha256:4af9580485920635d888efe1eddbd67e12f9d5d84dba87100e93feb4e46636b3 MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0
m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 21:20:03.442075  282690 out.go:177] * Starting control plane node embed-certs-20220630210659-9950 in cluster embed-certs-20220630210659-9950
	I0630 21:20:03.443525  282690 cache.go:120] Beginning downloading kic base image for docker with containerd
	I0630 21:20:03.445355  282690 out.go:177] * Pulling base image ...
	I0630 21:20:03.446826  282690 preload.go:132] Checking if preload exists for k8s version v1.24.2 and runtime containerd
	I0630 21:20:03.446872  282690 preload.go:148] Found local preload: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-containerd-overlay2-amd64.tar.lz4
	I0630 21:20:03.446895  282690 cache.go:57] Caching tarball of preloaded images
	I0630 21:20:03.446927  282690 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e in local docker daemon
	I0630 21:20:03.447161  282690 preload.go:174] Found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-containerd-overlay2-amd64.tar.lz4 in cache, skipping download
	I0630 21:20:03.447178  282690 cache.go:60] Finished verifying existence of preloaded tar for  v1.24.2 on containerd
	I0630 21:20:03.447328  282690 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/config.json ...
	I0630 21:20:03.484347  282690 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e in local docker daemon, skipping pull
	I0630 21:20:03.484373  282690 cache.go:142] gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e exists in daemon, skipping load
	I0630 21:20:03.484390  282690 cache.go:208] Successfully downloaded all kic artifacts
	I0630 21:20:03.484431  282690 start.go:352] acquiring machines lock for embed-certs-20220630210659-9950: {Name:mk6619dbb09b46cdd2b244e5bf2112b3274a30ef Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0630 21:20:03.484542  282690 start.go:356] acquired machines lock for "embed-certs-20220630210659-9950" in 89.652µs
	I0630 21:20:03.484563  282690 start.go:94] Skipping create...Using existing machine configuration
	I0630 21:20:03.484568  282690 fix.go:55] fixHost starting: 
	I0630 21:20:03.484786  282690 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:20:03.518786  282690 fix.go:103] recreateIfNeeded on embed-certs-20220630210659-9950: state=Stopped err=<nil>
	W0630 21:20:03.518832  282690 fix.go:129] unexpected machine state, will restart: <nil>
	I0630 21:20:03.522271  282690 out.go:177] * Restarting existing docker container for "embed-certs-20220630210659-9950" ...
	I0630 21:20:01.182137  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:03.183061  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:02.393449  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:04.893746  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:03.523749  282690 cli_runner.go:164] Run: docker start embed-certs-20220630210659-9950
	I0630 21:20:03.930910  282690 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:20:03.968503  282690 kic.go:416] container "embed-certs-20220630210659-9950" state is running.
	I0630 21:20:03.968961  282690 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-20220630210659-9950
	I0630 21:20:04.005032  282690 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/config.json ...
	I0630 21:20:04.005301  282690 machine.go:88] provisioning docker machine ...
	I0630 21:20:04.005330  282690 ubuntu.go:169] provisioning hostname "embed-certs-20220630210659-9950"
	I0630 21:20:04.005375  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:20:04.043967  282690 main.go:134] libmachine: Using SSH client type: native
	I0630 21:20:04.044205  282690 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil>  [] 0s} 127.0.0.1 49442 <nil> <nil>}
	I0630 21:20:04.044233  282690 main.go:134] libmachine: About to run SSH command:
	sudo hostname embed-certs-20220630210659-9950 && echo "embed-certs-20220630210659-9950" | sudo tee /etc/hostname
	I0630 21:20:04.044882  282690 main.go:134] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:41696->127.0.0.1:49442: read: connection reset by peer
	I0630 21:20:07.174483  282690 main.go:134] libmachine: SSH cmd err, output: <nil>: embed-certs-20220630210659-9950
	
	I0630 21:20:07.174561  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:20:07.210487  282690 main.go:134] libmachine: Using SSH client type: native
	I0630 21:20:07.210668  282690 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil>  [] 0s} 127.0.0.1 49442 <nil> <nil>}
	I0630 21:20:07.210690  282690 main.go:134] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sembed-certs-20220630210659-9950' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 embed-certs-20220630210659-9950/g' /etc/hosts;
				else 
					echo '127.0.1.1 embed-certs-20220630210659-9950' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0630 21:20:07.329184  282690 main.go:134] libmachine: SSH cmd err, output: <nil>: 
	I0630 21:20:07.329234  282690 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube CaCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/c
erts/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube}
	I0630 21:20:07.329264  282690 ubuntu.go:177] setting up certificates
	I0630 21:20:07.329274  282690 provision.go:83] configureAuth start
	I0630 21:20:07.329332  282690 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-20220630210659-9950
	I0630 21:20:07.365729  282690 provision.go:138] copyHostCerts
	I0630 21:20:07.365803  282690 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem, removing ...
	I0630 21:20:07.365816  282690 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem
	I0630 21:20:07.365887  282690 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem (1679 bytes)
	I0630 21:20:07.365984  282690 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem, removing ...
	I0630 21:20:07.365998  282690 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem
	I0630 21:20:07.366039  282690 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem (1082 bytes)
	I0630 21:20:07.366110  282690 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem, removing ...
	I0630 21:20:07.366123  282690 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem
	I0630 21:20:07.366164  282690 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem (1123 bytes)
	I0630 21:20:07.366225  282690 provision.go:112] generating server cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem org=jenkins.embed-certs-20220630210659-9950 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-20220630210659-9950]
	I0630 21:20:07.595656  282690 provision.go:172] copyRemoteCerts
	I0630 21:20:07.595725  282690 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0630 21:20:07.595756  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:20:07.631338  282690 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49442 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:20:07.716832  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
	I0630 21:20:07.735870  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem --> /etc/docker/server.pem (1265 bytes)
	I0630 21:20:07.756354  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0630 21:20:07.775209  282690 provision.go:86] duration metric: configureAuth took 445.919443ms
	I0630 21:20:07.775233  282690 ubuntu.go:193] setting minikube options for container-runtime
	I0630 21:20:07.775399  282690 config.go:178] Loaded profile config "embed-certs-20220630210659-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:20:07.775412  282690 machine.go:91] provisioned docker machine in 3.770097214s
	I0630 21:20:07.775419  282690 start.go:306] post-start starting for "embed-certs-20220630210659-9950" (driver="docker")
	I0630 21:20:07.775425  282690 start.go:316] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0630 21:20:07.775465  282690 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0630 21:20:07.775498  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:20:07.811677  282690 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49442 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:20:07.897450  282690 ssh_runner.go:195] Run: cat /etc/os-release
	I0630 21:20:07.900657  282690 main.go:134] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0630 21:20:07.900688  282690 main.go:134] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0630 21:20:07.900696  282690 main.go:134] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0630 21:20:07.900702  282690 info.go:137] Remote host: Ubuntu 20.04.4 LTS
	I0630 21:20:07.900711  282690 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/addons for local assets ...
	I0630 21:20:07.900762  282690 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files for local assets ...
	I0630 21:20:07.900829  282690 filesync.go:149] local asset: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem -> 99502.pem in /etc/ssl/certs
	I0630 21:20:07.900909  282690 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0630 21:20:07.908065  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem --> /etc/ssl/certs/99502.pem (1708 bytes)
	I0630 21:20:07.926474  282690 start.go:309] post-start completed in 151.040627ms
	I0630 21:20:07.926557  282690 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0630 21:20:07.926600  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:20:07.963198  282690 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49442 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:20:08.045725  282690 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0630 21:20:08.049536  282690 fix.go:57] fixHost completed within 4.564962738s
	I0630 21:20:08.049568  282690 start.go:81] releasing machines lock for "embed-certs-20220630210659-9950", held for 4.56500909s
	I0630 21:20:08.049668  282690 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-20220630210659-9950
	I0630 21:20:08.085452  282690 ssh_runner.go:195] Run: systemctl --version
	I0630 21:20:08.085508  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:20:08.085526  282690 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/
	I0630 21:20:08.085584  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:20:08.125940  282690 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49442 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:20:08.126756  282690 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49442 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:20:05.682082  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:07.682788  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:07.393189  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:09.893794  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:08.209826  282690 ssh_runner.go:195] Run: sudo systemctl stop -f crio
	I0630 21:20:08.240545  282690 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0630 21:20:08.251830  282690 docker.go:179] disabling docker service ...
	I0630 21:20:08.251890  282690 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0630 21:20:08.263344  282690 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0630 21:20:08.272763  282690 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0630 21:20:08.347490  282690 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0630 21:20:08.430323  282690 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0630 21:20:08.439736  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
	image-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0630 21:20:08.453177  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*sandbox_image = .*$|sandbox_image = "k8s.gcr.io/pause:3.7"|' -i /etc/containerd/config.toml"
	I0630 21:20:08.461609  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*restrict_oom_score_adj = .*$|restrict_oom_score_adj = false|' -i /etc/containerd/config.toml"
	I0630 21:20:08.469975  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*SystemdCgroup = .*$|SystemdCgroup = false|' -i /etc/containerd/config.toml"
	I0630 21:20:08.478446  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*conf_dir = .*$|conf_dir = "/etc/cni/net.mk"|' -i /etc/containerd/config.toml"
	I0630 21:20:08.486889  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^# imports|imports = ["/etc/containerd/containerd.conf.d/02-containerd.conf"]|' -i /etc/containerd/config.toml"
	I0630 21:20:08.495251  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc/containerd/containerd.conf.d && printf %!s(MISSING) "dmVyc2lvbiA9IDIK" | base64 -d | sudo tee /etc/containerd/containerd.conf.d/02-containerd.conf"
	I0630 21:20:08.508868  282690 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0630 21:20:08.515626  282690 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0630 21:20:08.522606  282690 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0630 21:20:08.605769  282690 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0630 21:20:08.682128  282690 start.go:447] Will wait 60s for socket path /run/containerd/containerd.sock
	I0630 21:20:08.682202  282690 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
	I0630 21:20:08.686167  282690 start.go:468] Will wait 60s for crictl version
	I0630 21:20:08.686246  282690 ssh_runner.go:195] Run: sudo crictl version
	I0630 21:20:08.713091  282690 retry.go:31] will retry after 11.04660288s: Temporary Error: sudo crictl version: Process exited with status 1
	stdout:
	
	stderr:
	time="2022-06-30T21:20:08Z" level=fatal msg="getting the runtime version: rpc error: code = Unknown desc = server is not initialized yet"
	I0630 21:20:10.182344  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:12.182594  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:12.392956  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:14.393428  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:14.682680  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:17.182245  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:19.182817  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:19.761138  282690 ssh_runner.go:195] Run: sudo crictl version
	I0630 21:20:19.786289  282690 start.go:477] Version:  0.1.0
	RuntimeName:  containerd
	RuntimeVersion:  1.6.6
	RuntimeApiVersion:  v1alpha2
	I0630 21:20:19.786365  282690 ssh_runner.go:195] Run: containerd --version
	I0630 21:20:19.816281  282690 ssh_runner.go:195] Run: containerd --version
	I0630 21:20:19.848226  282690 out.go:177] * Preparing Kubernetes v1.24.2 on containerd 1.6.6 ...
	I0630 21:20:16.893342  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:18.893566  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:19.849919  282690 cli_runner.go:164] Run: docker network inspect embed-certs-20220630210659-9950 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0630 21:20:19.887550  282690 ssh_runner.go:195] Run: grep 192.168.94.1	host.minikube.internal$ /etc/hosts
	I0630 21:20:19.891143  282690 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.94.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0630 21:20:19.900924  282690 preload.go:132] Checking if preload exists for k8s version v1.24.2 and runtime containerd
	I0630 21:20:19.900991  282690 ssh_runner.go:195] Run: sudo crictl images --output json
	I0630 21:20:19.925400  282690 containerd.go:547] all images are preloaded for containerd runtime.
	I0630 21:20:19.925429  282690 containerd.go:461] Images already preloaded, skipping extraction
	I0630 21:20:19.925482  282690 ssh_runner.go:195] Run: sudo crictl images --output json
	I0630 21:20:19.950061  282690 containerd.go:547] all images are preloaded for containerd runtime.
	I0630 21:20:19.950082  282690 cache_images.go:84] Images are preloaded, skipping loading
	I0630 21:20:19.950125  282690 ssh_runner.go:195] Run: sudo crictl info
	I0630 21:20:19.974750  282690 cni.go:95] Creating CNI manager for ""
	I0630 21:20:19.974773  282690 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:20:19.974785  282690 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
	I0630 21:20:19.974799  282690 kubeadm.go:158] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.94.2 APIServerPort:8443 KubernetesVersion:v1.24.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:embed-certs-20220630210659-9950 NodeName:embed-certs-20220630210659-9950 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.94.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.94.2 CgroupDriver:cgroupfs ClientC
AFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}
	I0630 21:20:19.974955  282690 kubeadm.go:162] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.94.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: /run/containerd/containerd.sock
	  name: "embed-certs-20220630210659-9950"
	  kubeletExtraArgs:
	    node-ip: 192.168.94.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.94.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.24.2
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%!"(MISSING)
	  nodefs.inodesFree: "0%!"(MISSING)
	  imagefs.available: "0%!"(MISSING)
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0630 21:20:19.975056  282690 kubeadm.go:961] kubelet [Unit]
	Wants=containerd.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.24.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=embed-certs-20220630210659-9950 --image-service-endpoint=unix:///run/containerd/containerd.sock --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.94.2 --runtime-request-timeout=15m
	
	[Install]
	 config:
	{KubernetesVersion:v1.24.2 ClusterName:embed-certs-20220630210659-9950 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
	I0630 21:20:19.975119  282690 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.24.2
	I0630 21:20:19.982477  282690 binaries.go:44] Found k8s binaries, skipping transfer
	I0630 21:20:19.982537  282690 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0630 21:20:19.989867  282690 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (524 bytes)
	I0630 21:20:20.003413  282690 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0630 21:20:20.016549  282690 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2060 bytes)
	I0630 21:20:20.030557  282690 ssh_runner.go:195] Run: grep 192.168.94.2	control-plane.minikube.internal$ /etc/hosts
	I0630 21:20:20.033673  282690 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.94.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0630 21:20:20.043309  282690 certs.go:54] Setting up /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950 for IP: 192.168.94.2
	I0630 21:20:20.043426  282690 certs.go:182] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.key
	I0630 21:20:20.043474  282690 certs.go:182] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.key
	I0630 21:20:20.043588  282690 certs.go:298] skipping minikube-user signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/client.key
	I0630 21:20:20.043669  282690 certs.go:298] skipping minikube signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.key.ad8e880a
	I0630 21:20:20.043722  282690 certs.go:298] skipping aggregator signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.key
	I0630 21:20:20.043847  282690 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950.pem (1338 bytes)
	W0630 21:20:20.043888  282690 certs.go:384] ignoring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950_empty.pem, impossibly tiny 0 bytes
	I0630 21:20:20.043906  282690 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem (1679 bytes)
	I0630 21:20:20.043944  282690 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem (1082 bytes)
	I0630 21:20:20.043983  282690 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem (1123 bytes)
	I0630 21:20:20.044018  282690 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/key.pem (1679 bytes)
	I0630 21:20:20.044074  282690 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem (1708 bytes)
	I0630 21:20:20.044672  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
	I0630 21:20:20.063809  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I0630 21:20:20.082364  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0630 21:20:20.100953  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
	I0630 21:20:20.119042  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0630 21:20:20.138260  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
	I0630 21:20:20.156455  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0630 21:20:20.175178  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
	I0630 21:20:20.193932  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem --> /usr/share/ca-certificates/99502.pem (1708 bytes)
	I0630 21:20:20.213463  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0630 21:20:20.232837  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950.pem --> /usr/share/ca-certificates/9950.pem (1338 bytes)
	I0630 21:20:20.252510  282690 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0630 21:20:20.267375  282690 ssh_runner.go:195] Run: openssl version
	I0630 21:20:20.273228  282690 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/99502.pem && ln -fs /usr/share/ca-certificates/99502.pem /etc/ssl/certs/99502.pem"
	I0630 21:20:20.281805  282690 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/99502.pem
	I0630 21:20:20.285276  282690 certs.go:431] hashing: -rw-r--r-- 1 root root 1708 Jun 30 20:26 /usr/share/ca-certificates/99502.pem
	I0630 21:20:20.285328  282690 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/99502.pem
	I0630 21:20:20.290565  282690 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/99502.pem /etc/ssl/certs/3ec20f2e.0"
	I0630 21:20:20.298693  282690 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0630 21:20:20.306974  282690 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:20:20.310492  282690 certs.go:431] hashing: -rw-r--r-- 1 root root 1111 Jun 30 20:22 /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:20:20.310555  282690 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:20:20.315748  282690 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0630 21:20:20.323429  282690 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/9950.pem && ln -fs /usr/share/ca-certificates/9950.pem /etc/ssl/certs/9950.pem"
	I0630 21:20:20.331855  282690 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/9950.pem
	I0630 21:20:20.335469  282690 certs.go:431] hashing: -rw-r--r-- 1 root root 1338 Jun 30 20:26 /usr/share/ca-certificates/9950.pem
	I0630 21:20:20.335531  282690 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/9950.pem
	I0630 21:20:20.340482  282690 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/9950.pem /etc/ssl/certs/51391683.0"
	I0630 21:20:20.348339  282690 kubeadm.go:395] StartCluster: {Name:embed-certs-20220630210659-9950 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:embed-certs-20220630210659-9950 Namespace:default APIServerName
:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[Dashboard:kubernetesui/dashboard:v2.6.0@sha256:4af9580485920635d888efe1eddbd67e12f9d5d84dba87100e93feb4e46636b3 MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet:
MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 21:20:20.348468  282690 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
	I0630 21:20:20.348531  282690 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0630 21:20:20.375578  282690 cri.go:87] found id: "6bdce580a9d6963de5c12d9e017d5662e2685851e130abf85abf7ccd2206a8a6"
	I0630 21:20:20.375605  282690 cri.go:87] found id: "8341041be1bdbcf0e0425bd1832777e15b2ed89bf8696d0c78d14301820032c3"
	I0630 21:20:20.375615  282690 cri.go:87] found id: "157c2b0c199b65e53b31cbc33bd298586d30106a66d587ee22f9c486df45d1ba"
	I0630 21:20:20.375624  282690 cri.go:87] found id: "ccc3bef31fe3faba9ff6daab0d5ca071fed6adb37d8cc554c7399ac599691557"
	I0630 21:20:20.375637  282690 cri.go:87] found id: "d56e346d0980d838b9cd42c94d9e084ef84bb0fdeb4316ae2dd5c8a25cc054a1"
	I0630 21:20:20.375652  282690 cri.go:87] found id: "7734f08ca26708ce34ae224077718432c05bc3133a11bb3d600a7d29c4df0045"
	I0630 21:20:20.375660  282690 cri.go:87] found id: ""
	I0630 21:20:20.375709  282690 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
	I0630 21:20:20.388498  282690 cri.go:114] JSON = null
	W0630 21:20:20.388559  282690 kubeadm.go:402] unpause failed: list paused: list returned 0 containers, but ps returned 6
	I0630 21:20:20.388621  282690 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0630 21:20:20.396168  282690 kubeadm.go:410] found existing configuration files, will attempt cluster restart
	I0630 21:20:20.396200  282690 kubeadm.go:626] restartCluster start
	I0630 21:20:20.396246  282690 ssh_runner.go:195] Run: sudo test -d /data/minikube
	I0630 21:20:20.403017  282690 kubeadm.go:127] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:20.403674  282690 kubeconfig.go:116] verify returned: extract IP: "embed-certs-20220630210659-9950" does not appear in /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:20:20.404147  282690 kubeconfig.go:127] "embed-certs-20220630210659-9950" context is missing from /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig - will repair!
	I0630 21:20:20.404911  282690 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig: {Name:mk34e4a4e7b04f624b9adbda4f77ee20b38308ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:20:20.406647  282690 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
	I0630 21:20:20.413413  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:20.413466  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:20.421286  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:20.621671  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:20.621798  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:20.630547  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:20.821858  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:20.821957  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:20.830758  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:21.022078  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:21.022162  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:21.030900  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:21.222204  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:21.222293  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:21.231221  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:21.421485  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:21.421579  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:21.430528  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:21.621730  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:21.621832  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:21.630704  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:21.822018  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:21.822098  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:21.830851  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:22.022202  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:22.022287  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:22.031086  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:22.222404  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:22.222489  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:22.231324  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:22.421567  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:22.421655  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:22.430581  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:22.621941  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:22.622040  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:22.631867  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:22.822177  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:22.822278  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:22.832202  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:23.021427  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:23.021501  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:23.030217  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:21.682805  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:24.182683  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:21.393221  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:23.893682  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:23.221874  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:23.221961  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:23.230645  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:23.421956  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:23.422028  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:23.430894  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:23.430917  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:23.430954  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:23.439029  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:23.439054  282690 kubeadm.go:601] needs reconfigure: apiserver error: timed out waiting for the condition
	I0630 21:20:23.439061  282690 kubeadm.go:1092] stopping kube-system containers ...
	I0630 21:20:23.439074  282690 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name: Namespaces:[kube-system]}
	I0630 21:20:23.439116  282690 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0630 21:20:23.463122  282690 cri.go:87] found id: "6bdce580a9d6963de5c12d9e017d5662e2685851e130abf85abf7ccd2206a8a6"
	I0630 21:20:23.463146  282690 cri.go:87] found id: "8341041be1bdbcf0e0425bd1832777e15b2ed89bf8696d0c78d14301820032c3"
	I0630 21:20:23.463152  282690 cri.go:87] found id: "157c2b0c199b65e53b31cbc33bd298586d30106a66d587ee22f9c486df45d1ba"
	I0630 21:20:23.463158  282690 cri.go:87] found id: "ccc3bef31fe3faba9ff6daab0d5ca071fed6adb37d8cc554c7399ac599691557"
	I0630 21:20:23.463163  282690 cri.go:87] found id: "d56e346d0980d838b9cd42c94d9e084ef84bb0fdeb4316ae2dd5c8a25cc054a1"
	I0630 21:20:23.463170  282690 cri.go:87] found id: "7734f08ca26708ce34ae224077718432c05bc3133a11bb3d600a7d29c4df0045"
	I0630 21:20:23.463175  282690 cri.go:87] found id: ""
	I0630 21:20:23.463180  282690 cri.go:232] Stopping containers: [6bdce580a9d6963de5c12d9e017d5662e2685851e130abf85abf7ccd2206a8a6 8341041be1bdbcf0e0425bd1832777e15b2ed89bf8696d0c78d14301820032c3 157c2b0c199b65e53b31cbc33bd298586d30106a66d587ee22f9c486df45d1ba ccc3bef31fe3faba9ff6daab0d5ca071fed6adb37d8cc554c7399ac599691557 d56e346d0980d838b9cd42c94d9e084ef84bb0fdeb4316ae2dd5c8a25cc054a1 7734f08ca26708ce34ae224077718432c05bc3133a11bb3d600a7d29c4df0045]
	I0630 21:20:23.463219  282690 ssh_runner.go:195] Run: which crictl
	I0630 21:20:23.466097  282690 ssh_runner.go:195] Run: sudo /usr/bin/crictl stop 6bdce580a9d6963de5c12d9e017d5662e2685851e130abf85abf7ccd2206a8a6 8341041be1bdbcf0e0425bd1832777e15b2ed89bf8696d0c78d14301820032c3 157c2b0c199b65e53b31cbc33bd298586d30106a66d587ee22f9c486df45d1ba ccc3bef31fe3faba9ff6daab0d5ca071fed6adb37d8cc554c7399ac599691557 d56e346d0980d838b9cd42c94d9e084ef84bb0fdeb4316ae2dd5c8a25cc054a1 7734f08ca26708ce34ae224077718432c05bc3133a11bb3d600a7d29c4df0045
	I0630 21:20:23.491529  282690 ssh_runner.go:195] Run: sudo systemctl stop kubelet
	I0630 21:20:23.501548  282690 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0630 21:20:23.508513  282690 kubeadm.go:155] found existing configuration files:
	-rw------- 1 root root 5643 Jun 30 21:07 /etc/kubernetes/admin.conf
	-rw------- 1 root root 5652 Jun 30 21:07 /etc/kubernetes/controller-manager.conf
	-rw------- 1 root root 2063 Jun 30 21:07 /etc/kubernetes/kubelet.conf
	-rw------- 1 root root 5600 Jun 30 21:07 /etc/kubernetes/scheduler.conf
	
	I0630 21:20:23.508569  282690 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
	I0630 21:20:23.515331  282690 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
	I0630 21:20:23.522134  282690 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
	I0630 21:20:23.528625  282690 kubeadm.go:166] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:23.528674  282690 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
	I0630 21:20:23.535118  282690 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
	I0630 21:20:23.541759  282690 kubeadm.go:166] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:23.541806  282690 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
	I0630 21:20:23.547839  282690 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0630 21:20:23.554281  282690 kubeadm.go:703] reconfiguring cluster from /var/tmp/minikube/kubeadm.yaml
	I0630 21:20:23.554304  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:20:23.597418  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:20:24.204823  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:20:24.388425  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:20:24.446940  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:20:24.548581  282690 api_server.go:51] waiting for apiserver process to appear ...
	I0630 21:20:24.548652  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 21:20:25.058272  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 21:20:25.558267  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 21:20:25.634820  282690 api_server.go:71] duration metric: took 1.086232371s to wait for apiserver process to appear ...
	I0630 21:20:25.634853  282690 api_server.go:87] waiting for apiserver healthz status ...
	I0630 21:20:25.634866  282690 api_server.go:240] Checking apiserver healthz at https://192.168.94.2:8443/healthz ...
	I0630 21:20:25.635225  282690 api_server.go:256] stopped: https://192.168.94.2:8443/healthz: Get "https://192.168.94.2:8443/healthz": dial tcp 192.168.94.2:8443: connect: connection refused
	I0630 21:20:26.135955  282690 api_server.go:240] Checking apiserver healthz at https://192.168.94.2:8443/healthz ...
	I0630 21:20:26.183141  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:28.683133  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:29.023735  282690 api_server.go:266] https://192.168.94.2:8443/healthz returned 403:
	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
	W0630 21:20:29.023845  282690 api_server.go:102] status: https://192.168.94.2:8443/healthz returned error 403:
	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
	I0630 21:20:29.136115  282690 api_server.go:240] Checking apiserver healthz at https://192.168.94.2:8443/healthz ...
	I0630 21:20:29.142290  282690 api_server.go:266] https://192.168.94.2:8443/healthz returned 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/bootstrap-controller ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[-]poststarthook/apiservice-registration-controller failed: reason withheld
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	W0630 21:20:29.142324  282690 api_server.go:102] status: https://192.168.94.2:8443/healthz returned error 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/bootstrap-controller ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[-]poststarthook/apiservice-registration-controller failed: reason withheld
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	I0630 21:20:29.635779  282690 api_server.go:240] Checking apiserver healthz at https://192.168.94.2:8443/healthz ...
	I0630 21:20:29.641744  282690 api_server.go:266] https://192.168.94.2:8443/healthz returned 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/bootstrap-controller ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-registration-controller ok
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	W0630 21:20:29.641774  282690 api_server.go:102] status: https://192.168.94.2:8443/healthz returned error 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/bootstrap-controller ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-registration-controller ok
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	I0630 21:20:30.135899  282690 api_server.go:240] Checking apiserver healthz at https://192.168.94.2:8443/healthz ...
	I0630 21:20:30.140340  282690 api_server.go:266] https://192.168.94.2:8443/healthz returned 200:
	ok
	I0630 21:20:30.146945  282690 api_server.go:140] control plane version: v1.24.2
	I0630 21:20:30.146967  282690 api_server.go:130] duration metric: took 4.512109627s to wait for apiserver health ...
	I0630 21:20:30.146976  282690 cni.go:95] Creating CNI manager for ""
	I0630 21:20:30.146983  282690 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:20:30.149207  282690 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0630 21:20:26.393339  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:28.893287  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:30.893492  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:30.150766  282690 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0630 21:20:30.154566  282690 cni.go:189] applying CNI manifest using /var/lib/minikube/binaries/v1.24.2/kubectl ...
	I0630 21:20:30.154592  282690 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2429 bytes)
	I0630 21:20:30.168730  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0630 21:20:30.976925  282690 system_pods.go:43] waiting for kube-system pods to appear ...
	I0630 21:20:30.983901  282690 system_pods.go:59] 9 kube-system pods found
	I0630 21:20:30.983933  282690 system_pods.go:61] "coredns-6d4b75cb6d-87dwf" [11e7f3e7-24e8-4e14-b1f6-a7e2b9bcfb74] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.)
	I0630 21:20:30.983941  282690 system_pods.go:61] "etcd-embed-certs-20220630210659-9950" [c7597376-29d8-4a64-a014-1bca6b00b239] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
	I0630 21:20:30.983951  282690 system_pods.go:61] "kindnet-z7fgt" [9d385a59-b071-48be-b547-db80254669bc] Running / Ready:ContainersNotReady (containers with unready status: [kindnet-cni]) / ContainersReady:ContainersNotReady (containers with unready status: [kindnet-cni])
	I0630 21:20:30.983963  282690 system_pods.go:61] "kube-apiserver-embed-certs-20220630210659-9950" [101e1b1d-d8d3-49c5-b250-f9524145064b] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
	I0630 21:20:30.983978  282690 system_pods.go:61] "kube-controller-manager-embed-certs-20220630210659-9950" [f93c4f3d-22de-4c13-a12a-c8ae9d47911c] Running
	I0630 21:20:30.983988  282690 system_pods.go:61] "kube-proxy-jhw4d" [78ec1767-ed48-4f50-ab14-61149fad7e98] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])
	I0630 21:20:30.984003  282690 system_pods.go:61] "kube-scheduler-embed-certs-20220630210659-9950" [727ac744-99fa-4867-9662-83efb2a98b35] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
	I0630 21:20:30.984012  282690 system_pods.go:61] "metrics-server-5c6f97fb75-dvslz" [3a4167d3-f572-4a2c-813a-d2d22e47d17e] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.)
	I0630 21:20:30.984019  282690 system_pods.go:61] "storage-provisioner" [4e574839-6ecb-47ba-b5c4-e45d9b19efc7] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.)
	I0630 21:20:30.984028  282690 system_pods.go:74] duration metric: took 7.077293ms to wait for pod list to return data ...
	I0630 21:20:30.984038  282690 node_conditions.go:102] verifying NodePressure condition ...
	I0630 21:20:30.986718  282690 node_conditions.go:122] node storage ephemeral capacity is 304695084Ki
	I0630 21:20:30.986752  282690 node_conditions.go:123] node cpu capacity is 8
	I0630 21:20:30.986766  282690 node_conditions.go:105] duration metric: took 2.718274ms to run NodePressure ...
	I0630 21:20:30.986786  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:20:31.145954  282690 kubeadm.go:762] waiting for restarted kubelet to initialise ...
	I0630 21:20:31.149839  282690 kubeadm.go:777] kubelet initialised
	I0630 21:20:31.149867  282690 kubeadm.go:778] duration metric: took 3.887979ms waiting for restarted kubelet to initialise ...
	I0630 21:20:31.149877  282690 pod_ready.go:35] extra waiting up to 4m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0630 21:20:31.154561  282690 pod_ready.go:78] waiting up to 4m0s for pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace to be "Ready" ...
	I0630 21:20:30.683577  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:33.182578  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:33.392832  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:35.393314  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:33.160352  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:35.660314  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:35.182728  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:37.682510  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:37.893265  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:39.893463  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:38.160526  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:40.660894  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:39.683375  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:42.182068  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:44.183054  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:42.393015  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:44.893292  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:43.160483  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:45.660796  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:47.660953  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:46.683087  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:49.183229  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:46.893432  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:49.393236  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:50.161308  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:52.660155  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:51.682409  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:53.682570  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:51.393511  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:53.893578  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:54.661629  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:57.159920  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:55.682710  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:58.182130  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:56.393487  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:58.892932  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:00.893465  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:59.160128  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:01.160665  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:00.182447  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:02.182840  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:04.182886  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:03.392696  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:05.393231  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:03.661112  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:06.160443  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:06.682224  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:08.682691  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:07.893418  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:10.392505  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:08.160644  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:10.661019  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:12.661060  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:11.182893  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:13.182991  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:12.393783  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:14.893314  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:15.160327  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:17.660228  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:15.682251  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:17.683152  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:17.393363  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:19.390281  276064 pod_ready.go:81] duration metric: took 4m0.003663432s waiting for pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace to be "Ready" ...
	E0630 21:21:19.390317  276064 pod_ready.go:66] WaitExtra: waitPodCondition: timed out waiting 4m0s for pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace to be "Ready" (will not retry!)
	I0630 21:21:19.390344  276064 pod_ready.go:38] duration metric: took 4m0.009122224s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0630 21:21:19.390376  276064 kubeadm.go:630] restartCluster took 4m11.317474742s
	W0630 21:21:19.390560  276064 out.go:239] ! Unable to restart cluster, will reset it: extra: timed out waiting 4m0s for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready"
	I0630 21:21:19.390595  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm reset --cri-socket /run/containerd/containerd.sock --force"
	I0630 21:21:19.660421  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:22.160264  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:20.183474  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:22.682948  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:21.023971  276064 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm reset --cri-socket /run/containerd/containerd.sock --force": (1.633354294s)
	I0630 21:21:21.024036  276064 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 21:21:21.033944  276064 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0630 21:21:21.041255  276064 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver
	I0630 21:21:21.041307  276064 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0630 21:21:21.048131  276064 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0630 21:21:21.048170  276064 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0630 21:21:24.160315  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:26.660444  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:25.181883  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:27.183120  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:30.433489  276064 out.go:204]   - Generating certificates and keys ...
	I0630 21:21:30.436707  276064 out.go:204]   - Booting up control plane ...
	I0630 21:21:30.439842  276064 out.go:204]   - Configuring RBAC rules ...
	I0630 21:21:30.442245  276064 cni.go:95] Creating CNI manager for ""
	I0630 21:21:30.442271  276064 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:21:30.444232  276064 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0630 21:21:30.446289  276064 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0630 21:21:30.450161  276064 cni.go:189] applying CNI manifest using /var/lib/minikube/binaries/v1.24.2/kubectl ...
	I0630 21:21:30.450180  276064 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2429 bytes)
	I0630 21:21:30.464668  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0630 21:21:28.661012  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:31.160051  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:29.682587  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:31.682697  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:33.683054  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:31.250327  276064 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0630 21:21:31.250457  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:31.250483  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl label nodes minikube.k8s.io/version=v1.26.0 minikube.k8s.io/commit=251ffcec0e4c997cd7732864187747cc579943c9 minikube.k8s.io/name=default-k8s-different-port-20220630210335-9950 minikube.k8s.io/updated_at=2022_06_30T21_21_31_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:31.337104  276064 ops.go:34] apiserver oom_adj: -16
	I0630 21:21:31.337122  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:31.898846  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:32.398504  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:32.898395  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:33.399197  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:33.898224  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:34.399278  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:34.898766  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:35.399106  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:35.898541  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:33.160337  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:35.660572  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:37.660625  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:36.183245  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:38.681927  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:36.399149  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:36.899206  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:37.398969  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:37.898306  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:38.398247  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:38.898685  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:39.399050  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:39.899197  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:40.399284  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:40.898565  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:40.159296  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:42.160359  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:41.398285  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:41.899049  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:42.399136  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:42.898362  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:42.955690  276064 kubeadm.go:1045] duration metric: took 11.705297596s to wait for elevateKubeSystemPrivileges.
	I0630 21:21:42.955725  276064 kubeadm.go:397] StartCluster complete in 4m34.928502204s
	I0630 21:21:42.955749  276064 settings.go:142] acquiring lock: {Name:mkcbd229caa05b60d3551ef0b47eea08424c9b5d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:21:42.955839  276064 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:21:42.956940  276064 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig: {Name:mk34e4a4e7b04f624b9adbda4f77ee20b38308ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:21:43.471460  276064 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "default-k8s-different-port-20220630210335-9950" rescaled to 1
	I0630 21:21:43.471523  276064 start.go:208] Will wait 6m0s for node &{Name: IP:192.168.85.2 Port:8444 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0630 21:21:43.473505  276064 out.go:177] * Verifying Kubernetes components...
	I0630 21:21:43.471586  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0630 21:21:43.471607  276064 addons.go:412] enableAddons start: toEnable=map[dashboard:true metrics-server:true], additional=[]
	I0630 21:21:43.471793  276064 config.go:178] Loaded profile config "default-k8s-different-port-20220630210335-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:21:43.474864  276064 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 21:21:43.474932  276064 addons.go:65] Setting dashboard=true in profile "default-k8s-different-port-20220630210335-9950"
	I0630 21:21:43.474957  276064 addons.go:65] Setting default-storageclass=true in profile "default-k8s-different-port-20220630210335-9950"
	I0630 21:21:43.474976  276064 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "default-k8s-different-port-20220630210335-9950"
	I0630 21:21:43.474962  276064 addons.go:153] Setting addon dashboard=true in "default-k8s-different-port-20220630210335-9950"
	W0630 21:21:43.475061  276064 addons.go:162] addon dashboard should already be in state true
	I0630 21:21:43.475110  276064 host.go:66] Checking if "default-k8s-different-port-20220630210335-9950" exists ...
	I0630 21:21:43.474944  276064 addons.go:65] Setting metrics-server=true in profile "default-k8s-different-port-20220630210335-9950"
	I0630 21:21:43.475161  276064 addons.go:153] Setting addon metrics-server=true in "default-k8s-different-port-20220630210335-9950"
	W0630 21:21:43.475179  276064 addons.go:162] addon metrics-server should already be in state true
	I0630 21:21:43.475224  276064 host.go:66] Checking if "default-k8s-different-port-20220630210335-9950" exists ...
	I0630 21:21:43.474932  276064 addons.go:65] Setting storage-provisioner=true in profile "default-k8s-different-port-20220630210335-9950"
	I0630 21:21:43.475323  276064 cli_runner.go:164] Run: docker container inspect default-k8s-different-port-20220630210335-9950 --format={{.State.Status}}
	I0630 21:21:43.475319  276064 addons.go:153] Setting addon storage-provisioner=true in "default-k8s-different-port-20220630210335-9950"
	W0630 21:21:43.475359  276064 addons.go:162] addon storage-provisioner should already be in state true
	I0630 21:21:43.475407  276064 host.go:66] Checking if "default-k8s-different-port-20220630210335-9950" exists ...
	I0630 21:21:43.475586  276064 cli_runner.go:164] Run: docker container inspect default-k8s-different-port-20220630210335-9950 --format={{.State.Status}}
	I0630 21:21:43.475682  276064 cli_runner.go:164] Run: docker container inspect default-k8s-different-port-20220630210335-9950 --format={{.State.Status}}
	I0630 21:21:43.475805  276064 cli_runner.go:164] Run: docker container inspect default-k8s-different-port-20220630210335-9950 --format={{.State.Status}}
	I0630 21:21:43.525211  276064 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0630 21:21:43.526633  276064 addons.go:345] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 21:21:43.526654  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0630 21:21:43.526703  276064 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	I0630 21:21:43.529674  276064 out.go:177]   - Using image fake.domain/k8s.gcr.io/echoserver:1.4
	I0630 21:21:43.531135  276064 addons.go:345] installing /etc/kubernetes/addons/metrics-apiservice.yaml
	I0630 21:21:43.531154  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
	I0630 21:21:43.532388  276064 out.go:177]   - Using image kubernetesui/dashboard:v2.6.0
	I0630 21:21:43.531211  276064 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	I0630 21:21:43.534873  276064 out.go:177]   - Using image k8s.gcr.io/echoserver:1.4
	I0630 21:21:40.682196  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:42.682640  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:43.536294  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-ns.yaml
	I0630 21:21:43.536318  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
	I0630 21:21:43.535327  276064 addons.go:153] Setting addon default-storageclass=true in "default-k8s-different-port-20220630210335-9950"
	I0630 21:21:43.536373  276064 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	W0630 21:21:43.536390  276064 addons.go:162] addon default-storageclass should already be in state true
	I0630 21:21:43.536436  276064 host.go:66] Checking if "default-k8s-different-port-20220630210335-9950" exists ...
	I0630 21:21:43.536996  276064 cli_runner.go:164] Run: docker container inspect default-k8s-different-port-20220630210335-9950 --format={{.State.Status}}
	I0630 21:21:43.568952  276064 node_ready.go:35] waiting up to 6m0s for node "default-k8s-different-port-20220630210335-9950" to be "Ready" ...
	I0630 21:21:43.569160  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.85.1 host.minikube.internal\n           fallthrough\n        }' | sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0630 21:21:43.573720  276064 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49437 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/default-k8s-different-port-20220630210335-9950/id_rsa Username:docker}
	I0630 21:21:43.585132  276064 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49437 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/default-k8s-different-port-20220630210335-9950/id_rsa Username:docker}
	I0630 21:21:43.585211  276064 addons.go:345] installing /etc/kubernetes/addons/storageclass.yaml
	I0630 21:21:43.585226  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0630 21:21:43.585277  276064 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	I0630 21:21:43.592285  276064 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49437 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/default-k8s-different-port-20220630210335-9950/id_rsa Username:docker}
	I0630 21:21:43.623221  276064 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49437 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/default-k8s-different-port-20220630210335-9950/id_rsa Username:docker}
	I0630 21:21:43.744945  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
	I0630 21:21:43.744974  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
	I0630 21:21:43.747847  276064 addons.go:345] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
	I0630 21:21:43.747873  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1820 bytes)
	I0630 21:21:43.748263  276064 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 21:21:43.924785  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
	I0630 21:21:43.924816  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
	I0630 21:21:43.928618  276064 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0630 21:21:43.940306  276064 addons.go:345] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
	I0630 21:21:43.940338  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
	I0630 21:21:43.950742  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-configmap.yaml
	I0630 21:21:43.950768  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
	I0630 21:21:44.037060  276064 addons.go:345] installing /etc/kubernetes/addons/metrics-server-service.yaml
	I0630 21:21:44.037089  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
	I0630 21:21:44.047010  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-dp.yaml
	I0630 21:21:44.047034  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4196 bytes)
	I0630 21:21:44.135080  276064 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I0630 21:21:44.140888  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-role.yaml
	I0630 21:21:44.140919  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
	I0630 21:21:44.230459  276064 start.go:806] {"host.minikube.internal": 192.168.85.1} host record injected into CoreDNS
	I0630 21:21:44.235255  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
	I0630 21:21:44.235283  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
	I0630 21:21:44.327158  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-sa.yaml
	I0630 21:21:44.327192  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
	I0630 21:21:44.351459  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-secret.yaml
	I0630 21:21:44.351527  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
	I0630 21:21:44.448179  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-svc.yaml
	I0630 21:21:44.448218  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
	I0630 21:21:44.537927  276064 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	I0630 21:21:45.130031  276064 addons.go:383] Verifying addon metrics-server=true in "default-k8s-different-port-20220630210335-9950"
	I0630 21:21:45.539430  276064 out.go:177] * Enabled addons: storage-provisioner, default-storageclass, metrics-server, dashboard
	I0630 21:21:45.540750  276064 addons.go:414] enableAddons completed in 2.0691399s
	I0630 21:21:45.575595  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:21:44.660831  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:47.160149  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:45.182445  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:47.682514  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:47.576330  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:21:49.576407  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:21:49.160793  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:51.660805  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:50.182451  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:52.183083  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:52.076426  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:21:54.076887  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:21:54.161146  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:56.660728  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:54.683102  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:57.182501  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:59.182957  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:56.575738  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:21:58.576604  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:00.577162  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:21:59.160517  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:01.160700  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:01.183043  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:03.682640  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:03.075860  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:05.076679  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:03.661117  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:06.160731  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:05.682843  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:08.182414  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:07.576553  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:10.075989  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:08.660876  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:11.160848  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:10.682414  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:12.682830  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:12.076661  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:14.576273  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:13.660019  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:15.660934  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:15.183230  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:17.681937  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:17.075764  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:19.076352  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:18.160512  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:20.661337  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:19.682685  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:22.182341  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:21.575906  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:24.076044  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:23.159968  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:25.659994  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:27.660386  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:24.682559  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:26.682712  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:28.682765  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:26.076272  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:28.076381  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:30.576589  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:29.660781  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:31.661081  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:31.182114  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:33.182667  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:33.075544  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:35.076859  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:34.160031  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:36.174889  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:35.682410  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:37.682440  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:37.576222  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:40.076094  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:38.660329  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:40.661271  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:39.682506  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:42.182441  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:44.182613  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:42.076569  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:44.575778  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:43.160906  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:45.660687  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:47.660756  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:46.182890  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:48.682065  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:50.184705  271327 node_ready.go:38] duration metric: took 4m0.008399385s waiting for node "old-k8s-version-20220630210005-9950" to be "Ready" ...
	I0630 21:22:50.186899  271327 out.go:177] 
	W0630 21:22:50.188676  271327 out.go:239] X Exiting due to GUEST_START: wait 6m0s for node: waiting for node to be ready: waitNodeCondition: timed out waiting for the condition
	W0630 21:22:50.188714  271327 out.go:239] * 
	W0630 21:22:50.189487  271327 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0630 21:22:50.191389  271327 out.go:177] 
	I0630 21:22:47.075947  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:49.576265  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:50.159356  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:52.163951  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:52.075526  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:54.076399  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:54.660447  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:57.160029  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:56.575822  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:58.576331  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:00.576702  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:59.160433  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:01.660547  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:03.076469  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:05.576257  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:03.660907  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:06.160339  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:08.076793  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:10.576173  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:08.160593  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:10.660347  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:12.660595  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:13.075956  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:15.076120  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:15.160070  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:17.660236  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:17.576068  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:20.076292  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:20.159819  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:22.159969  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:22.076376  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:24.576689  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:24.160202  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:26.160569  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:27.075866  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:29.075916  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:28.660765  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:30.661044  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:31.076034  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:33.076065  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:35.575815  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:33.160787  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:35.660078  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:37.660223  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:38.076264  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:40.076307  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:39.661253  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:42.160767  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:42.576389  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:45.076289  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:44.660279  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:46.660767  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:47.576205  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:50.076370  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:49.159959  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:51.160087  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:52.576483  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:55.076140  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:53.160885  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:55.660365  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:57.077197  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:59.575847  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:58.160601  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:00.660863  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:02.076497  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:04.576615  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:03.160979  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:05.661301  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:07.076328  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:09.076375  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:08.160501  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:10.661257  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:11.575987  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:13.576105  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:15.576639  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:13.160653  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:15.660136  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:18.076538  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:20.576354  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:18.160271  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:20.660902  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:23.076485  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:25.575931  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:23.160075  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:25.160311  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:27.660413  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:28.076238  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:30.076402  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:30.159564  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:31.157632  282690 pod_ready.go:81] duration metric: took 4m0.003038156s waiting for pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace to be "Ready" ...
	E0630 21:24:31.157659  282690 pod_ready.go:66] WaitExtra: waitPodCondition: timed out waiting 4m0s for pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace to be "Ready" (will not retry!)
	I0630 21:24:31.157707  282690 pod_ready.go:38] duration metric: took 4m0.007820375s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0630 21:24:31.157735  282690 kubeadm.go:630] restartCluster took 4m10.761529656s
	W0630 21:24:31.157891  282690 out.go:239] ! Unable to restart cluster, will reset it: extra: timed out waiting 4m0s for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready"
	I0630 21:24:31.157919  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm reset --cri-socket /run/containerd/containerd.sock --force"
	I0630 21:24:32.851642  282690 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm reset --cri-socket /run/containerd/containerd.sock --force": (1.693695416s)
	I0630 21:24:32.851727  282690 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 21:24:32.861758  282690 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0630 21:24:32.869625  282690 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver
	I0630 21:24:32.869693  282690 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0630 21:24:32.876878  282690 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0630 21:24:32.876929  282690 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0630 21:24:32.076763  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:34.576381  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:36.576542  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:39.075659  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:41.836005  282690 out.go:204]   - Generating certificates and keys ...
	I0630 21:24:41.839508  282690 out.go:204]   - Booting up control plane ...
	I0630 21:24:41.842351  282690 out.go:204]   - Configuring RBAC rules ...
	I0630 21:24:41.844644  282690 cni.go:95] Creating CNI manager for ""
	I0630 21:24:41.844675  282690 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:24:41.846424  282690 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0630 21:24:41.847990  282690 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0630 21:24:41.853099  282690 cni.go:189] applying CNI manifest using /var/lib/minikube/binaries/v1.24.2/kubectl ...
	I0630 21:24:41.853126  282690 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2429 bytes)
	I0630 21:24:41.932756  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0630 21:24:42.729823  282690 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0630 21:24:42.729895  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:42.729926  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl label nodes minikube.k8s.io/version=v1.26.0 minikube.k8s.io/commit=251ffcec0e4c997cd7732864187747cc579943c9 minikube.k8s.io/name=embed-certs-20220630210659-9950 minikube.k8s.io/updated_at=2022_06_30T21_24_42_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:42.738247  282690 ops.go:34] apiserver oom_adj: -16
	I0630 21:24:42.834211  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:41.076287  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:43.076543  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:45.576221  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:43.427269  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:43.927268  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:44.426722  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:44.926851  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:45.427106  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:45.927276  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:46.427354  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:46.926751  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:47.426882  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:47.927284  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:48.076060  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:50.575977  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:48.427353  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:48.927037  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:49.426521  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:49.926695  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:50.426914  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:50.927459  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:51.427334  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:51.927468  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:52.427189  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:52.927285  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:53.426965  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:53.926595  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:53.987285  282690 kubeadm.go:1045] duration metric: took 11.25744575s to wait for elevateKubeSystemPrivileges.
	I0630 21:24:53.987312  282690 kubeadm.go:397] StartCluster complete in 4m33.638985641s
	I0630 21:24:53.987328  282690 settings.go:142] acquiring lock: {Name:mkcbd229caa05b60d3551ef0b47eea08424c9b5d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:24:53.987411  282690 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:24:53.988694  282690 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig: {Name:mk34e4a4e7b04f624b9adbda4f77ee20b38308ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:24:54.505472  282690 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "embed-certs-20220630210659-9950" rescaled to 1
	I0630 21:24:54.505546  282690 start.go:208] Will wait 6m0s for node &{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0630 21:24:54.505581  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0630 21:24:54.507434  282690 out.go:177] * Verifying Kubernetes components...
	I0630 21:24:54.505671  282690 addons.go:412] enableAddons start: toEnable=map[dashboard:true metrics-server:true], additional=[]
	I0630 21:24:54.507512  282690 addons.go:65] Setting storage-provisioner=true in profile "embed-certs-20220630210659-9950"
	I0630 21:24:54.507530  282690 addons.go:153] Setting addon storage-provisioner=true in "embed-certs-20220630210659-9950"
	I0630 21:24:54.505785  282690 config.go:178] Loaded profile config "embed-certs-20220630210659-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:24:54.508995  282690 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 21:24:54.507534  282690 addons.go:65] Setting dashboard=true in profile "embed-certs-20220630210659-9950"
	I0630 21:24:54.509033  282690 addons.go:153] Setting addon dashboard=true in "embed-certs-20220630210659-9950"
	W0630 21:24:54.509043  282690 addons.go:162] addon dashboard should already be in state true
	I0630 21:24:54.507547  282690 addons.go:65] Setting default-storageclass=true in profile "embed-certs-20220630210659-9950"
	I0630 21:24:54.509118  282690 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "embed-certs-20220630210659-9950"
	I0630 21:24:54.507548  282690 addons.go:65] Setting metrics-server=true in profile "embed-certs-20220630210659-9950"
	W0630 21:24:54.507573  282690 addons.go:162] addon storage-provisioner should already be in state true
	I0630 21:24:54.509134  282690 host.go:66] Checking if "embed-certs-20220630210659-9950" exists ...
	I0630 21:24:54.509177  282690 host.go:66] Checking if "embed-certs-20220630210659-9950" exists ...
	I0630 21:24:54.509200  282690 addons.go:153] Setting addon metrics-server=true in "embed-certs-20220630210659-9950"
	W0630 21:24:54.509223  282690 addons.go:162] addon metrics-server should already be in state true
	I0630 21:24:54.509308  282690 host.go:66] Checking if "embed-certs-20220630210659-9950" exists ...
	I0630 21:24:54.509462  282690 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:24:54.509581  282690 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:24:54.509613  282690 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:24:54.509797  282690 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:24:54.560813  282690 out.go:177]   - Using image fake.domain/k8s.gcr.io/echoserver:1.4
	I0630 21:24:54.562228  282690 addons.go:345] installing /etc/kubernetes/addons/metrics-apiservice.yaml
	I0630 21:24:54.562250  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
	I0630 21:24:54.566558  282690 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0630 21:24:54.563422  282690 addons.go:153] Setting addon default-storageclass=true in "embed-certs-20220630210659-9950"
	I0630 21:24:54.564610  282690 out.go:177]   - Using image kubernetesui/dashboard:v2.6.0
	I0630 21:24:54.564664  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	W0630 21:24:54.566619  282690 addons.go:162] addon default-storageclass should already be in state true
	I0630 21:24:54.568042  282690 addons.go:345] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 21:24:54.568076  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0630 21:24:54.568138  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:24:54.568049  282690 host.go:66] Checking if "embed-certs-20220630210659-9950" exists ...
	I0630 21:24:54.568896  282690 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:24:54.571125  282690 out.go:177]   - Using image k8s.gcr.io/echoserver:1.4
	I0630 21:24:52.576199  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:54.577462  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:54.573220  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-ns.yaml
	I0630 21:24:54.573240  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
	I0630 21:24:54.573296  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:24:54.596761  282690 node_ready.go:35] waiting up to 6m0s for node "embed-certs-20220630210659-9950" to be "Ready" ...
	I0630 21:24:54.596796  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.94.1 host.minikube.internal\n           fallthrough\n        }' | sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0630 21:24:54.622285  282690 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49442 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:24:54.625192  282690 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49442 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:24:54.629199  282690 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49442 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:24:54.632573  282690 addons.go:345] installing /etc/kubernetes/addons/storageclass.yaml
	I0630 21:24:54.632600  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0630 21:24:54.632654  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:24:54.674915  282690 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49442 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:24:54.846449  282690 addons.go:345] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
	I0630 21:24:54.846481  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1820 bytes)
	I0630 21:24:54.938792  282690 addons.go:345] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
	I0630 21:24:54.938872  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
	I0630 21:24:54.943079  282690 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0630 21:24:54.947159  282690 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 21:24:54.947675  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
	I0630 21:24:54.947698  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
	I0630 21:24:55.026994  282690 addons.go:345] installing /etc/kubernetes/addons/metrics-server-service.yaml
	I0630 21:24:55.027031  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
	I0630 21:24:55.035197  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
	I0630 21:24:55.035232  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
	I0630 21:24:55.053605  282690 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I0630 21:24:55.126653  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-configmap.yaml
	I0630 21:24:55.126705  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
	I0630 21:24:55.146581  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-dp.yaml
	I0630 21:24:55.146621  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4196 bytes)
	I0630 21:24:55.327942  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-role.yaml
	I0630 21:24:55.328024  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
	I0630 21:24:55.343459  282690 start.go:806] {"host.minikube.internal": 192.168.94.1} host record injected into CoreDNS
	I0630 21:24:55.432902  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
	I0630 21:24:55.432936  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
	I0630 21:24:55.449659  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-sa.yaml
	I0630 21:24:55.449700  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
	I0630 21:24:55.535585  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-secret.yaml
	I0630 21:24:55.535622  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
	I0630 21:24:55.637082  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-svc.yaml
	I0630 21:24:55.637110  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
	I0630 21:24:55.654090  282690 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	I0630 21:24:56.256357  282690 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (1.202695189s)
	I0630 21:24:56.256419  282690 addons.go:383] Verifying addon metrics-server=true in "embed-certs-20220630210659-9950"
	I0630 21:24:56.635370  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:24:57.057755  282690 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (1.403598153s)
	I0630 21:24:57.059648  282690 out.go:177] * Enabled addons: default-storageclass, storage-provisioner, metrics-server, dashboard
	I0630 21:24:57.061353  282690 addons.go:414] enableAddons completed in 2.555682965s
	I0630 21:24:57.076377  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:59.575515  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:59.133305  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:01.133976  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:01.575803  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:03.576220  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:05.576603  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:03.633140  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:05.633312  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:07.633508  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:08.075989  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:10.576424  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:09.633916  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:12.134025  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:13.075816  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:15.076512  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:14.134148  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:16.633590  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:17.575814  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:19.576180  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:19.133861  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:21.634052  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:22.076523  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:24.076612  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:23.634100  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:26.133369  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:28.133752  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:26.076674  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:28.575901  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:30.134009  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:32.633645  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:31.076339  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:33.576385  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:34.633970  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:37.133998  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:36.076191  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:38.576126  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:40.576363  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:39.633552  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:42.133635  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:43.076600  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:43.577767  276064 node_ready.go:38] duration metric: took 4m0.008779238s waiting for node "default-k8s-different-port-20220630210335-9950" to be "Ready" ...
	I0630 21:25:43.580054  276064 out.go:177] 
	W0630 21:25:43.581406  276064 out.go:239] X Exiting due to GUEST_START: wait 6m0s for node: waiting for node to be ready: waitNodeCondition: timed out waiting for the condition
	W0630 21:25:43.581422  276064 out.go:239] * 
	W0630 21:25:43.582123  276064 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0630 21:25:43.583833  276064 out.go:177] 
	I0630 21:25:44.133850  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:46.633832  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:48.633923  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:51.133282  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:53.134021  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:55.134340  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:57.633598  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:59.633912  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:01.634030  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:04.134240  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:06.634341  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:09.134132  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:11.633755  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:13.633838  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:16.134412  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:18.634048  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:21.133258  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:23.134085  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:25.633525  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:27.633880  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:29.634672  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:32.133127  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:34.133922  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:36.134141  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:38.635943  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:41.134059  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:43.634129  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:46.133833  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:48.634266  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:51.133583  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:53.633861  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:55.634000  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:57.634221  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:00.134428  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:02.634184  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:04.634236  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:07.133392  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:09.133620  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:11.133918  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:13.633511  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:15.634578  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:18.134059  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:20.633162  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:22.634065  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:25.133441  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:27.133812  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:29.634200  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:32.133633  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:34.634090  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:37.134098  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:39.634528  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:42.134216  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:44.633646  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:46.633772  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:49.133433  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:51.633343  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:54.133271  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:56.133890  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:58.633874  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:01.133490  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:03.634155  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:06.133638  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:08.134014  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:10.633584  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:12.633988  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:15.133284  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:17.633303  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:19.633472  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:21.633579  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:24.133628  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:26.633535  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:29.133336  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:31.134181  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:33.633631  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:35.634122  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:38.134153  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:40.634086  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:43.134075  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:45.633956  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:47.634182  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:50.133652  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:52.633744  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:54.635658  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:54.635684  282690 node_ready.go:38] duration metric: took 4m0.038888758s waiting for node "embed-certs-20220630210659-9950" to be "Ready" ...
	I0630 21:28:54.638083  282690 out.go:177] 
	W0630 21:28:54.639729  282690 out.go:239] X Exiting due to GUEST_START: wait 6m0s for node: waiting for node to be ready: waitNodeCondition: timed out waiting for the condition
	W0630 21:28:54.639748  282690 out.go:239] * 
	W0630 21:28:54.640518  282690 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0630 21:28:54.642114  282690 out.go:177] 
	
	* 
	* ==> container status <==
	* CONTAINER           IMAGE               CREATED             STATE               NAME                      ATTEMPT             POD ID
	50775eb30f76a       6fb66cd78abfe       46 seconds ago      Running             kindnet-cni               4                   1273bf7fb0caa
	b65d598df0518       6fb66cd78abfe       4 minutes ago       Exited              kindnet-cni               3                   1273bf7fb0caa
	21661943a8d48       c21b0c7400f98       13 minutes ago      Running             kube-proxy                0                   cb02ca2270bd9
	4d472dfb5cbc3       b305571ca60a5       13 minutes ago      Running             kube-apiserver            0                   9fa7cfba92b44
	3812d0fe0857b       301ddc62b80b1       13 minutes ago      Running             kube-scheduler            0                   619d41221365d
	331440287c350       b2756210eeabf       13 minutes ago      Running             etcd                      0                   27998a6f37b0a
	765fc80bc943e       06a629a7e51cd       13 minutes ago      Running             kube-controller-manager   0                   32cbcbc6a054b
	
	* 
	* ==> containerd <==
	* -- Logs begin at Thu 2022-06-30 21:12:55 UTC, end at Thu 2022-06-30 21:31:53 UTC. --
	Jun 30 21:24:12 old-k8s-version-20220630210005-9950 containerd[394]: time="2022-06-30T21:24:12.431782888Z" level=info msg="RemoveContainer for \"454b40bfbcac196b43e741f3840736723df552ee910722c17916deaecfd68bce\" returns successfully"
	Jun 30 21:24:24 old-k8s-version-20220630210005-9950 containerd[394]: time="2022-06-30T21:24:24.835544936Z" level=info msg="CreateContainer within sandbox \"1273bf7fb0caa4bcdd8ca108e6840479675a95d99e48286d8f8e730189bd641d\" for container &ContainerMetadata{Name:kindnet-cni,Attempt:2,}"
	Jun 30 21:24:24 old-k8s-version-20220630210005-9950 containerd[394]: time="2022-06-30T21:24:24.849263122Z" level=info msg="CreateContainer within sandbox \"1273bf7fb0caa4bcdd8ca108e6840479675a95d99e48286d8f8e730189bd641d\" for &ContainerMetadata{Name:kindnet-cni,Attempt:2,} returns container id \"466dbbd160134cb4ef5e989ea7df17b5c53fe887da06bb45d98d077ed5b802d6\""
	Jun 30 21:24:24 old-k8s-version-20220630210005-9950 containerd[394]: time="2022-06-30T21:24:24.849769854Z" level=info msg="StartContainer for \"466dbbd160134cb4ef5e989ea7df17b5c53fe887da06bb45d98d077ed5b802d6\""
	Jun 30 21:24:25 old-k8s-version-20220630210005-9950 containerd[394]: time="2022-06-30T21:24:25.028237761Z" level=info msg="StartContainer for \"466dbbd160134cb4ef5e989ea7df17b5c53fe887da06bb45d98d077ed5b802d6\" returns successfully"
	Jun 30 21:27:05 old-k8s-version-20220630210005-9950 containerd[394]: time="2022-06-30T21:27:05.354294770Z" level=info msg="shim disconnected" id=466dbbd160134cb4ef5e989ea7df17b5c53fe887da06bb45d98d077ed5b802d6
	Jun 30 21:27:05 old-k8s-version-20220630210005-9950 containerd[394]: time="2022-06-30T21:27:05.354358839Z" level=warning msg="cleaning up after shim disconnected" id=466dbbd160134cb4ef5e989ea7df17b5c53fe887da06bb45d98d077ed5b802d6 namespace=k8s.io
	Jun 30 21:27:05 old-k8s-version-20220630210005-9950 containerd[394]: time="2022-06-30T21:27:05.354372001Z" level=info msg="cleaning up dead shim"
	Jun 30 21:27:05 old-k8s-version-20220630210005-9950 containerd[394]: time="2022-06-30T21:27:05.364052701Z" level=warning msg="cleanup warnings time=\"2022-06-30T21:27:05Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=5792 runtime=io.containerd.runc.v2\n"
	Jun 30 21:27:05 old-k8s-version-20220630210005-9950 containerd[394]: time="2022-06-30T21:27:05.709403425Z" level=info msg="RemoveContainer for \"4f9dd94adfa30343e4c2421831d64434853197db25d1394d119c4cb5ec099f61\""
	Jun 30 21:27:05 old-k8s-version-20220630210005-9950 containerd[394]: time="2022-06-30T21:27:05.714779225Z" level=info msg="RemoveContainer for \"4f9dd94adfa30343e4c2421831d64434853197db25d1394d119c4cb5ec099f61\" returns successfully"
	Jun 30 21:27:34 old-k8s-version-20220630210005-9950 containerd[394]: time="2022-06-30T21:27:34.835425293Z" level=info msg="CreateContainer within sandbox \"1273bf7fb0caa4bcdd8ca108e6840479675a95d99e48286d8f8e730189bd641d\" for container &ContainerMetadata{Name:kindnet-cni,Attempt:3,}"
	Jun 30 21:27:34 old-k8s-version-20220630210005-9950 containerd[394]: time="2022-06-30T21:27:34.848901955Z" level=info msg="CreateContainer within sandbox \"1273bf7fb0caa4bcdd8ca108e6840479675a95d99e48286d8f8e730189bd641d\" for &ContainerMetadata{Name:kindnet-cni,Attempt:3,} returns container id \"b65d598df0518b3473fbe7e9eecd9029da516ba539f6d46b2d48715e4df0395b\""
	Jun 30 21:27:34 old-k8s-version-20220630210005-9950 containerd[394]: time="2022-06-30T21:27:34.849583867Z" level=info msg="StartContainer for \"b65d598df0518b3473fbe7e9eecd9029da516ba539f6d46b2d48715e4df0395b\""
	Jun 30 21:27:35 old-k8s-version-20220630210005-9950 containerd[394]: time="2022-06-30T21:27:35.028590287Z" level=info msg="StartContainer for \"b65d598df0518b3473fbe7e9eecd9029da516ba539f6d46b2d48715e4df0395b\" returns successfully"
	Jun 30 21:30:15 old-k8s-version-20220630210005-9950 containerd[394]: time="2022-06-30T21:30:15.445240158Z" level=info msg="shim disconnected" id=b65d598df0518b3473fbe7e9eecd9029da516ba539f6d46b2d48715e4df0395b
	Jun 30 21:30:15 old-k8s-version-20220630210005-9950 containerd[394]: time="2022-06-30T21:30:15.445767815Z" level=warning msg="cleaning up after shim disconnected" id=b65d598df0518b3473fbe7e9eecd9029da516ba539f6d46b2d48715e4df0395b namespace=k8s.io
	Jun 30 21:30:15 old-k8s-version-20220630210005-9950 containerd[394]: time="2022-06-30T21:30:15.445803513Z" level=info msg="cleaning up dead shim"
	Jun 30 21:30:15 old-k8s-version-20220630210005-9950 containerd[394]: time="2022-06-30T21:30:15.455959429Z" level=warning msg="cleanup warnings time=\"2022-06-30T21:30:15Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=6256 runtime=io.containerd.runc.v2\n"
	Jun 30 21:30:16 old-k8s-version-20220630210005-9950 containerd[394]: time="2022-06-30T21:30:16.001193727Z" level=info msg="RemoveContainer for \"466dbbd160134cb4ef5e989ea7df17b5c53fe887da06bb45d98d077ed5b802d6\""
	Jun 30 21:30:16 old-k8s-version-20220630210005-9950 containerd[394]: time="2022-06-30T21:30:16.006648098Z" level=info msg="RemoveContainer for \"466dbbd160134cb4ef5e989ea7df17b5c53fe887da06bb45d98d077ed5b802d6\" returns successfully"
	Jun 30 21:31:07 old-k8s-version-20220630210005-9950 containerd[394]: time="2022-06-30T21:31:07.835130191Z" level=info msg="CreateContainer within sandbox \"1273bf7fb0caa4bcdd8ca108e6840479675a95d99e48286d8f8e730189bd641d\" for container &ContainerMetadata{Name:kindnet-cni,Attempt:4,}"
	Jun 30 21:31:07 old-k8s-version-20220630210005-9950 containerd[394]: time="2022-06-30T21:31:07.847957814Z" level=info msg="CreateContainer within sandbox \"1273bf7fb0caa4bcdd8ca108e6840479675a95d99e48286d8f8e730189bd641d\" for &ContainerMetadata{Name:kindnet-cni,Attempt:4,} returns container id \"50775eb30f76a289744c73276e65d3defa487832b801060defbe48e97e7b1119\""
	Jun 30 21:31:07 old-k8s-version-20220630210005-9950 containerd[394]: time="2022-06-30T21:31:07.848547298Z" level=info msg="StartContainer for \"50775eb30f76a289744c73276e65d3defa487832b801060defbe48e97e7b1119\""
	Jun 30 21:31:07 old-k8s-version-20220630210005-9950 containerd[394]: time="2022-06-30T21:31:07.946753882Z" level=info msg="StartContainer for \"50775eb30f76a289744c73276e65d3defa487832b801060defbe48e97e7b1119\" returns successfully"
	
	* 
	* ==> describe nodes <==
	* Name:               old-k8s-version-20220630210005-9950
	Roles:              master
	Labels:             beta.kubernetes.io/arch=amd64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=amd64
	                    kubernetes.io/hostname=old-k8s-version-20220630210005-9950
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=251ffcec0e4c997cd7732864187747cc579943c9
	                    minikube.k8s.io/name=old-k8s-version-20220630210005-9950
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2022_06_30T21_18_34_0700
	                    minikube.k8s.io/version=v1.26.0
	                    node-role.kubernetes.io/master=
	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: /run/containerd/containerd.sock
	                    node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Thu, 30 Jun 2022 21:18:29 +0000
	Taints:             node.kubernetes.io/not-ready:NoExecute
	                    node.kubernetes.io/not-ready:NoSchedule
	Unschedulable:      false
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Thu, 30 Jun 2022 21:31:29 +0000   Thu, 30 Jun 2022 21:18:26 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Thu, 30 Jun 2022 21:31:29 +0000   Thu, 30 Jun 2022 21:18:26 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Thu, 30 Jun 2022 21:31:29 +0000   Thu, 30 Jun 2022 21:18:26 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            False   Thu, 30 Jun 2022 21:31:29 +0000   Thu, 30 Jun 2022 21:18:26 +0000   KubeletNotReady              runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Addresses:
	  InternalIP:  192.168.67.2
	  Hostname:    old-k8s-version-20220630210005-9950
	Capacity:
	 cpu:                8
	 ephemeral-storage:  304695084Ki
	 hugepages-1Gi:      0
	 hugepages-2Mi:      0
	 memory:             32873488Ki
	 pods:               110
	Allocatable:
	 cpu:                8
	 ephemeral-storage:  304695084Ki
	 hugepages-1Gi:      0
	 hugepages-2Mi:      0
	 memory:             32873488Ki
	 pods:               110
	System Info:
	 Machine ID:                 bbe1e1cef6e940328962dca52b3c5731
	 System UUID:                2ca00556-ba1f-4dc3-b97e-bb738f788e2a
	 Boot ID:                    471c4729-f046-4a15-bc49-46f3ad561708
	 Kernel Version:             5.15.0-1012-gcp
	 OS Image:                   Ubuntu 20.04.4 LTS
	 Operating System:           linux
	 Architecture:               amd64
	 Container Runtime Version:  containerd://1.6.6
	 Kubelet Version:            v1.16.0
	 Kube-Proxy Version:         v1.16.0
	PodCIDR:                     10.244.0.0/24
	PodCIDRs:                    10.244.0.0/24
	Non-terminated Pods:         (6 in total)
	  Namespace                  Name                                                           CPU Requests  CPU Limits  Memory Requests  Memory Limits  AGE
	  ---------                  ----                                                           ------------  ----------  ---------------  -------------  ---
	  kube-system                etcd-old-k8s-version-20220630210005-9950                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         12m
	  kube-system                kindnet-lz24x                                                  100m (1%!)(MISSING)     100m (1%!)(MISSING)   50Mi (0%!)(MISSING)        50Mi (0%!)(MISSING)      13m
	  kube-system                kube-apiserver-old-k8s-version-20220630210005-9950             250m (3%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         12m
	  kube-system                kube-controller-manager-old-k8s-version-20220630210005-9950    200m (2%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         12m
	  kube-system                kube-proxy-vwp6l                                               0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         13m
	  kube-system                kube-scheduler-old-k8s-version-20220630210005-9950             100m (1%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         12m
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests   Limits
	  --------           --------   ------
	  cpu                650m (8%!)(MISSING)  100m (1%!)(MISSING)
	  memory             50Mi (0%!)(MISSING)  50Mi (0%!)(MISSING)
	  ephemeral-storage  0 (0%!)(MISSING)     0 (0%!)(MISSING)
	Events:
	  Type    Reason                   Age                From                                             Message
	  ----    ------                   ----               ----                                             -------
	  Normal  Starting                 13m                kubelet, old-k8s-version-20220630210005-9950     Starting kubelet.
	  Normal  NodeHasSufficientMemory  13m (x9 over 13m)  kubelet, old-k8s-version-20220630210005-9950     Node old-k8s-version-20220630210005-9950 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    13m (x7 over 13m)  kubelet, old-k8s-version-20220630210005-9950     Node old-k8s-version-20220630210005-9950 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     13m (x7 over 13m)  kubelet, old-k8s-version-20220630210005-9950     Node old-k8s-version-20220630210005-9950 status is now: NodeHasSufficientPID
	  Normal  NodeAllocatableEnforced  13m                kubelet, old-k8s-version-20220630210005-9950     Updated Node Allocatable limit across pods
	  Normal  Starting                 13m                kube-proxy, old-k8s-version-20220630210005-9950  Starting kube-proxy.
	
	* 
	* ==> dmesg <==
	* [  +2.939825] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000011] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.027789] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.019913] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[ +21.968090] IPv4: martian destination 127.0.0.11 from 10.244.0.3, dev veth8071d138
	[ +25.445872] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.029436] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.023957] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +2.947695] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[Jun30 21:05] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.023879] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +2.955783] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.011828] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000005] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.027896] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	
	* 
	* ==> etcd [331440287c35035c4e07207114bd03652cbc0ad94f85e5b85fcf8fa49587c5dd] <==
	* 2022-06-30 21:18:25.636614 I | raft: 8688e899f7831fc7 became follower at term 0
	2022-06-30 21:18:25.636623 I | raft: newRaft 8688e899f7831fc7 [peers: [], term: 0, commit: 0, applied: 0, lastindex: 0, lastterm: 0]
	2022-06-30 21:18:25.636631 I | raft: 8688e899f7831fc7 became follower at term 1
	2022-06-30 21:18:25.640654 W | auth: simple token is not cryptographically signed
	2022-06-30 21:18:25.649086 I | etcdserver: starting server... [version: 3.3.15, cluster version: to_be_decided]
	2022-06-30 21:18:25.649251 I | etcdserver: 8688e899f7831fc7 as single-node; fast-forwarding 9 ticks (election ticks 10)
	2022-06-30 21:18:25.649834 I | etcdserver/membership: added member 8688e899f7831fc7 [https://192.168.67.2:2380] to cluster 9d8fdeb88b6def78
	2022-06-30 21:18:25.651692 I | embed: ClientTLS: cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, ca = , trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = 
	2022-06-30 21:18:25.651838 I | embed: listening for metrics on http://127.0.0.1:2381
	2022-06-30 21:18:25.651913 I | embed: listening for metrics on http://192.168.67.2:2381
	2022-06-30 21:18:25.837077 I | raft: 8688e899f7831fc7 is starting a new election at term 1
	2022-06-30 21:18:25.837131 I | raft: 8688e899f7831fc7 became candidate at term 2
	2022-06-30 21:18:25.837160 I | raft: 8688e899f7831fc7 received MsgVoteResp from 8688e899f7831fc7 at term 2
	2022-06-30 21:18:25.837191 I | raft: 8688e899f7831fc7 became leader at term 2
	2022-06-30 21:18:25.837208 I | raft: raft.node: 8688e899f7831fc7 elected leader 8688e899f7831fc7 at term 2
	2022-06-30 21:18:25.837551 I | etcdserver: published {Name:old-k8s-version-20220630210005-9950 ClientURLs:[https://192.168.67.2:2379]} to cluster 9d8fdeb88b6def78
	2022-06-30 21:18:25.837611 I | embed: ready to serve client requests
	2022-06-30 21:18:25.837749 I | etcdserver: setting up the initial cluster version to 3.3
	2022-06-30 21:18:25.837829 I | embed: ready to serve client requests
	2022-06-30 21:18:25.838289 N | etcdserver/membership: set the initial cluster version to 3.3
	2022-06-30 21:18:25.838391 I | etcdserver/api: enabled capabilities for version 3.3
	2022-06-30 21:18:25.844856 I | embed: serving client requests on 192.168.67.2:2379
	2022-06-30 21:18:25.846232 I | embed: serving client requests on 127.0.0.1:2379
	2022-06-30 21:28:26.381344 I | mvcc: store.index: compact 579
	2022-06-30 21:28:26.383227 I | mvcc: finished scheduled compaction at 579 (took 1.507807ms)
	
	* 
	* ==> kernel <==
	*  21:31:54 up  1:14,  0 users,  load average: 0.51, 0.47, 0.81
	Linux old-k8s-version-20220630210005-9950 5.15.0-1012-gcp #17~20.04.1-Ubuntu SMP Thu Jun 23 16:10:34 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
	PRETTY_NAME="Ubuntu 20.04.4 LTS"
	
	* 
	* ==> kube-apiserver [4d472dfb5cbc3bcdb49161f3dc6443c4d2267f99d7de41ba7e3aca4e91f39975] <==
	* I0630 21:24:30.427976       1 controller.go:107] OpenAPI AggregationController: Processing item v1beta1.metrics.k8s.io
	W0630 21:24:30.428076       1 handler_proxy.go:99] no RequestInfo found in the context
	E0630 21:24:30.428131       1 controller.go:114] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
	, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
	I0630 21:24:30.428148       1 controller.go:127] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
	I0630 21:26:30.428386       1 controller.go:107] OpenAPI AggregationController: Processing item v1beta1.metrics.k8s.io
	W0630 21:26:30.428472       1 handler_proxy.go:99] no RequestInfo found in the context
	E0630 21:26:30.428556       1 controller.go:114] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
	, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
	I0630 21:26:30.428576       1 controller.go:127] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
	I0630 21:28:30.429574       1 controller.go:107] OpenAPI AggregationController: Processing item v1beta1.metrics.k8s.io
	W0630 21:28:30.429660       1 handler_proxy.go:99] no RequestInfo found in the context
	E0630 21:28:30.429725       1 controller.go:114] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
	, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
	I0630 21:28:30.429743       1 controller.go:127] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
	I0630 21:29:30.429971       1 controller.go:107] OpenAPI AggregationController: Processing item v1beta1.metrics.k8s.io
	W0630 21:29:30.430061       1 handler_proxy.go:99] no RequestInfo found in the context
	E0630 21:29:30.430140       1 controller.go:114] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
	, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
	I0630 21:29:30.430161       1 controller.go:127] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
	I0630 21:31:30.430402       1 controller.go:107] OpenAPI AggregationController: Processing item v1beta1.metrics.k8s.io
	W0630 21:31:30.430506       1 handler_proxy.go:99] no RequestInfo found in the context
	E0630 21:31:30.430588       1 controller.go:114] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
	, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
	I0630 21:31:30.430608       1 controller.go:127] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
	
	* 
	* ==> kube-controller-manager [765fc80bc943e9f53d0c41e845cb64f7e927639090ca57a25cf3d208159f4cef] <==
	* E0630 21:25:22.540703       1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	W0630 21:25:45.288671       1 garbagecollector.go:640] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0630 21:25:52.792328       1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	W0630 21:26:17.290411       1 garbagecollector.go:640] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0630 21:26:23.044002       1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	W0630 21:26:49.292040       1 garbagecollector.go:640] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0630 21:26:53.295525       1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	W0630 21:27:21.293688       1 garbagecollector.go:640] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0630 21:27:23.547165       1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	W0630 21:27:53.295462       1 garbagecollector.go:640] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0630 21:27:53.798693       1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	E0630 21:28:24.049996       1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	W0630 21:28:25.297091       1 garbagecollector.go:640] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0630 21:28:54.301652       1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	W0630 21:28:57.298712       1 garbagecollector.go:640] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0630 21:29:24.553361       1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	W0630 21:29:29.300354       1 garbagecollector.go:640] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0630 21:29:54.804881       1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	W0630 21:30:01.302214       1 garbagecollector.go:640] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0630 21:30:25.056556       1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	W0630 21:30:33.303924       1 garbagecollector.go:640] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0630 21:30:55.308180       1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	W0630 21:31:05.305675       1 garbagecollector.go:640] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0630 21:31:25.559664       1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	W0630 21:31:37.307371       1 garbagecollector.go:640] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	
	* 
	* ==> kube-proxy [21661943a8d48cf903788eaca7389af17a1b11a7e37c19d4eb9c1f3600d42801] <==
	* W0630 21:18:49.665138       1 server_others.go:329] Flag proxy-mode="" unknown, assuming iptables proxy
	I0630 21:18:49.672583       1 node.go:135] Successfully retrieved node IP: 192.168.67.2
	I0630 21:18:49.672627       1 server_others.go:149] Using iptables Proxier.
	I0630 21:18:49.673147       1 server.go:529] Version: v1.16.0
	I0630 21:18:49.673678       1 config.go:313] Starting service config controller
	I0630 21:18:49.673711       1 shared_informer.go:197] Waiting for caches to sync for service config
	I0630 21:18:49.673745       1 config.go:131] Starting endpoints config controller
	I0630 21:18:49.673785       1 shared_informer.go:197] Waiting for caches to sync for endpoints config
	I0630 21:18:49.773903       1 shared_informer.go:204] Caches are synced for service config 
	I0630 21:18:49.773917       1 shared_informer.go:204] Caches are synced for endpoints config 
	
	* 
	* ==> kube-scheduler [3812d0fe0857bfbb2a03d38fd044dac87dea9f7097280208ff88d8fa17a0692c] <==
	* I0630 21:18:29.435248       1 secure_serving.go:123] Serving securely on 127.0.0.1:10259
	E0630 21:18:29.529005       1 reflector.go:123] k8s.io/kubernetes/cmd/kube-scheduler/app/server.go:236: Failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E0630 21:18:29.531463       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E0630 21:18:29.531531       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E0630 21:18:29.531587       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1beta1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E0630 21:18:29.531647       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E0630 21:18:29.531693       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	E0630 21:18:29.531741       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	E0630 21:18:29.531781       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0630 21:18:29.531851       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	E0630 21:18:29.531905       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	E0630 21:18:29.532856       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	E0630 21:18:30.530234       1 reflector.go:123] k8s.io/kubernetes/cmd/kube-scheduler/app/server.go:236: Failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E0630 21:18:30.532535       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E0630 21:18:30.533773       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E0630 21:18:30.535014       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1beta1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E0630 21:18:30.536244       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E0630 21:18:30.537706       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	E0630 21:18:30.538891       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	E0630 21:18:30.540023       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0630 21:18:30.541375       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	E0630 21:18:30.542285       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	E0630 21:18:30.543489       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	E0630 21:18:51.025531       1 factory.go:585] pod is already present in the activeQ
	E0630 21:18:51.630743       1 factory.go:585] pod is already present in the activeQ
	
	* 
	* ==> kubelet <==
	* -- Logs begin at Thu 2022-06-30 21:12:55 UTC, end at Thu 2022-06-30 21:31:54 UTC. --
	Jun 30 21:30:10 old-k8s-version-20220630210005-9950 kubelet[2979]: E0630 21:30:10.048650    2979 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:30:15 old-k8s-version-20220630210005-9950 kubelet[2979]: E0630 21:30:15.049710    2979 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:30:16 old-k8s-version-20220630210005-9950 kubelet[2979]: E0630 21:30:16.001026    2979 pod_workers.go:191] Error syncing pod dd1abd4e-af36-4336-9a10-0212fd25fdca ("kindnet-lz24x_kube-system(dd1abd4e-af36-4336-9a10-0212fd25fdca)"), skipping: failed to "StartContainer" for "kindnet-cni" with CrashLoopBackOff: "back-off 40s restarting failed container=kindnet-cni pod=kindnet-lz24x_kube-system(dd1abd4e-af36-4336-9a10-0212fd25fdca)"
	Jun 30 21:30:20 old-k8s-version-20220630210005-9950 kubelet[2979]: E0630 21:30:20.050625    2979 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:30:25 old-k8s-version-20220630210005-9950 kubelet[2979]: E0630 21:30:25.051585    2979 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:30:27 old-k8s-version-20220630210005-9950 kubelet[2979]: E0630 21:30:27.832791    2979 pod_workers.go:191] Error syncing pod dd1abd4e-af36-4336-9a10-0212fd25fdca ("kindnet-lz24x_kube-system(dd1abd4e-af36-4336-9a10-0212fd25fdca)"), skipping: failed to "StartContainer" for "kindnet-cni" with CrashLoopBackOff: "back-off 40s restarting failed container=kindnet-cni pod=kindnet-lz24x_kube-system(dd1abd4e-af36-4336-9a10-0212fd25fdca)"
	Jun 30 21:30:30 old-k8s-version-20220630210005-9950 kubelet[2979]: E0630 21:30:30.052430    2979 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:30:35 old-k8s-version-20220630210005-9950 kubelet[2979]: E0630 21:30:35.053373    2979 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:30:38 old-k8s-version-20220630210005-9950 kubelet[2979]: E0630 21:30:38.833150    2979 pod_workers.go:191] Error syncing pod dd1abd4e-af36-4336-9a10-0212fd25fdca ("kindnet-lz24x_kube-system(dd1abd4e-af36-4336-9a10-0212fd25fdca)"), skipping: failed to "StartContainer" for "kindnet-cni" with CrashLoopBackOff: "back-off 40s restarting failed container=kindnet-cni pod=kindnet-lz24x_kube-system(dd1abd4e-af36-4336-9a10-0212fd25fdca)"
	Jun 30 21:30:40 old-k8s-version-20220630210005-9950 kubelet[2979]: E0630 21:30:40.054208    2979 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:30:45 old-k8s-version-20220630210005-9950 kubelet[2979]: E0630 21:30:45.054953    2979 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:30:50 old-k8s-version-20220630210005-9950 kubelet[2979]: E0630 21:30:50.055731    2979 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:30:53 old-k8s-version-20220630210005-9950 kubelet[2979]: E0630 21:30:53.832681    2979 pod_workers.go:191] Error syncing pod dd1abd4e-af36-4336-9a10-0212fd25fdca ("kindnet-lz24x_kube-system(dd1abd4e-af36-4336-9a10-0212fd25fdca)"), skipping: failed to "StartContainer" for "kindnet-cni" with CrashLoopBackOff: "back-off 40s restarting failed container=kindnet-cni pod=kindnet-lz24x_kube-system(dd1abd4e-af36-4336-9a10-0212fd25fdca)"
	Jun 30 21:30:55 old-k8s-version-20220630210005-9950 kubelet[2979]: E0630 21:30:55.056586    2979 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:31:00 old-k8s-version-20220630210005-9950 kubelet[2979]: E0630 21:31:00.057545    2979 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:31:05 old-k8s-version-20220630210005-9950 kubelet[2979]: E0630 21:31:05.058348    2979 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:31:10 old-k8s-version-20220630210005-9950 kubelet[2979]: E0630 21:31:10.059239    2979 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:31:15 old-k8s-version-20220630210005-9950 kubelet[2979]: E0630 21:31:15.060080    2979 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:31:20 old-k8s-version-20220630210005-9950 kubelet[2979]: E0630 21:31:20.060924    2979 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:31:25 old-k8s-version-20220630210005-9950 kubelet[2979]: E0630 21:31:25.061791    2979 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:31:30 old-k8s-version-20220630210005-9950 kubelet[2979]: E0630 21:31:30.062698    2979 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:31:35 old-k8s-version-20220630210005-9950 kubelet[2979]: E0630 21:31:35.063577    2979 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:31:40 old-k8s-version-20220630210005-9950 kubelet[2979]: E0630 21:31:40.064413    2979 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:31:45 old-k8s-version-20220630210005-9950 kubelet[2979]: E0630 21:31:45.065418    2979 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Jun 30 21:31:50 old-k8s-version-20220630210005-9950 kubelet[2979]: E0630 21:31:50.066379    2979 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	

                                                
                                                
-- /stdout --
helpers_test.go:254: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p old-k8s-version-20220630210005-9950 -n old-k8s-version-20220630210005-9950
helpers_test.go:261: (dbg) Run:  kubectl --context old-k8s-version-20220630210005-9950 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:270: non-running pods: coredns-5644d7b6d9-gpdfr metrics-server-7958775c-cbzqz storage-provisioner dashboard-metrics-scraper-6b84985989-mn9fl kubernetes-dashboard-958c5c65f-z5ppk
helpers_test.go:272: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop]: describe non-running pods <======
helpers_test.go:275: (dbg) Run:  kubectl --context old-k8s-version-20220630210005-9950 describe pod coredns-5644d7b6d9-gpdfr metrics-server-7958775c-cbzqz storage-provisioner dashboard-metrics-scraper-6b84985989-mn9fl kubernetes-dashboard-958c5c65f-z5ppk
helpers_test.go:275: (dbg) Non-zero exit: kubectl --context old-k8s-version-20220630210005-9950 describe pod coredns-5644d7b6d9-gpdfr metrics-server-7958775c-cbzqz storage-provisioner dashboard-metrics-scraper-6b84985989-mn9fl kubernetes-dashboard-958c5c65f-z5ppk: exit status 1 (60.204033ms)

                                                
                                                
** stderr ** 
	Error from server (NotFound): pods "coredns-5644d7b6d9-gpdfr" not found
	Error from server (NotFound): pods "metrics-server-7958775c-cbzqz" not found
	Error from server (NotFound): pods "storage-provisioner" not found
	Error from server (NotFound): pods "dashboard-metrics-scraper-6b84985989-mn9fl" not found
	Error from server (NotFound): pods "kubernetes-dashboard-958c5c65f-z5ppk" not found

                                                
                                                
** /stderr **
helpers_test.go:277: kubectl --context old-k8s-version-20220630210005-9950 describe pod coredns-5644d7b6d9-gpdfr metrics-server-7958775c-cbzqz storage-provisioner dashboard-metrics-scraper-6b84985989-mn9fl kubernetes-dashboard-958c5c65f-z5ppk: exit status 1
--- FAIL: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (542.52s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop (542.47s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:342: "kubernetes-dashboard-5fd5574d9f-2wm9p" [06dea62f-87a9-4562-8d3b-e9e2fe04e5d9] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.)
E0630 21:25:47.268945    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/ingress-addon-legacy-20220630202923-9950/client.crt: no such file or directory
E0630 21:26:24.473354    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/enable-default-cni-20220630204858-9950/client.crt: no such file or directory
E0630 21:26:27.108685    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/bridge-20220630204858-9950/client.crt: no such file or directory
E0630 21:28:30.280575    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/functional-20220630202638-9950/client.crt: no such file or directory
E0630 21:28:30.339811    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/no-preload-20220630210237-9950/client.crt: no such file or directory
E0630 21:28:50.205135    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/addons-20220630202117-9950/client.crt: no such file or directory

                                                
                                                
=== CONT  TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
E0630 21:33:50.204848    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/addons-20220630202117-9950/client.crt: no such file or directory
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
E0630 21:34:37.806881    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/auto-20220630204858-9950/client.crt: no such file or directory
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
E0630 21:34:41.441390    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/kindnet-20220630204858-9950/client.crt: no such file or directory
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
start_stop_delete_test.go:274: ***** TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: pod "k8s-app=kubernetes-dashboard" failed to start within 9m0s: timed out waiting for the condition ****
start_stop_delete_test.go:274: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p default-k8s-different-port-20220630210335-9950 -n default-k8s-different-port-20220630210335-9950
start_stop_delete_test.go:274: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: showing logs for failed pods as of 2022-06-30 21:34:46.092899678 +0000 UTC m=+4434.332037926
start_stop_delete_test.go:274: (dbg) Run:  kubectl --context default-k8s-different-port-20220630210335-9950 describe po kubernetes-dashboard-5fd5574d9f-2wm9p -n kubernetes-dashboard
start_stop_delete_test.go:274: (dbg) Non-zero exit: kubectl --context default-k8s-different-port-20220630210335-9950 describe po kubernetes-dashboard-5fd5574d9f-2wm9p -n kubernetes-dashboard: context deadline exceeded (1.578µs)
start_stop_delete_test.go:274: kubectl --context default-k8s-different-port-20220630210335-9950 describe po kubernetes-dashboard-5fd5574d9f-2wm9p -n kubernetes-dashboard: context deadline exceeded
start_stop_delete_test.go:274: (dbg) Run:  kubectl --context default-k8s-different-port-20220630210335-9950 logs kubernetes-dashboard-5fd5574d9f-2wm9p -n kubernetes-dashboard
start_stop_delete_test.go:274: (dbg) Non-zero exit: kubectl --context default-k8s-different-port-20220630210335-9950 logs kubernetes-dashboard-5fd5574d9f-2wm9p -n kubernetes-dashboard: context deadline exceeded (255ns)
start_stop_delete_test.go:274: kubectl --context default-k8s-different-port-20220630210335-9950 logs kubernetes-dashboard-5fd5574d9f-2wm9p -n kubernetes-dashboard: context deadline exceeded
start_stop_delete_test.go:275: failed waiting for 'addon dashboard' pod post-stop-start: k8s-app=kubernetes-dashboard within 9m0s: timed out waiting for the condition
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect default-k8s-different-port-20220630210335-9950
helpers_test.go:235: (dbg) docker inspect default-k8s-different-port-20220630210335-9950:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "99f8da15dcfc83187a1db4c0b15dfeb5920d55fd52718f4f99a491d1ec9f59fc",
	        "Created": "2022-06-30T21:03:43.366289202Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 276364,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2022-06-30T21:16:51.775031109Z",
	            "FinishedAt": "2022-06-30T21:16:50.340305297Z"
	        },
	        "Image": "sha256:573e7be5768273a7845baee1ae90fa2e33b83b10a7fbb0f0f41efbf29b53d1f1",
	        "ResolvConfPath": "/var/lib/docker/containers/99f8da15dcfc83187a1db4c0b15dfeb5920d55fd52718f4f99a491d1ec9f59fc/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/99f8da15dcfc83187a1db4c0b15dfeb5920d55fd52718f4f99a491d1ec9f59fc/hostname",
	        "HostsPath": "/var/lib/docker/containers/99f8da15dcfc83187a1db4c0b15dfeb5920d55fd52718f4f99a491d1ec9f59fc/hosts",
	        "LogPath": "/var/lib/docker/containers/99f8da15dcfc83187a1db4c0b15dfeb5920d55fd52718f4f99a491d1ec9f59fc/99f8da15dcfc83187a1db4c0b15dfeb5920d55fd52718f4f99a491d1ec9f59fc-json.log",
	        "Name": "/default-k8s-different-port-20220630210335-9950",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "default-k8s-different-port-20220630210335-9950:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "default-k8s-different-port-20220630210335-9950",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8444/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 2306867200,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": null,
	            "BlkioDeviceWriteBps": null,
	            "BlkioDeviceReadIOps": null,
	            "BlkioDeviceWriteIOps": null,
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "KernelMemory": 0,
	            "KernelMemoryTCP": 0,
	            "MemoryReservation": 0,
	            "MemorySwap": 4613734400,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": null,
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/6cae4fbb3ff06bafae7d678b8be88c46f728f7e162403189e54b6a928eed1dda-init/diff:/var/lib/docker/overlay2/8b88d9f6f12c48be642a133456203e58549a93f1da67d0349744bd0f78917fba/diff:/var/lib/docker/overlay2/2bcbb3b4718a64188802301a25d7f413bb307cb16d077e7e5af799f9152a2970/diff:/var/lib/docker/overlay2/70b0888bf22fcef1c004704b71288ac581cf26a3b3b19fbca3da296ba10d6978/diff:/var/lib/docker/overlay2/7c5332f38fe652f379ef9b6d23e795158e9994317cfb547b581dd2b1fdf1303b/diff:/var/lib/docker/overlay2/0ddb5a3abf433b644a8bfa124e3c87878eed67878faa35493f2befc2b392e9cb/diff:/var/lib/docker/overlay2/3b7cda5fb0232fdeecbec0531ac704a59eb38fe57664c25777193b07e2df0077/diff:/var/lib/docker/overlay2/a14687ada786c65465b9924ae2d77ba27afc07942851cafaade28e80dfe9da16/diff:/var/lib/docker/overlay2/c49a9b7157aa6e8714e192b2849866d035b59e18de462c0ee9b72f898cc5a485/diff:/var/lib/docker/overlay2/efd71a50e3a1044a6d1c4c1a7d4d91d9f070c066e03e51c6c73a5764b778ad72/diff:/var/lib/docker/overlay2/55476a
1c0a20aa4238a0bb0e43c6402c33dcad312938ad48ee81be0160e12a49/diff:/var/lib/docker/overlay2/c48c4a348a797b9a38f01568a6adbcb4b05b4f56f7b986a4bf1b509d8cb00732/diff:/var/lib/docker/overlay2/568e3f354ab0428de5cf82d1fdfb780c3377f5cc55d9f524731c53e39e0ecae7/diff:/var/lib/docker/overlay2/2857943e320cdcdae9af3d8c2acda1fb61e2f142a88b8b902908071cea67816e/diff:/var/lib/docker/overlay2/bdd9a57f0b65e65c5a16395f239425e794c678b0e8db2f4a368e0a9427fe5116/diff:/var/lib/docker/overlay2/b150183f1b73e8c13c751911bcee09fed8ef973478f4dc3cfdb9e509118bf1ea/diff:/var/lib/docker/overlay2/0a053e7c29417cd6feafb351c7944e81342a52898871bc779f7bf61868c78ec4/diff:/var/lib/docker/overlay2/d3c0de3a44d75d0a05acb7843d53deba5ce0457649d6ed757da9b4c532a81e4f/diff:/var/lib/docker/overlay2/53f6170132880e1697dd802b8577382b31c6f1ba144256f8cc62542998842a6b/diff:/var/lib/docker/overlay2/b5c0be6d8efdb1fcb12e73b8f72853f77baa4bc014ac2c1e28b7b972b07f3325/diff:/var/lib/docker/overlay2/36c908f082a1e5388bb25277f1c957eaecf70fcd958080422fa85a3105724fb2/diff:/var/lib/d
ocker/overlay2/b147fe9dce365cfaf9bfeca2e370829e4d87e2671c133a9836ecb02a85422cc7/diff:/var/lib/docker/overlay2/65f488eb9181a721f01b333f5fa0cb91d216abd7842a9ae193bd95316f378721/diff:/var/lib/docker/overlay2/b04269aa247b68912ddc5b1c98ad55d67af4103f576a900eef4069c196b8a263/diff:/var/lib/docker/overlay2/b714c37e15257ae9d0e15d271dd18a330c38ad765901d9b7e7e3feb73e1b03e4/diff:/var/lib/docker/overlay2/3c253b721193edeaade7bba7ce25ff687c889b8fa86e9489c7ee20d5624e6c5b/diff:/var/lib/docker/overlay2/7f67b74e101fa21dd320393c10576eefa4ce1cec2e210bff405784fa45b360f3/diff:/var/lib/docker/overlay2/c3b2adaa63a06a5e6ed966d7b6f20a757aeadd3f25eb09ef3c7e9a66a8904143/diff:/var/lib/docker/overlay2/ddb5d653d19e8cafc4625a8fe9597667d98b277a7f679e532ad84caa2c6da636/diff:/var/lib/docker/overlay2/03eb172b20323ebeee7cb09025726a6e10de6c3dd8661f4f6bbc5a3a3778bad4/diff:/var/lib/docker/overlay2/80ea9bf34d028e95a8a418b3aeb634be72ab3336448946d7855c51ffdf8258d7/diff:/var/lib/docker/overlay2/e28987ea3fb4d431dee111f38cc76814b85f73e86434be3c463c01fdd59
9ad46/diff:/var/lib/docker/overlay2/6f9a46c7c6cf4fd30ce32a1eb08ed9b1e8dd61cb0e42ce54f0f736f06558c306/diff:/var/lib/docker/overlay2/6fc942eb9ccfc09898edc9a5ef3b3d305a6fcb22e8cefb1a9f9c344d10b59b25/diff:/var/lib/docker/overlay2/f6b8c57540e798dc1dfd51fd29c020193c02a4362f31c6d07aa220327bb07b90/diff:/var/lib/docker/overlay2/85d0aa01a3fab8c77262c59d8a7b0809a72673a3da7d33e4e19c04a66db44a11/diff:/var/lib/docker/overlay2/58dcd81a1605641f785ced5aeb38657eec1f02a31b7adfaf4f6fdd49f4bab1d6/diff:/var/lib/docker/overlay2/9d537e0a65325e4bf85b26da9828002339f5c442ca85f931b340457a80ec8c94/diff:/var/lib/docker/overlay2/a6f73707ee6a74e948a02d03c4a3f12b57c2eb408dc67da3c39961bb3cefcc97/diff:/var/lib/docker/overlay2/922526c310b066dbb73b9a106eef8bf0064ad7907a8d7d7b353f5307a17a4901/diff:/var/lib/docker/overlay2/a4185854870ebf8d34a4c7e1827dbe3bc461559839301ffb23c5efff5e3c9f14/diff:/var/lib/docker/overlay2/8c02b1fcb9d79f5d7b2ee4d44f6625a692c44a0d18df0a5c01cac0cca0fdf3f3/diff",
	                "MergedDir": "/var/lib/docker/overlay2/6cae4fbb3ff06bafae7d678b8be88c46f728f7e162403189e54b6a928eed1dda/merged",
	                "UpperDir": "/var/lib/docker/overlay2/6cae4fbb3ff06bafae7d678b8be88c46f728f7e162403189e54b6a928eed1dda/diff",
	                "WorkDir": "/var/lib/docker/overlay2/6cae4fbb3ff06bafae7d678b8be88c46f728f7e162403189e54b6a928eed1dda/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "default-k8s-different-port-20220630210335-9950",
	                "Source": "/var/lib/docker/volumes/default-k8s-different-port-20220630210335-9950/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "default-k8s-different-port-20220630210335-9950",
	            "Domainname": "",
	            "User": "root",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8444/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e",
	            "Volumes": null,
	            "WorkingDir": "",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "default-k8s-different-port-20220630210335-9950",
	                "name.minikube.sigs.k8s.io": "default-k8s-different-port-20220630210335-9950",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "65a752487954fdae16c96429127bfb6a11b41cd67c17fe9a26bf8a7c54ec9b43",
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49437"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49436"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49433"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49435"
	                    }
	                ],
	                "8444/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49434"
	                    }
	                ]
	            },
	            "SandboxKey": "/var/run/docker/netns/65a752487954",
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "default-k8s-different-port-20220630210335-9950": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.85.2"
	                    },
	                    "Links": null,
	                    "Aliases": [
	                        "99f8da15dcfc",
	                        "default-k8s-different-port-20220630210335-9950"
	                    ],
	                    "NetworkID": "88cfda28f4387ea19e39fbebceded21d3930034fa00fca0cacdd2b97de1da8d9",
	                    "EndpointID": "f57b9372f4240b270f9da403706b34104e71d67ac61e471d943d4adae804ca04",
	                    "Gateway": "192.168.85.1",
	                    "IPAddress": "192.168.85.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "MacAddress": "02:42:c0:a8:55:02",
	                    "DriverOpts": null
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p default-k8s-different-port-20220630210335-9950 -n default-k8s-different-port-20220630210335-9950
helpers_test.go:244: <<< TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======>  post-mortem[TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop]: minikube logs <======
helpers_test.go:247: (dbg) Run:  out/minikube-linux-amd64 -p default-k8s-different-port-20220630210335-9950 logs -n 25
E0630 21:34:47.572164    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/client.crt: no such file or directory
E0630 21:34:47.578025    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/client.crt: no such file or directory
E0630 21:34:47.588133    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/client.crt: no such file or directory
helpers_test.go:252: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop logs: 
-- stdout --
	* 
	* ==> Audit <==
	* |---------|---------------------------------------------------|----------|---------|---------|---------------------|---------------------|
	| Command |                       Args                        | Profile  |  User   | Version |     Start Time      |      End Time       |
	|---------|---------------------------------------------------|----------|---------|---------|---------------------|---------------------|
	| ssh     | -p                                                | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                    |          |         |         |                     |                     |
	|         | sudo crictl images -o json                        |          |         |         |                     |                     |
	| pause   | -p                                                | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                    |          |         |         |                     |                     |
	|         | --alsologtostderr -v=1                            |          |         |         |                     |                     |
	| unpause | -p                                                | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                    |          |         |         |                     |                     |
	|         | --alsologtostderr -v=1                            |          |         |         |                     |                     |
	| delete  | -p                                                | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                    |          |         |         |                     |                     |
	| delete  | -p                                                | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                    |          |         |         |                     |                     |
	| delete  | -p                                                | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | disable-driver-mounts-20220630210659-9950         |          |         |         |                     |                     |
	| start   | -p                                                | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC |                     |
	|         | embed-certs-20220630210659-9950                   |          |         |         |                     |                     |
	|         | --memory=2200 --alsologtostderr                   |          |         |         |                     |                     |
	|         | --wait=true --embed-certs                         |          |         |         |                     |                     |
	|         | --driver=docker                                   |          |         |         |                     |                     |
	|         | --container-runtime=containerd                    |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                      |          |         |         |                     |                     |
	| ssh     | -p                                                | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                    |          |         |         |                     |                     |
	|         | sudo crictl images -o json                        |          |         |         |                     |                     |
	| pause   | -p                                                | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                    |          |         |         |                     |                     |
	|         | --alsologtostderr -v=1                            |          |         |         |                     |                     |
	| unpause | -p                                                | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                    |          |         |         |                     |                     |
	|         | --alsologtostderr -v=1                            |          |         |         |                     |                     |
	| delete  | -p                                                | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                    |          |         |         |                     |                     |
	| delete  | -p                                                | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                    |          |         |         |                     |                     |
	| addons  | enable metrics-server -p                          | minikube | jenkins | v1.26.0 | 30 Jun 22 21:12 UTC | 30 Jun 22 21:12 UTC |
	|         | old-k8s-version-20220630210005-9950               |          |         |         |                     |                     |
	|         | --images=MetricsServer=k8s.gcr.io/echoserver:1.4  |          |         |         |                     |                     |
	|         | --registries=MetricsServer=fake.domain            |          |         |         |                     |                     |
	| stop    | -p                                                | minikube | jenkins | v1.26.0 | 30 Jun 22 21:12 UTC | 30 Jun 22 21:12 UTC |
	|         | old-k8s-version-20220630210005-9950               |          |         |         |                     |                     |
	|         | --alsologtostderr -v=3                            |          |         |         |                     |                     |
	| addons  | enable dashboard -p                               | minikube | jenkins | v1.26.0 | 30 Jun 22 21:12 UTC | 30 Jun 22 21:12 UTC |
	|         | old-k8s-version-20220630210005-9950               |          |         |         |                     |                     |
	|         | --images=MetricsScraper=k8s.gcr.io/echoserver:1.4 |          |         |         |                     |                     |
	| start   | -p                                                | minikube | jenkins | v1.26.0 | 30 Jun 22 21:12 UTC |                     |
	|         | old-k8s-version-20220630210005-9950               |          |         |         |                     |                     |
	|         | --memory=2200 --alsologtostderr                   |          |         |         |                     |                     |
	|         | --wait=true --kvm-network=default                 |          |         |         |                     |                     |
	|         | --kvm-qemu-uri=qemu:///system                     |          |         |         |                     |                     |
	|         | --disable-driver-mounts                           |          |         |         |                     |                     |
	|         | --keep-context=false                              |          |         |         |                     |                     |
	|         | --driver=docker                                   |          |         |         |                     |                     |
	|         | --container-runtime=containerd                    |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.16.0                      |          |         |         |                     |                     |
	| addons  | enable metrics-server -p                          | minikube | jenkins | v1.26.0 | 30 Jun 22 21:16 UTC | 30 Jun 22 21:16 UTC |
	|         | default-k8s-different-port-20220630210335-9950    |          |         |         |                     |                     |
	|         | --images=MetricsServer=k8s.gcr.io/echoserver:1.4  |          |         |         |                     |                     |
	|         | --registries=MetricsServer=fake.domain            |          |         |         |                     |                     |
	| stop    | -p                                                | minikube | jenkins | v1.26.0 | 30 Jun 22 21:16 UTC | 30 Jun 22 21:16 UTC |
	|         | default-k8s-different-port-20220630210335-9950    |          |         |         |                     |                     |
	|         | --alsologtostderr -v=3                            |          |         |         |                     |                     |
	| addons  | enable dashboard -p                               | minikube | jenkins | v1.26.0 | 30 Jun 22 21:16 UTC | 30 Jun 22 21:16 UTC |
	|         | default-k8s-different-port-20220630210335-9950    |          |         |         |                     |                     |
	|         | --images=MetricsScraper=k8s.gcr.io/echoserver:1.4 |          |         |         |                     |                     |
	| start   | -p                                                | minikube | jenkins | v1.26.0 | 30 Jun 22 21:16 UTC |                     |
	|         | default-k8s-different-port-20220630210335-9950    |          |         |         |                     |                     |
	|         | --memory=2200 --alsologtostderr --wait=true       |          |         |         |                     |                     |
	|         | --apiserver-port=8444 --driver=docker             |          |         |         |                     |                     |
	|         |  --container-runtime=containerd                   |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                      |          |         |         |                     |                     |
	| addons  | enable metrics-server -p                          | minikube | jenkins | v1.26.0 | 30 Jun 22 21:19 UTC | 30 Jun 22 21:19 UTC |
	|         | embed-certs-20220630210659-9950                   |          |         |         |                     |                     |
	|         | --images=MetricsServer=k8s.gcr.io/echoserver:1.4  |          |         |         |                     |                     |
	|         | --registries=MetricsServer=fake.domain            |          |         |         |                     |                     |
	| stop    | -p                                                | minikube | jenkins | v1.26.0 | 30 Jun 22 21:19 UTC | 30 Jun 22 21:20 UTC |
	|         | embed-certs-20220630210659-9950                   |          |         |         |                     |                     |
	|         | --alsologtostderr -v=3                            |          |         |         |                     |                     |
	| addons  | enable dashboard -p                               | minikube | jenkins | v1.26.0 | 30 Jun 22 21:20 UTC | 30 Jun 22 21:20 UTC |
	|         | embed-certs-20220630210659-9950                   |          |         |         |                     |                     |
	|         | --images=MetricsScraper=k8s.gcr.io/echoserver:1.4 |          |         |         |                     |                     |
	| start   | -p                                                | minikube | jenkins | v1.26.0 | 30 Jun 22 21:20 UTC |                     |
	|         | embed-certs-20220630210659-9950                   |          |         |         |                     |                     |
	|         | --memory=2200 --alsologtostderr                   |          |         |         |                     |                     |
	|         | --wait=true --embed-certs                         |          |         |         |                     |                     |
	|         | --driver=docker                                   |          |         |         |                     |                     |
	|         | --container-runtime=containerd                    |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                      |          |         |         |                     |                     |
	| delete  | -p                                                | minikube | jenkins | v1.26.0 | 30 Jun 22 21:31 UTC | 30 Jun 22 21:31 UTC |
	|         | old-k8s-version-20220630210005-9950               |          |         |         |                     |                     |
	|---------|---------------------------------------------------|----------|---------|---------|---------------------|---------------------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2022/06/30 21:20:03
	Running on machine: ubuntu-20-agent-8
	Binary: Built with gc go1.18.3 for linux/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0630 21:20:03.147328  282690 out.go:296] Setting OutFile to fd 1 ...
	I0630 21:20:03.147439  282690 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 21:20:03.147448  282690 out.go:309] Setting ErrFile to fd 2...
	I0630 21:20:03.147453  282690 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 21:20:03.147898  282690 root.go:329] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/bin
	I0630 21:20:03.148141  282690 out.go:303] Setting JSON to false
	I0630 21:20:03.149531  282690 start.go:115] hostinfo: {"hostname":"ubuntu-20-agent-8","uptime":3755,"bootTime":1656620248,"procs":452,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1012-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0630 21:20:03.149604  282690 start.go:125] virtualization: kvm guest
	I0630 21:20:03.152275  282690 out.go:177] * [embed-certs-20220630210659-9950] minikube v1.26.0 on Ubuntu 20.04 (kvm/amd64)
	I0630 21:20:03.154290  282690 notify.go:193] Checking for updates...
	I0630 21:20:03.154307  282690 out.go:177]   - MINIKUBE_LOCATION=14420
	I0630 21:20:03.156071  282690 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0630 21:20:03.157769  282690 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:20:03.159343  282690 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube
	I0630 21:20:03.160888  282690 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0630 21:20:03.163346  282690 config.go:178] Loaded profile config "embed-certs-20220630210659-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:20:03.163802  282690 driver.go:360] Setting default libvirt URI to qemu:///system
	I0630 21:20:03.205706  282690 docker.go:137] docker version: linux-20.10.17
	I0630 21:20:03.205824  282690 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0630 21:20:03.318551  282690 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:8 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:43 OomKillDisable:true NGoroutines:44 SystemTime:2022-06-30 21:20:03.238323982 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1012-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexServ
erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662451712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-8 Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Client
Info:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
	I0630 21:20:03.318677  282690 docker.go:254] overlay module found
	I0630 21:20:03.322599  282690 out.go:177] * Using the docker driver based on existing profile
	I0630 21:20:03.324114  282690 start.go:284] selected driver: docker
	I0630 21:20:03.324129  282690 start.go:808] validating driver "docker" against &{Name:embed-certs-20220630210659-9950 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:embed-certs-20220630210659-9950 Namespace:d
efault APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[Dashboard:kubernetesui/dashboard:v2.6.0@sha256:4af9580485920635d888efe1eddbd67e12f9d5d84dba87100e93feb4e46636b3 MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddres
s: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 21:20:03.324222  282690 start.go:819] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0630 21:20:03.325145  282690 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0630 21:20:03.438547  282690 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:8 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:43 OomKillDisable:true NGoroutines:44 SystemTime:2022-06-30 21:20:03.358172615 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1012-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexServ
erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662451712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-8 Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Client
Info:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
	I0630 21:20:03.438832  282690 start_flags.go:853] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0630 21:20:03.438854  282690 cni.go:95] Creating CNI manager for ""
	I0630 21:20:03.438863  282690 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:20:03.438877  282690 start_flags.go:310] config:
	{Name:embed-certs-20220630210659-9950 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:embed-certs-20220630210659-9950 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:clus
ter.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[Dashboard:kubernetesui/dashboard:v2.6.0@sha256:4af9580485920635d888efe1eddbd67e12f9d5d84dba87100e93feb4e46636b3 MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0
m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 21:20:03.442075  282690 out.go:177] * Starting control plane node embed-certs-20220630210659-9950 in cluster embed-certs-20220630210659-9950
	I0630 21:20:03.443525  282690 cache.go:120] Beginning downloading kic base image for docker with containerd
	I0630 21:20:03.445355  282690 out.go:177] * Pulling base image ...
	I0630 21:20:03.446826  282690 preload.go:132] Checking if preload exists for k8s version v1.24.2 and runtime containerd
	I0630 21:20:03.446872  282690 preload.go:148] Found local preload: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-containerd-overlay2-amd64.tar.lz4
	I0630 21:20:03.446895  282690 cache.go:57] Caching tarball of preloaded images
	I0630 21:20:03.446927  282690 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e in local docker daemon
	I0630 21:20:03.447161  282690 preload.go:174] Found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-containerd-overlay2-amd64.tar.lz4 in cache, skipping download
	I0630 21:20:03.447178  282690 cache.go:60] Finished verifying existence of preloaded tar for  v1.24.2 on containerd
	I0630 21:20:03.447328  282690 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/config.json ...
	I0630 21:20:03.484347  282690 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e in local docker daemon, skipping pull
	I0630 21:20:03.484373  282690 cache.go:142] gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e exists in daemon, skipping load
	I0630 21:20:03.484390  282690 cache.go:208] Successfully downloaded all kic artifacts
	I0630 21:20:03.484431  282690 start.go:352] acquiring machines lock for embed-certs-20220630210659-9950: {Name:mk6619dbb09b46cdd2b244e5bf2112b3274a30ef Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0630 21:20:03.484542  282690 start.go:356] acquired machines lock for "embed-certs-20220630210659-9950" in 89.652µs
	I0630 21:20:03.484563  282690 start.go:94] Skipping create...Using existing machine configuration
	I0630 21:20:03.484568  282690 fix.go:55] fixHost starting: 
	I0630 21:20:03.484786  282690 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:20:03.518786  282690 fix.go:103] recreateIfNeeded on embed-certs-20220630210659-9950: state=Stopped err=<nil>
	W0630 21:20:03.518832  282690 fix.go:129] unexpected machine state, will restart: <nil>
	I0630 21:20:03.522271  282690 out.go:177] * Restarting existing docker container for "embed-certs-20220630210659-9950" ...
	I0630 21:20:01.182137  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:03.183061  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:02.393449  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:04.893746  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:03.523749  282690 cli_runner.go:164] Run: docker start embed-certs-20220630210659-9950
	I0630 21:20:03.930910  282690 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:20:03.968503  282690 kic.go:416] container "embed-certs-20220630210659-9950" state is running.
	I0630 21:20:03.968961  282690 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-20220630210659-9950
	I0630 21:20:04.005032  282690 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/config.json ...
	I0630 21:20:04.005301  282690 machine.go:88] provisioning docker machine ...
	I0630 21:20:04.005330  282690 ubuntu.go:169] provisioning hostname "embed-certs-20220630210659-9950"
	I0630 21:20:04.005375  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:20:04.043967  282690 main.go:134] libmachine: Using SSH client type: native
	I0630 21:20:04.044205  282690 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil>  [] 0s} 127.0.0.1 49442 <nil> <nil>}
	I0630 21:20:04.044233  282690 main.go:134] libmachine: About to run SSH command:
	sudo hostname embed-certs-20220630210659-9950 && echo "embed-certs-20220630210659-9950" | sudo tee /etc/hostname
	I0630 21:20:04.044882  282690 main.go:134] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:41696->127.0.0.1:49442: read: connection reset by peer
	I0630 21:20:07.174483  282690 main.go:134] libmachine: SSH cmd err, output: <nil>: embed-certs-20220630210659-9950
	
	I0630 21:20:07.174561  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:20:07.210487  282690 main.go:134] libmachine: Using SSH client type: native
	I0630 21:20:07.210668  282690 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil>  [] 0s} 127.0.0.1 49442 <nil> <nil>}
	I0630 21:20:07.210690  282690 main.go:134] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sembed-certs-20220630210659-9950' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 embed-certs-20220630210659-9950/g' /etc/hosts;
				else 
					echo '127.0.1.1 embed-certs-20220630210659-9950' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0630 21:20:07.329184  282690 main.go:134] libmachine: SSH cmd err, output: <nil>: 
	I0630 21:20:07.329234  282690 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube CaCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/c
erts/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube}
	I0630 21:20:07.329264  282690 ubuntu.go:177] setting up certificates
	I0630 21:20:07.329274  282690 provision.go:83] configureAuth start
	I0630 21:20:07.329332  282690 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-20220630210659-9950
	I0630 21:20:07.365729  282690 provision.go:138] copyHostCerts
	I0630 21:20:07.365803  282690 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem, removing ...
	I0630 21:20:07.365816  282690 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem
	I0630 21:20:07.365887  282690 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem (1679 bytes)
	I0630 21:20:07.365984  282690 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem, removing ...
	I0630 21:20:07.365998  282690 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem
	I0630 21:20:07.366039  282690 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem (1082 bytes)
	I0630 21:20:07.366110  282690 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem, removing ...
	I0630 21:20:07.366123  282690 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem
	I0630 21:20:07.366164  282690 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem (1123 bytes)
	I0630 21:20:07.366225  282690 provision.go:112] generating server cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem org=jenkins.embed-certs-20220630210659-9950 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-20220630210659-9950]
	I0630 21:20:07.595656  282690 provision.go:172] copyRemoteCerts
	I0630 21:20:07.595725  282690 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0630 21:20:07.595756  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:20:07.631338  282690 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49442 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:20:07.716832  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
	I0630 21:20:07.735870  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem --> /etc/docker/server.pem (1265 bytes)
	I0630 21:20:07.756354  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0630 21:20:07.775209  282690 provision.go:86] duration metric: configureAuth took 445.919443ms
	I0630 21:20:07.775233  282690 ubuntu.go:193] setting minikube options for container-runtime
	I0630 21:20:07.775399  282690 config.go:178] Loaded profile config "embed-certs-20220630210659-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:20:07.775412  282690 machine.go:91] provisioned docker machine in 3.770097214s
	I0630 21:20:07.775419  282690 start.go:306] post-start starting for "embed-certs-20220630210659-9950" (driver="docker")
	I0630 21:20:07.775425  282690 start.go:316] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0630 21:20:07.775465  282690 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0630 21:20:07.775498  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:20:07.811677  282690 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49442 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:20:07.897450  282690 ssh_runner.go:195] Run: cat /etc/os-release
	I0630 21:20:07.900657  282690 main.go:134] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0630 21:20:07.900688  282690 main.go:134] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0630 21:20:07.900696  282690 main.go:134] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0630 21:20:07.900702  282690 info.go:137] Remote host: Ubuntu 20.04.4 LTS
	I0630 21:20:07.900711  282690 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/addons for local assets ...
	I0630 21:20:07.900762  282690 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files for local assets ...
	I0630 21:20:07.900829  282690 filesync.go:149] local asset: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem -> 99502.pem in /etc/ssl/certs
	I0630 21:20:07.900909  282690 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0630 21:20:07.908065  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem --> /etc/ssl/certs/99502.pem (1708 bytes)
	I0630 21:20:07.926474  282690 start.go:309] post-start completed in 151.040627ms
	I0630 21:20:07.926557  282690 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0630 21:20:07.926600  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:20:07.963198  282690 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49442 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:20:08.045725  282690 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0630 21:20:08.049536  282690 fix.go:57] fixHost completed within 4.564962738s
	I0630 21:20:08.049568  282690 start.go:81] releasing machines lock for "embed-certs-20220630210659-9950", held for 4.56500909s
	I0630 21:20:08.049668  282690 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-20220630210659-9950
	I0630 21:20:08.085452  282690 ssh_runner.go:195] Run: systemctl --version
	I0630 21:20:08.085508  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:20:08.085526  282690 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/
	I0630 21:20:08.085584  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:20:08.125940  282690 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49442 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:20:08.126756  282690 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49442 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:20:05.682082  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:07.682788  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:07.393189  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:09.893794  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:08.209826  282690 ssh_runner.go:195] Run: sudo systemctl stop -f crio
	I0630 21:20:08.240545  282690 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0630 21:20:08.251830  282690 docker.go:179] disabling docker service ...
	I0630 21:20:08.251890  282690 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0630 21:20:08.263344  282690 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0630 21:20:08.272763  282690 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0630 21:20:08.347490  282690 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0630 21:20:08.430323  282690 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0630 21:20:08.439736  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
	image-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0630 21:20:08.453177  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*sandbox_image = .*$|sandbox_image = "k8s.gcr.io/pause:3.7"|' -i /etc/containerd/config.toml"
	I0630 21:20:08.461609  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*restrict_oom_score_adj = .*$|restrict_oom_score_adj = false|' -i /etc/containerd/config.toml"
	I0630 21:20:08.469975  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*SystemdCgroup = .*$|SystemdCgroup = false|' -i /etc/containerd/config.toml"
	I0630 21:20:08.478446  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*conf_dir = .*$|conf_dir = "/etc/cni/net.mk"|' -i /etc/containerd/config.toml"
	I0630 21:20:08.486889  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^# imports|imports = ["/etc/containerd/containerd.conf.d/02-containerd.conf"]|' -i /etc/containerd/config.toml"
	I0630 21:20:08.495251  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc/containerd/containerd.conf.d && printf %!s(MISSING) "dmVyc2lvbiA9IDIK" | base64 -d | sudo tee /etc/containerd/containerd.conf.d/02-containerd.conf"
	I0630 21:20:08.508868  282690 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0630 21:20:08.515626  282690 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0630 21:20:08.522606  282690 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0630 21:20:08.605769  282690 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0630 21:20:08.682128  282690 start.go:447] Will wait 60s for socket path /run/containerd/containerd.sock
	I0630 21:20:08.682202  282690 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
	I0630 21:20:08.686167  282690 start.go:468] Will wait 60s for crictl version
	I0630 21:20:08.686246  282690 ssh_runner.go:195] Run: sudo crictl version
	I0630 21:20:08.713091  282690 retry.go:31] will retry after 11.04660288s: Temporary Error: sudo crictl version: Process exited with status 1
	stdout:
	
	stderr:
	time="2022-06-30T21:20:08Z" level=fatal msg="getting the runtime version: rpc error: code = Unknown desc = server is not initialized yet"
	I0630 21:20:10.182344  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:12.182594  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:12.392956  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:14.393428  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:14.682680  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:17.182245  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:19.182817  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:19.761138  282690 ssh_runner.go:195] Run: sudo crictl version
	I0630 21:20:19.786289  282690 start.go:477] Version:  0.1.0
	RuntimeName:  containerd
	RuntimeVersion:  1.6.6
	RuntimeApiVersion:  v1alpha2
	I0630 21:20:19.786365  282690 ssh_runner.go:195] Run: containerd --version
	I0630 21:20:19.816281  282690 ssh_runner.go:195] Run: containerd --version
	I0630 21:20:19.848226  282690 out.go:177] * Preparing Kubernetes v1.24.2 on containerd 1.6.6 ...
	I0630 21:20:16.893342  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:18.893566  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:19.849919  282690 cli_runner.go:164] Run: docker network inspect embed-certs-20220630210659-9950 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0630 21:20:19.887550  282690 ssh_runner.go:195] Run: grep 192.168.94.1	host.minikube.internal$ /etc/hosts
	I0630 21:20:19.891143  282690 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.94.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0630 21:20:19.900924  282690 preload.go:132] Checking if preload exists for k8s version v1.24.2 and runtime containerd
	I0630 21:20:19.900991  282690 ssh_runner.go:195] Run: sudo crictl images --output json
	I0630 21:20:19.925400  282690 containerd.go:547] all images are preloaded for containerd runtime.
	I0630 21:20:19.925429  282690 containerd.go:461] Images already preloaded, skipping extraction
	I0630 21:20:19.925482  282690 ssh_runner.go:195] Run: sudo crictl images --output json
	I0630 21:20:19.950061  282690 containerd.go:547] all images are preloaded for containerd runtime.
	I0630 21:20:19.950082  282690 cache_images.go:84] Images are preloaded, skipping loading
	I0630 21:20:19.950125  282690 ssh_runner.go:195] Run: sudo crictl info
	I0630 21:20:19.974750  282690 cni.go:95] Creating CNI manager for ""
	I0630 21:20:19.974773  282690 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:20:19.974785  282690 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
	I0630 21:20:19.974799  282690 kubeadm.go:158] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.94.2 APIServerPort:8443 KubernetesVersion:v1.24.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:embed-certs-20220630210659-9950 NodeName:embed-certs-20220630210659-9950 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.94.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.94.2 CgroupDriver:cgroupfs ClientC
AFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}
	I0630 21:20:19.974955  282690 kubeadm.go:162] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.94.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: /run/containerd/containerd.sock
	  name: "embed-certs-20220630210659-9950"
	  kubeletExtraArgs:
	    node-ip: 192.168.94.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.94.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.24.2
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%!"(MISSING)
	  nodefs.inodesFree: "0%!"(MISSING)
	  imagefs.available: "0%!"(MISSING)
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0630 21:20:19.975056  282690 kubeadm.go:961] kubelet [Unit]
	Wants=containerd.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.24.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=embed-certs-20220630210659-9950 --image-service-endpoint=unix:///run/containerd/containerd.sock --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.94.2 --runtime-request-timeout=15m
	
	[Install]
	 config:
	{KubernetesVersion:v1.24.2 ClusterName:embed-certs-20220630210659-9950 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
	I0630 21:20:19.975119  282690 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.24.2
	I0630 21:20:19.982477  282690 binaries.go:44] Found k8s binaries, skipping transfer
	I0630 21:20:19.982537  282690 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0630 21:20:19.989867  282690 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (524 bytes)
	I0630 21:20:20.003413  282690 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0630 21:20:20.016549  282690 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2060 bytes)
	I0630 21:20:20.030557  282690 ssh_runner.go:195] Run: grep 192.168.94.2	control-plane.minikube.internal$ /etc/hosts
	I0630 21:20:20.033673  282690 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.94.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0630 21:20:20.043309  282690 certs.go:54] Setting up /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950 for IP: 192.168.94.2
	I0630 21:20:20.043426  282690 certs.go:182] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.key
	I0630 21:20:20.043474  282690 certs.go:182] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.key
	I0630 21:20:20.043588  282690 certs.go:298] skipping minikube-user signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/client.key
	I0630 21:20:20.043669  282690 certs.go:298] skipping minikube signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.key.ad8e880a
	I0630 21:20:20.043722  282690 certs.go:298] skipping aggregator signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.key
	I0630 21:20:20.043847  282690 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950.pem (1338 bytes)
	W0630 21:20:20.043888  282690 certs.go:384] ignoring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950_empty.pem, impossibly tiny 0 bytes
	I0630 21:20:20.043906  282690 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem (1679 bytes)
	I0630 21:20:20.043944  282690 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem (1082 bytes)
	I0630 21:20:20.043983  282690 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem (1123 bytes)
	I0630 21:20:20.044018  282690 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/key.pem (1679 bytes)
	I0630 21:20:20.044074  282690 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem (1708 bytes)
	I0630 21:20:20.044672  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
	I0630 21:20:20.063809  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I0630 21:20:20.082364  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0630 21:20:20.100953  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
	I0630 21:20:20.119042  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0630 21:20:20.138260  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
	I0630 21:20:20.156455  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0630 21:20:20.175178  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
	I0630 21:20:20.193932  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem --> /usr/share/ca-certificates/99502.pem (1708 bytes)
	I0630 21:20:20.213463  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0630 21:20:20.232837  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950.pem --> /usr/share/ca-certificates/9950.pem (1338 bytes)
	I0630 21:20:20.252510  282690 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0630 21:20:20.267375  282690 ssh_runner.go:195] Run: openssl version
	I0630 21:20:20.273228  282690 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/99502.pem && ln -fs /usr/share/ca-certificates/99502.pem /etc/ssl/certs/99502.pem"
	I0630 21:20:20.281805  282690 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/99502.pem
	I0630 21:20:20.285276  282690 certs.go:431] hashing: -rw-r--r-- 1 root root 1708 Jun 30 20:26 /usr/share/ca-certificates/99502.pem
	I0630 21:20:20.285328  282690 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/99502.pem
	I0630 21:20:20.290565  282690 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/99502.pem /etc/ssl/certs/3ec20f2e.0"
	I0630 21:20:20.298693  282690 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0630 21:20:20.306974  282690 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:20:20.310492  282690 certs.go:431] hashing: -rw-r--r-- 1 root root 1111 Jun 30 20:22 /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:20:20.310555  282690 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:20:20.315748  282690 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0630 21:20:20.323429  282690 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/9950.pem && ln -fs /usr/share/ca-certificates/9950.pem /etc/ssl/certs/9950.pem"
	I0630 21:20:20.331855  282690 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/9950.pem
	I0630 21:20:20.335469  282690 certs.go:431] hashing: -rw-r--r-- 1 root root 1338 Jun 30 20:26 /usr/share/ca-certificates/9950.pem
	I0630 21:20:20.335531  282690 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/9950.pem
	I0630 21:20:20.340482  282690 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/9950.pem /etc/ssl/certs/51391683.0"
	I0630 21:20:20.348339  282690 kubeadm.go:395] StartCluster: {Name:embed-certs-20220630210659-9950 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:embed-certs-20220630210659-9950 Namespace:default APIServerName
:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[Dashboard:kubernetesui/dashboard:v2.6.0@sha256:4af9580485920635d888efe1eddbd67e12f9d5d84dba87100e93feb4e46636b3 MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet:
MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 21:20:20.348468  282690 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
	I0630 21:20:20.348531  282690 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0630 21:20:20.375578  282690 cri.go:87] found id: "6bdce580a9d6963de5c12d9e017d5662e2685851e130abf85abf7ccd2206a8a6"
	I0630 21:20:20.375605  282690 cri.go:87] found id: "8341041be1bdbcf0e0425bd1832777e15b2ed89bf8696d0c78d14301820032c3"
	I0630 21:20:20.375615  282690 cri.go:87] found id: "157c2b0c199b65e53b31cbc33bd298586d30106a66d587ee22f9c486df45d1ba"
	I0630 21:20:20.375624  282690 cri.go:87] found id: "ccc3bef31fe3faba9ff6daab0d5ca071fed6adb37d8cc554c7399ac599691557"
	I0630 21:20:20.375637  282690 cri.go:87] found id: "d56e346d0980d838b9cd42c94d9e084ef84bb0fdeb4316ae2dd5c8a25cc054a1"
	I0630 21:20:20.375652  282690 cri.go:87] found id: "7734f08ca26708ce34ae224077718432c05bc3133a11bb3d600a7d29c4df0045"
	I0630 21:20:20.375660  282690 cri.go:87] found id: ""
	I0630 21:20:20.375709  282690 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
	I0630 21:20:20.388498  282690 cri.go:114] JSON = null
	W0630 21:20:20.388559  282690 kubeadm.go:402] unpause failed: list paused: list returned 0 containers, but ps returned 6
	I0630 21:20:20.388621  282690 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0630 21:20:20.396168  282690 kubeadm.go:410] found existing configuration files, will attempt cluster restart
	I0630 21:20:20.396200  282690 kubeadm.go:626] restartCluster start
	I0630 21:20:20.396246  282690 ssh_runner.go:195] Run: sudo test -d /data/minikube
	I0630 21:20:20.403017  282690 kubeadm.go:127] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:20.403674  282690 kubeconfig.go:116] verify returned: extract IP: "embed-certs-20220630210659-9950" does not appear in /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:20:20.404147  282690 kubeconfig.go:127] "embed-certs-20220630210659-9950" context is missing from /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig - will repair!
	I0630 21:20:20.404911  282690 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig: {Name:mk34e4a4e7b04f624b9adbda4f77ee20b38308ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:20:20.406647  282690 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
	I0630 21:20:20.413413  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:20.413466  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:20.421286  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:20.621671  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:20.621798  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:20.630547  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:20.821858  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:20.821957  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:20.830758  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:21.022078  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:21.022162  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:21.030900  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:21.222204  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:21.222293  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:21.231221  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:21.421485  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:21.421579  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:21.430528  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:21.621730  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:21.621832  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:21.630704  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:21.822018  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:21.822098  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:21.830851  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:22.022202  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:22.022287  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:22.031086  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:22.222404  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:22.222489  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:22.231324  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:22.421567  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:22.421655  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:22.430581  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:22.621941  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:22.622040  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:22.631867  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:22.822177  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:22.822278  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:22.832202  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:23.021427  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:23.021501  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:23.030217  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:21.682805  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:24.182683  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:21.393221  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:23.893682  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:23.221874  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:23.221961  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:23.230645  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:23.421956  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:23.422028  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:23.430894  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:23.430917  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:23.430954  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:23.439029  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:23.439054  282690 kubeadm.go:601] needs reconfigure: apiserver error: timed out waiting for the condition
	I0630 21:20:23.439061  282690 kubeadm.go:1092] stopping kube-system containers ...
	I0630 21:20:23.439074  282690 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name: Namespaces:[kube-system]}
	I0630 21:20:23.439116  282690 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0630 21:20:23.463122  282690 cri.go:87] found id: "6bdce580a9d6963de5c12d9e017d5662e2685851e130abf85abf7ccd2206a8a6"
	I0630 21:20:23.463146  282690 cri.go:87] found id: "8341041be1bdbcf0e0425bd1832777e15b2ed89bf8696d0c78d14301820032c3"
	I0630 21:20:23.463152  282690 cri.go:87] found id: "157c2b0c199b65e53b31cbc33bd298586d30106a66d587ee22f9c486df45d1ba"
	I0630 21:20:23.463158  282690 cri.go:87] found id: "ccc3bef31fe3faba9ff6daab0d5ca071fed6adb37d8cc554c7399ac599691557"
	I0630 21:20:23.463163  282690 cri.go:87] found id: "d56e346d0980d838b9cd42c94d9e084ef84bb0fdeb4316ae2dd5c8a25cc054a1"
	I0630 21:20:23.463170  282690 cri.go:87] found id: "7734f08ca26708ce34ae224077718432c05bc3133a11bb3d600a7d29c4df0045"
	I0630 21:20:23.463175  282690 cri.go:87] found id: ""
	I0630 21:20:23.463180  282690 cri.go:232] Stopping containers: [6bdce580a9d6963de5c12d9e017d5662e2685851e130abf85abf7ccd2206a8a6 8341041be1bdbcf0e0425bd1832777e15b2ed89bf8696d0c78d14301820032c3 157c2b0c199b65e53b31cbc33bd298586d30106a66d587ee22f9c486df45d1ba ccc3bef31fe3faba9ff6daab0d5ca071fed6adb37d8cc554c7399ac599691557 d56e346d0980d838b9cd42c94d9e084ef84bb0fdeb4316ae2dd5c8a25cc054a1 7734f08ca26708ce34ae224077718432c05bc3133a11bb3d600a7d29c4df0045]
	I0630 21:20:23.463219  282690 ssh_runner.go:195] Run: which crictl
	I0630 21:20:23.466097  282690 ssh_runner.go:195] Run: sudo /usr/bin/crictl stop 6bdce580a9d6963de5c12d9e017d5662e2685851e130abf85abf7ccd2206a8a6 8341041be1bdbcf0e0425bd1832777e15b2ed89bf8696d0c78d14301820032c3 157c2b0c199b65e53b31cbc33bd298586d30106a66d587ee22f9c486df45d1ba ccc3bef31fe3faba9ff6daab0d5ca071fed6adb37d8cc554c7399ac599691557 d56e346d0980d838b9cd42c94d9e084ef84bb0fdeb4316ae2dd5c8a25cc054a1 7734f08ca26708ce34ae224077718432c05bc3133a11bb3d600a7d29c4df0045
	I0630 21:20:23.491529  282690 ssh_runner.go:195] Run: sudo systemctl stop kubelet
	I0630 21:20:23.501548  282690 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0630 21:20:23.508513  282690 kubeadm.go:155] found existing configuration files:
	-rw------- 1 root root 5643 Jun 30 21:07 /etc/kubernetes/admin.conf
	-rw------- 1 root root 5652 Jun 30 21:07 /etc/kubernetes/controller-manager.conf
	-rw------- 1 root root 2063 Jun 30 21:07 /etc/kubernetes/kubelet.conf
	-rw------- 1 root root 5600 Jun 30 21:07 /etc/kubernetes/scheduler.conf
	
	I0630 21:20:23.508569  282690 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
	I0630 21:20:23.515331  282690 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
	I0630 21:20:23.522134  282690 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
	I0630 21:20:23.528625  282690 kubeadm.go:166] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:23.528674  282690 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
	I0630 21:20:23.535118  282690 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
	I0630 21:20:23.541759  282690 kubeadm.go:166] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:23.541806  282690 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
	I0630 21:20:23.547839  282690 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0630 21:20:23.554281  282690 kubeadm.go:703] reconfiguring cluster from /var/tmp/minikube/kubeadm.yaml
	I0630 21:20:23.554304  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:20:23.597418  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:20:24.204823  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:20:24.388425  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:20:24.446940  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:20:24.548581  282690 api_server.go:51] waiting for apiserver process to appear ...
	I0630 21:20:24.548652  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 21:20:25.058272  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 21:20:25.558267  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 21:20:25.634820  282690 api_server.go:71] duration metric: took 1.086232371s to wait for apiserver process to appear ...
	I0630 21:20:25.634853  282690 api_server.go:87] waiting for apiserver healthz status ...
	I0630 21:20:25.634866  282690 api_server.go:240] Checking apiserver healthz at https://192.168.94.2:8443/healthz ...
	I0630 21:20:25.635225  282690 api_server.go:256] stopped: https://192.168.94.2:8443/healthz: Get "https://192.168.94.2:8443/healthz": dial tcp 192.168.94.2:8443: connect: connection refused
	I0630 21:20:26.135955  282690 api_server.go:240] Checking apiserver healthz at https://192.168.94.2:8443/healthz ...
	I0630 21:20:26.183141  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:28.683133  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:29.023735  282690 api_server.go:266] https://192.168.94.2:8443/healthz returned 403:
	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
	W0630 21:20:29.023845  282690 api_server.go:102] status: https://192.168.94.2:8443/healthz returned error 403:
	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
	I0630 21:20:29.136115  282690 api_server.go:240] Checking apiserver healthz at https://192.168.94.2:8443/healthz ...
	I0630 21:20:29.142290  282690 api_server.go:266] https://192.168.94.2:8443/healthz returned 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/bootstrap-controller ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[-]poststarthook/apiservice-registration-controller failed: reason withheld
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	W0630 21:20:29.142324  282690 api_server.go:102] status: https://192.168.94.2:8443/healthz returned error 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/bootstrap-controller ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[-]poststarthook/apiservice-registration-controller failed: reason withheld
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	I0630 21:20:29.635779  282690 api_server.go:240] Checking apiserver healthz at https://192.168.94.2:8443/healthz ...
	I0630 21:20:29.641744  282690 api_server.go:266] https://192.168.94.2:8443/healthz returned 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/bootstrap-controller ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-registration-controller ok
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	W0630 21:20:29.641774  282690 api_server.go:102] status: https://192.168.94.2:8443/healthz returned error 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/bootstrap-controller ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-registration-controller ok
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	I0630 21:20:30.135899  282690 api_server.go:240] Checking apiserver healthz at https://192.168.94.2:8443/healthz ...
	I0630 21:20:30.140340  282690 api_server.go:266] https://192.168.94.2:8443/healthz returned 200:
	ok
	I0630 21:20:30.146945  282690 api_server.go:140] control plane version: v1.24.2
	I0630 21:20:30.146967  282690 api_server.go:130] duration metric: took 4.512109627s to wait for apiserver health ...
	I0630 21:20:30.146976  282690 cni.go:95] Creating CNI manager for ""
	I0630 21:20:30.146983  282690 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:20:30.149207  282690 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0630 21:20:26.393339  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:28.893287  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:30.893492  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:30.150766  282690 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0630 21:20:30.154566  282690 cni.go:189] applying CNI manifest using /var/lib/minikube/binaries/v1.24.2/kubectl ...
	I0630 21:20:30.154592  282690 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2429 bytes)
	I0630 21:20:30.168730  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0630 21:20:30.976925  282690 system_pods.go:43] waiting for kube-system pods to appear ...
	I0630 21:20:30.983901  282690 system_pods.go:59] 9 kube-system pods found
	I0630 21:20:30.983933  282690 system_pods.go:61] "coredns-6d4b75cb6d-87dwf" [11e7f3e7-24e8-4e14-b1f6-a7e2b9bcfb74] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.)
	I0630 21:20:30.983941  282690 system_pods.go:61] "etcd-embed-certs-20220630210659-9950" [c7597376-29d8-4a64-a014-1bca6b00b239] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
	I0630 21:20:30.983951  282690 system_pods.go:61] "kindnet-z7fgt" [9d385a59-b071-48be-b547-db80254669bc] Running / Ready:ContainersNotReady (containers with unready status: [kindnet-cni]) / ContainersReady:ContainersNotReady (containers with unready status: [kindnet-cni])
	I0630 21:20:30.983963  282690 system_pods.go:61] "kube-apiserver-embed-certs-20220630210659-9950" [101e1b1d-d8d3-49c5-b250-f9524145064b] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
	I0630 21:20:30.983978  282690 system_pods.go:61] "kube-controller-manager-embed-certs-20220630210659-9950" [f93c4f3d-22de-4c13-a12a-c8ae9d47911c] Running
	I0630 21:20:30.983988  282690 system_pods.go:61] "kube-proxy-jhw4d" [78ec1767-ed48-4f50-ab14-61149fad7e98] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])
	I0630 21:20:30.984003  282690 system_pods.go:61] "kube-scheduler-embed-certs-20220630210659-9950" [727ac744-99fa-4867-9662-83efb2a98b35] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
	I0630 21:20:30.984012  282690 system_pods.go:61] "metrics-server-5c6f97fb75-dvslz" [3a4167d3-f572-4a2c-813a-d2d22e47d17e] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.)
	I0630 21:20:30.984019  282690 system_pods.go:61] "storage-provisioner" [4e574839-6ecb-47ba-b5c4-e45d9b19efc7] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.)
	I0630 21:20:30.984028  282690 system_pods.go:74] duration metric: took 7.077293ms to wait for pod list to return data ...
	I0630 21:20:30.984038  282690 node_conditions.go:102] verifying NodePressure condition ...
	I0630 21:20:30.986718  282690 node_conditions.go:122] node storage ephemeral capacity is 304695084Ki
	I0630 21:20:30.986752  282690 node_conditions.go:123] node cpu capacity is 8
	I0630 21:20:30.986766  282690 node_conditions.go:105] duration metric: took 2.718274ms to run NodePressure ...
	I0630 21:20:30.986786  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:20:31.145954  282690 kubeadm.go:762] waiting for restarted kubelet to initialise ...
	I0630 21:20:31.149839  282690 kubeadm.go:777] kubelet initialised
	I0630 21:20:31.149867  282690 kubeadm.go:778] duration metric: took 3.887979ms waiting for restarted kubelet to initialise ...
	I0630 21:20:31.149877  282690 pod_ready.go:35] extra waiting up to 4m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0630 21:20:31.154561  282690 pod_ready.go:78] waiting up to 4m0s for pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace to be "Ready" ...
	I0630 21:20:30.683577  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:33.182578  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:33.392832  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:35.393314  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:33.160352  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:35.660314  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:35.182728  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:37.682510  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:37.893265  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:39.893463  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:38.160526  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:40.660894  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:39.683375  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:42.182068  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:44.183054  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:42.393015  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:44.893292  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:43.160483  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:45.660796  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:47.660953  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:46.683087  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:49.183229  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:46.893432  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:49.393236  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:50.161308  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:52.660155  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:51.682409  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:53.682570  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:51.393511  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:53.893578  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:54.661629  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:57.159920  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:55.682710  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:58.182130  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:56.393487  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:58.892932  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:00.893465  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:59.160128  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:01.160665  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:00.182447  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:02.182840  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:04.182886  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:03.392696  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:05.393231  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:03.661112  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:06.160443  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:06.682224  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:08.682691  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:07.893418  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:10.392505  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:08.160644  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:10.661019  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:12.661060  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:11.182893  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:13.182991  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:12.393783  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:14.893314  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:15.160327  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:17.660228  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:15.682251  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:17.683152  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:17.393363  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:19.390281  276064 pod_ready.go:81] duration metric: took 4m0.003663432s waiting for pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace to be "Ready" ...
	E0630 21:21:19.390317  276064 pod_ready.go:66] WaitExtra: waitPodCondition: timed out waiting 4m0s for pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace to be "Ready" (will not retry!)
	I0630 21:21:19.390344  276064 pod_ready.go:38] duration metric: took 4m0.009122224s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0630 21:21:19.390376  276064 kubeadm.go:630] restartCluster took 4m11.317474742s
	W0630 21:21:19.390560  276064 out.go:239] ! Unable to restart cluster, will reset it: extra: timed out waiting 4m0s for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready"
	I0630 21:21:19.390595  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm reset --cri-socket /run/containerd/containerd.sock --force"
	I0630 21:21:19.660421  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:22.160264  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:20.183474  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:22.682948  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:21.023971  276064 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm reset --cri-socket /run/containerd/containerd.sock --force": (1.633354294s)
	I0630 21:21:21.024036  276064 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 21:21:21.033944  276064 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0630 21:21:21.041255  276064 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver
	I0630 21:21:21.041307  276064 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0630 21:21:21.048131  276064 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0630 21:21:21.048170  276064 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0630 21:21:24.160315  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:26.660444  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:25.181883  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:27.183120  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:30.433489  276064 out.go:204]   - Generating certificates and keys ...
	I0630 21:21:30.436707  276064 out.go:204]   - Booting up control plane ...
	I0630 21:21:30.439842  276064 out.go:204]   - Configuring RBAC rules ...
	I0630 21:21:30.442245  276064 cni.go:95] Creating CNI manager for ""
	I0630 21:21:30.442271  276064 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:21:30.444232  276064 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0630 21:21:30.446289  276064 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0630 21:21:30.450161  276064 cni.go:189] applying CNI manifest using /var/lib/minikube/binaries/v1.24.2/kubectl ...
	I0630 21:21:30.450180  276064 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2429 bytes)
	I0630 21:21:30.464668  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0630 21:21:28.661012  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:31.160051  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:29.682587  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:31.682697  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:33.683054  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:31.250327  276064 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0630 21:21:31.250457  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:31.250483  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl label nodes minikube.k8s.io/version=v1.26.0 minikube.k8s.io/commit=251ffcec0e4c997cd7732864187747cc579943c9 minikube.k8s.io/name=default-k8s-different-port-20220630210335-9950 minikube.k8s.io/updated_at=2022_06_30T21_21_31_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:31.337104  276064 ops.go:34] apiserver oom_adj: -16
	I0630 21:21:31.337122  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:31.898846  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:32.398504  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:32.898395  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:33.399197  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:33.898224  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:34.399278  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:34.898766  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:35.399106  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:35.898541  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:33.160337  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:35.660572  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:37.660625  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:36.183245  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:38.681927  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:36.399149  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:36.899206  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:37.398969  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:37.898306  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:38.398247  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:38.898685  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:39.399050  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:39.899197  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:40.399284  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:40.898565  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:40.159296  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:42.160359  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:41.398285  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:41.899049  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:42.399136  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:42.898362  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:42.955690  276064 kubeadm.go:1045] duration metric: took 11.705297596s to wait for elevateKubeSystemPrivileges.
	I0630 21:21:42.955725  276064 kubeadm.go:397] StartCluster complete in 4m34.928502204s
	I0630 21:21:42.955749  276064 settings.go:142] acquiring lock: {Name:mkcbd229caa05b60d3551ef0b47eea08424c9b5d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:21:42.955839  276064 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:21:42.956940  276064 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig: {Name:mk34e4a4e7b04f624b9adbda4f77ee20b38308ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:21:43.471460  276064 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "default-k8s-different-port-20220630210335-9950" rescaled to 1
	I0630 21:21:43.471523  276064 start.go:208] Will wait 6m0s for node &{Name: IP:192.168.85.2 Port:8444 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0630 21:21:43.473505  276064 out.go:177] * Verifying Kubernetes components...
	I0630 21:21:43.471586  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0630 21:21:43.471607  276064 addons.go:412] enableAddons start: toEnable=map[dashboard:true metrics-server:true], additional=[]
	I0630 21:21:43.471793  276064 config.go:178] Loaded profile config "default-k8s-different-port-20220630210335-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:21:43.474864  276064 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 21:21:43.474932  276064 addons.go:65] Setting dashboard=true in profile "default-k8s-different-port-20220630210335-9950"
	I0630 21:21:43.474957  276064 addons.go:65] Setting default-storageclass=true in profile "default-k8s-different-port-20220630210335-9950"
	I0630 21:21:43.474976  276064 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "default-k8s-different-port-20220630210335-9950"
	I0630 21:21:43.474962  276064 addons.go:153] Setting addon dashboard=true in "default-k8s-different-port-20220630210335-9950"
	W0630 21:21:43.475061  276064 addons.go:162] addon dashboard should already be in state true
	I0630 21:21:43.475110  276064 host.go:66] Checking if "default-k8s-different-port-20220630210335-9950" exists ...
	I0630 21:21:43.474944  276064 addons.go:65] Setting metrics-server=true in profile "default-k8s-different-port-20220630210335-9950"
	I0630 21:21:43.475161  276064 addons.go:153] Setting addon metrics-server=true in "default-k8s-different-port-20220630210335-9950"
	W0630 21:21:43.475179  276064 addons.go:162] addon metrics-server should already be in state true
	I0630 21:21:43.475224  276064 host.go:66] Checking if "default-k8s-different-port-20220630210335-9950" exists ...
	I0630 21:21:43.474932  276064 addons.go:65] Setting storage-provisioner=true in profile "default-k8s-different-port-20220630210335-9950"
	I0630 21:21:43.475323  276064 cli_runner.go:164] Run: docker container inspect default-k8s-different-port-20220630210335-9950 --format={{.State.Status}}
	I0630 21:21:43.475319  276064 addons.go:153] Setting addon storage-provisioner=true in "default-k8s-different-port-20220630210335-9950"
	W0630 21:21:43.475359  276064 addons.go:162] addon storage-provisioner should already be in state true
	I0630 21:21:43.475407  276064 host.go:66] Checking if "default-k8s-different-port-20220630210335-9950" exists ...
	I0630 21:21:43.475586  276064 cli_runner.go:164] Run: docker container inspect default-k8s-different-port-20220630210335-9950 --format={{.State.Status}}
	I0630 21:21:43.475682  276064 cli_runner.go:164] Run: docker container inspect default-k8s-different-port-20220630210335-9950 --format={{.State.Status}}
	I0630 21:21:43.475805  276064 cli_runner.go:164] Run: docker container inspect default-k8s-different-port-20220630210335-9950 --format={{.State.Status}}
	I0630 21:21:43.525211  276064 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0630 21:21:43.526633  276064 addons.go:345] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 21:21:43.526654  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0630 21:21:43.526703  276064 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	I0630 21:21:43.529674  276064 out.go:177]   - Using image fake.domain/k8s.gcr.io/echoserver:1.4
	I0630 21:21:43.531135  276064 addons.go:345] installing /etc/kubernetes/addons/metrics-apiservice.yaml
	I0630 21:21:43.531154  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
	I0630 21:21:43.532388  276064 out.go:177]   - Using image kubernetesui/dashboard:v2.6.0
	I0630 21:21:43.531211  276064 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	I0630 21:21:43.534873  276064 out.go:177]   - Using image k8s.gcr.io/echoserver:1.4
	I0630 21:21:40.682196  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:42.682640  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:43.536294  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-ns.yaml
	I0630 21:21:43.536318  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
	I0630 21:21:43.535327  276064 addons.go:153] Setting addon default-storageclass=true in "default-k8s-different-port-20220630210335-9950"
	I0630 21:21:43.536373  276064 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	W0630 21:21:43.536390  276064 addons.go:162] addon default-storageclass should already be in state true
	I0630 21:21:43.536436  276064 host.go:66] Checking if "default-k8s-different-port-20220630210335-9950" exists ...
	I0630 21:21:43.536996  276064 cli_runner.go:164] Run: docker container inspect default-k8s-different-port-20220630210335-9950 --format={{.State.Status}}
	I0630 21:21:43.568952  276064 node_ready.go:35] waiting up to 6m0s for node "default-k8s-different-port-20220630210335-9950" to be "Ready" ...
	I0630 21:21:43.569160  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.85.1 host.minikube.internal\n           fallthrough\n        }' | sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0630 21:21:43.573720  276064 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49437 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/default-k8s-different-port-20220630210335-9950/id_rsa Username:docker}
	I0630 21:21:43.585132  276064 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49437 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/default-k8s-different-port-20220630210335-9950/id_rsa Username:docker}
	I0630 21:21:43.585211  276064 addons.go:345] installing /etc/kubernetes/addons/storageclass.yaml
	I0630 21:21:43.585226  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0630 21:21:43.585277  276064 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	I0630 21:21:43.592285  276064 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49437 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/default-k8s-different-port-20220630210335-9950/id_rsa Username:docker}
	I0630 21:21:43.623221  276064 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49437 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/default-k8s-different-port-20220630210335-9950/id_rsa Username:docker}
	I0630 21:21:43.744945  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
	I0630 21:21:43.744974  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
	I0630 21:21:43.747847  276064 addons.go:345] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
	I0630 21:21:43.747873  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1820 bytes)
	I0630 21:21:43.748263  276064 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 21:21:43.924785  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
	I0630 21:21:43.924816  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
	I0630 21:21:43.928618  276064 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0630 21:21:43.940306  276064 addons.go:345] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
	I0630 21:21:43.940338  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
	I0630 21:21:43.950742  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-configmap.yaml
	I0630 21:21:43.950768  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
	I0630 21:21:44.037060  276064 addons.go:345] installing /etc/kubernetes/addons/metrics-server-service.yaml
	I0630 21:21:44.037089  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
	I0630 21:21:44.047010  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-dp.yaml
	I0630 21:21:44.047034  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4196 bytes)
	I0630 21:21:44.135080  276064 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I0630 21:21:44.140888  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-role.yaml
	I0630 21:21:44.140919  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
	I0630 21:21:44.230459  276064 start.go:806] {"host.minikube.internal": 192.168.85.1} host record injected into CoreDNS
	I0630 21:21:44.235255  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
	I0630 21:21:44.235283  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
	I0630 21:21:44.327158  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-sa.yaml
	I0630 21:21:44.327192  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
	I0630 21:21:44.351459  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-secret.yaml
	I0630 21:21:44.351527  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
	I0630 21:21:44.448179  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-svc.yaml
	I0630 21:21:44.448218  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
	I0630 21:21:44.537927  276064 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	I0630 21:21:45.130031  276064 addons.go:383] Verifying addon metrics-server=true in "default-k8s-different-port-20220630210335-9950"
	I0630 21:21:45.539430  276064 out.go:177] * Enabled addons: storage-provisioner, default-storageclass, metrics-server, dashboard
	I0630 21:21:45.540750  276064 addons.go:414] enableAddons completed in 2.0691399s
	I0630 21:21:45.575595  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:21:44.660831  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:47.160149  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:45.182445  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:47.682514  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:47.576330  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:21:49.576407  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:21:49.160793  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:51.660805  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:50.182451  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:52.183083  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:52.076426  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:21:54.076887  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:21:54.161146  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:56.660728  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:54.683102  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:57.182501  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:59.182957  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:56.575738  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:21:58.576604  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:00.577162  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:21:59.160517  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:01.160700  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:01.183043  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:03.682640  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:03.075860  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:05.076679  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:03.661117  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:06.160731  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:05.682843  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:08.182414  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:07.576553  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:10.075989  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:08.660876  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:11.160848  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:10.682414  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:12.682830  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:12.076661  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:14.576273  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:13.660019  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:15.660934  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:15.183230  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:17.681937  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:17.075764  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:19.076352  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:18.160512  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:20.661337  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:19.682685  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:22.182341  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:21.575906  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:24.076044  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:23.159968  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:25.659994  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:27.660386  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:24.682559  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:26.682712  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:28.682765  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:26.076272  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:28.076381  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:30.576589  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:29.660781  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:31.661081  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:31.182114  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:33.182667  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:33.075544  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:35.076859  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:34.160031  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:36.174889  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:35.682410  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:37.682440  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:37.576222  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:40.076094  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:38.660329  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:40.661271  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:39.682506  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:42.182441  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:44.182613  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:42.076569  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:44.575778  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:43.160906  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:45.660687  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:47.660756  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:46.182890  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:48.682065  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:50.184705  271327 node_ready.go:38] duration metric: took 4m0.008399385s waiting for node "old-k8s-version-20220630210005-9950" to be "Ready" ...
	I0630 21:22:50.186899  271327 out.go:177] 
	W0630 21:22:50.188676  271327 out.go:239] X Exiting due to GUEST_START: wait 6m0s for node: waiting for node to be ready: waitNodeCondition: timed out waiting for the condition
	W0630 21:22:50.188714  271327 out.go:239] * 
	W0630 21:22:50.189487  271327 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0630 21:22:50.191389  271327 out.go:177] 
	I0630 21:22:47.075947  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:49.576265  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:50.159356  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:52.163951  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:52.075526  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:54.076399  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:54.660447  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:57.160029  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:56.575822  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:58.576331  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:00.576702  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:59.160433  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:01.660547  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:03.076469  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:05.576257  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:03.660907  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:06.160339  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:08.076793  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:10.576173  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:08.160593  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:10.660347  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:12.660595  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:13.075956  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:15.076120  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:15.160070  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:17.660236  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:17.576068  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:20.076292  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:20.159819  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:22.159969  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:22.076376  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:24.576689  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:24.160202  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:26.160569  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:27.075866  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:29.075916  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:28.660765  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:30.661044  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:31.076034  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:33.076065  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:35.575815  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:33.160787  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:35.660078  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:37.660223  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:38.076264  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:40.076307  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:39.661253  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:42.160767  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:42.576389  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:45.076289  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:44.660279  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:46.660767  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:47.576205  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:50.076370  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:49.159959  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:51.160087  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:52.576483  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:55.076140  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:53.160885  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:55.660365  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:57.077197  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:59.575847  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:58.160601  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:00.660863  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:02.076497  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:04.576615  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:03.160979  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:05.661301  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:07.076328  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:09.076375  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:08.160501  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:10.661257  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:11.575987  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:13.576105  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:15.576639  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:13.160653  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:15.660136  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:18.076538  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:20.576354  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:18.160271  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:20.660902  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:23.076485  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:25.575931  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:23.160075  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:25.160311  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:27.660413  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:28.076238  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:30.076402  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:30.159564  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:31.157632  282690 pod_ready.go:81] duration metric: took 4m0.003038156s waiting for pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace to be "Ready" ...
	E0630 21:24:31.157659  282690 pod_ready.go:66] WaitExtra: waitPodCondition: timed out waiting 4m0s for pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace to be "Ready" (will not retry!)
	I0630 21:24:31.157707  282690 pod_ready.go:38] duration metric: took 4m0.007820375s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0630 21:24:31.157735  282690 kubeadm.go:630] restartCluster took 4m10.761529656s
	W0630 21:24:31.157891  282690 out.go:239] ! Unable to restart cluster, will reset it: extra: timed out waiting 4m0s for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready"
	I0630 21:24:31.157919  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm reset --cri-socket /run/containerd/containerd.sock --force"
	I0630 21:24:32.851642  282690 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm reset --cri-socket /run/containerd/containerd.sock --force": (1.693695416s)
	I0630 21:24:32.851727  282690 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 21:24:32.861758  282690 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0630 21:24:32.869625  282690 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver
	I0630 21:24:32.869693  282690 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0630 21:24:32.876878  282690 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0630 21:24:32.876929  282690 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0630 21:24:32.076763  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:34.576381  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:36.576542  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:39.075659  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:41.836005  282690 out.go:204]   - Generating certificates and keys ...
	I0630 21:24:41.839508  282690 out.go:204]   - Booting up control plane ...
	I0630 21:24:41.842351  282690 out.go:204]   - Configuring RBAC rules ...
	I0630 21:24:41.844644  282690 cni.go:95] Creating CNI manager for ""
	I0630 21:24:41.844675  282690 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:24:41.846424  282690 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0630 21:24:41.847990  282690 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0630 21:24:41.853099  282690 cni.go:189] applying CNI manifest using /var/lib/minikube/binaries/v1.24.2/kubectl ...
	I0630 21:24:41.853126  282690 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2429 bytes)
	I0630 21:24:41.932756  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0630 21:24:42.729823  282690 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0630 21:24:42.729895  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:42.729926  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl label nodes minikube.k8s.io/version=v1.26.0 minikube.k8s.io/commit=251ffcec0e4c997cd7732864187747cc579943c9 minikube.k8s.io/name=embed-certs-20220630210659-9950 minikube.k8s.io/updated_at=2022_06_30T21_24_42_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:42.738247  282690 ops.go:34] apiserver oom_adj: -16
	I0630 21:24:42.834211  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:41.076287  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:43.076543  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:45.576221  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:43.427269  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:43.927268  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:44.426722  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:44.926851  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:45.427106  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:45.927276  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:46.427354  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:46.926751  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:47.426882  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:47.927284  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:48.076060  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:50.575977  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:48.427353  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:48.927037  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:49.426521  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:49.926695  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:50.426914  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:50.927459  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:51.427334  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:51.927468  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:52.427189  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:52.927285  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:53.426965  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:53.926595  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:53.987285  282690 kubeadm.go:1045] duration metric: took 11.25744575s to wait for elevateKubeSystemPrivileges.
	I0630 21:24:53.987312  282690 kubeadm.go:397] StartCluster complete in 4m33.638985641s
	I0630 21:24:53.987328  282690 settings.go:142] acquiring lock: {Name:mkcbd229caa05b60d3551ef0b47eea08424c9b5d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:24:53.987411  282690 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:24:53.988694  282690 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig: {Name:mk34e4a4e7b04f624b9adbda4f77ee20b38308ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:24:54.505472  282690 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "embed-certs-20220630210659-9950" rescaled to 1
	I0630 21:24:54.505546  282690 start.go:208] Will wait 6m0s for node &{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0630 21:24:54.505581  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0630 21:24:54.507434  282690 out.go:177] * Verifying Kubernetes components...
	I0630 21:24:54.505671  282690 addons.go:412] enableAddons start: toEnable=map[dashboard:true metrics-server:true], additional=[]
	I0630 21:24:54.507512  282690 addons.go:65] Setting storage-provisioner=true in profile "embed-certs-20220630210659-9950"
	I0630 21:24:54.507530  282690 addons.go:153] Setting addon storage-provisioner=true in "embed-certs-20220630210659-9950"
	I0630 21:24:54.505785  282690 config.go:178] Loaded profile config "embed-certs-20220630210659-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:24:54.508995  282690 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 21:24:54.507534  282690 addons.go:65] Setting dashboard=true in profile "embed-certs-20220630210659-9950"
	I0630 21:24:54.509033  282690 addons.go:153] Setting addon dashboard=true in "embed-certs-20220630210659-9950"
	W0630 21:24:54.509043  282690 addons.go:162] addon dashboard should already be in state true
	I0630 21:24:54.507547  282690 addons.go:65] Setting default-storageclass=true in profile "embed-certs-20220630210659-9950"
	I0630 21:24:54.509118  282690 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "embed-certs-20220630210659-9950"
	I0630 21:24:54.507548  282690 addons.go:65] Setting metrics-server=true in profile "embed-certs-20220630210659-9950"
	W0630 21:24:54.507573  282690 addons.go:162] addon storage-provisioner should already be in state true
	I0630 21:24:54.509134  282690 host.go:66] Checking if "embed-certs-20220630210659-9950" exists ...
	I0630 21:24:54.509177  282690 host.go:66] Checking if "embed-certs-20220630210659-9950" exists ...
	I0630 21:24:54.509200  282690 addons.go:153] Setting addon metrics-server=true in "embed-certs-20220630210659-9950"
	W0630 21:24:54.509223  282690 addons.go:162] addon metrics-server should already be in state true
	I0630 21:24:54.509308  282690 host.go:66] Checking if "embed-certs-20220630210659-9950" exists ...
	I0630 21:24:54.509462  282690 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:24:54.509581  282690 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:24:54.509613  282690 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:24:54.509797  282690 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:24:54.560813  282690 out.go:177]   - Using image fake.domain/k8s.gcr.io/echoserver:1.4
	I0630 21:24:54.562228  282690 addons.go:345] installing /etc/kubernetes/addons/metrics-apiservice.yaml
	I0630 21:24:54.562250  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
	I0630 21:24:54.566558  282690 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0630 21:24:54.563422  282690 addons.go:153] Setting addon default-storageclass=true in "embed-certs-20220630210659-9950"
	I0630 21:24:54.564610  282690 out.go:177]   - Using image kubernetesui/dashboard:v2.6.0
	I0630 21:24:54.564664  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	W0630 21:24:54.566619  282690 addons.go:162] addon default-storageclass should already be in state true
	I0630 21:24:54.568042  282690 addons.go:345] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 21:24:54.568076  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0630 21:24:54.568138  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:24:54.568049  282690 host.go:66] Checking if "embed-certs-20220630210659-9950" exists ...
	I0630 21:24:54.568896  282690 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:24:54.571125  282690 out.go:177]   - Using image k8s.gcr.io/echoserver:1.4
	I0630 21:24:52.576199  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:54.577462  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:54.573220  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-ns.yaml
	I0630 21:24:54.573240  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
	I0630 21:24:54.573296  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:24:54.596761  282690 node_ready.go:35] waiting up to 6m0s for node "embed-certs-20220630210659-9950" to be "Ready" ...
	I0630 21:24:54.596796  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.94.1 host.minikube.internal\n           fallthrough\n        }' | sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0630 21:24:54.622285  282690 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49442 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:24:54.625192  282690 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49442 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:24:54.629199  282690 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49442 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:24:54.632573  282690 addons.go:345] installing /etc/kubernetes/addons/storageclass.yaml
	I0630 21:24:54.632600  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0630 21:24:54.632654  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:24:54.674915  282690 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49442 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:24:54.846449  282690 addons.go:345] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
	I0630 21:24:54.846481  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1820 bytes)
	I0630 21:24:54.938792  282690 addons.go:345] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
	I0630 21:24:54.938872  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
	I0630 21:24:54.943079  282690 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0630 21:24:54.947159  282690 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 21:24:54.947675  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
	I0630 21:24:54.947698  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
	I0630 21:24:55.026994  282690 addons.go:345] installing /etc/kubernetes/addons/metrics-server-service.yaml
	I0630 21:24:55.027031  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
	I0630 21:24:55.035197  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
	I0630 21:24:55.035232  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
	I0630 21:24:55.053605  282690 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I0630 21:24:55.126653  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-configmap.yaml
	I0630 21:24:55.126705  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
	I0630 21:24:55.146581  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-dp.yaml
	I0630 21:24:55.146621  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4196 bytes)
	I0630 21:24:55.327942  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-role.yaml
	I0630 21:24:55.328024  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
	I0630 21:24:55.343459  282690 start.go:806] {"host.minikube.internal": 192.168.94.1} host record injected into CoreDNS
	I0630 21:24:55.432902  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
	I0630 21:24:55.432936  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
	I0630 21:24:55.449659  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-sa.yaml
	I0630 21:24:55.449700  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
	I0630 21:24:55.535585  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-secret.yaml
	I0630 21:24:55.535622  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
	I0630 21:24:55.637082  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-svc.yaml
	I0630 21:24:55.637110  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
	I0630 21:24:55.654090  282690 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	I0630 21:24:56.256357  282690 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (1.202695189s)
	I0630 21:24:56.256419  282690 addons.go:383] Verifying addon metrics-server=true in "embed-certs-20220630210659-9950"
	I0630 21:24:56.635370  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:24:57.057755  282690 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (1.403598153s)
	I0630 21:24:57.059648  282690 out.go:177] * Enabled addons: default-storageclass, storage-provisioner, metrics-server, dashboard
	I0630 21:24:57.061353  282690 addons.go:414] enableAddons completed in 2.555682965s
	I0630 21:24:57.076377  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:59.575515  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:59.133305  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:01.133976  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:01.575803  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:03.576220  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:05.576603  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:03.633140  282690 node_ready.go:58] node "embE0630 21:34:47.609040    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/client.crt: no such file or directory
ed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:05.633312  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:07.633508  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:08.075989  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:10.576424  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:09.633916  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:12.134025  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:13.075816  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:15.076512  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:14.134148  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:16.633590  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:17.575814  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:19.576180  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:19.133861  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:21.634052  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:22.076523  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:24.076612  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:23.634100  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:26.133369  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:28.133752  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:26.076674  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:28.575901  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:30.134009  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:32.633645  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:31.076339  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:33.576385  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:34.633970  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:37.133998  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:36.076191  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:38.576126  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:40.576363  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:39.633552  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:42.133635  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:43.076600  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:43.577767  276064 node_ready.go:38] duration metric: took 4m0.008779238s waiting for node "default-k8s-different-port-20220630210335-9950" to be "Ready" ...
	I0630 21:25:43.580054  276064 out.go:177] 
	W0630 21:25:43.581406  276064 out.go:239] X Exiting due to GUEST_START: wait 6m0s for node: waiting for node to be ready: waitNodeCondition: timed out waiting for the condition
	W0630 21:25:43.581422  276064 out.go:239] * 
	W0630 21:25:43.582123  276064 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0630 21:25:43.583833  276064 out.go:177] 
	I0630 21:25:44.133850  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:46.633832  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:48.633923  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:51.133282  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:53.134021  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:55.134340  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:57.633598  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:59.633912  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:01.634030  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:04.134240  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:06.634341  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:09.134132  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:11.633755  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:13.633838  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:16.134412  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:18.634048  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:21.133258  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:23.134085  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:25.633525  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:27.633880  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:29.634672  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:32.133127  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:34.133922  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:36.134141  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:38.635943  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:41.134059  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:43.634129  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:46.133833  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:48.634266  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:51.133583  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:53.633861  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:55.634000  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:57.634221  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:00.134428  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:02.634184  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:04.634236  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:07.133392  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:09.133620  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:11.133918  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:13.633511  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:15.634578  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:18.134059  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:20.633162  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:22.634065  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:25.133441  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:27.133812  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:29.634200  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:32.133633  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:34.634090  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:37.134098  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:39.634528  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:42.134216  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:44.633646  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:46.633772  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:49.133433  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:51.633343  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:54.133271  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:56.133890  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:58.633874  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:01.133490  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:03.634155  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:06.133638  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:08.134014  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:10.633584  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:12.633988  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:15.133284  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:17.633303  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:19.633472  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:21.633579  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:24.133628  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:26.633535  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:29.133336  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:31.134181  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:33.633631  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:35.634122  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:38.134153  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:40.634086  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:43.134075  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:45.633956  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:47.634182  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:50.133652  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:52.633744  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:54.635658  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:54.635684  282690 node_ready.go:38] duration metric: took 4m0.038888758s waiting for node "embed-certs-20220630210659-9950" to be "Ready" ...
	I0630 21:28:54.638083  282690 out.go:177] 
	W0630 21:28:54.639729  282690 out.go:239] X Exiting due to GUEST_START: wait 6m0s for node: waiting for node to be ready: waitNodeCondition: timed out waiting for the condition
	W0630 21:28:54.639748  282690 out.go:239] * 
	W0630 21:28:54.640518  282690 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0630 21:28:54.642114  282690 out.go:177] 
	
	* 
	* ==> container status <==
	* CONTAINER           IMAGE               CREATED             STATE               NAME                      ATTEMPT             POD ID
	5abd47f0e714b       6fb66cd78abfe       46 seconds ago      Running             kindnet-cni               4                   876e5b9119df9
	7d08ab779c2a5       6fb66cd78abfe       4 minutes ago       Exited              kindnet-cni               3                   876e5b9119df9
	d47f6a5df5e9b       a634548d10b03       13 minutes ago      Running             kube-proxy                0                   cd72e6783bb1f
	0adbc36a43397       5d725196c1f47       13 minutes ago      Running             kube-scheduler            2                   dc38f884e8b32
	3083b721cff99       aebe758cef4cd       13 minutes ago      Running             etcd                      2                   c5dfb9627bf22
	ade2cb7ba62f5       d3377ffb7177c       13 minutes ago      Running             kube-apiserver            2                   d121049ea110c
	af7e649d4589c       34cdf99b1bb3b       13 minutes ago      Running             kube-controller-manager   2                   9e70ab11adf3c
	
	* 
	* ==> containerd <==
	* -- Logs begin at Thu 2022-06-30 21:16:52 UTC, end at Thu 2022-06-30 21:34:47 UTC. --
	Jun 30 21:27:07 default-k8s-different-port-20220630210335-9950 containerd[394]: time="2022-06-30T21:27:07.151414119Z" level=info msg="RemoveContainer for \"e8ebd443f41a48f9dd19d3ad11b8b72c1e0e6c274746e99732dddedf4cbae04b\" returns successfully"
	Jun 30 21:27:20 default-k8s-different-port-20220630210335-9950 containerd[394]: time="2022-06-30T21:27:20.427667252Z" level=info msg="CreateContainer within sandbox \"876e5b9119df9849592e6a00db07791a256acd949bd98804a0a82c03338fb66e\" for container &ContainerMetadata{Name:kindnet-cni,Attempt:2,}"
	Jun 30 21:27:20 default-k8s-different-port-20220630210335-9950 containerd[394]: time="2022-06-30T21:27:20.442151058Z" level=info msg="CreateContainer within sandbox \"876e5b9119df9849592e6a00db07791a256acd949bd98804a0a82c03338fb66e\" for &ContainerMetadata{Name:kindnet-cni,Attempt:2,} returns container id \"fcf9d1168de18ef9ae713445b2315258fb4c5d62b1e8d5d2dcce492088cda2d4\""
	Jun 30 21:27:20 default-k8s-different-port-20220630210335-9950 containerd[394]: time="2022-06-30T21:27:20.442646321Z" level=info msg="StartContainer for \"fcf9d1168de18ef9ae713445b2315258fb4c5d62b1e8d5d2dcce492088cda2d4\""
	Jun 30 21:27:20 default-k8s-different-port-20220630210335-9950 containerd[394]: time="2022-06-30T21:27:20.540954907Z" level=info msg="StartContainer for \"fcf9d1168de18ef9ae713445b2315258fb4c5d62b1e8d5d2dcce492088cda2d4\" returns successfully"
	Jun 30 21:30:00 default-k8s-different-port-20220630210335-9950 containerd[394]: time="2022-06-30T21:30:00.976499714Z" level=info msg="shim disconnected" id=fcf9d1168de18ef9ae713445b2315258fb4c5d62b1e8d5d2dcce492088cda2d4
	Jun 30 21:30:00 default-k8s-different-port-20220630210335-9950 containerd[394]: time="2022-06-30T21:30:00.976558154Z" level=warning msg="cleaning up after shim disconnected" id=fcf9d1168de18ef9ae713445b2315258fb4c5d62b1e8d5d2dcce492088cda2d4 namespace=k8s.io
	Jun 30 21:30:00 default-k8s-different-port-20220630210335-9950 containerd[394]: time="2022-06-30T21:30:00.976572925Z" level=info msg="cleaning up dead shim"
	Jun 30 21:30:00 default-k8s-different-port-20220630210335-9950 containerd[394]: time="2022-06-30T21:30:00.986596220Z" level=warning msg="cleanup warnings time=\"2022-06-30T21:30:00Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=4376 runtime=io.containerd.runc.v2\n"
	Jun 30 21:30:01 default-k8s-different-port-20220630210335-9950 containerd[394]: time="2022-06-30T21:30:01.479664702Z" level=info msg="RemoveContainer for \"4443c9b8140601692cfb05660640a781fea18055b410ee8102fcfc6fac406e94\""
	Jun 30 21:30:01 default-k8s-different-port-20220630210335-9950 containerd[394]: time="2022-06-30T21:30:01.484925052Z" level=info msg="RemoveContainer for \"4443c9b8140601692cfb05660640a781fea18055b410ee8102fcfc6fac406e94\" returns successfully"
	Jun 30 21:30:30 default-k8s-different-port-20220630210335-9950 containerd[394]: time="2022-06-30T21:30:30.427889325Z" level=info msg="CreateContainer within sandbox \"876e5b9119df9849592e6a00db07791a256acd949bd98804a0a82c03338fb66e\" for container &ContainerMetadata{Name:kindnet-cni,Attempt:3,}"
	Jun 30 21:30:30 default-k8s-different-port-20220630210335-9950 containerd[394]: time="2022-06-30T21:30:30.440662178Z" level=info msg="CreateContainer within sandbox \"876e5b9119df9849592e6a00db07791a256acd949bd98804a0a82c03338fb66e\" for &ContainerMetadata{Name:kindnet-cni,Attempt:3,} returns container id \"7d08ab779c2a51d85818a00f55578066de39dce4a7dd45dfbbb6b62bacc6e5f2\""
	Jun 30 21:30:30 default-k8s-different-port-20220630210335-9950 containerd[394]: time="2022-06-30T21:30:30.441316562Z" level=info msg="StartContainer for \"7d08ab779c2a51d85818a00f55578066de39dce4a7dd45dfbbb6b62bacc6e5f2\""
	Jun 30 21:30:30 default-k8s-different-port-20220630210335-9950 containerd[394]: time="2022-06-30T21:30:30.627916807Z" level=info msg="StartContainer for \"7d08ab779c2a51d85818a00f55578066de39dce4a7dd45dfbbb6b62bacc6e5f2\" returns successfully"
	Jun 30 21:33:10 default-k8s-different-port-20220630210335-9950 containerd[394]: time="2022-06-30T21:33:10.981068483Z" level=info msg="shim disconnected" id=7d08ab779c2a51d85818a00f55578066de39dce4a7dd45dfbbb6b62bacc6e5f2
	Jun 30 21:33:10 default-k8s-different-port-20220630210335-9950 containerd[394]: time="2022-06-30T21:33:10.981141181Z" level=warning msg="cleaning up after shim disconnected" id=7d08ab779c2a51d85818a00f55578066de39dce4a7dd45dfbbb6b62bacc6e5f2 namespace=k8s.io
	Jun 30 21:33:10 default-k8s-different-port-20220630210335-9950 containerd[394]: time="2022-06-30T21:33:10.981153237Z" level=info msg="cleaning up dead shim"
	Jun 30 21:33:10 default-k8s-different-port-20220630210335-9950 containerd[394]: time="2022-06-30T21:33:10.991143882Z" level=warning msg="cleanup warnings time=\"2022-06-30T21:33:10Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=4485 runtime=io.containerd.runc.v2\n"
	Jun 30 21:33:11 default-k8s-different-port-20220630210335-9950 containerd[394]: time="2022-06-30T21:33:11.835466043Z" level=info msg="RemoveContainer for \"fcf9d1168de18ef9ae713445b2315258fb4c5d62b1e8d5d2dcce492088cda2d4\""
	Jun 30 21:33:11 default-k8s-different-port-20220630210335-9950 containerd[394]: time="2022-06-30T21:33:11.839953948Z" level=info msg="RemoveContainer for \"fcf9d1168de18ef9ae713445b2315258fb4c5d62b1e8d5d2dcce492088cda2d4\" returns successfully"
	Jun 30 21:34:00 default-k8s-different-port-20220630210335-9950 containerd[394]: time="2022-06-30T21:34:00.428186657Z" level=info msg="CreateContainer within sandbox \"876e5b9119df9849592e6a00db07791a256acd949bd98804a0a82c03338fb66e\" for container &ContainerMetadata{Name:kindnet-cni,Attempt:4,}"
	Jun 30 21:34:00 default-k8s-different-port-20220630210335-9950 containerd[394]: time="2022-06-30T21:34:00.441250975Z" level=info msg="CreateContainer within sandbox \"876e5b9119df9849592e6a00db07791a256acd949bd98804a0a82c03338fb66e\" for &ContainerMetadata{Name:kindnet-cni,Attempt:4,} returns container id \"5abd47f0e714b641aacfbb3823ff2f99896acb5959ff85abff4b8955f963c5e7\""
	Jun 30 21:34:00 default-k8s-different-port-20220630210335-9950 containerd[394]: time="2022-06-30T21:34:00.441864981Z" level=info msg="StartContainer for \"5abd47f0e714b641aacfbb3823ff2f99896acb5959ff85abff4b8955f963c5e7\""
	Jun 30 21:34:00 default-k8s-different-port-20220630210335-9950 containerd[394]: time="2022-06-30T21:34:00.528165887Z" level=info msg="StartContainer for \"5abd47f0e714b641aacfbb3823ff2f99896acb5959ff85abff4b8955f963c5e7\" returns successfully"
	
	* 
	* ==> describe nodes <==
	* Name:               default-k8s-different-port-20220630210335-9950
	Roles:              control-plane
	Labels:             beta.kubernetes.io/arch=amd64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=amd64
	                    kubernetes.io/hostname=default-k8s-different-port-20220630210335-9950
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=251ffcec0e4c997cd7732864187747cc579943c9
	                    minikube.k8s.io/name=default-k8s-different-port-20220630210335-9950
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2022_06_30T21_21_31_0700
	                    minikube.k8s.io/version=v1.26.0
	                    node-role.kubernetes.io/control-plane=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///run/containerd/containerd.sock
	                    node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Thu, 30 Jun 2022 21:21:27 +0000
	Taints:             node.kubernetes.io/not-ready:NoExecute
	                    node.kubernetes.io/not-ready:NoSchedule
	Unschedulable:      false
	Lease:
	  HolderIdentity:  default-k8s-different-port-20220630210335-9950
	  AcquireTime:     <unset>
	  RenewTime:       Thu, 30 Jun 2022 21:34:38 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Thu, 30 Jun 2022 21:31:54 +0000   Thu, 30 Jun 2022 21:21:24 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Thu, 30 Jun 2022 21:31:54 +0000   Thu, 30 Jun 2022 21:21:24 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Thu, 30 Jun 2022 21:31:54 +0000   Thu, 30 Jun 2022 21:21:24 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            False   Thu, 30 Jun 2022 21:31:54 +0000   Thu, 30 Jun 2022 21:21:24 +0000   KubeletNotReady              container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Addresses:
	  InternalIP:  192.168.85.2
	  Hostname:    default-k8s-different-port-20220630210335-9950
	Capacity:
	  cpu:                8
	  ephemeral-storage:  304695084Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32873488Ki
	  pods:               110
	Allocatable:
	  cpu:                8
	  ephemeral-storage:  304695084Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32873488Ki
	  pods:               110
	System Info:
	  Machine ID:                 bbe1e1cef6e940328962dca52b3c5731
	  System UUID:                f0807fcb-4145-441b-8a5a-5dbf32733249
	  Boot ID:                    471c4729-f046-4a15-bc49-46f3ad561708
	  Kernel Version:             5.15.0-1012-gcp
	  OS Image:                   Ubuntu 20.04.4 LTS
	  Operating System:           linux
	  Architecture:               amd64
	  Container Runtime Version:  containerd://1.6.6
	  Kubelet Version:            v1.24.2
	  Kube-Proxy Version:         v1.24.2
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (6 in total)
	  Namespace                   Name                                                                      CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                                                      ------------  ----------  ---------------  -------------  ---
	  kube-system                 etcd-default-k8s-different-port-20220630210335-9950                       100m (1%!)(MISSING)     0 (0%!)(MISSING)      100Mi (0%!)(MISSING)       0 (0%!)(MISSING)         13m
	  kube-system                 kindnet-pt7lb                                                             100m (1%!)(MISSING)     100m (1%!)(MISSING)   50Mi (0%!)(MISSING)        50Mi (0%!)(MISSING)      13m
	  kube-system                 kube-apiserver-default-k8s-different-port-20220630210335-9950             250m (3%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         13m
	  kube-system                 kube-controller-manager-default-k8s-different-port-20220630210335-9950    200m (2%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         13m
	  kube-system                 kube-proxy-pwz8s                                                          0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         13m
	  kube-system                 kube-scheduler-default-k8s-different-port-20220630210335-9950             100m (1%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         13m
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                750m (9%!)(MISSING)   100m (1%!)(MISSING)
	  memory             150Mi (0%!)(MISSING)  50Mi (0%!)(MISSING)
	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	Events:
	  Type    Reason                   Age   From             Message
	  ----    ------                   ----  ----             -------
	  Normal  Starting                 13m   kube-proxy       
	  Normal  Starting                 13m   kubelet          Starting kubelet.
	  Normal  NodeHasSufficientMemory  13m   kubelet          Node default-k8s-different-port-20220630210335-9950 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    13m   kubelet          Node default-k8s-different-port-20220630210335-9950 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     13m   kubelet          Node default-k8s-different-port-20220630210335-9950 status is now: NodeHasSufficientPID
	  Normal  NodeAllocatableEnforced  13m   kubelet          Updated Node Allocatable limit across pods
	  Normal  RegisteredNode           13m   node-controller  Node default-k8s-different-port-20220630210335-9950 event: Registered Node default-k8s-different-port-20220630210335-9950 in Controller
	
	* 
	* ==> dmesg <==
	* [  +2.939825] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000011] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.027789] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.019913] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[ +21.968090] IPv4: martian destination 127.0.0.11 from 10.244.0.3, dev veth8071d138
	[ +25.445872] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.029436] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.023957] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +2.947695] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[Jun30 21:05] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.023879] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +2.955783] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.011828] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000005] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.027896] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	
	* 
	* ==> etcd [3083b721cff99d67d84ed589eadc4c2e61265cef0e7da855dd486e67d6be5953] <==
	* {"level":"info","ts":"2022-06-30T21:21:23.828Z","caller":"embed/etcd.go:688","msg":"starting with client TLS","tls-info":"cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, client-cert=, client-key=, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = ","cipher-suites":[]}
	{"level":"info","ts":"2022-06-30T21:21:23.829Z","caller":"embed/etcd.go:581","msg":"serving peer traffic","address":"192.168.85.2:2380"}
	{"level":"info","ts":"2022-06-30T21:21:23.829Z","caller":"embed/etcd.go:553","msg":"cmux::serve","address":"192.168.85.2:2380"}
	{"level":"info","ts":"2022-06-30T21:21:23.829Z","caller":"embed/etcd.go:277","msg":"now serving peer/client/metrics","local-member-id":"9f0758e1c58a86ed","initial-advertise-peer-urls":["https://192.168.85.2:2380"],"listen-peer-urls":["https://192.168.85.2:2380"],"advertise-client-urls":["https://192.168.85.2:2379"],"listen-client-urls":["https://127.0.0.1:2379","https://192.168.85.2:2379"],"listen-metrics-urls":["http://127.0.0.1:2381"]}
	{"level":"info","ts":"2022-06-30T21:21:23.829Z","caller":"embed/etcd.go:763","msg":"serving metrics","address":"http://127.0.0.1:2381"}
	{"level":"info","ts":"2022-06-30T21:21:24.357Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"9f0758e1c58a86ed is starting a new election at term 1"}
	{"level":"info","ts":"2022-06-30T21:21:24.357Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"9f0758e1c58a86ed became pre-candidate at term 1"}
	{"level":"info","ts":"2022-06-30T21:21:24.357Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"9f0758e1c58a86ed received MsgPreVoteResp from 9f0758e1c58a86ed at term 1"}
	{"level":"info","ts":"2022-06-30T21:21:24.357Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"9f0758e1c58a86ed became candidate at term 2"}
	{"level":"info","ts":"2022-06-30T21:21:24.357Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"9f0758e1c58a86ed received MsgVoteResp from 9f0758e1c58a86ed at term 2"}
	{"level":"info","ts":"2022-06-30T21:21:24.357Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"9f0758e1c58a86ed became leader at term 2"}
	{"level":"info","ts":"2022-06-30T21:21:24.357Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: 9f0758e1c58a86ed elected leader 9f0758e1c58a86ed at term 2"}
	{"level":"info","ts":"2022-06-30T21:21:24.357Z","caller":"etcdserver/server.go:2507","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}
	{"level":"info","ts":"2022-06-30T21:21:24.358Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"68eaea490fab4e05","local-member-id":"9f0758e1c58a86ed","cluster-version":"3.5"}
	{"level":"info","ts":"2022-06-30T21:21:24.358Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
	{"level":"info","ts":"2022-06-30T21:21:24.358Z","caller":"etcdserver/server.go:2042","msg":"published local member to cluster through raft","local-member-id":"9f0758e1c58a86ed","local-member-attributes":"{Name:default-k8s-different-port-20220630210335-9950 ClientURLs:[https://192.168.85.2:2379]}","request-path":"/0/members/9f0758e1c58a86ed/attributes","cluster-id":"68eaea490fab4e05","publish-timeout":"7s"}
	{"level":"info","ts":"2022-06-30T21:21:24.358Z","caller":"etcdserver/server.go:2531","msg":"cluster version is updated","cluster-version":"3.5"}
	{"level":"info","ts":"2022-06-30T21:21:24.358Z","caller":"embed/serve.go:98","msg":"ready to serve client requests"}
	{"level":"info","ts":"2022-06-30T21:21:24.358Z","caller":"embed/serve.go:98","msg":"ready to serve client requests"}
	{"level":"info","ts":"2022-06-30T21:21:24.359Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
	{"level":"info","ts":"2022-06-30T21:21:24.359Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
	{"level":"info","ts":"2022-06-30T21:21:24.360Z","caller":"embed/serve.go:188","msg":"serving client traffic securely","address":"192.168.85.2:2379"}
	{"level":"info","ts":"2022-06-30T21:21:24.360Z","caller":"embed/serve.go:188","msg":"serving client traffic securely","address":"127.0.0.1:2379"}
	{"level":"info","ts":"2022-06-30T21:31:24.641Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":537}
	{"level":"info","ts":"2022-06-30T21:31:24.642Z","caller":"mvcc/kvstore_compaction.go:57","msg":"finished scheduled compaction","compact-revision":537,"took":"462.988µs"}
	
	* 
	* ==> kernel <==
	*  21:34:47 up  1:17,  0 users,  load average: 0.15, 0.30, 0.68
	Linux default-k8s-different-port-20220630210335-9950 5.15.0-1012-gcp #17~20.04.1-Ubuntu SMP Thu Jun 23 16:10:34 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
	PRETTY_NAME="Ubuntu 20.04.4 LTS"
	
	* 
	* ==> kube-apiserver [ade2cb7ba62f5944399cb66c2f872cdd8fc48a3620be8eeaa0500bd0967b4e9f] <==
	* W0630 21:29:28.043363       1 handler_proxy.go:102] no RequestInfo found in the context
	E0630 21:29:28.043431       1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
	, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
	I0630 21:29:28.043444       1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
	W0630 21:31:28.045988       1 handler_proxy.go:102] no RequestInfo found in the context
	W0630 21:31:28.045994       1 handler_proxy.go:102] no RequestInfo found in the context
	E0630 21:31:28.046041       1 controller.go:113] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: Error, could not get list of group versions for APIService
	I0630 21:31:28.046051       1 controller.go:126] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
	E0630 21:31:28.046105       1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
	, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
	I0630 21:31:28.047263       1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
	W0630 21:32:28.046361       1 handler_proxy.go:102] no RequestInfo found in the context
	E0630 21:32:28.046409       1 controller.go:113] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: Error, could not get list of group versions for APIService
	I0630 21:32:28.046418       1 controller.go:126] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
	W0630 21:32:28.047434       1 handler_proxy.go:102] no RequestInfo found in the context
	E0630 21:32:28.047485       1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
	, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
	I0630 21:32:28.047497       1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
	W0630 21:34:28.047599       1 handler_proxy.go:102] no RequestInfo found in the context
	W0630 21:34:28.047616       1 handler_proxy.go:102] no RequestInfo found in the context
	E0630 21:34:28.047654       1 controller.go:113] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: Error, could not get list of group versions for APIService
	I0630 21:34:28.047663       1 controller.go:126] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
	E0630 21:34:28.047690       1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
	, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
	I0630 21:34:28.048805       1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
	
	* 
	* ==> kube-controller-manager [af7e649d4589c7d448c2c06a361ca79a6b23d90fa8eae302f2c0e0e495ad5240] <==
	* W0630 21:28:43.633815       1 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0630 21:29:13.234452       1 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	W0630 21:29:13.648628       1 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0630 21:29:43.242959       1 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	W0630 21:29:43.664037       1 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0630 21:30:13.254563       1 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	W0630 21:30:13.679982       1 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0630 21:30:43.264780       1 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	W0630 21:30:43.692495       1 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0630 21:31:13.277472       1 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	W0630 21:31:13.707520       1 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0630 21:31:43.290881       1 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	W0630 21:31:43.724065       1 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0630 21:32:13.302420       1 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	W0630 21:32:13.738674       1 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0630 21:32:43.311306       1 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	W0630 21:32:43.753196       1 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0630 21:33:13.319546       1 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	W0630 21:33:13.768222       1 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0630 21:33:43.330344       1 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	W0630 21:33:43.782922       1 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0630 21:34:13.355923       1 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	W0630 21:34:13.797373       1 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0630 21:34:43.368997       1 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	W0630 21:34:43.811777       1 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	
	* 
	* ==> kube-proxy [d47f6a5df5e9b26d2438fb390d864ae4ba3f8bbe2309e09681a299f41991dd9b] <==
	* I0630 21:21:45.143403       1 node.go:163] Successfully retrieved node IP: 192.168.85.2
	I0630 21:21:45.143482       1 server_others.go:138] "Detected node IP" address="192.168.85.2"
	I0630 21:21:45.143523       1 server_others.go:578] "Unknown proxy mode, assuming iptables proxy" proxyMode=""
	I0630 21:21:45.234187       1 server_others.go:206] "Using iptables Proxier"
	I0630 21:21:45.234242       1 server_others.go:213] "kube-proxy running in dual-stack mode" ipFamily=IPv4
	I0630 21:21:45.234255       1 server_others.go:214] "Creating dualStackProxier for iptables"
	I0630 21:21:45.234274       1 server_others.go:501] "Detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, , defaulting to no-op detect-local for IPv6"
	I0630 21:21:45.234306       1 proxier.go:259] "Setting route_localnet=1, use nodePortAddresses to filter loopback addresses for NodePorts to skip it https://issues.k8s.io/90259"
	I0630 21:21:45.234498       1 proxier.go:259] "Setting route_localnet=1, use nodePortAddresses to filter loopback addresses for NodePorts to skip it https://issues.k8s.io/90259"
	I0630 21:21:45.234850       1 server.go:661] "Version info" version="v1.24.2"
	I0630 21:21:45.234871       1 server.go:663] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
	I0630 21:21:45.235711       1 config.go:444] "Starting node config controller"
	I0630 21:21:45.235737       1 shared_informer.go:255] Waiting for caches to sync for node config
	I0630 21:21:45.236027       1 config.go:317] "Starting service config controller"
	I0630 21:21:45.236044       1 shared_informer.go:255] Waiting for caches to sync for service config
	I0630 21:21:45.236101       1 config.go:226] "Starting endpoint slice config controller"
	I0630 21:21:45.236108       1 shared_informer.go:255] Waiting for caches to sync for endpoint slice config
	I0630 21:21:45.336288       1 shared_informer.go:262] Caches are synced for node config
	I0630 21:21:45.336316       1 shared_informer.go:262] Caches are synced for endpoint slice config
	I0630 21:21:45.336348       1 shared_informer.go:262] Caches are synced for service config
	
	* 
	* ==> kube-scheduler [0adbc36a43397fe388bed72d2f08645e829158e14a3f25808074ca99d9eac410] <==
	* W0630 21:21:27.145923       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	E0630 21:21:27.145953       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	W0630 21:21:27.146055       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
	E0630 21:21:27.146078       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
	W0630 21:21:27.146224       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	E0630 21:21:27.146248       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	W0630 21:21:27.146756       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E0630 21:21:27.146832       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	W0630 21:21:28.044993       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	W0630 21:21:28.044994       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
	E0630 21:21:28.045032       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E0630 21:21:28.045084       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
	W0630 21:21:28.047263       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0630 21:21:28.047313       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	W0630 21:21:28.171939       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E0630 21:21:28.171994       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	W0630 21:21:28.183387       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	E0630 21:21:28.183431       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	W0630 21:21:28.274358       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E0630 21:21:28.274408       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	W0630 21:21:28.280575       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E0630 21:21:28.280613       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	W0630 21:21:28.460364       1 reflector.go:324] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	E0630 21:21:28.460407       1 reflector.go:138] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	I0630 21:21:31.143202       1 shared_informer.go:262] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	
	* 
	* ==> kubelet <==
	* -- Logs begin at Thu 2022-06-30 21:16:52 UTC, end at Thu 2022-06-30 21:34:47 UTC. --
	Jun 30 21:33:20 default-k8s-different-port-20220630210335-9950 kubelet[3063]: E0630 21:33:20.744474    3063 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:33:24 default-k8s-different-port-20220630210335-9950 kubelet[3063]: I0630 21:33:24.425302    3063 scope.go:110] "RemoveContainer" containerID="7d08ab779c2a51d85818a00f55578066de39dce4a7dd45dfbbb6b62bacc6e5f2"
	Jun 30 21:33:24 default-k8s-different-port-20220630210335-9950 kubelet[3063]: E0630 21:33:24.425638    3063 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kindnet-cni\" with CrashLoopBackOff: \"back-off 40s restarting failed container=kindnet-cni pod=kindnet-pt7lb_kube-system(32dbc267-fce9-4d77-96b8-5521b9a88f87)\"" pod="kube-system/kindnet-pt7lb" podUID=32dbc267-fce9-4d77-96b8-5521b9a88f87
	Jun 30 21:33:25 default-k8s-different-port-20220630210335-9950 kubelet[3063]: E0630 21:33:25.745276    3063 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:33:30 default-k8s-different-port-20220630210335-9950 kubelet[3063]: E0630 21:33:30.746787    3063 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:33:35 default-k8s-different-port-20220630210335-9950 kubelet[3063]: E0630 21:33:35.747784    3063 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:33:36 default-k8s-different-port-20220630210335-9950 kubelet[3063]: I0630 21:33:36.425004    3063 scope.go:110] "RemoveContainer" containerID="7d08ab779c2a51d85818a00f55578066de39dce4a7dd45dfbbb6b62bacc6e5f2"
	Jun 30 21:33:36 default-k8s-different-port-20220630210335-9950 kubelet[3063]: E0630 21:33:36.425309    3063 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kindnet-cni\" with CrashLoopBackOff: \"back-off 40s restarting failed container=kindnet-cni pod=kindnet-pt7lb_kube-system(32dbc267-fce9-4d77-96b8-5521b9a88f87)\"" pod="kube-system/kindnet-pt7lb" podUID=32dbc267-fce9-4d77-96b8-5521b9a88f87
	Jun 30 21:33:40 default-k8s-different-port-20220630210335-9950 kubelet[3063]: E0630 21:33:40.749120    3063 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:33:45 default-k8s-different-port-20220630210335-9950 kubelet[3063]: E0630 21:33:45.750673    3063 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:33:47 default-k8s-different-port-20220630210335-9950 kubelet[3063]: I0630 21:33:47.424479    3063 scope.go:110] "RemoveContainer" containerID="7d08ab779c2a51d85818a00f55578066de39dce4a7dd45dfbbb6b62bacc6e5f2"
	Jun 30 21:33:47 default-k8s-different-port-20220630210335-9950 kubelet[3063]: E0630 21:33:47.424763    3063 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kindnet-cni\" with CrashLoopBackOff: \"back-off 40s restarting failed container=kindnet-cni pod=kindnet-pt7lb_kube-system(32dbc267-fce9-4d77-96b8-5521b9a88f87)\"" pod="kube-system/kindnet-pt7lb" podUID=32dbc267-fce9-4d77-96b8-5521b9a88f87
	Jun 30 21:33:50 default-k8s-different-port-20220630210335-9950 kubelet[3063]: E0630 21:33:50.751449    3063 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:33:55 default-k8s-different-port-20220630210335-9950 kubelet[3063]: E0630 21:33:55.752503    3063 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:34:00 default-k8s-different-port-20220630210335-9950 kubelet[3063]: I0630 21:34:00.425333    3063 scope.go:110] "RemoveContainer" containerID="7d08ab779c2a51d85818a00f55578066de39dce4a7dd45dfbbb6b62bacc6e5f2"
	Jun 30 21:34:00 default-k8s-different-port-20220630210335-9950 kubelet[3063]: E0630 21:34:00.753702    3063 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:34:05 default-k8s-different-port-20220630210335-9950 kubelet[3063]: E0630 21:34:05.755200    3063 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:34:10 default-k8s-different-port-20220630210335-9950 kubelet[3063]: E0630 21:34:10.756313    3063 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:34:15 default-k8s-different-port-20220630210335-9950 kubelet[3063]: E0630 21:34:15.757845    3063 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:34:20 default-k8s-different-port-20220630210335-9950 kubelet[3063]: E0630 21:34:20.759446    3063 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:34:25 default-k8s-different-port-20220630210335-9950 kubelet[3063]: E0630 21:34:25.760197    3063 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:34:30 default-k8s-different-port-20220630210335-9950 kubelet[3063]: E0630 21:34:30.760919    3063 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:34:35 default-k8s-different-port-20220630210335-9950 kubelet[3063]: E0630 21:34:35.762357    3063 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:34:40 default-k8s-different-port-20220630210335-9950 kubelet[3063]: E0630 21:34:40.763840    3063 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:34:45 default-k8s-different-port-20220630210335-9950 kubelet[3063]: E0630 21:34:45.765230    3063 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	

                                                
                                                
-- /stdout --
helpers_test.go:254: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p default-k8s-different-port-20220630210335-9950 -n default-k8s-different-port-20220630210335-9950
E0630 21:34:47.654059    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/client.crt: no such file or directory
E0630 21:34:47.734284    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/client.crt: no such file or directory
E0630 21:34:47.894867    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/client.crt: no such file or directory
helpers_test.go:261: (dbg) Run:  kubectl --context default-k8s-different-port-20220630210335-9950 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:270: non-running pods: coredns-6d4b75cb6d-xpj4r metrics-server-5c6f97fb75-485k9 storage-provisioner dashboard-metrics-scraper-dffd48c4c-k46b6 kubernetes-dashboard-5fd5574d9f-2wm9p
helpers_test.go:272: ======> post-mortem[TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop]: describe non-running pods <======
helpers_test.go:275: (dbg) Run:  kubectl --context default-k8s-different-port-20220630210335-9950 describe pod coredns-6d4b75cb6d-xpj4r metrics-server-5c6f97fb75-485k9 storage-provisioner dashboard-metrics-scraper-dffd48c4c-k46b6 kubernetes-dashboard-5fd5574d9f-2wm9p
helpers_test.go:275: (dbg) Non-zero exit: kubectl --context default-k8s-different-port-20220630210335-9950 describe pod coredns-6d4b75cb6d-xpj4r metrics-server-5c6f97fb75-485k9 storage-provisioner dashboard-metrics-scraper-dffd48c4c-k46b6 kubernetes-dashboard-5fd5574d9f-2wm9p: exit status 1 (55.074762ms)

                                                
                                                
** stderr ** 
	Error from server (NotFound): pods "coredns-6d4b75cb6d-xpj4r" not found
	Error from server (NotFound): pods "metrics-server-5c6f97fb75-485k9" not found
	Error from server (NotFound): pods "storage-provisioner" not found
	Error from server (NotFound): pods "dashboard-metrics-scraper-dffd48c4c-k46b6" not found
	Error from server (NotFound): pods "kubernetes-dashboard-5fd5574d9f-2wm9p" not found

                                                
                                                
** /stderr **
helpers_test.go:277: kubectl --context default-k8s-different-port-20220630210335-9950 describe pod coredns-6d4b75cb6d-xpj4r metrics-server-5c6f97fb75-485k9 storage-provisioner dashboard-metrics-scraper-dffd48c4c-k46b6 kubernetes-dashboard-5fd5574d9f-2wm9p: exit status 1
--- FAIL: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop (542.47s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (542.42s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:342: "kubernetes-dashboard-5fd5574d9f-gfm2q" [de2024d8-7d9c-4558-a068-e1010da772ee] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.)
E0630 21:29:37.806432    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/auto-20220630204858-9950/client.crt: no such file or directory
E0630 21:29:41.441009    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/kindnet-20220630204858-9950/client.crt: no such file or directory
E0630 21:29:53.383041    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/no-preload-20220630210237-9950/client.crt: no such file or directory
E0630 21:30:01.427090    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/enable-default-cni-20220630204858-9950/client.crt: no such file or directory

                                                
                                                
=== CONT  TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop
helpers_test.go:327: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
E0630 21:37:31.421085    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/old-k8s-version-20220630210005-9950/client.crt: no such file or directory
helpers_test.go:327: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
helpers_test.go:327: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
start_stop_delete_test.go:274: ***** TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: pod "k8s-app=kubernetes-dashboard" failed to start within 9m0s: timed out waiting for the condition ****
start_stop_delete_test.go:274: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p embed-certs-20220630210659-9950 -n embed-certs-20220630210659-9950
start_stop_delete_test.go:274: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: showing logs for failed pods as of 2022-06-30 21:37:57.15650961 +0000 UTC m=+4625.395647855
start_stop_delete_test.go:274: (dbg) Run:  kubectl --context embed-certs-20220630210659-9950 describe po kubernetes-dashboard-5fd5574d9f-gfm2q -n kubernetes-dashboard
start_stop_delete_test.go:274: (dbg) Non-zero exit: kubectl --context embed-certs-20220630210659-9950 describe po kubernetes-dashboard-5fd5574d9f-gfm2q -n kubernetes-dashboard: context deadline exceeded (1.612µs)
start_stop_delete_test.go:274: kubectl --context embed-certs-20220630210659-9950 describe po kubernetes-dashboard-5fd5574d9f-gfm2q -n kubernetes-dashboard: context deadline exceeded
start_stop_delete_test.go:274: (dbg) Run:  kubectl --context embed-certs-20220630210659-9950 logs kubernetes-dashboard-5fd5574d9f-gfm2q -n kubernetes-dashboard
start_stop_delete_test.go:274: (dbg) Non-zero exit: kubectl --context embed-certs-20220630210659-9950 logs kubernetes-dashboard-5fd5574d9f-gfm2q -n kubernetes-dashboard: context deadline exceeded (159ns)
start_stop_delete_test.go:274: kubectl --context embed-certs-20220630210659-9950 logs kubernetes-dashboard-5fd5574d9f-gfm2q -n kubernetes-dashboard: context deadline exceeded
start_stop_delete_test.go:275: failed waiting for 'addon dashboard' pod post-stop-start: k8s-app=kubernetes-dashboard within 9m0s: timed out waiting for the condition
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect embed-certs-20220630210659-9950
helpers_test.go:235: (dbg) docker inspect embed-certs-20220630210659-9950:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "8d43dca0a5ff56a08f5b0493d261e7c5d2aa00d085ae1a1182a97b5635cc1304",
	        "Created": "2022-06-30T21:07:07.545531471Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 282997,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2022-06-30T21:20:03.922267815Z",
	            "FinishedAt": "2022-06-30T21:20:02.548966491Z"
	        },
	        "Image": "sha256:573e7be5768273a7845baee1ae90fa2e33b83b10a7fbb0f0f41efbf29b53d1f1",
	        "ResolvConfPath": "/var/lib/docker/containers/8d43dca0a5ff56a08f5b0493d261e7c5d2aa00d085ae1a1182a97b5635cc1304/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/8d43dca0a5ff56a08f5b0493d261e7c5d2aa00d085ae1a1182a97b5635cc1304/hostname",
	        "HostsPath": "/var/lib/docker/containers/8d43dca0a5ff56a08f5b0493d261e7c5d2aa00d085ae1a1182a97b5635cc1304/hosts",
	        "LogPath": "/var/lib/docker/containers/8d43dca0a5ff56a08f5b0493d261e7c5d2aa00d085ae1a1182a97b5635cc1304/8d43dca0a5ff56a08f5b0493d261e7c5d2aa00d085ae1a1182a97b5635cc1304-json.log",
	        "Name": "/embed-certs-20220630210659-9950",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "embed-certs-20220630210659-9950:/var",
	                "/lib/modules:/lib/modules:ro"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "embed-certs-20220630210659-9950",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 2306867200,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": null,
	            "BlkioDeviceWriteBps": null,
	            "BlkioDeviceReadIOps": null,
	            "BlkioDeviceWriteIOps": null,
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "KernelMemory": 0,
	            "KernelMemoryTCP": 0,
	            "MemoryReservation": 0,
	            "MemorySwap": 4613734400,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": null,
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/9c28feead8af894b180999110a5cc0d8344ae5c74789cd8dc72d94ee221f8e10-init/diff:/var/lib/docker/overlay2/8b88d9f6f12c48be642a133456203e58549a93f1da67d0349744bd0f78917fba/diff:/var/lib/docker/overlay2/2bcbb3b4718a64188802301a25d7f413bb307cb16d077e7e5af799f9152a2970/diff:/var/lib/docker/overlay2/70b0888bf22fcef1c004704b71288ac581cf26a3b3b19fbca3da296ba10d6978/diff:/var/lib/docker/overlay2/7c5332f38fe652f379ef9b6d23e795158e9994317cfb547b581dd2b1fdf1303b/diff:/var/lib/docker/overlay2/0ddb5a3abf433b644a8bfa124e3c87878eed67878faa35493f2befc2b392e9cb/diff:/var/lib/docker/overlay2/3b7cda5fb0232fdeecbec0531ac704a59eb38fe57664c25777193b07e2df0077/diff:/var/lib/docker/overlay2/a14687ada786c65465b9924ae2d77ba27afc07942851cafaade28e80dfe9da16/diff:/var/lib/docker/overlay2/c49a9b7157aa6e8714e192b2849866d035b59e18de462c0ee9b72f898cc5a485/diff:/var/lib/docker/overlay2/efd71a50e3a1044a6d1c4c1a7d4d91d9f070c066e03e51c6c73a5764b778ad72/diff:/var/lib/docker/overlay2/55476a
1c0a20aa4238a0bb0e43c6402c33dcad312938ad48ee81be0160e12a49/diff:/var/lib/docker/overlay2/c48c4a348a797b9a38f01568a6adbcb4b05b4f56f7b986a4bf1b509d8cb00732/diff:/var/lib/docker/overlay2/568e3f354ab0428de5cf82d1fdfb780c3377f5cc55d9f524731c53e39e0ecae7/diff:/var/lib/docker/overlay2/2857943e320cdcdae9af3d8c2acda1fb61e2f142a88b8b902908071cea67816e/diff:/var/lib/docker/overlay2/bdd9a57f0b65e65c5a16395f239425e794c678b0e8db2f4a368e0a9427fe5116/diff:/var/lib/docker/overlay2/b150183f1b73e8c13c751911bcee09fed8ef973478f4dc3cfdb9e509118bf1ea/diff:/var/lib/docker/overlay2/0a053e7c29417cd6feafb351c7944e81342a52898871bc779f7bf61868c78ec4/diff:/var/lib/docker/overlay2/d3c0de3a44d75d0a05acb7843d53deba5ce0457649d6ed757da9b4c532a81e4f/diff:/var/lib/docker/overlay2/53f6170132880e1697dd802b8577382b31c6f1ba144256f8cc62542998842a6b/diff:/var/lib/docker/overlay2/b5c0be6d8efdb1fcb12e73b8f72853f77baa4bc014ac2c1e28b7b972b07f3325/diff:/var/lib/docker/overlay2/36c908f082a1e5388bb25277f1c957eaecf70fcd958080422fa85a3105724fb2/diff:/var/lib/d
ocker/overlay2/b147fe9dce365cfaf9bfeca2e370829e4d87e2671c133a9836ecb02a85422cc7/diff:/var/lib/docker/overlay2/65f488eb9181a721f01b333f5fa0cb91d216abd7842a9ae193bd95316f378721/diff:/var/lib/docker/overlay2/b04269aa247b68912ddc5b1c98ad55d67af4103f576a900eef4069c196b8a263/diff:/var/lib/docker/overlay2/b714c37e15257ae9d0e15d271dd18a330c38ad765901d9b7e7e3feb73e1b03e4/diff:/var/lib/docker/overlay2/3c253b721193edeaade7bba7ce25ff687c889b8fa86e9489c7ee20d5624e6c5b/diff:/var/lib/docker/overlay2/7f67b74e101fa21dd320393c10576eefa4ce1cec2e210bff405784fa45b360f3/diff:/var/lib/docker/overlay2/c3b2adaa63a06a5e6ed966d7b6f20a757aeadd3f25eb09ef3c7e9a66a8904143/diff:/var/lib/docker/overlay2/ddb5d653d19e8cafc4625a8fe9597667d98b277a7f679e532ad84caa2c6da636/diff:/var/lib/docker/overlay2/03eb172b20323ebeee7cb09025726a6e10de6c3dd8661f4f6bbc5a3a3778bad4/diff:/var/lib/docker/overlay2/80ea9bf34d028e95a8a418b3aeb634be72ab3336448946d7855c51ffdf8258d7/diff:/var/lib/docker/overlay2/e28987ea3fb4d431dee111f38cc76814b85f73e86434be3c463c01fdd59
9ad46/diff:/var/lib/docker/overlay2/6f9a46c7c6cf4fd30ce32a1eb08ed9b1e8dd61cb0e42ce54f0f736f06558c306/diff:/var/lib/docker/overlay2/6fc942eb9ccfc09898edc9a5ef3b3d305a6fcb22e8cefb1a9f9c344d10b59b25/diff:/var/lib/docker/overlay2/f6b8c57540e798dc1dfd51fd29c020193c02a4362f31c6d07aa220327bb07b90/diff:/var/lib/docker/overlay2/85d0aa01a3fab8c77262c59d8a7b0809a72673a3da7d33e4e19c04a66db44a11/diff:/var/lib/docker/overlay2/58dcd81a1605641f785ced5aeb38657eec1f02a31b7adfaf4f6fdd49f4bab1d6/diff:/var/lib/docker/overlay2/9d537e0a65325e4bf85b26da9828002339f5c442ca85f931b340457a80ec8c94/diff:/var/lib/docker/overlay2/a6f73707ee6a74e948a02d03c4a3f12b57c2eb408dc67da3c39961bb3cefcc97/diff:/var/lib/docker/overlay2/922526c310b066dbb73b9a106eef8bf0064ad7907a8d7d7b353f5307a17a4901/diff:/var/lib/docker/overlay2/a4185854870ebf8d34a4c7e1827dbe3bc461559839301ffb23c5efff5e3c9f14/diff:/var/lib/docker/overlay2/8c02b1fcb9d79f5d7b2ee4d44f6625a692c44a0d18df0a5c01cac0cca0fdf3f3/diff",
	                "MergedDir": "/var/lib/docker/overlay2/9c28feead8af894b180999110a5cc0d8344ae5c74789cd8dc72d94ee221f8e10/merged",
	                "UpperDir": "/var/lib/docker/overlay2/9c28feead8af894b180999110a5cc0d8344ae5c74789cd8dc72d94ee221f8e10/diff",
	                "WorkDir": "/var/lib/docker/overlay2/9c28feead8af894b180999110a5cc0d8344ae5c74789cd8dc72d94ee221f8e10/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "volume",
	                "Name": "embed-certs-20220630210659-9950",
	                "Source": "/var/lib/docker/volumes/embed-certs-20220630210659-9950/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            },
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            }
	        ],
	        "Config": {
	            "Hostname": "embed-certs-20220630210659-9950",
	            "Domainname": "",
	            "User": "root",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e",
	            "Volumes": null,
	            "WorkingDir": "",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "embed-certs-20220630210659-9950",
	                "name.minikube.sigs.k8s.io": "embed-certs-20220630210659-9950",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "ba5b884b6e56db06325cda7b5cff38a7d1995cc679a9436ca69f5c1ff4958e9c",
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49442"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49441"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49438"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49440"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "49439"
	                    }
	                ]
	            },
	            "SandboxKey": "/var/run/docker/netns/ba5b884b6e56",
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "embed-certs-20220630210659-9950": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.94.2"
	                    },
	                    "Links": null,
	                    "Aliases": [
	                        "8d43dca0a5ff",
	                        "embed-certs-20220630210659-9950"
	                    ],
	                    "NetworkID": "a762009b1f738e8867dc868c38a8f04b91d930fa90f85eb117025e337ab9ed89",
	                    "EndpointID": "dddeec6fd3923e176e3a8b445351ecb95a49f42067ff168fddafe1aa887acccd",
	                    "Gateway": "192.168.94.1",
	                    "IPAddress": "192.168.94.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "MacAddress": "02:42:c0:a8:5e:02",
	                    "DriverOpts": null
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-20220630210659-9950 -n embed-certs-20220630210659-9950
helpers_test.go:244: <<< TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======>  post-mortem[TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop]: minikube logs <======
helpers_test.go:247: (dbg) Run:  out/minikube-linux-amd64 -p embed-certs-20220630210659-9950 logs -n 25
helpers_test.go:252: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop logs: 
-- stdout --
	* 
	* ==> Audit <==
	* |---------|---------------------------------------------------|----------|---------|---------|---------------------|---------------------|
	| Command |                       Args                        | Profile  |  User   | Version |     Start Time      |      End Time       |
	|---------|---------------------------------------------------|----------|---------|---------|---------------------|---------------------|
	| pause   | -p                                                | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                    |          |         |         |                     |                     |
	|         | --alsologtostderr -v=1                            |          |         |         |                     |                     |
	| unpause | -p                                                | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                    |          |         |         |                     |                     |
	|         | --alsologtostderr -v=1                            |          |         |         |                     |                     |
	| delete  | -p                                                | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                    |          |         |         |                     |                     |
	| delete  | -p                                                | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | newest-cni-20220630210514-9950                    |          |         |         |                     |                     |
	| delete  | -p                                                | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC | 30 Jun 22 21:06 UTC |
	|         | disable-driver-mounts-20220630210659-9950         |          |         |         |                     |                     |
	| start   | -p                                                | minikube | jenkins | v1.26.0 | 30 Jun 22 21:06 UTC |                     |
	|         | embed-certs-20220630210659-9950                   |          |         |         |                     |                     |
	|         | --memory=2200 --alsologtostderr                   |          |         |         |                     |                     |
	|         | --wait=true --embed-certs                         |          |         |         |                     |                     |
	|         | --driver=docker                                   |          |         |         |                     |                     |
	|         | --container-runtime=containerd                    |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                      |          |         |         |                     |                     |
	| ssh     | -p                                                | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                    |          |         |         |                     |                     |
	|         | sudo crictl images -o json                        |          |         |         |                     |                     |
	| pause   | -p                                                | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                    |          |         |         |                     |                     |
	|         | --alsologtostderr -v=1                            |          |         |         |                     |                     |
	| unpause | -p                                                | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                    |          |         |         |                     |                     |
	|         | --alsologtostderr -v=1                            |          |         |         |                     |                     |
	| delete  | -p                                                | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                    |          |         |         |                     |                     |
	| delete  | -p                                                | minikube | jenkins | v1.26.0 | 30 Jun 22 21:09 UTC | 30 Jun 22 21:09 UTC |
	|         | no-preload-20220630210237-9950                    |          |         |         |                     |                     |
	| addons  | enable metrics-server -p                          | minikube | jenkins | v1.26.0 | 30 Jun 22 21:12 UTC | 30 Jun 22 21:12 UTC |
	|         | old-k8s-version-20220630210005-9950               |          |         |         |                     |                     |
	|         | --images=MetricsServer=k8s.gcr.io/echoserver:1.4  |          |         |         |                     |                     |
	|         | --registries=MetricsServer=fake.domain            |          |         |         |                     |                     |
	| stop    | -p                                                | minikube | jenkins | v1.26.0 | 30 Jun 22 21:12 UTC | 30 Jun 22 21:12 UTC |
	|         | old-k8s-version-20220630210005-9950               |          |         |         |                     |                     |
	|         | --alsologtostderr -v=3                            |          |         |         |                     |                     |
	| addons  | enable dashboard -p                               | minikube | jenkins | v1.26.0 | 30 Jun 22 21:12 UTC | 30 Jun 22 21:12 UTC |
	|         | old-k8s-version-20220630210005-9950               |          |         |         |                     |                     |
	|         | --images=MetricsScraper=k8s.gcr.io/echoserver:1.4 |          |         |         |                     |                     |
	| start   | -p                                                | minikube | jenkins | v1.26.0 | 30 Jun 22 21:12 UTC |                     |
	|         | old-k8s-version-20220630210005-9950               |          |         |         |                     |                     |
	|         | --memory=2200 --alsologtostderr                   |          |         |         |                     |                     |
	|         | --wait=true --kvm-network=default                 |          |         |         |                     |                     |
	|         | --kvm-qemu-uri=qemu:///system                     |          |         |         |                     |                     |
	|         | --disable-driver-mounts                           |          |         |         |                     |                     |
	|         | --keep-context=false                              |          |         |         |                     |                     |
	|         | --driver=docker                                   |          |         |         |                     |                     |
	|         | --container-runtime=containerd                    |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.16.0                      |          |         |         |                     |                     |
	| addons  | enable metrics-server -p                          | minikube | jenkins | v1.26.0 | 30 Jun 22 21:16 UTC | 30 Jun 22 21:16 UTC |
	|         | default-k8s-different-port-20220630210335-9950    |          |         |         |                     |                     |
	|         | --images=MetricsServer=k8s.gcr.io/echoserver:1.4  |          |         |         |                     |                     |
	|         | --registries=MetricsServer=fake.domain            |          |         |         |                     |                     |
	| stop    | -p                                                | minikube | jenkins | v1.26.0 | 30 Jun 22 21:16 UTC | 30 Jun 22 21:16 UTC |
	|         | default-k8s-different-port-20220630210335-9950    |          |         |         |                     |                     |
	|         | --alsologtostderr -v=3                            |          |         |         |                     |                     |
	| addons  | enable dashboard -p                               | minikube | jenkins | v1.26.0 | 30 Jun 22 21:16 UTC | 30 Jun 22 21:16 UTC |
	|         | default-k8s-different-port-20220630210335-9950    |          |         |         |                     |                     |
	|         | --images=MetricsScraper=k8s.gcr.io/echoserver:1.4 |          |         |         |                     |                     |
	| start   | -p                                                | minikube | jenkins | v1.26.0 | 30 Jun 22 21:16 UTC |                     |
	|         | default-k8s-different-port-20220630210335-9950    |          |         |         |                     |                     |
	|         | --memory=2200 --alsologtostderr --wait=true       |          |         |         |                     |                     |
	|         | --apiserver-port=8444 --driver=docker             |          |         |         |                     |                     |
	|         |  --container-runtime=containerd                   |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                      |          |         |         |                     |                     |
	| addons  | enable metrics-server -p                          | minikube | jenkins | v1.26.0 | 30 Jun 22 21:19 UTC | 30 Jun 22 21:19 UTC |
	|         | embed-certs-20220630210659-9950                   |          |         |         |                     |                     |
	|         | --images=MetricsServer=k8s.gcr.io/echoserver:1.4  |          |         |         |                     |                     |
	|         | --registries=MetricsServer=fake.domain            |          |         |         |                     |                     |
	| stop    | -p                                                | minikube | jenkins | v1.26.0 | 30 Jun 22 21:19 UTC | 30 Jun 22 21:20 UTC |
	|         | embed-certs-20220630210659-9950                   |          |         |         |                     |                     |
	|         | --alsologtostderr -v=3                            |          |         |         |                     |                     |
	| addons  | enable dashboard -p                               | minikube | jenkins | v1.26.0 | 30 Jun 22 21:20 UTC | 30 Jun 22 21:20 UTC |
	|         | embed-certs-20220630210659-9950                   |          |         |         |                     |                     |
	|         | --images=MetricsScraper=k8s.gcr.io/echoserver:1.4 |          |         |         |                     |                     |
	| start   | -p                                                | minikube | jenkins | v1.26.0 | 30 Jun 22 21:20 UTC |                     |
	|         | embed-certs-20220630210659-9950                   |          |         |         |                     |                     |
	|         | --memory=2200 --alsologtostderr                   |          |         |         |                     |                     |
	|         | --wait=true --embed-certs                         |          |         |         |                     |                     |
	|         | --driver=docker                                   |          |         |         |                     |                     |
	|         | --container-runtime=containerd                    |          |         |         |                     |                     |
	|         | --kubernetes-version=v1.24.2                      |          |         |         |                     |                     |
	| delete  | -p                                                | minikube | jenkins | v1.26.0 | 30 Jun 22 21:31 UTC | 30 Jun 22 21:31 UTC |
	|         | old-k8s-version-20220630210005-9950               |          |         |         |                     |                     |
	| delete  | -p                                                | minikube | jenkins | v1.26.0 | 30 Jun 22 21:34 UTC | 30 Jun 22 21:34 UTC |
	|         | default-k8s-different-port-20220630210335-9950    |          |         |         |                     |                     |
	|---------|---------------------------------------------------|----------|---------|---------|---------------------|---------------------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2022/06/30 21:20:03
	Running on machine: ubuntu-20-agent-8
	Binary: Built with gc go1.18.3 for linux/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0630 21:20:03.147328  282690 out.go:296] Setting OutFile to fd 1 ...
	I0630 21:20:03.147439  282690 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 21:20:03.147448  282690 out.go:309] Setting ErrFile to fd 2...
	I0630 21:20:03.147453  282690 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 21:20:03.147898  282690 root.go:329] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/bin
	I0630 21:20:03.148141  282690 out.go:303] Setting JSON to false
	I0630 21:20:03.149531  282690 start.go:115] hostinfo: {"hostname":"ubuntu-20-agent-8","uptime":3755,"bootTime":1656620248,"procs":452,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1012-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0630 21:20:03.149604  282690 start.go:125] virtualization: kvm guest
	I0630 21:20:03.152275  282690 out.go:177] * [embed-certs-20220630210659-9950] minikube v1.26.0 on Ubuntu 20.04 (kvm/amd64)
	I0630 21:20:03.154290  282690 notify.go:193] Checking for updates...
	I0630 21:20:03.154307  282690 out.go:177]   - MINIKUBE_LOCATION=14420
	I0630 21:20:03.156071  282690 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0630 21:20:03.157769  282690 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:20:03.159343  282690 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube
	I0630 21:20:03.160888  282690 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0630 21:20:03.163346  282690 config.go:178] Loaded profile config "embed-certs-20220630210659-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:20:03.163802  282690 driver.go:360] Setting default libvirt URI to qemu:///system
	I0630 21:20:03.205706  282690 docker.go:137] docker version: linux-20.10.17
	I0630 21:20:03.205824  282690 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0630 21:20:03.318551  282690 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:8 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:43 OomKillDisable:true NGoroutines:44 SystemTime:2022-06-30 21:20:03.238323982 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1012-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexServ
erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662451712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-8 Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Client
Info:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
	I0630 21:20:03.318677  282690 docker.go:254] overlay module found
	I0630 21:20:03.322599  282690 out.go:177] * Using the docker driver based on existing profile
	I0630 21:20:03.324114  282690 start.go:284] selected driver: docker
	I0630 21:20:03.324129  282690 start.go:808] validating driver "docker" against &{Name:embed-certs-20220630210659-9950 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:embed-certs-20220630210659-9950 Namespace:d
efault APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[Dashboard:kubernetesui/dashboard:v2.6.0@sha256:4af9580485920635d888efe1eddbd67e12f9d5d84dba87100e93feb4e46636b3 MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddres
s: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 21:20:03.324222  282690 start.go:819] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0630 21:20:03.325145  282690 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0630 21:20:03.438547  282690 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:8 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:43 OomKillDisable:true NGoroutines:44 SystemTime:2022-06-30 21:20:03.358172615 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1012-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexServ
erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662451712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-8 Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Client
Info:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
	I0630 21:20:03.438832  282690 start_flags.go:853] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0630 21:20:03.438854  282690 cni.go:95] Creating CNI manager for ""
	I0630 21:20:03.438863  282690 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:20:03.438877  282690 start_flags.go:310] config:
	{Name:embed-certs-20220630210659-9950 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:embed-certs-20220630210659-9950 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:clus
ter.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[Dashboard:kubernetesui/dashboard:v2.6.0@sha256:4af9580485920635d888efe1eddbd67e12f9d5d84dba87100e93feb4e46636b3 MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0
m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 21:20:03.442075  282690 out.go:177] * Starting control plane node embed-certs-20220630210659-9950 in cluster embed-certs-20220630210659-9950
	I0630 21:20:03.443525  282690 cache.go:120] Beginning downloading kic base image for docker with containerd
	I0630 21:20:03.445355  282690 out.go:177] * Pulling base image ...
	I0630 21:20:03.446826  282690 preload.go:132] Checking if preload exists for k8s version v1.24.2 and runtime containerd
	I0630 21:20:03.446872  282690 preload.go:148] Found local preload: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-containerd-overlay2-amd64.tar.lz4
	I0630 21:20:03.446895  282690 cache.go:57] Caching tarball of preloaded images
	I0630 21:20:03.446927  282690 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e in local docker daemon
	I0630 21:20:03.447161  282690 preload.go:174] Found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-containerd-overlay2-amd64.tar.lz4 in cache, skipping download
	I0630 21:20:03.447178  282690 cache.go:60] Finished verifying existence of preloaded tar for  v1.24.2 on containerd
	I0630 21:20:03.447328  282690 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/config.json ...
	I0630 21:20:03.484347  282690 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e in local docker daemon, skipping pull
	I0630 21:20:03.484373  282690 cache.go:142] gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e exists in daemon, skipping load
	I0630 21:20:03.484390  282690 cache.go:208] Successfully downloaded all kic artifacts
	I0630 21:20:03.484431  282690 start.go:352] acquiring machines lock for embed-certs-20220630210659-9950: {Name:mk6619dbb09b46cdd2b244e5bf2112b3274a30ef Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0630 21:20:03.484542  282690 start.go:356] acquired machines lock for "embed-certs-20220630210659-9950" in 89.652µs
	I0630 21:20:03.484563  282690 start.go:94] Skipping create...Using existing machine configuration
	I0630 21:20:03.484568  282690 fix.go:55] fixHost starting: 
	I0630 21:20:03.484786  282690 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:20:03.518786  282690 fix.go:103] recreateIfNeeded on embed-certs-20220630210659-9950: state=Stopped err=<nil>
	W0630 21:20:03.518832  282690 fix.go:129] unexpected machine state, will restart: <nil>
	I0630 21:20:03.522271  282690 out.go:177] * Restarting existing docker container for "embed-certs-20220630210659-9950" ...
	I0630 21:20:01.182137  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:03.183061  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:02.393449  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:04.893746  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:03.523749  282690 cli_runner.go:164] Run: docker start embed-certs-20220630210659-9950
	I0630 21:20:03.930910  282690 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:20:03.968503  282690 kic.go:416] container "embed-certs-20220630210659-9950" state is running.
	I0630 21:20:03.968961  282690 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-20220630210659-9950
	I0630 21:20:04.005032  282690 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/config.json ...
	I0630 21:20:04.005301  282690 machine.go:88] provisioning docker machine ...
	I0630 21:20:04.005330  282690 ubuntu.go:169] provisioning hostname "embed-certs-20220630210659-9950"
	I0630 21:20:04.005375  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:20:04.043967  282690 main.go:134] libmachine: Using SSH client type: native
	I0630 21:20:04.044205  282690 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil>  [] 0s} 127.0.0.1 49442 <nil> <nil>}
	I0630 21:20:04.044233  282690 main.go:134] libmachine: About to run SSH command:
	sudo hostname embed-certs-20220630210659-9950 && echo "embed-certs-20220630210659-9950" | sudo tee /etc/hostname
	I0630 21:20:04.044882  282690 main.go:134] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:41696->127.0.0.1:49442: read: connection reset by peer
	I0630 21:20:07.174483  282690 main.go:134] libmachine: SSH cmd err, output: <nil>: embed-certs-20220630210659-9950
	
	I0630 21:20:07.174561  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:20:07.210487  282690 main.go:134] libmachine: Using SSH client type: native
	I0630 21:20:07.210668  282690 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil>  [] 0s} 127.0.0.1 49442 <nil> <nil>}
	I0630 21:20:07.210690  282690 main.go:134] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sembed-certs-20220630210659-9950' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 embed-certs-20220630210659-9950/g' /etc/hosts;
				else 
					echo '127.0.1.1 embed-certs-20220630210659-9950' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0630 21:20:07.329184  282690 main.go:134] libmachine: SSH cmd err, output: <nil>: 
	I0630 21:20:07.329234  282690 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube CaCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/c
erts/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube}
	I0630 21:20:07.329264  282690 ubuntu.go:177] setting up certificates
	I0630 21:20:07.329274  282690 provision.go:83] configureAuth start
	I0630 21:20:07.329332  282690 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-20220630210659-9950
	I0630 21:20:07.365729  282690 provision.go:138] copyHostCerts
	I0630 21:20:07.365803  282690 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem, removing ...
	I0630 21:20:07.365816  282690 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem
	I0630 21:20:07.365887  282690 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/key.pem (1679 bytes)
	I0630 21:20:07.365984  282690 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem, removing ...
	I0630 21:20:07.365998  282690 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem
	I0630 21:20:07.366039  282690 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.pem (1082 bytes)
	I0630 21:20:07.366110  282690 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem, removing ...
	I0630 21:20:07.366123  282690 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem
	I0630 21:20:07.366164  282690 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cert.pem (1123 bytes)
	I0630 21:20:07.366225  282690 provision.go:112] generating server cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem org=jenkins.embed-certs-20220630210659-9950 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-20220630210659-9950]
	I0630 21:20:07.595656  282690 provision.go:172] copyRemoteCerts
	I0630 21:20:07.595725  282690 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0630 21:20:07.595756  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:20:07.631338  282690 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49442 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:20:07.716832  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
	I0630 21:20:07.735870  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server.pem --> /etc/docker/server.pem (1265 bytes)
	I0630 21:20:07.756354  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0630 21:20:07.775209  282690 provision.go:86] duration metric: configureAuth took 445.919443ms
	I0630 21:20:07.775233  282690 ubuntu.go:193] setting minikube options for container-runtime
	I0630 21:20:07.775399  282690 config.go:178] Loaded profile config "embed-certs-20220630210659-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:20:07.775412  282690 machine.go:91] provisioned docker machine in 3.770097214s
	I0630 21:20:07.775419  282690 start.go:306] post-start starting for "embed-certs-20220630210659-9950" (driver="docker")
	I0630 21:20:07.775425  282690 start.go:316] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0630 21:20:07.775465  282690 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0630 21:20:07.775498  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:20:07.811677  282690 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49442 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:20:07.897450  282690 ssh_runner.go:195] Run: cat /etc/os-release
	I0630 21:20:07.900657  282690 main.go:134] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0630 21:20:07.900688  282690 main.go:134] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0630 21:20:07.900696  282690 main.go:134] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0630 21:20:07.900702  282690 info.go:137] Remote host: Ubuntu 20.04.4 LTS
	I0630 21:20:07.900711  282690 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/addons for local assets ...
	I0630 21:20:07.900762  282690 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files for local assets ...
	I0630 21:20:07.900829  282690 filesync.go:149] local asset: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem -> 99502.pem in /etc/ssl/certs
	I0630 21:20:07.900909  282690 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0630 21:20:07.908065  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem --> /etc/ssl/certs/99502.pem (1708 bytes)
	I0630 21:20:07.926474  282690 start.go:309] post-start completed in 151.040627ms
	I0630 21:20:07.926557  282690 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0630 21:20:07.926600  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:20:07.963198  282690 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49442 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:20:08.045725  282690 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0630 21:20:08.049536  282690 fix.go:57] fixHost completed within 4.564962738s
	I0630 21:20:08.049568  282690 start.go:81] releasing machines lock for "embed-certs-20220630210659-9950", held for 4.56500909s
	I0630 21:20:08.049668  282690 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-20220630210659-9950
	I0630 21:20:08.085452  282690 ssh_runner.go:195] Run: systemctl --version
	I0630 21:20:08.085508  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:20:08.085526  282690 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/
	I0630 21:20:08.085584  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:20:08.125940  282690 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49442 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:20:08.126756  282690 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49442 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:20:05.682082  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:07.682788  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:07.393189  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:09.893794  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:08.209826  282690 ssh_runner.go:195] Run: sudo systemctl stop -f crio
	I0630 21:20:08.240545  282690 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0630 21:20:08.251830  282690 docker.go:179] disabling docker service ...
	I0630 21:20:08.251890  282690 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0630 21:20:08.263344  282690 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0630 21:20:08.272763  282690 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0630 21:20:08.347490  282690 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0630 21:20:08.430323  282690 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0630 21:20:08.439736  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
	image-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0630 21:20:08.453177  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*sandbox_image = .*$|sandbox_image = "k8s.gcr.io/pause:3.7"|' -i /etc/containerd/config.toml"
	I0630 21:20:08.461609  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*restrict_oom_score_adj = .*$|restrict_oom_score_adj = false|' -i /etc/containerd/config.toml"
	I0630 21:20:08.469975  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*SystemdCgroup = .*$|SystemdCgroup = false|' -i /etc/containerd/config.toml"
	I0630 21:20:08.478446  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*conf_dir = .*$|conf_dir = "/etc/cni/net.mk"|' -i /etc/containerd/config.toml"
	I0630 21:20:08.486889  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^# imports|imports = ["/etc/containerd/containerd.conf.d/02-containerd.conf"]|' -i /etc/containerd/config.toml"
	I0630 21:20:08.495251  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc/containerd/containerd.conf.d && printf %!s(MISSING) "dmVyc2lvbiA9IDIK" | base64 -d | sudo tee /etc/containerd/containerd.conf.d/02-containerd.conf"
	I0630 21:20:08.508868  282690 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0630 21:20:08.515626  282690 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0630 21:20:08.522606  282690 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0630 21:20:08.605769  282690 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0630 21:20:08.682128  282690 start.go:447] Will wait 60s for socket path /run/containerd/containerd.sock
	I0630 21:20:08.682202  282690 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
	I0630 21:20:08.686167  282690 start.go:468] Will wait 60s for crictl version
	I0630 21:20:08.686246  282690 ssh_runner.go:195] Run: sudo crictl version
	I0630 21:20:08.713091  282690 retry.go:31] will retry after 11.04660288s: Temporary Error: sudo crictl version: Process exited with status 1
	stdout:
	
	stderr:
	time="2022-06-30T21:20:08Z" level=fatal msg="getting the runtime version: rpc error: code = Unknown desc = server is not initialized yet"
	I0630 21:20:10.182344  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:12.182594  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:12.392956  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:14.393428  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:14.682680  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:17.182245  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:19.182817  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:19.761138  282690 ssh_runner.go:195] Run: sudo crictl version
	I0630 21:20:19.786289  282690 start.go:477] Version:  0.1.0
	RuntimeName:  containerd
	RuntimeVersion:  1.6.6
	RuntimeApiVersion:  v1alpha2
	I0630 21:20:19.786365  282690 ssh_runner.go:195] Run: containerd --version
	I0630 21:20:19.816281  282690 ssh_runner.go:195] Run: containerd --version
	I0630 21:20:19.848226  282690 out.go:177] * Preparing Kubernetes v1.24.2 on containerd 1.6.6 ...
	I0630 21:20:16.893342  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:18.893566  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:19.849919  282690 cli_runner.go:164] Run: docker network inspect embed-certs-20220630210659-9950 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0630 21:20:19.887550  282690 ssh_runner.go:195] Run: grep 192.168.94.1	host.minikube.internal$ /etc/hosts
	I0630 21:20:19.891143  282690 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.94.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0630 21:20:19.900924  282690 preload.go:132] Checking if preload exists for k8s version v1.24.2 and runtime containerd
	I0630 21:20:19.900991  282690 ssh_runner.go:195] Run: sudo crictl images --output json
	I0630 21:20:19.925400  282690 containerd.go:547] all images are preloaded for containerd runtime.
	I0630 21:20:19.925429  282690 containerd.go:461] Images already preloaded, skipping extraction
	I0630 21:20:19.925482  282690 ssh_runner.go:195] Run: sudo crictl images --output json
	I0630 21:20:19.950061  282690 containerd.go:547] all images are preloaded for containerd runtime.
	I0630 21:20:19.950082  282690 cache_images.go:84] Images are preloaded, skipping loading
	I0630 21:20:19.950125  282690 ssh_runner.go:195] Run: sudo crictl info
	I0630 21:20:19.974750  282690 cni.go:95] Creating CNI manager for ""
	I0630 21:20:19.974773  282690 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:20:19.974785  282690 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
	I0630 21:20:19.974799  282690 kubeadm.go:158] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.94.2 APIServerPort:8443 KubernetesVersion:v1.24.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:embed-certs-20220630210659-9950 NodeName:embed-certs-20220630210659-9950 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.94.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.94.2 CgroupDriver:cgroupfs ClientC
AFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}
	I0630 21:20:19.974955  282690 kubeadm.go:162] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.94.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: /run/containerd/containerd.sock
	  name: "embed-certs-20220630210659-9950"
	  kubeletExtraArgs:
	    node-ip: 192.168.94.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.94.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.24.2
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%!"(MISSING)
	  nodefs.inodesFree: "0%!"(MISSING)
	  imagefs.available: "0%!"(MISSING)
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0630 21:20:19.975056  282690 kubeadm.go:961] kubelet [Unit]
	Wants=containerd.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.24.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=embed-certs-20220630210659-9950 --image-service-endpoint=unix:///run/containerd/containerd.sock --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.94.2 --runtime-request-timeout=15m
	
	[Install]
	 config:
	{KubernetesVersion:v1.24.2 ClusterName:embed-certs-20220630210659-9950 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
	I0630 21:20:19.975119  282690 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.24.2
	I0630 21:20:19.982477  282690 binaries.go:44] Found k8s binaries, skipping transfer
	I0630 21:20:19.982537  282690 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0630 21:20:19.989867  282690 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (524 bytes)
	I0630 21:20:20.003413  282690 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0630 21:20:20.016549  282690 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2060 bytes)
	I0630 21:20:20.030557  282690 ssh_runner.go:195] Run: grep 192.168.94.2	control-plane.minikube.internal$ /etc/hosts
	I0630 21:20:20.033673  282690 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.94.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0630 21:20:20.043309  282690 certs.go:54] Setting up /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950 for IP: 192.168.94.2
	I0630 21:20:20.043426  282690 certs.go:182] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.key
	I0630 21:20:20.043474  282690 certs.go:182] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.key
	I0630 21:20:20.043588  282690 certs.go:298] skipping minikube-user signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/client.key
	I0630 21:20:20.043669  282690 certs.go:298] skipping minikube signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.key.ad8e880a
	I0630 21:20:20.043722  282690 certs.go:298] skipping aggregator signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.key
	I0630 21:20:20.043847  282690 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950.pem (1338 bytes)
	W0630 21:20:20.043888  282690 certs.go:384] ignoring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950_empty.pem, impossibly tiny 0 bytes
	I0630 21:20:20.043906  282690 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca-key.pem (1679 bytes)
	I0630 21:20:20.043944  282690 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/ca.pem (1082 bytes)
	I0630 21:20:20.043983  282690 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/cert.pem (1123 bytes)
	I0630 21:20:20.044018  282690 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/key.pem (1679 bytes)
	I0630 21:20:20.044074  282690 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem (1708 bytes)
	I0630 21:20:20.044672  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
	I0630 21:20:20.063809  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I0630 21:20:20.082364  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0630 21:20:20.100953  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/embed-certs-20220630210659-9950/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
	I0630 21:20:20.119042  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0630 21:20:20.138260  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
	I0630 21:20:20.156455  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0630 21:20:20.175178  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
	I0630 21:20:20.193932  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/ssl/certs/99502.pem --> /usr/share/ca-certificates/99502.pem (1708 bytes)
	I0630 21:20:20.213463  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0630 21:20:20.232837  282690 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/certs/9950.pem --> /usr/share/ca-certificates/9950.pem (1338 bytes)
	I0630 21:20:20.252510  282690 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0630 21:20:20.267375  282690 ssh_runner.go:195] Run: openssl version
	I0630 21:20:20.273228  282690 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/99502.pem && ln -fs /usr/share/ca-certificates/99502.pem /etc/ssl/certs/99502.pem"
	I0630 21:20:20.281805  282690 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/99502.pem
	I0630 21:20:20.285276  282690 certs.go:431] hashing: -rw-r--r-- 1 root root 1708 Jun 30 20:26 /usr/share/ca-certificates/99502.pem
	I0630 21:20:20.285328  282690 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/99502.pem
	I0630 21:20:20.290565  282690 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/99502.pem /etc/ssl/certs/3ec20f2e.0"
	I0630 21:20:20.298693  282690 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0630 21:20:20.306974  282690 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:20:20.310492  282690 certs.go:431] hashing: -rw-r--r-- 1 root root 1111 Jun 30 20:22 /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:20:20.310555  282690 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0630 21:20:20.315748  282690 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0630 21:20:20.323429  282690 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/9950.pem && ln -fs /usr/share/ca-certificates/9950.pem /etc/ssl/certs/9950.pem"
	I0630 21:20:20.331855  282690 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/9950.pem
	I0630 21:20:20.335469  282690 certs.go:431] hashing: -rw-r--r-- 1 root root 1338 Jun 30 20:26 /usr/share/ca-certificates/9950.pem
	I0630 21:20:20.335531  282690 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/9950.pem
	I0630 21:20:20.340482  282690 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/9950.pem /etc/ssl/certs/51391683.0"
	I0630 21:20:20.348339  282690 kubeadm.go:395] StartCluster: {Name:embed-certs-20220630210659-9950 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:embed-certs-20220630210659-9950 Namespace:default APIServerName
:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[Dashboard:kubernetesui/dashboard:v2.6.0@sha256:4af9580485920635d888efe1eddbd67e12f9d5d84dba87100e93feb4e46636b3 MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet:
MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 21:20:20.348468  282690 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
	I0630 21:20:20.348531  282690 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0630 21:20:20.375578  282690 cri.go:87] found id: "6bdce580a9d6963de5c12d9e017d5662e2685851e130abf85abf7ccd2206a8a6"
	I0630 21:20:20.375605  282690 cri.go:87] found id: "8341041be1bdbcf0e0425bd1832777e15b2ed89bf8696d0c78d14301820032c3"
	I0630 21:20:20.375615  282690 cri.go:87] found id: "157c2b0c199b65e53b31cbc33bd298586d30106a66d587ee22f9c486df45d1ba"
	I0630 21:20:20.375624  282690 cri.go:87] found id: "ccc3bef31fe3faba9ff6daab0d5ca071fed6adb37d8cc554c7399ac599691557"
	I0630 21:20:20.375637  282690 cri.go:87] found id: "d56e346d0980d838b9cd42c94d9e084ef84bb0fdeb4316ae2dd5c8a25cc054a1"
	I0630 21:20:20.375652  282690 cri.go:87] found id: "7734f08ca26708ce34ae224077718432c05bc3133a11bb3d600a7d29c4df0045"
	I0630 21:20:20.375660  282690 cri.go:87] found id: ""
	I0630 21:20:20.375709  282690 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
	I0630 21:20:20.388498  282690 cri.go:114] JSON = null
	W0630 21:20:20.388559  282690 kubeadm.go:402] unpause failed: list paused: list returned 0 containers, but ps returned 6
	I0630 21:20:20.388621  282690 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0630 21:20:20.396168  282690 kubeadm.go:410] found existing configuration files, will attempt cluster restart
	I0630 21:20:20.396200  282690 kubeadm.go:626] restartCluster start
	I0630 21:20:20.396246  282690 ssh_runner.go:195] Run: sudo test -d /data/minikube
	I0630 21:20:20.403017  282690 kubeadm.go:127] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:20.403674  282690 kubeconfig.go:116] verify returned: extract IP: "embed-certs-20220630210659-9950" does not appear in /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:20:20.404147  282690 kubeconfig.go:127] "embed-certs-20220630210659-9950" context is missing from /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig - will repair!
	I0630 21:20:20.404911  282690 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig: {Name:mk34e4a4e7b04f624b9adbda4f77ee20b38308ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:20:20.406647  282690 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
	I0630 21:20:20.413413  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:20.413466  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:20.421286  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:20.621671  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:20.621798  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:20.630547  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:20.821858  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:20.821957  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:20.830758  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:21.022078  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:21.022162  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:21.030900  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:21.222204  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:21.222293  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:21.231221  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:21.421485  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:21.421579  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:21.430528  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:21.621730  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:21.621832  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:21.630704  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:21.822018  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:21.822098  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:21.830851  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:22.022202  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:22.022287  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:22.031086  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:22.222404  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:22.222489  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:22.231324  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:22.421567  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:22.421655  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:22.430581  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:22.621941  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:22.622040  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:22.631867  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:22.822177  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:22.822278  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:22.832202  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:23.021427  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:23.021501  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:23.030217  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:21.682805  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:24.182683  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:21.393221  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:23.893682  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:23.221874  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:23.221961  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:23.230645  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:23.421956  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:23.422028  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:23.430894  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:23.430917  282690 api_server.go:165] Checking apiserver status ...
	I0630 21:20:23.430954  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	W0630 21:20:23.439029  282690 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:23.439054  282690 kubeadm.go:601] needs reconfigure: apiserver error: timed out waiting for the condition
	I0630 21:20:23.439061  282690 kubeadm.go:1092] stopping kube-system containers ...
	I0630 21:20:23.439074  282690 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name: Namespaces:[kube-system]}
	I0630 21:20:23.439116  282690 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0630 21:20:23.463122  282690 cri.go:87] found id: "6bdce580a9d6963de5c12d9e017d5662e2685851e130abf85abf7ccd2206a8a6"
	I0630 21:20:23.463146  282690 cri.go:87] found id: "8341041be1bdbcf0e0425bd1832777e15b2ed89bf8696d0c78d14301820032c3"
	I0630 21:20:23.463152  282690 cri.go:87] found id: "157c2b0c199b65e53b31cbc33bd298586d30106a66d587ee22f9c486df45d1ba"
	I0630 21:20:23.463158  282690 cri.go:87] found id: "ccc3bef31fe3faba9ff6daab0d5ca071fed6adb37d8cc554c7399ac599691557"
	I0630 21:20:23.463163  282690 cri.go:87] found id: "d56e346d0980d838b9cd42c94d9e084ef84bb0fdeb4316ae2dd5c8a25cc054a1"
	I0630 21:20:23.463170  282690 cri.go:87] found id: "7734f08ca26708ce34ae224077718432c05bc3133a11bb3d600a7d29c4df0045"
	I0630 21:20:23.463175  282690 cri.go:87] found id: ""
	I0630 21:20:23.463180  282690 cri.go:232] Stopping containers: [6bdce580a9d6963de5c12d9e017d5662e2685851e130abf85abf7ccd2206a8a6 8341041be1bdbcf0e0425bd1832777e15b2ed89bf8696d0c78d14301820032c3 157c2b0c199b65e53b31cbc33bd298586d30106a66d587ee22f9c486df45d1ba ccc3bef31fe3faba9ff6daab0d5ca071fed6adb37d8cc554c7399ac599691557 d56e346d0980d838b9cd42c94d9e084ef84bb0fdeb4316ae2dd5c8a25cc054a1 7734f08ca26708ce34ae224077718432c05bc3133a11bb3d600a7d29c4df0045]
	I0630 21:20:23.463219  282690 ssh_runner.go:195] Run: which crictl
	I0630 21:20:23.466097  282690 ssh_runner.go:195] Run: sudo /usr/bin/crictl stop 6bdce580a9d6963de5c12d9e017d5662e2685851e130abf85abf7ccd2206a8a6 8341041be1bdbcf0e0425bd1832777e15b2ed89bf8696d0c78d14301820032c3 157c2b0c199b65e53b31cbc33bd298586d30106a66d587ee22f9c486df45d1ba ccc3bef31fe3faba9ff6daab0d5ca071fed6adb37d8cc554c7399ac599691557 d56e346d0980d838b9cd42c94d9e084ef84bb0fdeb4316ae2dd5c8a25cc054a1 7734f08ca26708ce34ae224077718432c05bc3133a11bb3d600a7d29c4df0045
	I0630 21:20:23.491529  282690 ssh_runner.go:195] Run: sudo systemctl stop kubelet
	I0630 21:20:23.501548  282690 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0630 21:20:23.508513  282690 kubeadm.go:155] found existing configuration files:
	-rw------- 1 root root 5643 Jun 30 21:07 /etc/kubernetes/admin.conf
	-rw------- 1 root root 5652 Jun 30 21:07 /etc/kubernetes/controller-manager.conf
	-rw------- 1 root root 2063 Jun 30 21:07 /etc/kubernetes/kubelet.conf
	-rw------- 1 root root 5600 Jun 30 21:07 /etc/kubernetes/scheduler.conf
	
	I0630 21:20:23.508569  282690 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
	I0630 21:20:23.515331  282690 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
	I0630 21:20:23.522134  282690 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
	I0630 21:20:23.528625  282690 kubeadm.go:166] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:23.528674  282690 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
	I0630 21:20:23.535118  282690 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
	I0630 21:20:23.541759  282690 kubeadm.go:166] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 1
	stdout:
	
	stderr:
	I0630 21:20:23.541806  282690 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
	I0630 21:20:23.547839  282690 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0630 21:20:23.554281  282690 kubeadm.go:703] reconfiguring cluster from /var/tmp/minikube/kubeadm.yaml
	I0630 21:20:23.554304  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:20:23.597418  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:20:24.204823  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:20:24.388425  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:20:24.446940  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:20:24.548581  282690 api_server.go:51] waiting for apiserver process to appear ...
	I0630 21:20:24.548652  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 21:20:25.058272  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 21:20:25.558267  282690 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 21:20:25.634820  282690 api_server.go:71] duration metric: took 1.086232371s to wait for apiserver process to appear ...
	I0630 21:20:25.634853  282690 api_server.go:87] waiting for apiserver healthz status ...
	I0630 21:20:25.634866  282690 api_server.go:240] Checking apiserver healthz at https://192.168.94.2:8443/healthz ...
	I0630 21:20:25.635225  282690 api_server.go:256] stopped: https://192.168.94.2:8443/healthz: Get "https://192.168.94.2:8443/healthz": dial tcp 192.168.94.2:8443: connect: connection refused
	I0630 21:20:26.135955  282690 api_server.go:240] Checking apiserver healthz at https://192.168.94.2:8443/healthz ...
	I0630 21:20:26.183141  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:28.683133  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:29.023735  282690 api_server.go:266] https://192.168.94.2:8443/healthz returned 403:
	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
	W0630 21:20:29.023845  282690 api_server.go:102] status: https://192.168.94.2:8443/healthz returned error 403:
	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
	I0630 21:20:29.136115  282690 api_server.go:240] Checking apiserver healthz at https://192.168.94.2:8443/healthz ...
	I0630 21:20:29.142290  282690 api_server.go:266] https://192.168.94.2:8443/healthz returned 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/bootstrap-controller ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[-]poststarthook/apiservice-registration-controller failed: reason withheld
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	W0630 21:20:29.142324  282690 api_server.go:102] status: https://192.168.94.2:8443/healthz returned error 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/bootstrap-controller ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[-]poststarthook/apiservice-registration-controller failed: reason withheld
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	I0630 21:20:29.635779  282690 api_server.go:240] Checking apiserver healthz at https://192.168.94.2:8443/healthz ...
	I0630 21:20:29.641744  282690 api_server.go:266] https://192.168.94.2:8443/healthz returned 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/bootstrap-controller ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-registration-controller ok
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	W0630 21:20:29.641774  282690 api_server.go:102] status: https://192.168.94.2:8443/healthz returned error 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-kube-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/bootstrap-controller ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-registration-controller ok
	[+]poststarthook/apiservice-status-available-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	I0630 21:20:30.135899  282690 api_server.go:240] Checking apiserver healthz at https://192.168.94.2:8443/healthz ...
	I0630 21:20:30.140340  282690 api_server.go:266] https://192.168.94.2:8443/healthz returned 200:
	ok
	I0630 21:20:30.146945  282690 api_server.go:140] control plane version: v1.24.2
	I0630 21:20:30.146967  282690 api_server.go:130] duration metric: took 4.512109627s to wait for apiserver health ...
	I0630 21:20:30.146976  282690 cni.go:95] Creating CNI manager for ""
	I0630 21:20:30.146983  282690 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:20:30.149207  282690 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0630 21:20:26.393339  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:28.893287  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:30.893492  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:30.150766  282690 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0630 21:20:30.154566  282690 cni.go:189] applying CNI manifest using /var/lib/minikube/binaries/v1.24.2/kubectl ...
	I0630 21:20:30.154592  282690 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2429 bytes)
	I0630 21:20:30.168730  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0630 21:20:30.976925  282690 system_pods.go:43] waiting for kube-system pods to appear ...
	I0630 21:20:30.983901  282690 system_pods.go:59] 9 kube-system pods found
	I0630 21:20:30.983933  282690 system_pods.go:61] "coredns-6d4b75cb6d-87dwf" [11e7f3e7-24e8-4e14-b1f6-a7e2b9bcfb74] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.)
	I0630 21:20:30.983941  282690 system_pods.go:61] "etcd-embed-certs-20220630210659-9950" [c7597376-29d8-4a64-a014-1bca6b00b239] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
	I0630 21:20:30.983951  282690 system_pods.go:61] "kindnet-z7fgt" [9d385a59-b071-48be-b547-db80254669bc] Running / Ready:ContainersNotReady (containers with unready status: [kindnet-cni]) / ContainersReady:ContainersNotReady (containers with unready status: [kindnet-cni])
	I0630 21:20:30.983963  282690 system_pods.go:61] "kube-apiserver-embed-certs-20220630210659-9950" [101e1b1d-d8d3-49c5-b250-f9524145064b] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
	I0630 21:20:30.983978  282690 system_pods.go:61] "kube-controller-manager-embed-certs-20220630210659-9950" [f93c4f3d-22de-4c13-a12a-c8ae9d47911c] Running
	I0630 21:20:30.983988  282690 system_pods.go:61] "kube-proxy-jhw4d" [78ec1767-ed48-4f50-ab14-61149fad7e98] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])
	I0630 21:20:30.984003  282690 system_pods.go:61] "kube-scheduler-embed-certs-20220630210659-9950" [727ac744-99fa-4867-9662-83efb2a98b35] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
	I0630 21:20:30.984012  282690 system_pods.go:61] "metrics-server-5c6f97fb75-dvslz" [3a4167d3-f572-4a2c-813a-d2d22e47d17e] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.)
	I0630 21:20:30.984019  282690 system_pods.go:61] "storage-provisioner" [4e574839-6ecb-47ba-b5c4-e45d9b19efc7] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.)
	I0630 21:20:30.984028  282690 system_pods.go:74] duration metric: took 7.077293ms to wait for pod list to return data ...
	I0630 21:20:30.984038  282690 node_conditions.go:102] verifying NodePressure condition ...
	I0630 21:20:30.986718  282690 node_conditions.go:122] node storage ephemeral capacity is 304695084Ki
	I0630 21:20:30.986752  282690 node_conditions.go:123] node cpu capacity is 8
	I0630 21:20:30.986766  282690 node_conditions.go:105] duration metric: took 2.718274ms to run NodePressure ...
	I0630 21:20:30.986786  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"
	I0630 21:20:31.145954  282690 kubeadm.go:762] waiting for restarted kubelet to initialise ...
	I0630 21:20:31.149839  282690 kubeadm.go:777] kubelet initialised
	I0630 21:20:31.149867  282690 kubeadm.go:778] duration metric: took 3.887979ms waiting for restarted kubelet to initialise ...
	I0630 21:20:31.149877  282690 pod_ready.go:35] extra waiting up to 4m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0630 21:20:31.154561  282690 pod_ready.go:78] waiting up to 4m0s for pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace to be "Ready" ...
	I0630 21:20:30.683577  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:33.182578  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:33.392832  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:35.393314  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:33.160352  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:35.660314  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:35.182728  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:37.682510  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:37.893265  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:39.893463  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:38.160526  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:40.660894  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:39.683375  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:42.182068  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:44.183054  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:42.393015  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:44.893292  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:43.160483  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:45.660796  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:47.660953  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:46.683087  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:49.183229  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:46.893432  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:49.393236  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:50.161308  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:52.660155  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:51.682409  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:53.682570  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:51.393511  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:53.893578  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:54.661629  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:57.159920  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:55.682710  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:58.182130  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:20:56.393487  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:58.892932  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:00.893465  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:20:59.160128  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:01.160665  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:00.182447  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:02.182840  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:04.182886  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:03.392696  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:05.393231  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:03.661112  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:06.160443  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:06.682224  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:08.682691  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:07.893418  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:10.392505  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:08.160644  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:10.661019  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:12.661060  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:11.182893  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:13.182991  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:12.393783  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:14.893314  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:15.160327  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:17.660228  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:15.682251  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:17.683152  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:17.393363  276064 pod_ready.go:102] pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:04:22 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:19.390281  276064 pod_ready.go:81] duration metric: took 4m0.003663432s waiting for pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace to be "Ready" ...
	E0630 21:21:19.390317  276064 pod_ready.go:66] WaitExtra: waitPodCondition: timed out waiting 4m0s for pod "coredns-6d4b75cb6d-cnt2b" in "kube-system" namespace to be "Ready" (will not retry!)
	I0630 21:21:19.390344  276064 pod_ready.go:38] duration metric: took 4m0.009122224s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0630 21:21:19.390376  276064 kubeadm.go:630] restartCluster took 4m11.317474742s
	W0630 21:21:19.390560  276064 out.go:239] ! Unable to restart cluster, will reset it: extra: timed out waiting 4m0s for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready"
	I0630 21:21:19.390595  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm reset --cri-socket /run/containerd/containerd.sock --force"
	I0630 21:21:19.660421  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:22.160264  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:20.183474  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:22.682948  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:21.023971  276064 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm reset --cri-socket /run/containerd/containerd.sock --force": (1.633354294s)
	I0630 21:21:21.024036  276064 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 21:21:21.033944  276064 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0630 21:21:21.041255  276064 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver
	I0630 21:21:21.041307  276064 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0630 21:21:21.048131  276064 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0630 21:21:21.048170  276064 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0630 21:21:24.160315  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:26.660444  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:25.181883  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:27.183120  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:30.433489  276064 out.go:204]   - Generating certificates and keys ...
	I0630 21:21:30.436707  276064 out.go:204]   - Booting up control plane ...
	I0630 21:21:30.439842  276064 out.go:204]   - Configuring RBAC rules ...
	I0630 21:21:30.442245  276064 cni.go:95] Creating CNI manager for ""
	I0630 21:21:30.442271  276064 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:21:30.444232  276064 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0630 21:21:30.446289  276064 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0630 21:21:30.450161  276064 cni.go:189] applying CNI manifest using /var/lib/minikube/binaries/v1.24.2/kubectl ...
	I0630 21:21:30.450180  276064 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2429 bytes)
	I0630 21:21:30.464668  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0630 21:21:28.661012  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:31.160051  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:29.682587  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:31.682697  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:33.683054  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:31.250327  276064 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0630 21:21:31.250457  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:31.250483  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl label nodes minikube.k8s.io/version=v1.26.0 minikube.k8s.io/commit=251ffcec0e4c997cd7732864187747cc579943c9 minikube.k8s.io/name=default-k8s-different-port-20220630210335-9950 minikube.k8s.io/updated_at=2022_06_30T21_21_31_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:31.337104  276064 ops.go:34] apiserver oom_adj: -16
	I0630 21:21:31.337122  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:31.898846  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:32.398504  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:32.898395  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:33.399197  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:33.898224  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:34.399278  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:34.898766  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:35.399106  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:35.898541  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:33.160337  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:35.660572  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:37.660625  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:36.183245  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:38.681927  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:36.399149  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:36.899206  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:37.398969  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:37.898306  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:38.398247  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:38.898685  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:39.399050  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:39.899197  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:40.399284  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:40.898565  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:40.159296  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:42.160359  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:41.398285  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:41.899049  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:42.399136  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:42.898362  276064 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:21:42.955690  276064 kubeadm.go:1045] duration metric: took 11.705297596s to wait for elevateKubeSystemPrivileges.
	I0630 21:21:42.955725  276064 kubeadm.go:397] StartCluster complete in 4m34.928502204s
	I0630 21:21:42.955749  276064 settings.go:142] acquiring lock: {Name:mkcbd229caa05b60d3551ef0b47eea08424c9b5d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:21:42.955839  276064 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:21:42.956940  276064 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig: {Name:mk34e4a4e7b04f624b9adbda4f77ee20b38308ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:21:43.471460  276064 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "default-k8s-different-port-20220630210335-9950" rescaled to 1
	I0630 21:21:43.471523  276064 start.go:208] Will wait 6m0s for node &{Name: IP:192.168.85.2 Port:8444 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0630 21:21:43.473505  276064 out.go:177] * Verifying Kubernetes components...
	I0630 21:21:43.471586  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0630 21:21:43.471607  276064 addons.go:412] enableAddons start: toEnable=map[dashboard:true metrics-server:true], additional=[]
	I0630 21:21:43.471793  276064 config.go:178] Loaded profile config "default-k8s-different-port-20220630210335-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:21:43.474864  276064 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 21:21:43.474932  276064 addons.go:65] Setting dashboard=true in profile "default-k8s-different-port-20220630210335-9950"
	I0630 21:21:43.474957  276064 addons.go:65] Setting default-storageclass=true in profile "default-k8s-different-port-20220630210335-9950"
	I0630 21:21:43.474976  276064 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "default-k8s-different-port-20220630210335-9950"
	I0630 21:21:43.474962  276064 addons.go:153] Setting addon dashboard=true in "default-k8s-different-port-20220630210335-9950"
	W0630 21:21:43.475061  276064 addons.go:162] addon dashboard should already be in state true
	I0630 21:21:43.475110  276064 host.go:66] Checking if "default-k8s-different-port-20220630210335-9950" exists ...
	I0630 21:21:43.474944  276064 addons.go:65] Setting metrics-server=true in profile "default-k8s-different-port-20220630210335-9950"
	I0630 21:21:43.475161  276064 addons.go:153] Setting addon metrics-server=true in "default-k8s-different-port-20220630210335-9950"
	W0630 21:21:43.475179  276064 addons.go:162] addon metrics-server should already be in state true
	I0630 21:21:43.475224  276064 host.go:66] Checking if "default-k8s-different-port-20220630210335-9950" exists ...
	I0630 21:21:43.474932  276064 addons.go:65] Setting storage-provisioner=true in profile "default-k8s-different-port-20220630210335-9950"
	I0630 21:21:43.475323  276064 cli_runner.go:164] Run: docker container inspect default-k8s-different-port-20220630210335-9950 --format={{.State.Status}}
	I0630 21:21:43.475319  276064 addons.go:153] Setting addon storage-provisioner=true in "default-k8s-different-port-20220630210335-9950"
	W0630 21:21:43.475359  276064 addons.go:162] addon storage-provisioner should already be in state true
	I0630 21:21:43.475407  276064 host.go:66] Checking if "default-k8s-different-port-20220630210335-9950" exists ...
	I0630 21:21:43.475586  276064 cli_runner.go:164] Run: docker container inspect default-k8s-different-port-20220630210335-9950 --format={{.State.Status}}
	I0630 21:21:43.475682  276064 cli_runner.go:164] Run: docker container inspect default-k8s-different-port-20220630210335-9950 --format={{.State.Status}}
	I0630 21:21:43.475805  276064 cli_runner.go:164] Run: docker container inspect default-k8s-different-port-20220630210335-9950 --format={{.State.Status}}
	I0630 21:21:43.525211  276064 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0630 21:21:43.526633  276064 addons.go:345] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 21:21:43.526654  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0630 21:21:43.526703  276064 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	I0630 21:21:43.529674  276064 out.go:177]   - Using image fake.domain/k8s.gcr.io/echoserver:1.4
	I0630 21:21:43.531135  276064 addons.go:345] installing /etc/kubernetes/addons/metrics-apiservice.yaml
	I0630 21:21:43.531154  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
	I0630 21:21:43.532388  276064 out.go:177]   - Using image kubernetesui/dashboard:v2.6.0
	I0630 21:21:43.531211  276064 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	I0630 21:21:43.534873  276064 out.go:177]   - Using image k8s.gcr.io/echoserver:1.4
	I0630 21:21:40.682196  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:42.682640  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:43.536294  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-ns.yaml
	I0630 21:21:43.536318  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
	I0630 21:21:43.535327  276064 addons.go:153] Setting addon default-storageclass=true in "default-k8s-different-port-20220630210335-9950"
	I0630 21:21:43.536373  276064 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	W0630 21:21:43.536390  276064 addons.go:162] addon default-storageclass should already be in state true
	I0630 21:21:43.536436  276064 host.go:66] Checking if "default-k8s-different-port-20220630210335-9950" exists ...
	I0630 21:21:43.536996  276064 cli_runner.go:164] Run: docker container inspect default-k8s-different-port-20220630210335-9950 --format={{.State.Status}}
	I0630 21:21:43.568952  276064 node_ready.go:35] waiting up to 6m0s for node "default-k8s-different-port-20220630210335-9950" to be "Ready" ...
	I0630 21:21:43.569160  276064 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.85.1 host.minikube.internal\n           fallthrough\n        }' | sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0630 21:21:43.573720  276064 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49437 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/default-k8s-different-port-20220630210335-9950/id_rsa Username:docker}
	I0630 21:21:43.585132  276064 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49437 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/default-k8s-different-port-20220630210335-9950/id_rsa Username:docker}
	I0630 21:21:43.585211  276064 addons.go:345] installing /etc/kubernetes/addons/storageclass.yaml
	I0630 21:21:43.585226  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0630 21:21:43.585277  276064 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220630210335-9950
	I0630 21:21:43.592285  276064 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49437 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/default-k8s-different-port-20220630210335-9950/id_rsa Username:docker}
	I0630 21:21:43.623221  276064 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49437 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/default-k8s-different-port-20220630210335-9950/id_rsa Username:docker}
	I0630 21:21:43.744945  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
	I0630 21:21:43.744974  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
	I0630 21:21:43.747847  276064 addons.go:345] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
	I0630 21:21:43.747873  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1820 bytes)
	I0630 21:21:43.748263  276064 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 21:21:43.924785  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
	I0630 21:21:43.924816  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
	I0630 21:21:43.928618  276064 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0630 21:21:43.940306  276064 addons.go:345] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
	I0630 21:21:43.940338  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
	I0630 21:21:43.950742  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-configmap.yaml
	I0630 21:21:43.950768  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
	I0630 21:21:44.037060  276064 addons.go:345] installing /etc/kubernetes/addons/metrics-server-service.yaml
	I0630 21:21:44.037089  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
	I0630 21:21:44.047010  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-dp.yaml
	I0630 21:21:44.047034  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4196 bytes)
	I0630 21:21:44.135080  276064 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I0630 21:21:44.140888  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-role.yaml
	I0630 21:21:44.140919  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
	I0630 21:21:44.230459  276064 start.go:806] {"host.minikube.internal": 192.168.85.1} host record injected into CoreDNS
	I0630 21:21:44.235255  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
	I0630 21:21:44.235283  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
	I0630 21:21:44.327158  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-sa.yaml
	I0630 21:21:44.327192  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
	I0630 21:21:44.351459  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-secret.yaml
	I0630 21:21:44.351527  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
	I0630 21:21:44.448179  276064 addons.go:345] installing /etc/kubernetes/addons/dashboard-svc.yaml
	I0630 21:21:44.448218  276064 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
	I0630 21:21:44.537927  276064 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	I0630 21:21:45.130031  276064 addons.go:383] Verifying addon metrics-server=true in "default-k8s-different-port-20220630210335-9950"
	I0630 21:21:45.539430  276064 out.go:177] * Enabled addons: storage-provisioner, default-storageclass, metrics-server, dashboard
	I0630 21:21:45.540750  276064 addons.go:414] enableAddons completed in 2.0691399s
	I0630 21:21:45.575595  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:21:44.660831  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:47.160149  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:45.182445  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:47.682514  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:47.576330  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:21:49.576407  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:21:49.160793  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:51.660805  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:50.182451  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:52.183083  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:52.076426  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:21:54.076887  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:21:54.161146  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:56.660728  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:21:54.683102  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:57.182501  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:59.182957  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:21:56.575738  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:21:58.576604  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:00.577162  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:21:59.160517  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:01.160700  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:01.183043  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:03.682640  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:03.075860  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:05.076679  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:03.661117  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:06.160731  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:05.682843  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:08.182414  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:07.576553  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:10.075989  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:08.660876  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:11.160848  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:10.682414  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:12.682830  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:12.076661  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:14.576273  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:13.660019  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:15.660934  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:15.183230  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:17.681937  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:17.075764  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:19.076352  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:18.160512  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:20.661337  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:19.682685  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:22.182341  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:21.575906  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:24.076044  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:23.159968  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:25.659994  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:27.660386  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:24.682559  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:26.682712  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:28.682765  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:26.076272  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:28.076381  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:30.576589  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:29.660781  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:31.661081  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:31.182114  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:33.182667  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:33.075544  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:35.076859  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:34.160031  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:36.174889  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:35.682410  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:37.682440  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:37.576222  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:40.076094  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:38.660329  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:40.661271  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:39.682506  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:42.182441  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:44.182613  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:42.076569  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:44.575778  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:43.160906  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:45.660687  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:47.660756  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:46.182890  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:48.682065  271327 node_ready.go:58] node "old-k8s-version-20220630210005-9950" has status "Ready":"False"
	I0630 21:22:50.184705  271327 node_ready.go:38] duration metric: took 4m0.008399385s waiting for node "old-k8s-version-20220630210005-9950" to be "Ready" ...
	I0630 21:22:50.186899  271327 out.go:177] 
	W0630 21:22:50.188676  271327 out.go:239] X Exiting due to GUEST_START: wait 6m0s for node: waiting for node to be ready: waitNodeCondition: timed out waiting for the condition
	W0630 21:22:50.188714  271327 out.go:239] * 
	W0630 21:22:50.189487  271327 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0630 21:22:50.191389  271327 out.go:177] 
	I0630 21:22:47.075947  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:49.576265  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:50.159356  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:52.163951  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:52.075526  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:54.076399  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:54.660447  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:57.160029  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:22:56.575822  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:58.576331  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:00.576702  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:22:59.160433  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:01.660547  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:03.076469  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:05.576257  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:03.660907  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:06.160339  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:08.076793  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:10.576173  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:08.160593  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:10.660347  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:12.660595  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:13.075956  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:15.076120  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:15.160070  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:17.660236  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:17.576068  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:20.076292  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:20.159819  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:22.159969  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:22.076376  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:24.576689  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:24.160202  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:26.160569  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:27.075866  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:29.075916  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:28.660765  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:30.661044  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:31.076034  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:33.076065  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:35.575815  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:33.160787  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:35.660078  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:37.660223  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:38.076264  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:40.076307  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:39.661253  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:42.160767  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:42.576389  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:45.076289  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:44.660279  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:46.660767  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:47.576205  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:50.076370  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:49.159959  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:51.160087  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:52.576483  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:55.076140  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:53.160885  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:55.660365  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:23:57.077197  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:59.575847  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:23:58.160601  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:00.660863  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:02.076497  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:04.576615  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:03.160979  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:05.661301  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:07.076328  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:09.076375  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:08.160501  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:10.661257  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:11.575987  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:13.576105  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:15.576639  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:13.160653  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:15.660136  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:18.076538  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:20.576354  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:18.160271  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:20.660902  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:23.076485  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:25.575931  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:23.160075  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:25.160311  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:27.660413  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:28.076238  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:30.076402  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:30.159564  282690 pod_ready.go:102] pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-06-30 21:07:35 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.}] Message: Reason: NominatedNodeName: HostIP: PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[]}
	I0630 21:24:31.157632  282690 pod_ready.go:81] duration metric: took 4m0.003038156s waiting for pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace to be "Ready" ...
	E0630 21:24:31.157659  282690 pod_ready.go:66] WaitExtra: waitPodCondition: timed out waiting 4m0s for pod "coredns-6d4b75cb6d-87dwf" in "kube-system" namespace to be "Ready" (will not retry!)
	I0630 21:24:31.157707  282690 pod_ready.go:38] duration metric: took 4m0.007820375s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0630 21:24:31.157735  282690 kubeadm.go:630] restartCluster took 4m10.761529656s
	W0630 21:24:31.157891  282690 out.go:239] ! Unable to restart cluster, will reset it: extra: timed out waiting 4m0s for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready"
	I0630 21:24:31.157919  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm reset --cri-socket /run/containerd/containerd.sock --force"
	I0630 21:24:32.851642  282690 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm reset --cri-socket /run/containerd/containerd.sock --force": (1.693695416s)
	I0630 21:24:32.851727  282690 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 21:24:32.861758  282690 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0630 21:24:32.869625  282690 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver
	I0630 21:24:32.869693  282690 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0630 21:24:32.876878  282690 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0630 21:24:32.876929  282690 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0630 21:24:32.076763  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:34.576381  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:36.576542  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:39.075659  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:41.836005  282690 out.go:204]   - Generating certificates and keys ...
	I0630 21:24:41.839508  282690 out.go:204]   - Booting up control plane ...
	I0630 21:24:41.842351  282690 out.go:204]   - Configuring RBAC rules ...
	I0630 21:24:41.844644  282690 cni.go:95] Creating CNI manager for ""
	I0630 21:24:41.844675  282690 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 21:24:41.846424  282690 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0630 21:24:41.847990  282690 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0630 21:24:41.853099  282690 cni.go:189] applying CNI manifest using /var/lib/minikube/binaries/v1.24.2/kubectl ...
	I0630 21:24:41.853126  282690 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2429 bytes)
	I0630 21:24:41.932756  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0630 21:24:42.729823  282690 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0630 21:24:42.729895  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:42.729926  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl label nodes minikube.k8s.io/version=v1.26.0 minikube.k8s.io/commit=251ffcec0e4c997cd7732864187747cc579943c9 minikube.k8s.io/name=embed-certs-20220630210659-9950 minikube.k8s.io/updated_at=2022_06_30T21_24_42_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:42.738247  282690 ops.go:34] apiserver oom_adj: -16
	I0630 21:24:42.834211  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:41.076287  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:43.076543  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:45.576221  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:43.427269  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:43.927268  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:44.426722  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:44.926851  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:45.427106  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:45.927276  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:46.427354  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:46.926751  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:47.426882  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:47.927284  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:48.076060  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:50.575977  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:48.427353  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:48.927037  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:49.426521  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:49.926695  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:50.426914  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:50.927459  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:51.427334  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:51.927468  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:52.427189  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:52.927285  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:53.426965  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:53.926595  282690 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0630 21:24:53.987285  282690 kubeadm.go:1045] duration metric: took 11.25744575s to wait for elevateKubeSystemPrivileges.
	I0630 21:24:53.987312  282690 kubeadm.go:397] StartCluster complete in 4m33.638985641s
	I0630 21:24:53.987328  282690 settings.go:142] acquiring lock: {Name:mkcbd229caa05b60d3551ef0b47eea08424c9b5d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:24:53.987411  282690 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 21:24:53.988694  282690 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig: {Name:mk34e4a4e7b04f624b9adbda4f77ee20b38308ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 21:24:54.505472  282690 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "embed-certs-20220630210659-9950" rescaled to 1
	I0630 21:24:54.505546  282690 start.go:208] Will wait 6m0s for node &{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0630 21:24:54.505581  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0630 21:24:54.507434  282690 out.go:177] * Verifying Kubernetes components...
	I0630 21:24:54.505671  282690 addons.go:412] enableAddons start: toEnable=map[dashboard:true metrics-server:true], additional=[]
	I0630 21:24:54.507512  282690 addons.go:65] Setting storage-provisioner=true in profile "embed-certs-20220630210659-9950"
	I0630 21:24:54.507530  282690 addons.go:153] Setting addon storage-provisioner=true in "embed-certs-20220630210659-9950"
	I0630 21:24:54.505785  282690 config.go:178] Loaded profile config "embed-certs-20220630210659-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 21:24:54.508995  282690 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 21:24:54.507534  282690 addons.go:65] Setting dashboard=true in profile "embed-certs-20220630210659-9950"
	I0630 21:24:54.509033  282690 addons.go:153] Setting addon dashboard=true in "embed-certs-20220630210659-9950"
	W0630 21:24:54.509043  282690 addons.go:162] addon dashboard should already be in state true
	I0630 21:24:54.507547  282690 addons.go:65] Setting default-storageclass=true in profile "embed-certs-20220630210659-9950"
	I0630 21:24:54.509118  282690 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "embed-certs-20220630210659-9950"
	I0630 21:24:54.507548  282690 addons.go:65] Setting metrics-server=true in profile "embed-certs-20220630210659-9950"
	W0630 21:24:54.507573  282690 addons.go:162] addon storage-provisioner should already be in state true
	I0630 21:24:54.509134  282690 host.go:66] Checking if "embed-certs-20220630210659-9950" exists ...
	I0630 21:24:54.509177  282690 host.go:66] Checking if "embed-certs-20220630210659-9950" exists ...
	I0630 21:24:54.509200  282690 addons.go:153] Setting addon metrics-server=true in "embed-certs-20220630210659-9950"
	W0630 21:24:54.509223  282690 addons.go:162] addon metrics-server should already be in state true
	I0630 21:24:54.509308  282690 host.go:66] Checking if "embed-certs-20220630210659-9950" exists ...
	I0630 21:24:54.509462  282690 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:24:54.509581  282690 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:24:54.509613  282690 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:24:54.509797  282690 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:24:54.560813  282690 out.go:177]   - Using image fake.domain/k8s.gcr.io/echoserver:1.4
	I0630 21:24:54.562228  282690 addons.go:345] installing /etc/kubernetes/addons/metrics-apiservice.yaml
	I0630 21:24:54.562250  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
	I0630 21:24:54.566558  282690 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0630 21:24:54.563422  282690 addons.go:153] Setting addon default-storageclass=true in "embed-certs-20220630210659-9950"
	I0630 21:24:54.564610  282690 out.go:177]   - Using image kubernetesui/dashboard:v2.6.0
	I0630 21:24:54.564664  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	W0630 21:24:54.566619  282690 addons.go:162] addon default-storageclass should already be in state true
	I0630 21:24:54.568042  282690 addons.go:345] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 21:24:54.568076  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0630 21:24:54.568138  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:24:54.568049  282690 host.go:66] Checking if "embed-certs-20220630210659-9950" exists ...
	I0630 21:24:54.568896  282690 cli_runner.go:164] Run: docker container inspect embed-certs-20220630210659-9950 --format={{.State.Status}}
	I0630 21:24:54.571125  282690 out.go:177]   - Using image k8s.gcr.io/echoserver:1.4
	I0630 21:24:52.576199  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:54.577462  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:54.573220  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-ns.yaml
	I0630 21:24:54.573240  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
	I0630 21:24:54.573296  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:24:54.596761  282690 node_ready.go:35] waiting up to 6m0s for node "embed-certs-20220630210659-9950" to be "Ready" ...
	I0630 21:24:54.596796  282690 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.94.1 host.minikube.internal\n           fallthrough\n        }' | sudo /var/lib/minikube/binaries/v1.24.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0630 21:24:54.622285  282690 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49442 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:24:54.625192  282690 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49442 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:24:54.629199  282690 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49442 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:24:54.632573  282690 addons.go:345] installing /etc/kubernetes/addons/storageclass.yaml
	I0630 21:24:54.632600  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0630 21:24:54.632654  282690 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220630210659-9950
	I0630 21:24:54.674915  282690 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49442 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/embed-certs-20220630210659-9950/id_rsa Username:docker}
	I0630 21:24:54.846449  282690 addons.go:345] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
	I0630 21:24:54.846481  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1820 bytes)
	I0630 21:24:54.938792  282690 addons.go:345] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
	I0630 21:24:54.938872  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
	I0630 21:24:54.943079  282690 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0630 21:24:54.947159  282690 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0630 21:24:54.947675  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
	I0630 21:24:54.947698  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
	I0630 21:24:55.026994  282690 addons.go:345] installing /etc/kubernetes/addons/metrics-server-service.yaml
	I0630 21:24:55.027031  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
	I0630 21:24:55.035197  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
	I0630 21:24:55.035232  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
	I0630 21:24:55.053605  282690 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I0630 21:24:55.126653  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-configmap.yaml
	I0630 21:24:55.126705  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
	I0630 21:24:55.146581  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-dp.yaml
	I0630 21:24:55.146621  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4196 bytes)
	I0630 21:24:55.327942  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-role.yaml
	I0630 21:24:55.328024  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
	I0630 21:24:55.343459  282690 start.go:806] {"host.minikube.internal": 192.168.94.1} host record injected into CoreDNS
	I0630 21:24:55.432902  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
	I0630 21:24:55.432936  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
	I0630 21:24:55.449659  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-sa.yaml
	I0630 21:24:55.449700  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
	I0630 21:24:55.535585  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-secret.yaml
	I0630 21:24:55.535622  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
	I0630 21:24:55.637082  282690 addons.go:345] installing /etc/kubernetes/addons/dashboard-svc.yaml
	I0630 21:24:55.637110  282690 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
	I0630 21:24:55.654090  282690 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	I0630 21:24:56.256357  282690 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (1.202695189s)
	I0630 21:24:56.256419  282690 addons.go:383] Verifying addon metrics-server=true in "embed-certs-20220630210659-9950"
	I0630 21:24:56.635370  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:24:57.057755  282690 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.2/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (1.403598153s)
	I0630 21:24:57.059648  282690 out.go:177] * Enabled addons: default-storageclass, storage-provisioner, metrics-server, dashboard
	I0630 21:24:57.061353  282690 addons.go:414] enableAddons completed in 2.555682965s
	I0630 21:24:57.076377  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:59.575515  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:24:59.133305  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:01.133976  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:01.575803  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:03.576220  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:05.576603  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:03.633140  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:05.633312  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:07.633508  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:08.075989  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:10.576424  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:09.633916  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:12.134025  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:13.075816  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:15.076512  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:14.134148  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:16.633590  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:17.575814  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:19.576180  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:19.133861  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:21.634052  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:22.076523  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:24.076612  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:23.634100  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:26.133369  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:28.133752  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:26.076674  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:28.575901  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:30.134009  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:32.633645  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:31.076339  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:33.576385  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:34.633970  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:37.133998  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:36.076191  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:38.576126  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:40.576363  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:39.633552  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:42.133635  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:43.076600  276064 node_ready.go:58] node "default-k8s-different-port-20220630210335-9950" has status "Ready":"False"
	I0630 21:25:43.577767  276064 node_ready.go:38] duration metric: took 4m0.008779238s waiting for node "default-k8s-different-port-20220630210335-9950" to be "Ready" ...
	I0630 21:25:43.580054  276064 out.go:177] 
	W0630 21:25:43.581406  276064 out.go:239] X Exiting due to GUEST_START: wait 6m0s for node: waiting for node to be ready: waitNodeCondition: timed out waiting for the condition
	W0630 21:25:43.581422  276064 out.go:239] * 
	W0630 21:25:43.582123  276064 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0630 21:25:43.583833  276064 out.go:177] 
	I0630 21:25:44.133850  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:46.633832  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:48.633923  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:51.133282  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:53.134021  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:55.134340  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:57.633598  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:25:59.633912  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:01.634030  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:04.134240  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:06.634341  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:09.134132  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:11.633755  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:13.633838  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:16.134412  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:18.634048  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:21.133258  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:23.134085  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:25.633525  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:27.633880  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:29.634672  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:32.133127  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:34.133922  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:36.134141  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:38.635943  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:41.134059  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:43.634129  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:46.133833  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:48.634266  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:51.133583  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:53.633861  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:55.634000  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:26:57.634221  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:00.134428  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:02.634184  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:04.634236  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:07.133392  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:09.133620  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:11.133918  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:13.633511  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:15.634578  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:18.134059  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:20.633162  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:22.634065  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:25.133441  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:27.133812  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:29.634200  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:32.133633  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:34.634090  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:37.134098  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:39.634528  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:42.134216  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:44.633646  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:46.633772  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:49.133433  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:51.633343  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:54.133271  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:56.133890  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:27:58.633874  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:01.133490  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:03.634155  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:06.133638  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:08.134014  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:10.633584  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:12.633988  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:15.133284  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:17.633303  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:19.633472  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:21.633579  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:24.133628  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:26.633535  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:29.133336  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:31.134181  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:33.633631  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:35.634122  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:38.134153  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:40.634086  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:43.134075  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:45.633956  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:47.634182  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:50.133652  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:52.633744  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:54.635658  282690 node_ready.go:58] node "embed-certs-20220630210659-9950" has status "Ready":"False"
	I0630 21:28:54.635684  282690 node_ready.go:38] duration metric: took 4m0.038888758s waiting for node "embed-certs-20220630210659-9950" to be "Ready" ...
	I0630 21:28:54.638083  282690 out.go:177] 
	W0630 21:28:54.639729  282690 out.go:239] X Exiting due to GUEST_START: wait 6m0s for node: waiting for node to be ready: waitNodeCondition: timed out waiting for the condition
	W0630 21:28:54.639748  282690 out.go:239] * 
	W0630 21:28:54.640518  282690 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0630 21:28:54.642114  282690 out.go:177] 
	
	* 
	* ==> container status <==
	* CONTAINER           IMAGE               CREATED             STATE               NAME                      ATTEMPT             POD ID
	97de679306a47       6fb66cd78abfe       50 seconds ago      Running             kindnet-cni               4                   0fdc2f54e5621
	639a7f1e407ae       6fb66cd78abfe       4 minutes ago       Exited              kindnet-cni               3                   0fdc2f54e5621
	833b51196bf62       a634548d10b03       13 minutes ago      Running             kube-proxy                0                   3b04b654bf293
	9cb12a28b2ecb       5d725196c1f47       13 minutes ago      Running             kube-scheduler            2                   2452657082377
	c50613e594499       aebe758cef4cd       13 minutes ago      Running             etcd                      2                   5a17cc10edf6f
	a254fdd241c22       34cdf99b1bb3b       13 minutes ago      Running             kube-controller-manager   2                   961a7ff8eb8e6
	a37e0a712134d       d3377ffb7177c       13 minutes ago      Running             kube-apiserver            2                   41b7abf9937c8
	
	* 
	* ==> containerd <==
	* -- Logs begin at Thu 2022-06-30 21:20:04 UTC, end at Thu 2022-06-30 21:37:58 UTC. --
	Jun 30 21:30:18 embed-certs-20220630210659-9950 containerd[394]: time="2022-06-30T21:30:18.637690741Z" level=info msg="RemoveContainer for \"fb26d581a951b28cf7fcfe4779356fc56c2ce4d8fb92d06b1dbec14f32a9b083\" returns successfully"
	Jun 30 21:30:33 embed-certs-20220630210659-9950 containerd[394]: time="2022-06-30T21:30:33.842741907Z" level=info msg="CreateContainer within sandbox \"0fdc2f54e56211eb72ecd16663f2a1841191ec9d15bc94e17422e429ac47ecde\" for container &ContainerMetadata{Name:kindnet-cni,Attempt:2,}"
	Jun 30 21:30:33 embed-certs-20220630210659-9950 containerd[394]: time="2022-06-30T21:30:33.856472988Z" level=info msg="CreateContainer within sandbox \"0fdc2f54e56211eb72ecd16663f2a1841191ec9d15bc94e17422e429ac47ecde\" for &ContainerMetadata{Name:kindnet-cni,Attempt:2,} returns container id \"cee8185a7b73fb18c81b38170e2493f6a497a171d69375f18b61306a881e4e77\""
	Jun 30 21:30:33 embed-certs-20220630210659-9950 containerd[394]: time="2022-06-30T21:30:33.859896436Z" level=info msg="StartContainer for \"cee8185a7b73fb18c81b38170e2493f6a497a171d69375f18b61306a881e4e77\""
	Jun 30 21:30:33 embed-certs-20220630210659-9950 containerd[394]: time="2022-06-30T21:30:33.941182233Z" level=info msg="StartContainer for \"cee8185a7b73fb18c81b38170e2493f6a497a171d69375f18b61306a881e4e77\" returns successfully"
	Jun 30 21:33:14 embed-certs-20220630210659-9950 containerd[394]: time="2022-06-30T21:33:14.375900302Z" level=info msg="shim disconnected" id=cee8185a7b73fb18c81b38170e2493f6a497a171d69375f18b61306a881e4e77
	Jun 30 21:33:14 embed-certs-20220630210659-9950 containerd[394]: time="2022-06-30T21:33:14.375962096Z" level=warning msg="cleaning up after shim disconnected" id=cee8185a7b73fb18c81b38170e2493f6a497a171d69375f18b61306a881e4e77 namespace=k8s.io
	Jun 30 21:33:14 embed-certs-20220630210659-9950 containerd[394]: time="2022-06-30T21:33:14.375972005Z" level=info msg="cleaning up dead shim"
	Jun 30 21:33:14 embed-certs-20220630210659-9950 containerd[394]: time="2022-06-30T21:33:14.385502900Z" level=warning msg="cleanup warnings time=\"2022-06-30T21:33:14Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=4359 runtime=io.containerd.runc.v2\n"
	Jun 30 21:33:14 embed-certs-20220630210659-9950 containerd[394]: time="2022-06-30T21:33:14.969828079Z" level=info msg="RemoveContainer for \"56df5b1d8f1d27837d4ba419c2ee21f7ec4691704b7b4a8cf374e1658312deee\""
	Jun 30 21:33:14 embed-certs-20220630210659-9950 containerd[394]: time="2022-06-30T21:33:14.974697608Z" level=info msg="RemoveContainer for \"56df5b1d8f1d27837d4ba419c2ee21f7ec4691704b7b4a8cf374e1658312deee\" returns successfully"
	Jun 30 21:33:42 embed-certs-20220630210659-9950 containerd[394]: time="2022-06-30T21:33:42.842936125Z" level=info msg="CreateContainer within sandbox \"0fdc2f54e56211eb72ecd16663f2a1841191ec9d15bc94e17422e429ac47ecde\" for container &ContainerMetadata{Name:kindnet-cni,Attempt:3,}"
	Jun 30 21:33:42 embed-certs-20220630210659-9950 containerd[394]: time="2022-06-30T21:33:42.855532016Z" level=info msg="CreateContainer within sandbox \"0fdc2f54e56211eb72ecd16663f2a1841191ec9d15bc94e17422e429ac47ecde\" for &ContainerMetadata{Name:kindnet-cni,Attempt:3,} returns container id \"639a7f1e407aebdd61cc486d13fc8a94ae4ac86d0ac9ee5f7a2ff0c363606023\""
	Jun 30 21:33:42 embed-certs-20220630210659-9950 containerd[394]: time="2022-06-30T21:33:42.856247976Z" level=info msg="StartContainer for \"639a7f1e407aebdd61cc486d13fc8a94ae4ac86d0ac9ee5f7a2ff0c363606023\""
	Jun 30 21:33:42 embed-certs-20220630210659-9950 containerd[394]: time="2022-06-30T21:33:42.941579312Z" level=info msg="StartContainer for \"639a7f1e407aebdd61cc486d13fc8a94ae4ac86d0ac9ee5f7a2ff0c363606023\" returns successfully"
	Jun 30 21:36:23 embed-certs-20220630210659-9950 containerd[394]: time="2022-06-30T21:36:23.359847264Z" level=info msg="shim disconnected" id=639a7f1e407aebdd61cc486d13fc8a94ae4ac86d0ac9ee5f7a2ff0c363606023
	Jun 30 21:36:23 embed-certs-20220630210659-9950 containerd[394]: time="2022-06-30T21:36:23.359919068Z" level=warning msg="cleaning up after shim disconnected" id=639a7f1e407aebdd61cc486d13fc8a94ae4ac86d0ac9ee5f7a2ff0c363606023 namespace=k8s.io
	Jun 30 21:36:23 embed-certs-20220630210659-9950 containerd[394]: time="2022-06-30T21:36:23.359938524Z" level=info msg="cleaning up dead shim"
	Jun 30 21:36:23 embed-certs-20220630210659-9950 containerd[394]: time="2022-06-30T21:36:23.369416956Z" level=warning msg="cleanup warnings time=\"2022-06-30T21:36:23Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=4469 runtime=io.containerd.runc.v2\n"
	Jun 30 21:36:24 embed-certs-20220630210659-9950 containerd[394]: time="2022-06-30T21:36:24.327087538Z" level=info msg="RemoveContainer for \"cee8185a7b73fb18c81b38170e2493f6a497a171d69375f18b61306a881e4e77\""
	Jun 30 21:36:24 embed-certs-20220630210659-9950 containerd[394]: time="2022-06-30T21:36:24.331592131Z" level=info msg="RemoveContainer for \"cee8185a7b73fb18c81b38170e2493f6a497a171d69375f18b61306a881e4e77\" returns successfully"
	Jun 30 21:37:07 embed-certs-20220630210659-9950 containerd[394]: time="2022-06-30T21:37:07.842595771Z" level=info msg="CreateContainer within sandbox \"0fdc2f54e56211eb72ecd16663f2a1841191ec9d15bc94e17422e429ac47ecde\" for container &ContainerMetadata{Name:kindnet-cni,Attempt:4,}"
	Jun 30 21:37:07 embed-certs-20220630210659-9950 containerd[394]: time="2022-06-30T21:37:07.856699401Z" level=info msg="CreateContainer within sandbox \"0fdc2f54e56211eb72ecd16663f2a1841191ec9d15bc94e17422e429ac47ecde\" for &ContainerMetadata{Name:kindnet-cni,Attempt:4,} returns container id \"97de679306a47cc5ad450b40ed4307b34b481a94ce47e217087fd08e56411e18\""
	Jun 30 21:37:07 embed-certs-20220630210659-9950 containerd[394]: time="2022-06-30T21:37:07.857358663Z" level=info msg="StartContainer for \"97de679306a47cc5ad450b40ed4307b34b481a94ce47e217087fd08e56411e18\""
	Jun 30 21:37:07 embed-certs-20220630210659-9950 containerd[394]: time="2022-06-30T21:37:07.940507586Z" level=info msg="StartContainer for \"97de679306a47cc5ad450b40ed4307b34b481a94ce47e217087fd08e56411e18\" returns successfully"
	
	* 
	* ==> describe nodes <==
	* Name:               embed-certs-20220630210659-9950
	Roles:              control-plane
	Labels:             beta.kubernetes.io/arch=amd64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=amd64
	                    kubernetes.io/hostname=embed-certs-20220630210659-9950
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=251ffcec0e4c997cd7732864187747cc579943c9
	                    minikube.k8s.io/name=embed-certs-20220630210659-9950
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2022_06_30T21_24_42_0700
	                    minikube.k8s.io/version=v1.26.0
	                    node-role.kubernetes.io/control-plane=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///run/containerd/containerd.sock
	                    node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Thu, 30 Jun 2022 21:24:38 +0000
	Taints:             node.kubernetes.io/not-ready:NoSchedule
	Unschedulable:      false
	Lease:
	  HolderIdentity:  embed-certs-20220630210659-9950
	  AcquireTime:     <unset>
	  RenewTime:       Thu, 30 Jun 2022 21:37:48 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Thu, 30 Jun 2022 21:35:04 +0000   Thu, 30 Jun 2022 21:24:35 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Thu, 30 Jun 2022 21:35:04 +0000   Thu, 30 Jun 2022 21:24:35 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Thu, 30 Jun 2022 21:35:04 +0000   Thu, 30 Jun 2022 21:24:35 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            False   Thu, 30 Jun 2022 21:35:04 +0000   Thu, 30 Jun 2022 21:24:35 +0000   KubeletNotReady              container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
	Addresses:
	  InternalIP:  192.168.94.2
	  Hostname:    embed-certs-20220630210659-9950
	Capacity:
	  cpu:                8
	  ephemeral-storage:  304695084Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32873488Ki
	  pods:               110
	Allocatable:
	  cpu:                8
	  ephemeral-storage:  304695084Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32873488Ki
	  pods:               110
	System Info:
	  Machine ID:                 bbe1e1cef6e940328962dca52b3c5731
	  System UUID:                e149cbc8-bbc1-4888-b53f-97553d30d981
	  Boot ID:                    471c4729-f046-4a15-bc49-46f3ad561708
	  Kernel Version:             5.15.0-1012-gcp
	  OS Image:                   Ubuntu 20.04.4 LTS
	  Operating System:           linux
	  Architecture:               amd64
	  Container Runtime Version:  containerd://1.6.6
	  Kubelet Version:            v1.24.2
	  Kube-Proxy Version:         v1.24.2
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (6 in total)
	  Namespace                   Name                                                       CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                                       ------------  ----------  ---------------  -------------  ---
	  kube-system                 etcd-embed-certs-20220630210659-9950                       100m (1%!)(MISSING)     0 (0%!)(MISSING)      100Mi (0%!)(MISSING)       0 (0%!)(MISSING)         13m
	  kube-system                 kindnet-4rws6                                              100m (1%!)(MISSING)     100m (1%!)(MISSING)   50Mi (0%!)(MISSING)        50Mi (0%!)(MISSING)      13m
	  kube-system                 kube-apiserver-embed-certs-20220630210659-9950             250m (3%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         13m
	  kube-system                 kube-controller-manager-embed-certs-20220630210659-9950    200m (2%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         13m
	  kube-system                 kube-proxy-nxxvt                                           0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         13m
	  kube-system                 kube-scheduler-embed-certs-20220630210659-9950             100m (1%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         13m
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                750m (9%!)(MISSING)   100m (1%!)(MISSING)
	  memory             150Mi (0%!)(MISSING)  50Mi (0%!)(MISSING)
	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	Events:
	  Type    Reason                   Age                From             Message
	  ----    ------                   ----               ----             -------
	  Normal  Starting                 13m                kube-proxy       
	  Normal  NodeHasSufficientMemory  13m (x5 over 13m)  kubelet          Node embed-certs-20220630210659-9950 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    13m (x5 over 13m)  kubelet          Node embed-certs-20220630210659-9950 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     13m (x3 over 13m)  kubelet          Node embed-certs-20220630210659-9950 status is now: NodeHasSufficientPID
	  Normal  NodeHasNoDiskPressure    13m                kubelet          Node embed-certs-20220630210659-9950 status is now: NodeHasNoDiskPressure
	  Normal  Starting                 13m                kubelet          Starting kubelet.
	  Normal  NodeHasSufficientMemory  13m                kubelet          Node embed-certs-20220630210659-9950 status is now: NodeHasSufficientMemory
	  Normal  NodeHasSufficientPID     13m                kubelet          Node embed-certs-20220630210659-9950 status is now: NodeHasSufficientPID
	  Normal  NodeAllocatableEnforced  13m                kubelet          Updated Node Allocatable limit across pods
	  Normal  RegisteredNode           13m                node-controller  Node embed-certs-20220630210659-9950 event: Registered Node embed-certs-20220630210659-9950 in Controller
	
	* 
	* ==> dmesg <==
	* [  +2.939825] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000011] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.027789] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.019913] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[ +21.968090] IPv4: martian destination 127.0.0.11 from 10.244.0.3, dev veth8071d138
	[ +25.445872] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.029436] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.023957] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +2.947695] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[Jun30 21:05] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.023879] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +2.955783] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.011828] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000005] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	[  +1.027896] IPv4: martian source 10.244.0.98 from 10.244.0.4, on dev eth0
	[  +0.000006] ll header: 00000000: ff ff ff ff ff ff 12 52 e9 66 ff 76 08 06
	
	* 
	* ==> etcd [c50613e594499cee812306fd3c897ca03098f8f388e6ac0945c96b39297cb862] <==
	* {"level":"info","ts":"2022-06-30T21:24:35.432Z","caller":"embed/etcd.go:688","msg":"starting with client TLS","tls-info":"cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, client-cert=, client-key=, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = ","cipher-suites":[]}
	{"level":"info","ts":"2022-06-30T21:24:35.432Z","caller":"embed/etcd.go:581","msg":"serving peer traffic","address":"192.168.94.2:2380"}
	{"level":"info","ts":"2022-06-30T21:24:35.432Z","caller":"embed/etcd.go:553","msg":"cmux::serve","address":"192.168.94.2:2380"}
	{"level":"info","ts":"2022-06-30T21:24:35.432Z","caller":"embed/etcd.go:277","msg":"now serving peer/client/metrics","local-member-id":"dfc97eb0aae75b33","initial-advertise-peer-urls":["https://192.168.94.2:2380"],"listen-peer-urls":["https://192.168.94.2:2380"],"advertise-client-urls":["https://192.168.94.2:2379"],"listen-client-urls":["https://127.0.0.1:2379","https://192.168.94.2:2379"],"listen-metrics-urls":["http://127.0.0.1:2381"]}
	{"level":"info","ts":"2022-06-30T21:24:35.432Z","caller":"embed/etcd.go:763","msg":"serving metrics","address":"http://127.0.0.1:2381"}
	{"level":"info","ts":"2022-06-30T21:24:35.853Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"dfc97eb0aae75b33 is starting a new election at term 1"}
	{"level":"info","ts":"2022-06-30T21:24:35.854Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"dfc97eb0aae75b33 became pre-candidate at term 1"}
	{"level":"info","ts":"2022-06-30T21:24:35.854Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"dfc97eb0aae75b33 received MsgPreVoteResp from dfc97eb0aae75b33 at term 1"}
	{"level":"info","ts":"2022-06-30T21:24:35.854Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"dfc97eb0aae75b33 became candidate at term 2"}
	{"level":"info","ts":"2022-06-30T21:24:35.854Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"dfc97eb0aae75b33 received MsgVoteResp from dfc97eb0aae75b33 at term 2"}
	{"level":"info","ts":"2022-06-30T21:24:35.854Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"dfc97eb0aae75b33 became leader at term 2"}
	{"level":"info","ts":"2022-06-30T21:24:35.854Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: dfc97eb0aae75b33 elected leader dfc97eb0aae75b33 at term 2"}
	{"level":"info","ts":"2022-06-30T21:24:35.854Z","caller":"etcdserver/server.go:2507","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}
	{"level":"info","ts":"2022-06-30T21:24:35.855Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"da400bbece288f5a","local-member-id":"dfc97eb0aae75b33","cluster-version":"3.5"}
	{"level":"info","ts":"2022-06-30T21:24:35.855Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
	{"level":"info","ts":"2022-06-30T21:24:35.855Z","caller":"etcdserver/server.go:2531","msg":"cluster version is updated","cluster-version":"3.5"}
	{"level":"info","ts":"2022-06-30T21:24:35.855Z","caller":"etcdserver/server.go:2042","msg":"published local member to cluster through raft","local-member-id":"dfc97eb0aae75b33","local-member-attributes":"{Name:embed-certs-20220630210659-9950 ClientURLs:[https://192.168.94.2:2379]}","request-path":"/0/members/dfc97eb0aae75b33/attributes","cluster-id":"da400bbece288f5a","publish-timeout":"7s"}
	{"level":"info","ts":"2022-06-30T21:24:35.855Z","caller":"embed/serve.go:98","msg":"ready to serve client requests"}
	{"level":"info","ts":"2022-06-30T21:24:35.855Z","caller":"embed/serve.go:98","msg":"ready to serve client requests"}
	{"level":"info","ts":"2022-06-30T21:24:35.855Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
	{"level":"info","ts":"2022-06-30T21:24:35.855Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
	{"level":"info","ts":"2022-06-30T21:24:35.857Z","caller":"embed/serve.go:188","msg":"serving client traffic securely","address":"127.0.0.1:2379"}
	{"level":"info","ts":"2022-06-30T21:24:35.857Z","caller":"embed/serve.go:188","msg":"serving client traffic securely","address":"192.168.94.2:2379"}
	{"level":"info","ts":"2022-06-30T21:34:36.178Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":542}
	{"level":"info","ts":"2022-06-30T21:34:36.179Z","caller":"mvcc/kvstore_compaction.go:57","msg":"finished scheduled compaction","compact-revision":542,"took":"502.306µs"}
	
	* 
	* ==> kernel <==
	*  21:37:58 up  1:20,  0 users,  load average: 0.35, 0.26, 0.58
	Linux embed-certs-20220630210659-9950 5.15.0-1012-gcp #17~20.04.1-Ubuntu SMP Thu Jun 23 16:10:34 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
	PRETTY_NAME="Ubuntu 20.04.4 LTS"
	
	* 
	* ==> kube-apiserver [a37e0a712134dba6b38cc4dcb6d1f5d6148318183800ad5f951ca37f88666208] <==
	* W0630 21:32:39.673670       1 handler_proxy.go:102] no RequestInfo found in the context
	E0630 21:32:39.673740       1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
	, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
	I0630 21:32:39.673758       1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
	W0630 21:34:39.677295       1 handler_proxy.go:102] no RequestInfo found in the context
	W0630 21:34:39.677295       1 handler_proxy.go:102] no RequestInfo found in the context
	E0630 21:34:39.677360       1 controller.go:113] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: Error, could not get list of group versions for APIService
	I0630 21:34:39.677373       1 controller.go:126] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
	E0630 21:34:39.677381       1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
	, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
	I0630 21:34:39.678519       1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
	W0630 21:35:39.678292       1 handler_proxy.go:102] no RequestInfo found in the context
	E0630 21:35:39.678334       1 controller.go:113] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: Error, could not get list of group versions for APIService
	I0630 21:35:39.678342       1 controller.go:126] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
	W0630 21:35:39.679446       1 handler_proxy.go:102] no RequestInfo found in the context
	E0630 21:35:39.679505       1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
	, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
	I0630 21:35:39.679527       1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
	W0630 21:37:39.679277       1 handler_proxy.go:102] no RequestInfo found in the context
	E0630 21:37:39.679330       1 controller.go:113] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: Error, could not get list of group versions for APIService
	I0630 21:37:39.679339       1 controller.go:126] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
	W0630 21:37:39.680333       1 handler_proxy.go:102] no RequestInfo found in the context
	E0630 21:37:39.680399       1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
	, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
	I0630 21:37:39.680416       1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
	
	* 
	* ==> kube-controller-manager [a254fdd241c2240c0286acf2197722ad7a3a4cf36dd663e20d37c69ef814f7c4] <==
	* W0630 21:31:54.541270       1 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0630 21:32:24.104751       1 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	W0630 21:32:24.556770       1 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0630 21:32:54.115372       1 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	W0630 21:32:54.571392       1 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0630 21:33:24.125704       1 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	W0630 21:33:24.585631       1 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0630 21:33:54.135892       1 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	W0630 21:33:54.600932       1 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0630 21:34:24.145079       1 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	W0630 21:34:24.615267       1 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0630 21:34:54.155151       1 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	W0630 21:34:54.629319       1 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0630 21:35:24.165917       1 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	W0630 21:35:24.644829       1 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0630 21:35:54.191475       1 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	W0630 21:35:54.658807       1 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0630 21:36:24.211497       1 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	W0630 21:36:24.674576       1 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0630 21:36:54.221502       1 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	W0630 21:36:54.689382       1 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0630 21:37:24.245820       1 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	W0630 21:37:24.704703       1 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0630 21:37:54.254811       1 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	W0630 21:37:54.719129       1 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	
	* 
	* ==> kube-proxy [833b51196bf62aa4ed19c53acaf7f95c975063aa5bc7935e710ce263a3a20450] <==
	* I0630 21:24:56.145662       1 node.go:163] Successfully retrieved node IP: 192.168.94.2
	I0630 21:24:56.145735       1 server_others.go:138] "Detected node IP" address="192.168.94.2"
	I0630 21:24:56.145823       1 server_others.go:578] "Unknown proxy mode, assuming iptables proxy" proxyMode=""
	I0630 21:24:56.325338       1 server_others.go:206] "Using iptables Proxier"
	I0630 21:24:56.325381       1 server_others.go:213] "kube-proxy running in dual-stack mode" ipFamily=IPv4
	I0630 21:24:56.325390       1 server_others.go:214] "Creating dualStackProxier for iptables"
	I0630 21:24:56.325407       1 server_others.go:501] "Detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, , defaulting to no-op detect-local for IPv6"
	I0630 21:24:56.325438       1 proxier.go:259] "Setting route_localnet=1, use nodePortAddresses to filter loopback addresses for NodePorts to skip it https://issues.k8s.io/90259"
	I0630 21:24:56.325595       1 proxier.go:259] "Setting route_localnet=1, use nodePortAddresses to filter loopback addresses for NodePorts to skip it https://issues.k8s.io/90259"
	I0630 21:24:56.325909       1 server.go:661] "Version info" version="v1.24.2"
	I0630 21:24:56.325929       1 server.go:663] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
	I0630 21:24:56.326455       1 config.go:317] "Starting service config controller"
	I0630 21:24:56.326482       1 config.go:226] "Starting endpoint slice config controller"
	I0630 21:24:56.326498       1 shared_informer.go:255] Waiting for caches to sync for service config
	I0630 21:24:56.326499       1 shared_informer.go:255] Waiting for caches to sync for endpoint slice config
	I0630 21:24:56.326820       1 config.go:444] "Starting node config controller"
	I0630 21:24:56.326890       1 shared_informer.go:255] Waiting for caches to sync for node config
	I0630 21:24:56.427061       1 shared_informer.go:262] Caches are synced for node config
	I0630 21:24:56.427076       1 shared_informer.go:262] Caches are synced for service config
	I0630 21:24:56.427142       1 shared_informer.go:262] Caches are synced for endpoint slice config
	
	* 
	* ==> kube-scheduler [9cb12a28b2ecb262dbd3bee9a62bbfee084db1d07c795697fc796e09724dafef] <==
	* W0630 21:24:38.738670       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0630 21:24:38.738699       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	W0630 21:24:38.738962       1 reflector.go:324] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	E0630 21:24:38.738987       1 reflector.go:138] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	W0630 21:24:38.739254       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	W0630 21:24:38.739278       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
	E0630 21:24:38.739297       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
	E0630 21:24:38.739283       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	W0630 21:24:38.739328       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	E0630 21:24:38.739338       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	W0630 21:24:38.739652       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E0630 21:24:38.739686       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	W0630 21:24:38.740039       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	E0630 21:24:38.740072       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	W0630 21:24:39.641302       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E0630 21:24:39.641341       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	W0630 21:24:39.673518       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
	E0630 21:24:39.673560       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
	W0630 21:24:39.759368       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
	E0630 21:24:39.759417       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
	W0630 21:24:39.769596       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E0630 21:24:39.769636       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	W0630 21:24:39.785898       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	E0630 21:24:39.785939       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	I0630 21:24:40.234799       1 shared_informer.go:262] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	
	* 
	* ==> kubelet <==
	* -- Logs begin at Thu 2022-06-30 21:20:04 UTC, end at Thu 2022-06-30 21:37:58 UTC. --
	Jun 30 21:36:24 embed-certs-20220630210659-9950 kubelet[3064]: E0630 21:36:24.326512    3064 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kindnet-cni\" with CrashLoopBackOff: \"back-off 40s restarting failed container=kindnet-cni pod=kindnet-4rws6_kube-system(8af2153a-93ed-458a-ab7f-8fac1d943717)\"" pod="kube-system/kindnet-4rws6" podUID=8af2153a-93ed-458a-ab7f-8fac1d943717
	Jun 30 21:36:27 embed-certs-20220630210659-9950 kubelet[3064]: E0630 21:36:27.243613    3064 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:36:32 embed-certs-20220630210659-9950 kubelet[3064]: E0630 21:36:32.245138    3064 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:36:37 embed-certs-20220630210659-9950 kubelet[3064]: E0630 21:36:37.246239    3064 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:36:38 embed-certs-20220630210659-9950 kubelet[3064]: I0630 21:36:38.839970    3064 scope.go:110] "RemoveContainer" containerID="639a7f1e407aebdd61cc486d13fc8a94ae4ac86d0ac9ee5f7a2ff0c363606023"
	Jun 30 21:36:38 embed-certs-20220630210659-9950 kubelet[3064]: E0630 21:36:38.840294    3064 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kindnet-cni\" with CrashLoopBackOff: \"back-off 40s restarting failed container=kindnet-cni pod=kindnet-4rws6_kube-system(8af2153a-93ed-458a-ab7f-8fac1d943717)\"" pod="kube-system/kindnet-4rws6" podUID=8af2153a-93ed-458a-ab7f-8fac1d943717
	Jun 30 21:36:42 embed-certs-20220630210659-9950 kubelet[3064]: E0630 21:36:42.247550    3064 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:36:47 embed-certs-20220630210659-9950 kubelet[3064]: E0630 21:36:47.248981    3064 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:36:52 embed-certs-20220630210659-9950 kubelet[3064]: E0630 21:36:52.249998    3064 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:36:53 embed-certs-20220630210659-9950 kubelet[3064]: I0630 21:36:53.840022    3064 scope.go:110] "RemoveContainer" containerID="639a7f1e407aebdd61cc486d13fc8a94ae4ac86d0ac9ee5f7a2ff0c363606023"
	Jun 30 21:36:53 embed-certs-20220630210659-9950 kubelet[3064]: E0630 21:36:53.840353    3064 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kindnet-cni\" with CrashLoopBackOff: \"back-off 40s restarting failed container=kindnet-cni pod=kindnet-4rws6_kube-system(8af2153a-93ed-458a-ab7f-8fac1d943717)\"" pod="kube-system/kindnet-4rws6" podUID=8af2153a-93ed-458a-ab7f-8fac1d943717
	Jun 30 21:36:57 embed-certs-20220630210659-9950 kubelet[3064]: E0630 21:36:57.251598    3064 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:37:02 embed-certs-20220630210659-9950 kubelet[3064]: E0630 21:37:02.253186    3064 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:37:07 embed-certs-20220630210659-9950 kubelet[3064]: E0630 21:37:07.254215    3064 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:37:07 embed-certs-20220630210659-9950 kubelet[3064]: I0630 21:37:07.839993    3064 scope.go:110] "RemoveContainer" containerID="639a7f1e407aebdd61cc486d13fc8a94ae4ac86d0ac9ee5f7a2ff0c363606023"
	Jun 30 21:37:12 embed-certs-20220630210659-9950 kubelet[3064]: E0630 21:37:12.255129    3064 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:37:17 embed-certs-20220630210659-9950 kubelet[3064]: E0630 21:37:17.255912    3064 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:37:22 embed-certs-20220630210659-9950 kubelet[3064]: E0630 21:37:22.257478    3064 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:37:27 embed-certs-20220630210659-9950 kubelet[3064]: E0630 21:37:27.259351    3064 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:37:32 embed-certs-20220630210659-9950 kubelet[3064]: E0630 21:37:32.260974    3064 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:37:37 embed-certs-20220630210659-9950 kubelet[3064]: E0630 21:37:37.262665    3064 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:37:42 embed-certs-20220630210659-9950 kubelet[3064]: E0630 21:37:42.264123    3064 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:37:47 embed-certs-20220630210659-9950 kubelet[3064]: E0630 21:37:47.265583    3064 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:37:52 embed-certs-20220630210659-9950 kubelet[3064]: E0630 21:37:52.267147    3064 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Jun 30 21:37:57 embed-certs-20220630210659-9950 kubelet[3064]: E0630 21:37:57.268737    3064 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	

                                                
                                                
-- /stdout --
helpers_test.go:254: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p embed-certs-20220630210659-9950 -n embed-certs-20220630210659-9950
helpers_test.go:261: (dbg) Run:  kubectl --context embed-certs-20220630210659-9950 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:270: non-running pods: coredns-6d4b75cb6d-pb4bz metrics-server-5c6f97fb75-fgsb4 storage-provisioner dashboard-metrics-scraper-dffd48c4c-pplc5 kubernetes-dashboard-5fd5574d9f-gfm2q
helpers_test.go:272: ======> post-mortem[TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop]: describe non-running pods <======
helpers_test.go:275: (dbg) Run:  kubectl --context embed-certs-20220630210659-9950 describe pod coredns-6d4b75cb6d-pb4bz metrics-server-5c6f97fb75-fgsb4 storage-provisioner dashboard-metrics-scraper-dffd48c4c-pplc5 kubernetes-dashboard-5fd5574d9f-gfm2q
helpers_test.go:275: (dbg) Non-zero exit: kubectl --context embed-certs-20220630210659-9950 describe pod coredns-6d4b75cb6d-pb4bz metrics-server-5c6f97fb75-fgsb4 storage-provisioner dashboard-metrics-scraper-dffd48c4c-pplc5 kubernetes-dashboard-5fd5574d9f-gfm2q: exit status 1 (57.354624ms)

                                                
                                                
** stderr ** 
	Error from server (NotFound): pods "coredns-6d4b75cb6d-pb4bz" not found
	Error from server (NotFound): pods "metrics-server-5c6f97fb75-fgsb4" not found
	Error from server (NotFound): pods "storage-provisioner" not found
	Error from server (NotFound): pods "dashboard-metrics-scraper-dffd48c4c-pplc5" not found
	Error from server (NotFound): pods "kubernetes-dashboard-5fd5574d9f-gfm2q" not found

                                                
                                                
** /stderr **
helpers_test.go:277: kubectl --context embed-certs-20220630210659-9950 describe pod coredns-6d4b75cb6d-pb4bz metrics-server-5c6f97fb75-fgsb4 storage-provisioner dashboard-metrics-scraper-dffd48c4c-pplc5 kubernetes-dashboard-5fd5574d9f-gfm2q: exit status 1
--- FAIL: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (542.42s)

                                                
                                    

Test pass (227/266)

Order passed test Duration
3 TestDownloadOnly/v1.16.0/json-events 14.6
4 TestDownloadOnly/v1.16.0/preload-exists 0
8 TestDownloadOnly/v1.16.0/LogsDuration 0.08
10 TestDownloadOnly/v1.24.2/json-events 4.77
11 TestDownloadOnly/v1.24.2/preload-exists 0
15 TestDownloadOnly/v1.24.2/LogsDuration 0.08
16 TestDownloadOnly/DeleteAll 0.36
17 TestDownloadOnly/DeleteAlwaysSucceeds 0.22
18 TestDownloadOnlyKic 4.37
19 TestBinaryMirror 0.92
20 TestOffline 72.32
22 TestAddons/Setup 152.77
24 TestAddons/parallel/Registry 19.96
25 TestAddons/parallel/Ingress 23.74
26 TestAddons/parallel/MetricsServer 5.6
27 TestAddons/parallel/HelmTiller 11.54
29 TestAddons/parallel/CSI 45.66
30 TestAddons/parallel/Headlamp 10.94
32 TestAddons/serial/GCPAuth 40.97
33 TestAddons/StoppedEnableDisable 20.38
34 TestCertOptions 38.25
35 TestCertExpiration 236.22
37 TestForceSystemdFlag 49.71
38 TestForceSystemdEnv 40.9
39 TestKVMDriverInstallOrUpdate 6.67
43 TestErrorSpam/setup 24.1
44 TestErrorSpam/start 1.02
45 TestErrorSpam/status 1.21
46 TestErrorSpam/pause 1.63
47 TestErrorSpam/unpause 1.66
48 TestErrorSpam/stop 20.43
51 TestFunctional/serial/CopySyncFile 0
52 TestFunctional/serial/StartWithProxy 45.28
53 TestFunctional/serial/AuditLog 0
54 TestFunctional/serial/SoftStart 15.6
55 TestFunctional/serial/KubeContext 0.04
56 TestFunctional/serial/KubectlGetPods 0.18
59 TestFunctional/serial/CacheCmd/cache/add_remote 4.47
60 TestFunctional/serial/CacheCmd/cache/add_local 2.18
61 TestFunctional/serial/CacheCmd/cache/delete_k8s.gcr.io/pause:3.3 0.07
62 TestFunctional/serial/CacheCmd/cache/list 0.07
63 TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node 0.38
64 TestFunctional/serial/CacheCmd/cache/cache_reload 2.46
65 TestFunctional/serial/CacheCmd/cache/delete 0.13
66 TestFunctional/serial/MinikubeKubectlCmd 0.12
67 TestFunctional/serial/MinikubeKubectlCmdDirectly 0.11
68 TestFunctional/serial/ExtraConfig 38.11
69 TestFunctional/serial/ComponentHealth 0.06
70 TestFunctional/serial/LogsCmd 1.19
71 TestFunctional/serial/LogsFileCmd 1.19
73 TestFunctional/parallel/ConfigCmd 0.59
74 TestFunctional/parallel/DashboardCmd 13.79
75 TestFunctional/parallel/DryRun 0.72
76 TestFunctional/parallel/InternationalLanguage 0.24
77 TestFunctional/parallel/StatusCmd 1.38
80 TestFunctional/parallel/ServiceCmd 13.72
81 TestFunctional/parallel/ServiceCmdConnect 10.63
82 TestFunctional/parallel/AddonsCmd 0.18
83 TestFunctional/parallel/PersistentVolumeClaim 34.01
85 TestFunctional/parallel/SSHCmd 0.9
86 TestFunctional/parallel/CpCmd 1.9
87 TestFunctional/parallel/MySQL 26.66
88 TestFunctional/parallel/FileSync 0.4
89 TestFunctional/parallel/CertSync 2.34
93 TestFunctional/parallel/NodeLabels 0.07
95 TestFunctional/parallel/NonActiveRuntimeDisabled 0.8
97 TestFunctional/parallel/ProfileCmd/profile_not_create 0.65
99 TestFunctional/parallel/TunnelCmd/serial/StartTunnel 0
101 TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup 10.25
102 TestFunctional/parallel/ProfileCmd/profile_list 0.48
103 TestFunctional/parallel/ProfileCmd/profile_json_output 0.48
104 TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP 0.06
105 TestFunctional/parallel/TunnelCmd/serial/AccessDirect 0
109 TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel 0.11
110 TestFunctional/parallel/UpdateContextCmd/no_changes 0.27
111 TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster 0.24
112 TestFunctional/parallel/UpdateContextCmd/no_clusters 0.24
113 TestFunctional/parallel/Version/short 0.08
114 TestFunctional/parallel/Version/components 0.67
115 TestFunctional/parallel/ImageCommands/ImageListShort 0.27
116 TestFunctional/parallel/ImageCommands/ImageListTable 0.27
117 TestFunctional/parallel/ImageCommands/ImageListJson 0.26
118 TestFunctional/parallel/ImageCommands/ImageListYaml 0.26
119 TestFunctional/parallel/ImageCommands/ImageBuild 3.71
120 TestFunctional/parallel/ImageCommands/Setup 1.44
121 TestFunctional/parallel/ImageCommands/ImageLoadDaemon 6.23
122 TestFunctional/parallel/MountCmd/any-port 18.5
123 TestFunctional/parallel/ImageCommands/ImageReloadDaemon 6.19
124 TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon 7.56
125 TestFunctional/parallel/ImageCommands/ImageSaveToFile 1.36
126 TestFunctional/parallel/MountCmd/specific-port 2.28
127 TestFunctional/parallel/ImageCommands/ImageRemove 0.62
128 TestFunctional/parallel/ImageCommands/ImageLoadFromFile 1.36
129 TestFunctional/parallel/ImageCommands/ImageSaveDaemon 1.77
130 TestFunctional/delete_addon-resizer_images 0.1
131 TestFunctional/delete_my-image_image 0.03
132 TestFunctional/delete_minikube_cached_images 0.03
135 TestIngressAddonLegacy/StartLegacyK8sCluster 68.89
137 TestIngressAddonLegacy/serial/ValidateIngressAddonActivation 14.14
138 TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation 0.39
139 TestIngressAddonLegacy/serial/ValidateIngressAddons 43.69
142 TestJSONOutput/start/Command 45.89
143 TestJSONOutput/start/Audit 0
145 TestJSONOutput/start/parallel/DistinctCurrentSteps 0
146 TestJSONOutput/start/parallel/IncreasingCurrentSteps 0
148 TestJSONOutput/pause/Command 0.73
149 TestJSONOutput/pause/Audit 0
151 TestJSONOutput/pause/parallel/DistinctCurrentSteps 0
152 TestJSONOutput/pause/parallel/IncreasingCurrentSteps 0
154 TestJSONOutput/unpause/Command 0.67
155 TestJSONOutput/unpause/Audit 0
157 TestJSONOutput/unpause/parallel/DistinctCurrentSteps 0
158 TestJSONOutput/unpause/parallel/IncreasingCurrentSteps 0
160 TestJSONOutput/stop/Command 20.22
161 TestJSONOutput/stop/Audit 0
163 TestJSONOutput/stop/parallel/DistinctCurrentSteps 0
164 TestJSONOutput/stop/parallel/IncreasingCurrentSteps 0
165 TestErrorJSONOutput 0.31
167 TestKicCustomNetwork/create_custom_network 36.03
168 TestKicCustomNetwork/use_default_bridge_network 30.48
169 TestKicExistingNetwork 31.05
170 TestKicCustomSubnet 30.76
171 TestMainNoArgs 0.07
172 TestMinikubeProfile 56.94
175 TestMountStart/serial/StartWithMountFirst 5.15
176 TestMountStart/serial/VerifyMountFirst 0.36
177 TestMountStart/serial/StartWithMountSecond 5.11
178 TestMountStart/serial/VerifyMountSecond 0.37
179 TestMountStart/serial/DeleteFirst 1.86
180 TestMountStart/serial/VerifyMountPostDelete 0.37
181 TestMountStart/serial/Stop 1.29
182 TestMountStart/serial/RestartStopped 6.84
183 TestMountStart/serial/VerifyMountPostStop 0.38
186 TestMultiNode/serial/FreshStart2Nodes 82.79
187 TestMultiNode/serial/DeployApp2Nodes 4.17
188 TestMultiNode/serial/PingHostFrom2Pods 0.91
189 TestMultiNode/serial/AddNode 31.82
190 TestMultiNode/serial/ProfileList 0.4
191 TestMultiNode/serial/CopyFile 13
192 TestMultiNode/serial/StopNode 2.52
193 TestMultiNode/serial/StartAfterStop 31.21
194 TestMultiNode/serial/RestartKeepsNodes 172.26
195 TestMultiNode/serial/DeleteNode 5.21
196 TestMultiNode/serial/StopMultiNode 40.4
197 TestMultiNode/serial/RestartMultiNode 99.23
198 TestMultiNode/serial/ValidateNameConflict 38.34
203 TestPreload 117.1
205 TestScheduledStopUnix 101.59
208 TestInsufficientStorage 16.91
209 TestRunningBinaryUpgrade 81.54
212 TestMissingContainerUpgrade 160.59
214 TestNoKubernetes/serial/StartNoK8sWithVersion 0.11
218 TestNoKubernetes/serial/StartWithK8s 36.51
223 TestNetworkPlugins/group/false 0.6
227 TestNoKubernetes/serial/StartWithStopK8s 17.2
228 TestNoKubernetes/serial/Start 4.75
229 TestNoKubernetes/serial/VerifyK8sNotRunning 0.41
230 TestNoKubernetes/serial/ProfileList 2.23
231 TestNoKubernetes/serial/Stop 3.7
232 TestNoKubernetes/serial/StartNoArgs 6.16
233 TestNoKubernetes/serial/VerifyK8sNotRunningSecond 0.47
234 TestStoppedBinaryUpgrade/Setup 0.45
235 TestStoppedBinaryUpgrade/Upgrade 137.21
236 TestStoppedBinaryUpgrade/MinikubeLogs 1.07
245 TestPause/serial/Start 59.88
246 TestNetworkPlugins/group/auto/Start 60.28
247 TestPause/serial/SecondStartNoReconfiguration 16.09
248 TestNetworkPlugins/group/kindnet/Start 47.46
249 TestPause/serial/Pause 0.88
250 TestPause/serial/VerifyStatus 0.47
251 TestPause/serial/Unpause 0.81
252 TestPause/serial/PauseAgain 1.08
253 TestPause/serial/DeletePaused 3.03
254 TestPause/serial/VerifyDeletedResources 2.5
255 TestNetworkPlugins/group/cilium/Start 68.48
256 TestNetworkPlugins/group/auto/KubeletFlags 0.47
257 TestNetworkPlugins/group/auto/NetCatPod 9.37
258 TestNetworkPlugins/group/kindnet/ControllerPod 5.02
259 TestNetworkPlugins/group/kindnet/KubeletFlags 0.39
260 TestNetworkPlugins/group/auto/DNS 0.16
261 TestNetworkPlugins/group/kindnet/NetCatPod 10.37
262 TestNetworkPlugins/group/auto/Localhost 0.14
263 TestNetworkPlugins/group/auto/HairPin 0.12
265 TestNetworkPlugins/group/kindnet/DNS 0.19
266 TestNetworkPlugins/group/kindnet/Localhost 0.16
267 TestNetworkPlugins/group/kindnet/HairPin 0.18
268 TestNetworkPlugins/group/enable-default-cni/Start 299.35
269 TestNetworkPlugins/group/cilium/ControllerPod 5.02
270 TestNetworkPlugins/group/cilium/KubeletFlags 0.45
271 TestNetworkPlugins/group/cilium/NetCatPod 11.13
272 TestNetworkPlugins/group/cilium/DNS 0.16
273 TestNetworkPlugins/group/cilium/Localhost 0.12
274 TestNetworkPlugins/group/cilium/HairPin 0.13
275 TestNetworkPlugins/group/bridge/Start 40.39
276 TestNetworkPlugins/group/bridge/KubeletFlags 0.4
277 TestNetworkPlugins/group/bridge/NetCatPod 8.22
279 TestNetworkPlugins/group/enable-default-cni/KubeletFlags 0.47
280 TestNetworkPlugins/group/enable-default-cni/NetCatPod 10.24
285 TestStartStop/group/no-preload/serial/FirstStart 52.62
286 TestStartStop/group/no-preload/serial/DeployApp 8.33
289 TestStartStop/group/no-preload/serial/EnableAddonWhileActive 1.07
290 TestStartStop/group/no-preload/serial/Stop 20.58
291 TestStartStop/group/no-preload/serial/EnableAddonAfterStop 0.24
292 TestStartStop/group/no-preload/serial/SecondStart 312.97
295 TestStartStop/group/newest-cni/serial/FirstStart 47.21
296 TestStartStop/group/newest-cni/serial/DeployApp 0
297 TestStartStop/group/newest-cni/serial/EnableAddonWhileActive 0.65
298 TestStartStop/group/newest-cni/serial/Stop 20.26
299 TestStartStop/group/newest-cni/serial/EnableAddonAfterStop 0.23
300 TestStartStop/group/newest-cni/serial/SecondStart 30.73
301 TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop 0
302 TestStartStop/group/newest-cni/serial/AddonExistsAfterStop 0
303 TestStartStop/group/newest-cni/serial/VerifyKubernetesImages 0.42
304 TestStartStop/group/newest-cni/serial/Pause 3.08
308 TestStartStop/group/no-preload/serial/UserAppExistsAfterStop 10.01
309 TestStartStop/group/no-preload/serial/AddonExistsAfterStop 5.07
310 TestStartStop/group/no-preload/serial/VerifyKubernetesImages 0.43
311 TestStartStop/group/no-preload/serial/Pause 3.33
313 TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive 0.61
314 TestStartStop/group/old-k8s-version/serial/Stop 1.32
315 TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop 0.23
317 TestStartStop/group/default-k8s-different-port/serial/EnableAddonWhileActive 0.64
318 TestStartStop/group/default-k8s-different-port/serial/Stop 20.2
319 TestStartStop/group/default-k8s-different-port/serial/EnableAddonAfterStop 0.24
321 TestStartStop/group/embed-certs/serial/EnableAddonWhileActive 0.64
322 TestStartStop/group/embed-certs/serial/Stop 20.22
323 TestStartStop/group/embed-certs/serial/EnableAddonAfterStop 0.23
x
+
TestDownloadOnly/v1.16.0/json-events (14.6s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/json-events
aaa_download_only_test.go:71: (dbg) Run:  out/minikube-linux-amd64 start -o=json --download-only -p download-only-20220630202051-9950 --force --alsologtostderr --kubernetes-version=v1.16.0 --container-runtime=containerd --driver=docker  --container-runtime=containerd
aaa_download_only_test.go:71: (dbg) Done: out/minikube-linux-amd64 start -o=json --download-only -p download-only-20220630202051-9950 --force --alsologtostderr --kubernetes-version=v1.16.0 --container-runtime=containerd --driver=docker  --container-runtime=containerd: (14.598446937s)
--- PASS: TestDownloadOnly/v1.16.0/json-events (14.60s)

                                                
                                    
x
+
TestDownloadOnly/v1.16.0/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/preload-exists
--- PASS: TestDownloadOnly/v1.16.0/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.16.0/LogsDuration (0.08s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/LogsDuration
aaa_download_only_test.go:173: (dbg) Run:  out/minikube-linux-amd64 logs -p download-only-20220630202051-9950
aaa_download_only_test.go:173: (dbg) Non-zero exit: out/minikube-linux-amd64 logs -p download-only-20220630202051-9950: exit status 85 (84.135385ms)

                                                
                                                
-- stdout --
	* 
	* ==> Audit <==
	* |---------|-----------------------------------|----------|---------|---------|---------------------|----------|
	| Command |               Args                | Profile  |  User   | Version |     Start Time      | End Time |
	|---------|-----------------------------------|----------|---------|---------|---------------------|----------|
	| start   | -o=json --download-only -p        | minikube | jenkins | v1.26.0 | 30 Jun 22 20:20 UTC |          |
	|         | download-only-20220630202051-9950 |          |         |         |                     |          |
	|         | --force --alsologtostderr         |          |         |         |                     |          |
	|         | --kubernetes-version=v1.16.0      |          |         |         |                     |          |
	|         | --container-runtime=containerd    |          |         |         |                     |          |
	|         | --driver=docker                   |          |         |         |                     |          |
	|         | --container-runtime=containerd    |          |         |         |                     |          |
	|---------|-----------------------------------|----------|---------|---------|---------------------|----------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2022/06/30 20:20:51
	Running on machine: ubuntu-20-agent-8
	Binary: Built with gc go1.18.3 for linux/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0630 20:20:51.873072    9962 out.go:296] Setting OutFile to fd 1 ...
	I0630 20:20:51.873200    9962 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 20:20:51.873208    9962 out.go:309] Setting ErrFile to fd 2...
	I0630 20:20:51.873215    9962 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 20:20:51.873664    9962 root.go:329] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/bin
	W0630 20:20:51.873812    9962 root.go:307] Error reading config file at /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/config/config.json: open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/config/config.json: no such file or directory
	I0630 20:20:51.874098    9962 out.go:303] Setting JSON to true
	I0630 20:20:51.874892    9962 start.go:115] hostinfo: {"hostname":"ubuntu-20-agent-8","uptime":204,"bootTime":1656620248,"procs":178,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1012-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0630 20:20:51.874955    9962 start.go:125] virtualization: kvm guest
	I0630 20:20:51.877958    9962 out.go:97] [download-only-20220630202051-9950] minikube v1.26.0 on Ubuntu 20.04 (kvm/amd64)
	W0630 20:20:51.878079    9962 preload.go:295] Failed to list preload files: open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball: no such file or directory
	I0630 20:20:51.879862    9962 out.go:169] MINIKUBE_LOCATION=14420
	I0630 20:20:51.878148    9962 notify.go:193] Checking for updates...
	I0630 20:20:51.882915    9962 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0630 20:20:51.884487    9962 out.go:169] KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 20:20:51.885988    9962 out.go:169] MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube
	I0630 20:20:51.887401    9962 out.go:169] MINIKUBE_BIN=out/minikube-linux-amd64
	W0630 20:20:51.890006    9962 out.go:272] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I0630 20:20:51.890537    9962 driver.go:360] Setting default libvirt URI to qemu:///system
	I0630 20:20:51.927007    9962 docker.go:137] docker version: linux-20.10.17
	I0630 20:20:51.927105    9962 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0630 20:20:52.679100    9962 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:28 OomKillDisable:true NGoroutines:34 SystemTime:2022-06-30 20:20:51.954214823 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1012-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexServ
erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662451712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-8 Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Client
Info:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
	I0630 20:20:52.679213    9962 docker.go:254] overlay module found
	I0630 20:20:52.681406    9962 out.go:97] Using the docker driver based on user configuration
	I0630 20:20:52.681436    9962 start.go:284] selected driver: docker
	I0630 20:20:52.681442    9962 start.go:808] validating driver "docker" against <nil>
	I0630 20:20:52.681531    9962 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0630 20:20:52.790676    9962 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:28 OomKillDisable:true NGoroutines:34 SystemTime:2022-06-30 20:20:52.711298109 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1012-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexServ
erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662451712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-8 Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Client
Info:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
	I0630 20:20:52.790796    9962 start_flags.go:296] no existing cluster config was found, will generate one from the flags 
	I0630 20:20:52.791255    9962 start_flags.go:377] Using suggested 8000MB memory alloc based on sys=32103MB, container=32103MB
	I0630 20:20:52.791364    9962 start_flags.go:835] Wait components to verify : map[apiserver:true system_pods:true]
	I0630 20:20:52.793911    9962 out.go:169] Using Docker driver with root privileges
	I0630 20:20:52.795411    9962 cni.go:95] Creating CNI manager for ""
	I0630 20:20:52.795431    9962 cni.go:162] "docker" driver + containerd runtime found, recommending kindnet
	I0630 20:20:52.795446    9962 cni.go:225] auto-setting extra-config to "kubelet.cni-conf-dir=/etc/cni/net.mk"
	I0630 20:20:52.795451    9962 cni.go:230] extra-config set to "kubelet.cni-conf-dir=/etc/cni/net.mk"
	I0630 20:20:52.795457    9962 start_flags.go:305] Found "CNI" CNI - setting NetworkPlugin=cni
	I0630 20:20:52.795480    9962 start_flags.go:310] config:
	{Name:download-only-20220630202051-9950 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:8000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:download-only-20220630202051-9950 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain
:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 20:20:52.797041    9962 out.go:97] Starting control plane node download-only-20220630202051-9950 in cluster download-only-20220630202051-9950
	I0630 20:20:52.797089    9962 cache.go:120] Beginning downloading kic base image for docker with containerd
	I0630 20:20:52.798550    9962 out.go:97] Pulling base image ...
	I0630 20:20:52.798578    9962 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime containerd
	I0630 20:20:52.798692    9962 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e in local docker daemon
	I0630 20:20:52.830517    9962 cache.go:147] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e to local cache
	I0630 20:20:52.830798    9962 image.go:59] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e in local cache directory
	I0630 20:20:52.830922    9962 image.go:119] Writing gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e to local cache
	I0630 20:20:52.903863    9962 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.16.0/preloaded-images-k8s-v18-v1.16.0-containerd-overlay2-amd64.tar.lz4
	I0630 20:20:52.903895    9962 cache.go:57] Caching tarball of preloaded images
	I0630 20:20:52.904108    9962 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime containerd
	I0630 20:20:52.906462    9962 out.go:97] Downloading Kubernetes v1.16.0 preload ...
	I0630 20:20:52.906484    9962 preload.go:238] getting checksum for preloaded-images-k8s-v18-v1.16.0-containerd-overlay2-amd64.tar.lz4 ...
	I0630 20:20:53.014684    9962 download.go:101] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.16.0/preloaded-images-k8s-v18-v1.16.0-containerd-overlay2-amd64.tar.lz4?checksum=md5:d96a2b2afa188e17db7ddabb58d563fd -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-containerd-overlay2-amd64.tar.lz4
	I0630 20:20:55.767338    9962 preload.go:249] saving checksum for preloaded-images-k8s-v18-v1.16.0-containerd-overlay2-amd64.tar.lz4 ...
	I0630 20:20:55.767425    9962 preload.go:256] verifying checksumm of /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-containerd-overlay2-amd64.tar.lz4 ...
	I0630 20:20:56.690821    9962 cache.go:60] Finished verifying existence of preloaded tar for  v1.16.0 on containerd
	I0630 20:20:56.691179    9962 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/download-only-20220630202051-9950/config.json ...
	I0630 20:20:56.691232    9962 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/download-only-20220630202051-9950/config.json: {Name:mkaa0e6da1abd2c6dfccc9908ff34221597a173a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0630 20:20:56.691478    9962 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime containerd
	I0630 20:20:56.691769    9962 download.go:101] Downloading: https://storage.googleapis.com/kubernetes-release/release/v1.16.0/bin/linux/amd64/kubectl?checksum=file:https://storage.googleapis.com/kubernetes-release/release/v1.16.0/bin/linux/amd64/kubectl.sha1 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/cache/linux/amd64/v1.16.0/kubectl
	
	* 
	* The control plane node "" does not exist.
	  To start a cluster, run: "minikube start -p download-only-20220630202051-9950"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:174: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.16.0/LogsDuration (0.08s)

                                                
                                    
x
+
TestDownloadOnly/v1.24.2/json-events (4.77s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.24.2/json-events
aaa_download_only_test.go:71: (dbg) Run:  out/minikube-linux-amd64 start -o=json --download-only -p download-only-20220630202051-9950 --force --alsologtostderr --kubernetes-version=v1.24.2 --container-runtime=containerd --driver=docker  --container-runtime=containerd
aaa_download_only_test.go:71: (dbg) Done: out/minikube-linux-amd64 start -o=json --download-only -p download-only-20220630202051-9950 --force --alsologtostderr --kubernetes-version=v1.24.2 --container-runtime=containerd --driver=docker  --container-runtime=containerd: (4.771293022s)
--- PASS: TestDownloadOnly/v1.24.2/json-events (4.77s)

                                                
                                    
x
+
TestDownloadOnly/v1.24.2/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.24.2/preload-exists
--- PASS: TestDownloadOnly/v1.24.2/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.24.2/LogsDuration (0.08s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.24.2/LogsDuration
aaa_download_only_test.go:173: (dbg) Run:  out/minikube-linux-amd64 logs -p download-only-20220630202051-9950
aaa_download_only_test.go:173: (dbg) Non-zero exit: out/minikube-linux-amd64 logs -p download-only-20220630202051-9950: exit status 85 (77.242417ms)

                                                
                                                
-- stdout --
	* 
	* ==> Audit <==
	* |---------|-----------------------------------|----------|---------|---------|---------------------|----------|
	| Command |               Args                | Profile  |  User   | Version |     Start Time      | End Time |
	|---------|-----------------------------------|----------|---------|---------|---------------------|----------|
	| start   | -o=json --download-only -p        | minikube | jenkins | v1.26.0 | 30 Jun 22 20:20 UTC |          |
	|         | download-only-20220630202051-9950 |          |         |         |                     |          |
	|         | --force --alsologtostderr         |          |         |         |                     |          |
	|         | --kubernetes-version=v1.16.0      |          |         |         |                     |          |
	|         | --container-runtime=containerd    |          |         |         |                     |          |
	|         | --driver=docker                   |          |         |         |                     |          |
	|         | --container-runtime=containerd    |          |         |         |                     |          |
	| start   | -o=json --download-only -p        | minikube | jenkins | v1.26.0 | 30 Jun 22 20:21 UTC |          |
	|         | download-only-20220630202051-9950 |          |         |         |                     |          |
	|         | --force --alsologtostderr         |          |         |         |                     |          |
	|         | --kubernetes-version=v1.24.2      |          |         |         |                     |          |
	|         | --container-runtime=containerd    |          |         |         |                     |          |
	|         | --driver=docker                   |          |         |         |                     |          |
	|         | --container-runtime=containerd    |          |         |         |                     |          |
	|---------|-----------------------------------|----------|---------|---------|---------------------|----------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2022/06/30 20:21:06
	Running on machine: ubuntu-20-agent-8
	Binary: Built with gc go1.18.3 for linux/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0630 20:21:06.564547   10129 out.go:296] Setting OutFile to fd 1 ...
	I0630 20:21:06.564680   10129 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 20:21:06.564690   10129 out.go:309] Setting ErrFile to fd 2...
	I0630 20:21:06.564697   10129 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 20:21:06.565173   10129 root.go:329] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/bin
	W0630 20:21:06.565295   10129 root.go:307] Error reading config file at /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/config/config.json: open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/config/config.json: no such file or directory
	I0630 20:21:06.565406   10129 out.go:303] Setting JSON to true
	I0630 20:21:06.566174   10129 start.go:115] hostinfo: {"hostname":"ubuntu-20-agent-8","uptime":219,"bootTime":1656620248,"procs":174,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1012-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0630 20:21:06.566238   10129 start.go:125] virtualization: kvm guest
	I0630 20:21:06.568584   10129 out.go:97] [download-only-20220630202051-9950] minikube v1.26.0 on Ubuntu 20.04 (kvm/amd64)
	I0630 20:21:06.568732   10129 notify.go:193] Checking for updates...
	I0630 20:21:06.570400   10129 out.go:169] MINIKUBE_LOCATION=14420
	I0630 20:21:06.572060   10129 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0630 20:21:06.573480   10129 out.go:169] KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 20:21:06.574877   10129 out.go:169] MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube
	I0630 20:21:06.576386   10129 out.go:169] MINIKUBE_BIN=out/minikube-linux-amd64
	
	* 
	* The control plane node "" does not exist.
	  To start a cluster, run: "minikube start -p download-only-20220630202051-9950"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:174: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.24.2/LogsDuration (0.08s)

                                                
                                    
x
+
TestDownloadOnly/DeleteAll (0.36s)

                                                
                                                
=== RUN   TestDownloadOnly/DeleteAll
aaa_download_only_test.go:191: (dbg) Run:  out/minikube-linux-amd64 delete --all
--- PASS: TestDownloadOnly/DeleteAll (0.36s)

                                                
                                    
x
+
TestDownloadOnly/DeleteAlwaysSucceeds (0.22s)

                                                
                                                
=== RUN   TestDownloadOnly/DeleteAlwaysSucceeds
aaa_download_only_test.go:203: (dbg) Run:  out/minikube-linux-amd64 delete -p download-only-20220630202051-9950
--- PASS: TestDownloadOnly/DeleteAlwaysSucceeds (0.22s)

                                                
                                    
x
+
TestDownloadOnlyKic (4.37s)

                                                
                                                
=== RUN   TestDownloadOnlyKic
aaa_download_only_test.go:228: (dbg) Run:  out/minikube-linux-amd64 start --download-only -p download-docker-20220630202112-9950 --force --alsologtostderr --driver=docker  --container-runtime=containerd
aaa_download_only_test.go:228: (dbg) Done: out/minikube-linux-amd64 start --download-only -p download-docker-20220630202112-9950 --force --alsologtostderr --driver=docker  --container-runtime=containerd: (3.257303675s)
helpers_test.go:175: Cleaning up "download-docker-20220630202112-9950" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p download-docker-20220630202112-9950
--- PASS: TestDownloadOnlyKic (4.37s)

                                                
                                    
x
+
TestBinaryMirror (0.92s)

                                                
                                                
=== RUN   TestBinaryMirror
aaa_download_only_test.go:310: (dbg) Run:  out/minikube-linux-amd64 start --download-only -p binary-mirror-20220630202116-9950 --alsologtostderr --binary-mirror http://127.0.0.1:43647 --driver=docker  --container-runtime=containerd
helpers_test.go:175: Cleaning up "binary-mirror-20220630202116-9950" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p binary-mirror-20220630202116-9950
--- PASS: TestBinaryMirror (0.92s)

                                                
                                    
x
+
TestOffline (72.32s)

                                                
                                                
=== RUN   TestOffline
=== PAUSE TestOffline

                                                
                                                

                                                
                                                
=== CONT  TestOffline

                                                
                                                
=== CONT  TestOffline
aab_offline_test.go:55: (dbg) Run:  out/minikube-linux-amd64 start -p offline-containerd-20220630204858-9950 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=docker  --container-runtime=containerd

                                                
                                                
=== CONT  TestOffline
aab_offline_test.go:55: (dbg) Done: out/minikube-linux-amd64 start -p offline-containerd-20220630204858-9950 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=docker  --container-runtime=containerd: (1m9.623959378s)
helpers_test.go:175: Cleaning up "offline-containerd-20220630204858-9950" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p offline-containerd-20220630204858-9950

                                                
                                                
=== CONT  TestOffline
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p offline-containerd-20220630204858-9950: (2.693289515s)
--- PASS: TestOffline (72.32s)

                                                
                                    
x
+
TestAddons/Setup (152.77s)

                                                
                                                
=== RUN   TestAddons/Setup
addons_test.go:76: (dbg) Run:  out/minikube-linux-amd64 start -p addons-20220630202117-9950 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --driver=docker  --container-runtime=containerd --addons=ingress --addons=ingress-dns --addons=helm-tiller
addons_test.go:76: (dbg) Done: out/minikube-linux-amd64 start -p addons-20220630202117-9950 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --driver=docker  --container-runtime=containerd --addons=ingress --addons=ingress-dns --addons=helm-tiller: (2m32.766881473s)
--- PASS: TestAddons/Setup (152.77s)

                                                
                                    
x
+
TestAddons/parallel/Registry (19.96s)

                                                
                                                
=== RUN   TestAddons/parallel/Registry
=== PAUSE TestAddons/parallel/Registry

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Registry

                                                
                                                
=== CONT  TestAddons/parallel/Registry
addons_test.go:282: registry stabilized in 10.507383ms

                                                
                                                
=== CONT  TestAddons/parallel/Registry
addons_test.go:284: (dbg) TestAddons/parallel/Registry: waiting 6m0s for pods matching "actual-registry=true" in namespace "kube-system" ...

                                                
                                                
=== CONT  TestAddons/parallel/Registry
helpers_test.go:342: "registry-gj44l" [f37868d6-0ccc-47c7-a2fa-b14538f02d02] Running

                                                
                                                
=== CONT  TestAddons/parallel/Registry
addons_test.go:284: (dbg) TestAddons/parallel/Registry: actual-registry=true healthy within 5.012790677s

                                                
                                                
=== CONT  TestAddons/parallel/Registry
addons_test.go:287: (dbg) TestAddons/parallel/Registry: waiting 10m0s for pods matching "registry-proxy=true" in namespace "kube-system" ...
helpers_test.go:342: "registry-proxy-qt9hr" [7c3dd541-3083-4c3f-9b37-52920fef12ba] Running

                                                
                                                
=== CONT  TestAddons/parallel/Registry
addons_test.go:287: (dbg) TestAddons/parallel/Registry: registry-proxy=true healthy within 5.008793181s
addons_test.go:292: (dbg) Run:  kubectl --context addons-20220630202117-9950 delete po -l run=registry-test --now
addons_test.go:297: (dbg) Run:  kubectl --context addons-20220630202117-9950 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local"

                                                
                                                
=== CONT  TestAddons/parallel/Registry
addons_test.go:297: (dbg) Done: kubectl --context addons-20220630202117-9950 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local": (9.020385406s)
addons_test.go:311: (dbg) Run:  out/minikube-linux-amd64 -p addons-20220630202117-9950 ip
2022/06/30 20:24:09 [DEBUG] GET http://192.168.49.2:5000
addons_test.go:340: (dbg) Run:  out/minikube-linux-amd64 -p addons-20220630202117-9950 addons disable registry --alsologtostderr -v=1
--- PASS: TestAddons/parallel/Registry (19.96s)

                                                
                                    
x
+
TestAddons/parallel/Ingress (23.74s)

                                                
                                                
=== RUN   TestAddons/parallel/Ingress
=== PAUSE TestAddons/parallel/Ingress

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Ingress
addons_test.go:164: (dbg) Run:  kubectl --context addons-20220630202117-9950 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s
addons_test.go:184: (dbg) Run:  kubectl --context addons-20220630202117-9950 replace --force -f testdata/nginx-ingress-v1.yaml

                                                
                                                
=== CONT  TestAddons/parallel/Ingress
addons_test.go:197: (dbg) Run:  kubectl --context addons-20220630202117-9950 replace --force -f testdata/nginx-pod-svc.yaml
addons_test.go:202: (dbg) TestAddons/parallel/Ingress: waiting 8m0s for pods matching "run=nginx" in namespace "default" ...
helpers_test.go:342: "nginx" [fcd94d73-5d41-40bf-a430-4da22cf87e5a] Pending

                                                
                                                
=== CONT  TestAddons/parallel/Ingress
helpers_test.go:342: "nginx" [fcd94d73-5d41-40bf-a430-4da22cf87e5a] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])

                                                
                                                
=== CONT  TestAddons/parallel/Ingress
helpers_test.go:342: "nginx" [fcd94d73-5d41-40bf-a430-4da22cf87e5a] Running

                                                
                                                
=== CONT  TestAddons/parallel/Ingress
addons_test.go:202: (dbg) TestAddons/parallel/Ingress: run=nginx healthy within 14.008741498s
addons_test.go:214: (dbg) Run:  out/minikube-linux-amd64 -p addons-20220630202117-9950 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'"
addons_test.go:238: (dbg) Run:  kubectl --context addons-20220630202117-9950 replace --force -f testdata/ingress-dns-example-v1.yaml
addons_test.go:243: (dbg) Run:  out/minikube-linux-amd64 -p addons-20220630202117-9950 ip
addons_test.go:249: (dbg) Run:  nslookup hello-john.test 192.168.49.2
addons_test.go:258: (dbg) Run:  out/minikube-linux-amd64 -p addons-20220630202117-9950 addons disable ingress-dns --alsologtostderr -v=1
addons_test.go:263: (dbg) Run:  out/minikube-linux-amd64 -p addons-20220630202117-9950 addons disable ingress --alsologtostderr -v=1

                                                
                                                
=== CONT  TestAddons/parallel/Ingress
addons_test.go:263: (dbg) Done: out/minikube-linux-amd64 -p addons-20220630202117-9950 addons disable ingress --alsologtostderr -v=1: (7.551163986s)
--- PASS: TestAddons/parallel/Ingress (23.74s)

                                                
                                    
x
+
TestAddons/parallel/MetricsServer (5.6s)

                                                
                                                
=== RUN   TestAddons/parallel/MetricsServer
=== PAUSE TestAddons/parallel/MetricsServer

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/MetricsServer
addons_test.go:359: metrics-server stabilized in 2.742759ms
addons_test.go:361: (dbg) TestAddons/parallel/MetricsServer: waiting 6m0s for pods matching "k8s-app=metrics-server" in namespace "kube-system" ...
helpers_test.go:342: "metrics-server-8595bd7d4c-bfc7q" [c5b005bd-7278-4ffc-9426-0957d627d7b4] Running

                                                
                                                
=== CONT  TestAddons/parallel/MetricsServer
addons_test.go:361: (dbg) TestAddons/parallel/MetricsServer: k8s-app=metrics-server healthy within 5.078651576s
addons_test.go:367: (dbg) Run:  kubectl --context addons-20220630202117-9950 top pods -n kube-system
addons_test.go:384: (dbg) Run:  out/minikube-linux-amd64 -p addons-20220630202117-9950 addons disable metrics-server --alsologtostderr -v=1
--- PASS: TestAddons/parallel/MetricsServer (5.60s)

                                                
                                    
x
+
TestAddons/parallel/HelmTiller (11.54s)

                                                
                                                
=== RUN   TestAddons/parallel/HelmTiller
=== PAUSE TestAddons/parallel/HelmTiller

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/HelmTiller
addons_test.go:408: tiller-deploy stabilized in 9.274313ms

                                                
                                                
=== CONT  TestAddons/parallel/HelmTiller
addons_test.go:410: (dbg) TestAddons/parallel/HelmTiller: waiting 6m0s for pods matching "app=helm" in namespace "kube-system" ...

                                                
                                                
=== CONT  TestAddons/parallel/HelmTiller
helpers_test.go:342: "tiller-deploy-c7d76457b-ltx4s" [c409699f-8217-4d32-a5cd-0236625984ea] Running

                                                
                                                
=== CONT  TestAddons/parallel/HelmTiller
addons_test.go:410: (dbg) TestAddons/parallel/HelmTiller: app=helm healthy within 5.013127552s
addons_test.go:425: (dbg) Run:  kubectl --context addons-20220630202117-9950 run --rm helm-test --restart=Never --image=alpine/helm:2.16.3 -it --namespace=kube-system -- version

                                                
                                                
=== CONT  TestAddons/parallel/HelmTiller
addons_test.go:425: (dbg) Done: kubectl --context addons-20220630202117-9950 run --rm helm-test --restart=Never --image=alpine/helm:2.16.3 -it --namespace=kube-system -- version: (5.978513573s)
addons_test.go:442: (dbg) Run:  out/minikube-linux-amd64 -p addons-20220630202117-9950 addons disable helm-tiller --alsologtostderr -v=1
--- PASS: TestAddons/parallel/HelmTiller (11.54s)

                                                
                                    
x
+
TestAddons/parallel/CSI (45.66s)

                                                
                                                
=== RUN   TestAddons/parallel/CSI
=== PAUSE TestAddons/parallel/CSI

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/CSI

                                                
                                                
=== CONT  TestAddons/parallel/CSI
addons_test.go:513: csi-hostpath-driver pods stabilized in 12.144642ms
addons_test.go:516: (dbg) Run:  kubectl --context addons-20220630202117-9950 create -f testdata/csi-hostpath-driver/pvc.yaml

                                                
                                                
=== CONT  TestAddons/parallel/CSI
addons_test.go:521: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc" in namespace "default" ...
helpers_test.go:392: (dbg) Run:  kubectl --context addons-20220630202117-9950 get pvc hpvc -o jsonpath={.status.phase} -n default

                                                
                                                
=== CONT  TestAddons/parallel/CSI
helpers_test.go:392: (dbg) Run:  kubectl --context addons-20220630202117-9950 get pvc hpvc -o jsonpath={.status.phase} -n default
addons_test.go:526: (dbg) Run:  kubectl --context addons-20220630202117-9950 create -f testdata/csi-hostpath-driver/pv-pod.yaml
addons_test.go:531: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod" in namespace "default" ...
helpers_test.go:342: "task-pv-pod" [bf6c2991-3d37-4414-afa2-a6a7b1acc2d8] Pending
helpers_test.go:342: "task-pv-pod" [bf6c2991-3d37-4414-afa2-a6a7b1acc2d8] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])

                                                
                                                
=== CONT  TestAddons/parallel/CSI
helpers_test.go:342: "task-pv-pod" [bf6c2991-3d37-4414-afa2-a6a7b1acc2d8] Running

                                                
                                                
=== CONT  TestAddons/parallel/CSI
addons_test.go:531: (dbg) TestAddons/parallel/CSI: app=task-pv-pod healthy within 17.187401125s
addons_test.go:536: (dbg) Run:  kubectl --context addons-20220630202117-9950 create -f testdata/csi-hostpath-driver/snapshot.yaml
addons_test.go:541: (dbg) TestAddons/parallel/CSI: waiting 6m0s for volume snapshot "new-snapshot-demo" in namespace "default" ...
helpers_test.go:417: (dbg) Run:  kubectl --context addons-20220630202117-9950 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
helpers_test.go:417: (dbg) Run:  kubectl --context addons-20220630202117-9950 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
addons_test.go:546: (dbg) Run:  kubectl --context addons-20220630202117-9950 delete pod task-pv-pod
addons_test.go:552: (dbg) Run:  kubectl --context addons-20220630202117-9950 delete pvc hpvc
addons_test.go:558: (dbg) Run:  kubectl --context addons-20220630202117-9950 create -f testdata/csi-hostpath-driver/pvc-restore.yaml
addons_test.go:563: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc-restore" in namespace "default" ...
helpers_test.go:392: (dbg) Run:  kubectl --context addons-20220630202117-9950 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
addons_test.go:568: (dbg) Run:  kubectl --context addons-20220630202117-9950 create -f testdata/csi-hostpath-driver/pv-pod-restore.yaml
addons_test.go:573: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod-restore" in namespace "default" ...
helpers_test.go:342: "task-pv-pod-restore" [98be164b-225d-415d-8d8e-7f8a76f09b3f] Pending
helpers_test.go:342: "task-pv-pod-restore" [98be164b-225d-415d-8d8e-7f8a76f09b3f] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])

                                                
                                                
=== CONT  TestAddons/parallel/CSI
helpers_test.go:342: "task-pv-pod-restore" [98be164b-225d-415d-8d8e-7f8a76f09b3f] Running

                                                
                                                
=== CONT  TestAddons/parallel/CSI
addons_test.go:573: (dbg) TestAddons/parallel/CSI: app=task-pv-pod-restore healthy within 15.006338041s
addons_test.go:578: (dbg) Run:  kubectl --context addons-20220630202117-9950 delete pod task-pv-pod-restore
addons_test.go:582: (dbg) Run:  kubectl --context addons-20220630202117-9950 delete pvc hpvc-restore
addons_test.go:586: (dbg) Run:  kubectl --context addons-20220630202117-9950 delete volumesnapshot new-snapshot-demo
addons_test.go:590: (dbg) Run:  out/minikube-linux-amd64 -p addons-20220630202117-9950 addons disable csi-hostpath-driver --alsologtostderr -v=1
addons_test.go:590: (dbg) Done: out/minikube-linux-amd64 -p addons-20220630202117-9950 addons disable csi-hostpath-driver --alsologtostderr -v=1: (6.800838691s)
addons_test.go:594: (dbg) Run:  out/minikube-linux-amd64 -p addons-20220630202117-9950 addons disable volumesnapshots --alsologtostderr -v=1
--- PASS: TestAddons/parallel/CSI (45.66s)

                                                
                                    
x
+
TestAddons/parallel/Headlamp (10.94s)

                                                
                                                
=== RUN   TestAddons/parallel/Headlamp
=== PAUSE TestAddons/parallel/Headlamp

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Headlamp
addons_test.go:737: (dbg) Run:  out/minikube-linux-amd64 addons enable headlamp -p addons-20220630202117-9950 --alsologtostderr -v=1

                                                
                                                
=== CONT  TestAddons/parallel/Headlamp
addons_test.go:742: (dbg) TestAddons/parallel/Headlamp: waiting 8m0s for pods matching "app.kubernetes.io/name=headlamp" in namespace "headlamp" ...
helpers_test.go:342: "headlamp-866f5bd7bc-p6t45" [335effdd-3d0c-44f1-9830-15045d047ea0] Pending

                                                
                                                
=== CONT  TestAddons/parallel/Headlamp
helpers_test.go:342: "headlamp-866f5bd7bc-p6t45" [335effdd-3d0c-44f1-9830-15045d047ea0] Pending / Ready:ContainersNotReady (containers with unready status: [headlamp]) / ContainersReady:ContainersNotReady (containers with unready status: [headlamp])

                                                
                                                
=== CONT  TestAddons/parallel/Headlamp
helpers_test.go:342: "headlamp-866f5bd7bc-p6t45" [335effdd-3d0c-44f1-9830-15045d047ea0] Running

                                                
                                                
=== CONT  TestAddons/parallel/Headlamp
addons_test.go:742: (dbg) TestAddons/parallel/Headlamp: app.kubernetes.io/name=headlamp healthy within 10.046324957s
--- PASS: TestAddons/parallel/Headlamp (10.94s)

                                                
                                    
x
+
TestAddons/serial/GCPAuth (40.97s)

                                                
                                                
=== RUN   TestAddons/serial/GCPAuth
addons_test.go:605: (dbg) Run:  kubectl --context addons-20220630202117-9950 create -f testdata/busybox.yaml
addons_test.go:612: (dbg) Run:  kubectl --context addons-20220630202117-9950 create sa gcp-auth-test
addons_test.go:618: (dbg) TestAddons/serial/GCPAuth: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:342: "busybox" [2feb238d-10ef-4030-b95e-b75a292fecf0] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:342: "busybox" [2feb238d-10ef-4030-b95e-b75a292fecf0] Running
addons_test.go:618: (dbg) TestAddons/serial/GCPAuth: integration-test=busybox healthy within 9.006071552s
addons_test.go:624: (dbg) Run:  kubectl --context addons-20220630202117-9950 exec busybox -- /bin/sh -c "printenv GOOGLE_APPLICATION_CREDENTIALS"
addons_test.go:636: (dbg) Run:  kubectl --context addons-20220630202117-9950 describe sa gcp-auth-test
addons_test.go:674: (dbg) Run:  kubectl --context addons-20220630202117-9950 exec busybox -- /bin/sh -c "printenv GOOGLE_CLOUD_PROJECT"
addons_test.go:687: (dbg) Run:  out/minikube-linux-amd64 -p addons-20220630202117-9950 addons disable gcp-auth --alsologtostderr -v=1
addons_test.go:687: (dbg) Done: out/minikube-linux-amd64 -p addons-20220630202117-9950 addons disable gcp-auth --alsologtostderr -v=1: (5.795961778s)
addons_test.go:703: (dbg) Run:  out/minikube-linux-amd64 -p addons-20220630202117-9950 addons enable gcp-auth
addons_test.go:703: (dbg) Done: out/minikube-linux-amd64 -p addons-20220630202117-9950 addons enable gcp-auth: (2.17944617s)
addons_test.go:709: (dbg) Run:  kubectl --context addons-20220630202117-9950 apply -f testdata/private-image.yaml
addons_test.go:716: (dbg) TestAddons/serial/GCPAuth: waiting 8m0s for pods matching "integration-test=private-image" in namespace "default" ...
helpers_test.go:342: "private-image-7c74db7cd9-29fhk" [db295ad9-c4f9-43fd-96be-8ddb5d3f38dc] Pending / Ready:ContainersNotReady (containers with unready status: [private-image]) / ContainersReady:ContainersNotReady (containers with unready status: [private-image])
helpers_test.go:342: "private-image-7c74db7cd9-29fhk" [db295ad9-c4f9-43fd-96be-8ddb5d3f38dc] Running
addons_test.go:716: (dbg) TestAddons/serial/GCPAuth: integration-test=private-image healthy within 15.006285215s
addons_test.go:722: (dbg) Run:  kubectl --context addons-20220630202117-9950 apply -f testdata/private-image-eu.yaml
addons_test.go:727: (dbg) TestAddons/serial/GCPAuth: waiting 8m0s for pods matching "integration-test=private-image-eu" in namespace "default" ...
helpers_test.go:342: "private-image-eu-545d57c67f-99spf" [de9e104b-5932-4d13-bb46-617ea8bf16ba] Pending / Ready:ContainersNotReady (containers with unready status: [private-image-eu]) / ContainersReady:ContainersNotReady (containers with unready status: [private-image-eu])
helpers_test.go:342: "private-image-eu-545d57c67f-99spf" [de9e104b-5932-4d13-bb46-617ea8bf16ba] Running
addons_test.go:727: (dbg) TestAddons/serial/GCPAuth: integration-test=private-image-eu healthy within 7.006193475s
--- PASS: TestAddons/serial/GCPAuth (40.97s)

                                                
                                    
x
+
TestAddons/StoppedEnableDisable (20.38s)

                                                
                                                
=== RUN   TestAddons/StoppedEnableDisable
addons_test.go:134: (dbg) Run:  out/minikube-linux-amd64 stop -p addons-20220630202117-9950
addons_test.go:134: (dbg) Done: out/minikube-linux-amd64 stop -p addons-20220630202117-9950: (20.175967095s)
addons_test.go:138: (dbg) Run:  out/minikube-linux-amd64 addons enable dashboard -p addons-20220630202117-9950
addons_test.go:142: (dbg) Run:  out/minikube-linux-amd64 addons disable dashboard -p addons-20220630202117-9950
--- PASS: TestAddons/StoppedEnableDisable (20.38s)

                                                
                                    
x
+
TestCertOptions (38.25s)

                                                
                                                
=== RUN   TestCertOptions
=== PAUSE TestCertOptions

                                                
                                                

                                                
                                                
=== CONT  TestCertOptions
cert_options_test.go:49: (dbg) Run:  out/minikube-linux-amd64 start -p cert-options-20220630204954-9950 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=docker  --container-runtime=containerd

                                                
                                                
=== CONT  TestCertOptions
cert_options_test.go:49: (dbg) Done: out/minikube-linux-amd64 start -p cert-options-20220630204954-9950 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=docker  --container-runtime=containerd: (26.802464984s)
cert_options_test.go:60: (dbg) Run:  out/minikube-linux-amd64 -p cert-options-20220630204954-9950 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt"
cert_options_test.go:88: (dbg) Run:  kubectl --context cert-options-20220630204954-9950 config view
cert_options_test.go:100: (dbg) Run:  out/minikube-linux-amd64 ssh -p cert-options-20220630204954-9950 -- "sudo cat /etc/kubernetes/admin.conf"
helpers_test.go:175: Cleaning up "cert-options-20220630204954-9950" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p cert-options-20220630204954-9950
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p cert-options-20220630204954-9950: (10.46008187s)
--- PASS: TestCertOptions (38.25s)

                                                
                                    
x
+
TestCertExpiration (236.22s)

                                                
                                                
=== RUN   TestCertExpiration
=== PAUSE TestCertExpiration

                                                
                                                

                                                
                                                
=== CONT  TestCertExpiration
cert_options_test.go:123: (dbg) Run:  out/minikube-linux-amd64 start -p cert-expiration-20220630204940-9950 --memory=2048 --cert-expiration=3m --driver=docker  --container-runtime=containerd

                                                
                                                
=== CONT  TestCertExpiration
cert_options_test.go:123: (dbg) Done: out/minikube-linux-amd64 start -p cert-expiration-20220630204940-9950 --memory=2048 --cert-expiration=3m --driver=docker  --container-runtime=containerd: (38.061985081s)

                                                
                                                
=== CONT  TestCertExpiration
cert_options_test.go:131: (dbg) Run:  out/minikube-linux-amd64 start -p cert-expiration-20220630204940-9950 --memory=2048 --cert-expiration=8760h --driver=docker  --container-runtime=containerd
E0630 20:53:30.280136    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/functional-20220630202638-9950/client.crt: no such file or directory
cert_options_test.go:131: (dbg) Done: out/minikube-linux-amd64 start -p cert-expiration-20220630204940-9950 --memory=2048 --cert-expiration=8760h --driver=docker  --container-runtime=containerd: (15.402062601s)
helpers_test.go:175: Cleaning up "cert-expiration-20220630204940-9950" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p cert-expiration-20220630204940-9950
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p cert-expiration-20220630204940-9950: (2.750488139s)
--- PASS: TestCertExpiration (236.22s)

                                                
                                    
x
+
TestForceSystemdFlag (49.71s)

                                                
                                                
=== RUN   TestForceSystemdFlag
=== PAUSE TestForceSystemdFlag

                                                
                                                

                                                
                                                
=== CONT  TestForceSystemdFlag
docker_test.go:85: (dbg) Run:  out/minikube-linux-amd64 start -p force-systemd-flag-20220630204904-9950 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=docker  --container-runtime=containerd

                                                
                                                
=== CONT  TestForceSystemdFlag
docker_test.go:85: (dbg) Done: out/minikube-linux-amd64 start -p force-systemd-flag-20220630204904-9950 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=docker  --container-runtime=containerd: (46.595981374s)
docker_test.go:115: (dbg) Run:  out/minikube-linux-amd64 -p force-systemd-flag-20220630204904-9950 ssh "cat /etc/containerd/config.toml"
helpers_test.go:175: Cleaning up "force-systemd-flag-20220630204904-9950" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p force-systemd-flag-20220630204904-9950

                                                
                                                
=== CONT  TestForceSystemdFlag
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p force-systemd-flag-20220630204904-9950: (2.62456568s)
--- PASS: TestForceSystemdFlag (49.71s)

                                                
                                    
x
+
TestForceSystemdEnv (40.9s)

                                                
                                                
=== RUN   TestForceSystemdEnv
=== PAUSE TestForceSystemdEnv

                                                
                                                

                                                
                                                
=== CONT  TestForceSystemdEnv
docker_test.go:149: (dbg) Run:  out/minikube-linux-amd64 start -p force-systemd-env-20220630204859-9950 --memory=2048 --alsologtostderr -v=5 --driver=docker  --container-runtime=containerd

                                                
                                                
=== CONT  TestForceSystemdEnv
docker_test.go:149: (dbg) Done: out/minikube-linux-amd64 start -p force-systemd-env-20220630204859-9950 --memory=2048 --alsologtostderr -v=5 --driver=docker  --container-runtime=containerd: (37.735523001s)
docker_test.go:115: (dbg) Run:  out/minikube-linux-amd64 -p force-systemd-env-20220630204859-9950 ssh "cat /etc/containerd/config.toml"
helpers_test.go:175: Cleaning up "force-systemd-env-20220630204859-9950" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p force-systemd-env-20220630204859-9950
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p force-systemd-env-20220630204859-9950: (2.702300311s)
--- PASS: TestForceSystemdEnv (40.90s)

                                                
                                    
x
+
TestKVMDriverInstallOrUpdate (6.67s)

                                                
                                                
=== RUN   TestKVMDriverInstallOrUpdate
=== PAUSE TestKVMDriverInstallOrUpdate

                                                
                                                

                                                
                                                
=== CONT  TestKVMDriverInstallOrUpdate
--- PASS: TestKVMDriverInstallOrUpdate (6.67s)

                                                
                                    
x
+
TestErrorSpam/setup (24.1s)

                                                
                                                
=== RUN   TestErrorSpam/setup
error_spam_test.go:78: (dbg) Run:  out/minikube-linux-amd64 start -p nospam-20220630202543-9950 -n=1 --memory=2250 --wait=false --log_dir=/tmp/nospam-20220630202543-9950 --driver=docker  --container-runtime=containerd
error_spam_test.go:78: (dbg) Done: out/minikube-linux-amd64 start -p nospam-20220630202543-9950 -n=1 --memory=2250 --wait=false --log_dir=/tmp/nospam-20220630202543-9950 --driver=docker  --container-runtime=containerd: (24.102666614s)
--- PASS: TestErrorSpam/setup (24.10s)

                                                
                                    
x
+
TestErrorSpam/start (1.02s)

                                                
                                                
=== RUN   TestErrorSpam/start
error_spam_test.go:213: Cleaning up 1 logfile(s) ...
error_spam_test.go:156: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20220630202543-9950 --log_dir /tmp/nospam-20220630202543-9950 start --dry-run
error_spam_test.go:156: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20220630202543-9950 --log_dir /tmp/nospam-20220630202543-9950 start --dry-run
error_spam_test.go:179: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20220630202543-9950 --log_dir /tmp/nospam-20220630202543-9950 start --dry-run
--- PASS: TestErrorSpam/start (1.02s)

                                                
                                    
x
+
TestErrorSpam/status (1.21s)

                                                
                                                
=== RUN   TestErrorSpam/status
error_spam_test.go:213: Cleaning up 0 logfile(s) ...
error_spam_test.go:156: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20220630202543-9950 --log_dir /tmp/nospam-20220630202543-9950 status
error_spam_test.go:156: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20220630202543-9950 --log_dir /tmp/nospam-20220630202543-9950 status
error_spam_test.go:179: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20220630202543-9950 --log_dir /tmp/nospam-20220630202543-9950 status
--- PASS: TestErrorSpam/status (1.21s)

                                                
                                    
x
+
TestErrorSpam/pause (1.63s)

                                                
                                                
=== RUN   TestErrorSpam/pause
error_spam_test.go:213: Cleaning up 0 logfile(s) ...
error_spam_test.go:156: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20220630202543-9950 --log_dir /tmp/nospam-20220630202543-9950 pause
error_spam_test.go:156: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20220630202543-9950 --log_dir /tmp/nospam-20220630202543-9950 pause
error_spam_test.go:179: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20220630202543-9950 --log_dir /tmp/nospam-20220630202543-9950 pause
--- PASS: TestErrorSpam/pause (1.63s)

                                                
                                    
x
+
TestErrorSpam/unpause (1.66s)

                                                
                                                
=== RUN   TestErrorSpam/unpause
error_spam_test.go:213: Cleaning up 0 logfile(s) ...
error_spam_test.go:156: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20220630202543-9950 --log_dir /tmp/nospam-20220630202543-9950 unpause
error_spam_test.go:156: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20220630202543-9950 --log_dir /tmp/nospam-20220630202543-9950 unpause
error_spam_test.go:179: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20220630202543-9950 --log_dir /tmp/nospam-20220630202543-9950 unpause
--- PASS: TestErrorSpam/unpause (1.66s)

                                                
                                    
x
+
TestErrorSpam/stop (20.43s)

                                                
                                                
=== RUN   TestErrorSpam/stop
error_spam_test.go:213: Cleaning up 0 logfile(s) ...
error_spam_test.go:156: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20220630202543-9950 --log_dir /tmp/nospam-20220630202543-9950 stop
error_spam_test.go:156: (dbg) Done: out/minikube-linux-amd64 -p nospam-20220630202543-9950 --log_dir /tmp/nospam-20220630202543-9950 stop: (20.149964854s)
error_spam_test.go:156: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20220630202543-9950 --log_dir /tmp/nospam-20220630202543-9950 stop
error_spam_test.go:179: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20220630202543-9950 --log_dir /tmp/nospam-20220630202543-9950 stop
--- PASS: TestErrorSpam/stop (20.43s)

                                                
                                    
x
+
TestFunctional/serial/CopySyncFile (0s)

                                                
                                                
=== RUN   TestFunctional/serial/CopySyncFile
functional_test.go:1781: local sync path: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/files/etc/test/nested/copy/9950/hosts
--- PASS: TestFunctional/serial/CopySyncFile (0.00s)

                                                
                                    
x
+
TestFunctional/serial/StartWithProxy (45.28s)

                                                
                                                
=== RUN   TestFunctional/serial/StartWithProxy
functional_test.go:2160: (dbg) Run:  out/minikube-linux-amd64 start -p functional-20220630202638-9950 --memory=4000 --apiserver-port=8441 --wait=all --driver=docker  --container-runtime=containerd
functional_test.go:2160: (dbg) Done: out/minikube-linux-amd64 start -p functional-20220630202638-9950 --memory=4000 --apiserver-port=8441 --wait=all --driver=docker  --container-runtime=containerd: (45.277322139s)
--- PASS: TestFunctional/serial/StartWithProxy (45.28s)

                                                
                                    
x
+
TestFunctional/serial/AuditLog (0s)

                                                
                                                
=== RUN   TestFunctional/serial/AuditLog
--- PASS: TestFunctional/serial/AuditLog (0.00s)

                                                
                                    
x
+
TestFunctional/serial/SoftStart (15.6s)

                                                
                                                
=== RUN   TestFunctional/serial/SoftStart
functional_test.go:651: (dbg) Run:  out/minikube-linux-amd64 start -p functional-20220630202638-9950 --alsologtostderr -v=8
functional_test.go:651: (dbg) Done: out/minikube-linux-amd64 start -p functional-20220630202638-9950 --alsologtostderr -v=8: (15.603987951s)
functional_test.go:655: soft start took 15.604650451s for "functional-20220630202638-9950" cluster.
--- PASS: TestFunctional/serial/SoftStart (15.60s)

                                                
                                    
x
+
TestFunctional/serial/KubeContext (0.04s)

                                                
                                                
=== RUN   TestFunctional/serial/KubeContext
functional_test.go:673: (dbg) Run:  kubectl config current-context
--- PASS: TestFunctional/serial/KubeContext (0.04s)

                                                
                                    
x
+
TestFunctional/serial/KubectlGetPods (0.18s)

                                                
                                                
=== RUN   TestFunctional/serial/KubectlGetPods
functional_test.go:688: (dbg) Run:  kubectl --context functional-20220630202638-9950 get po -A
--- PASS: TestFunctional/serial/KubectlGetPods (0.18s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/add_remote (4.47s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/add_remote
functional_test.go:1041: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 cache add k8s.gcr.io/pause:3.1
functional_test.go:1041: (dbg) Done: out/minikube-linux-amd64 -p functional-20220630202638-9950 cache add k8s.gcr.io/pause:3.1: (1.595299169s)
functional_test.go:1041: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 cache add k8s.gcr.io/pause:3.3
functional_test.go:1041: (dbg) Done: out/minikube-linux-amd64 -p functional-20220630202638-9950 cache add k8s.gcr.io/pause:3.3: (1.563337686s)
functional_test.go:1041: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 cache add k8s.gcr.io/pause:latest
functional_test.go:1041: (dbg) Done: out/minikube-linux-amd64 -p functional-20220630202638-9950 cache add k8s.gcr.io/pause:latest: (1.309951511s)
--- PASS: TestFunctional/serial/CacheCmd/cache/add_remote (4.47s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/add_local (2.18s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/add_local
functional_test.go:1069: (dbg) Run:  docker build -t minikube-local-cache-test:functional-20220630202638-9950 /tmp/TestFunctionalserialCacheCmdcacheadd_local1121737296/001
functional_test.go:1081: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 cache add minikube-local-cache-test:functional-20220630202638-9950
functional_test.go:1081: (dbg) Done: out/minikube-linux-amd64 -p functional-20220630202638-9950 cache add minikube-local-cache-test:functional-20220630202638-9950: (1.896288268s)
functional_test.go:1086: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 cache delete minikube-local-cache-test:functional-20220630202638-9950
functional_test.go:1075: (dbg) Run:  docker rmi minikube-local-cache-test:functional-20220630202638-9950
--- PASS: TestFunctional/serial/CacheCmd/cache/add_local (2.18s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/delete_k8s.gcr.io/pause:3.3 (0.07s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/delete_k8s.gcr.io/pause:3.3
functional_test.go:1094: (dbg) Run:  out/minikube-linux-amd64 cache delete k8s.gcr.io/pause:3.3
--- PASS: TestFunctional/serial/CacheCmd/cache/delete_k8s.gcr.io/pause:3.3 (0.07s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/list (0.07s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/list
functional_test.go:1102: (dbg) Run:  out/minikube-linux-amd64 cache list
--- PASS: TestFunctional/serial/CacheCmd/cache/list (0.07s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.38s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node
functional_test.go:1116: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 ssh sudo crictl images
--- PASS: TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.38s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/cache_reload (2.46s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/cache_reload
functional_test.go:1139: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 ssh sudo crictl rmi k8s.gcr.io/pause:latest
functional_test.go:1145: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 ssh sudo crictl inspecti k8s.gcr.io/pause:latest
functional_test.go:1145: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-20220630202638-9950 ssh sudo crictl inspecti k8s.gcr.io/pause:latest: exit status 1 (369.93013ms)

                                                
                                                
-- stdout --
	FATA[0000] no such image "k8s.gcr.io/pause:latest" present 

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test.go:1150: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 cache reload
functional_test.go:1150: (dbg) Done: out/minikube-linux-amd64 -p functional-20220630202638-9950 cache reload: (1.313798295s)
functional_test.go:1155: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 ssh sudo crictl inspecti k8s.gcr.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/cache_reload (2.46s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/delete (0.13s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/delete
functional_test.go:1164: (dbg) Run:  out/minikube-linux-amd64 cache delete k8s.gcr.io/pause:3.1
functional_test.go:1164: (dbg) Run:  out/minikube-linux-amd64 cache delete k8s.gcr.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/delete (0.13s)

                                                
                                    
x
+
TestFunctional/serial/MinikubeKubectlCmd (0.12s)

                                                
                                                
=== RUN   TestFunctional/serial/MinikubeKubectlCmd
functional_test.go:708: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 kubectl -- --context functional-20220630202638-9950 get pods
--- PASS: TestFunctional/serial/MinikubeKubectlCmd (0.12s)

                                                
                                    
x
+
TestFunctional/serial/MinikubeKubectlCmdDirectly (0.11s)

                                                
                                                
=== RUN   TestFunctional/serial/MinikubeKubectlCmdDirectly
functional_test.go:733: (dbg) Run:  out/kubectl --context functional-20220630202638-9950 get pods
--- PASS: TestFunctional/serial/MinikubeKubectlCmdDirectly (0.11s)

                                                
                                    
x
+
TestFunctional/serial/ExtraConfig (38.11s)

                                                
                                                
=== RUN   TestFunctional/serial/ExtraConfig
functional_test.go:749: (dbg) Run:  out/minikube-linux-amd64 start -p functional-20220630202638-9950 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all
functional_test.go:749: (dbg) Done: out/minikube-linux-amd64 start -p functional-20220630202638-9950 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all: (38.106369492s)
functional_test.go:753: restart took 38.106481199s for "functional-20220630202638-9950" cluster.
--- PASS: TestFunctional/serial/ExtraConfig (38.11s)

                                                
                                    
x
+
TestFunctional/serial/ComponentHealth (0.06s)

                                                
                                                
=== RUN   TestFunctional/serial/ComponentHealth
functional_test.go:802: (dbg) Run:  kubectl --context functional-20220630202638-9950 get po -l tier=control-plane -n kube-system -o=json
functional_test.go:817: etcd phase: Running
functional_test.go:827: etcd status: Ready
functional_test.go:817: kube-apiserver phase: Running
functional_test.go:827: kube-apiserver status: Ready
functional_test.go:817: kube-controller-manager phase: Running
functional_test.go:827: kube-controller-manager status: Ready
functional_test.go:817: kube-scheduler phase: Running
functional_test.go:827: kube-scheduler status: Ready
--- PASS: TestFunctional/serial/ComponentHealth (0.06s)

                                                
                                    
x
+
TestFunctional/serial/LogsCmd (1.19s)

                                                
                                                
=== RUN   TestFunctional/serial/LogsCmd
functional_test.go:1228: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 logs
functional_test.go:1228: (dbg) Done: out/minikube-linux-amd64 -p functional-20220630202638-9950 logs: (1.192158313s)
--- PASS: TestFunctional/serial/LogsCmd (1.19s)

                                                
                                    
x
+
TestFunctional/serial/LogsFileCmd (1.19s)

                                                
                                                
=== RUN   TestFunctional/serial/LogsFileCmd
functional_test.go:1242: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 logs --file /tmp/TestFunctionalserialLogsFileCmd718860592/001/logs.txt
functional_test.go:1242: (dbg) Done: out/minikube-linux-amd64 -p functional-20220630202638-9950 logs --file /tmp/TestFunctionalserialLogsFileCmd718860592/001/logs.txt: (1.187153941s)
--- PASS: TestFunctional/serial/LogsFileCmd (1.19s)

                                                
                                    
x
+
TestFunctional/parallel/ConfigCmd (0.59s)

                                                
                                                
=== RUN   TestFunctional/parallel/ConfigCmd
=== PAUSE TestFunctional/parallel/ConfigCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ConfigCmd
functional_test.go:1191: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 config unset cpus

                                                
                                                
=== CONT  TestFunctional/parallel/ConfigCmd
functional_test.go:1191: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 config get cpus

                                                
                                                
=== CONT  TestFunctional/parallel/ConfigCmd
functional_test.go:1191: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-20220630202638-9950 config get cpus: exit status 14 (113.132668ms)

                                                
                                                
** stderr ** 
	Error: specified key could not be found in config

                                                
                                                
** /stderr **
functional_test.go:1191: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 config set cpus 2

                                                
                                                
=== CONT  TestFunctional/parallel/ConfigCmd
functional_test.go:1191: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 config get cpus
functional_test.go:1191: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 config unset cpus

                                                
                                                
=== CONT  TestFunctional/parallel/ConfigCmd
functional_test.go:1191: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 config get cpus
functional_test.go:1191: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-20220630202638-9950 config get cpus: exit status 14 (86.054795ms)

                                                
                                                
** stderr ** 
	Error: specified key could not be found in config

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/ConfigCmd (0.59s)

                                                
                                    
x
+
TestFunctional/parallel/DashboardCmd (13.79s)

                                                
                                                
=== RUN   TestFunctional/parallel/DashboardCmd
=== PAUSE TestFunctional/parallel/DashboardCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DashboardCmd
functional_test.go:897: (dbg) daemon: [out/minikube-linux-amd64 dashboard --url --port 36195 -p functional-20220630202638-9950 --alsologtostderr -v=1]

                                                
                                                
=== CONT  TestFunctional/parallel/DashboardCmd
functional_test.go:902: (dbg) stopping [out/minikube-linux-amd64 dashboard --url --port 36195 -p functional-20220630202638-9950 --alsologtostderr -v=1] ...
helpers_test.go:506: unable to kill pid 47572: os: process already finished
--- PASS: TestFunctional/parallel/DashboardCmd (13.79s)

                                                
                                    
x
+
TestFunctional/parallel/DryRun (0.72s)

                                                
                                                
=== RUN   TestFunctional/parallel/DryRun
=== PAUSE TestFunctional/parallel/DryRun

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DryRun
functional_test.go:966: (dbg) Run:  out/minikube-linux-amd64 start -p functional-20220630202638-9950 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=containerd

                                                
                                                
=== CONT  TestFunctional/parallel/DryRun
functional_test.go:966: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p functional-20220630202638-9950 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=containerd: exit status 23 (290.309258ms)

                                                
                                                
-- stdout --
	* [functional-20220630202638-9950] minikube v1.26.0 on Ubuntu 20.04 (kvm/amd64)
	  - MINIKUBE_LOCATION=14420
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-amd64
	* Using the docker driver based on existing profile
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0630 20:29:06.340361   46638 out.go:296] Setting OutFile to fd 1 ...
	I0630 20:29:06.340483   46638 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 20:29:06.340496   46638 out.go:309] Setting ErrFile to fd 2...
	I0630 20:29:06.340503   46638 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 20:29:06.341086   46638 root.go:329] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/bin
	I0630 20:29:06.341407   46638 out.go:303] Setting JSON to false
	I0630 20:29:06.342935   46638 start.go:115] hostinfo: {"hostname":"ubuntu-20-agent-8","uptime":699,"bootTime":1656620248,"procs":419,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1012-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0630 20:29:06.343022   46638 start.go:125] virtualization: kvm guest
	I0630 20:29:06.347875   46638 out.go:177] * [functional-20220630202638-9950] minikube v1.26.0 on Ubuntu 20.04 (kvm/amd64)
	I0630 20:29:06.350202   46638 out.go:177]   - MINIKUBE_LOCATION=14420
	I0630 20:29:06.351855   46638 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0630 20:29:06.353515   46638 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 20:29:06.355235   46638 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube
	I0630 20:29:06.356701   46638 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0630 20:29:06.358534   46638 config.go:178] Loaded profile config "functional-20220630202638-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 20:29:06.359080   46638 driver.go:360] Setting default libvirt URI to qemu:///system
	I0630 20:29:06.408733   46638 docker.go:137] docker version: linux-20.10.17
	I0630 20:29:06.408839   46638 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0630 20:29:06.543403   46638 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:7 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:32 OomKillDisable:true NGoroutines:39 SystemTime:2022-06-30 20:29:06.44419119 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1012-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexServe
rAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662451712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-8 Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] ClientI
nfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
	I0630 20:29:06.543506   46638 docker.go:254] overlay module found
	I0630 20:29:06.546008   46638 out.go:177] * Using the docker driver based on existing profile
	I0630 20:29:06.547543   46638 start.go:284] selected driver: docker
	I0630 20:29:06.547560   46638 start.go:808] validating driver "docker" against &{Name:functional-20220630202638-9950 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:functional-20220630202638-9950 Namespace:de
fault APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false istio:false istio-provisioner:false kong:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-sec
urity-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false volumesnapshots:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 20:29:06.547689   46638 start.go:819] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0630 20:29:06.550409   46638 out.go:177] 
	W0630 20:29:06.551998   46638 out.go:239] X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
	X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
	I0630 20:29:06.553334   46638 out.go:177] 

                                                
                                                
** /stderr **
functional_test.go:983: (dbg) Run:  out/minikube-linux-amd64 start -p functional-20220630202638-9950 --dry-run --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
--- PASS: TestFunctional/parallel/DryRun (0.72s)

                                                
                                    
x
+
TestFunctional/parallel/InternationalLanguage (0.24s)

                                                
                                                
=== RUN   TestFunctional/parallel/InternationalLanguage
=== PAUSE TestFunctional/parallel/InternationalLanguage

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/InternationalLanguage
functional_test.go:1012: (dbg) Run:  out/minikube-linux-amd64 start -p functional-20220630202638-9950 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=containerd
functional_test.go:1012: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p functional-20220630202638-9950 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=containerd: exit status 23 (236.09272ms)

                                                
                                                
-- stdout --
	* [functional-20220630202638-9950] minikube v1.26.0 sur Ubuntu 20.04 (kvm/amd64)
	  - MINIKUBE_LOCATION=14420
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-amd64
	* Utilisation du pilote docker basé sur le profil existant
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0630 20:28:45.687248   43325 out.go:296] Setting OutFile to fd 1 ...
	I0630 20:28:45.687393   43325 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 20:28:45.687405   43325 out.go:309] Setting ErrFile to fd 2...
	I0630 20:28:45.687411   43325 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 20:28:45.687927   43325 root.go:329] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/bin
	I0630 20:28:45.688162   43325 out.go:303] Setting JSON to false
	I0630 20:28:45.689337   43325 start.go:115] hostinfo: {"hostname":"ubuntu-20-agent-8","uptime":678,"bootTime":1656620248,"procs":402,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1012-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0630 20:28:45.689404   43325 start.go:125] virtualization: kvm guest
	I0630 20:28:45.691995   43325 out.go:177] * [functional-20220630202638-9950] minikube v1.26.0 sur Ubuntu 20.04 (kvm/amd64)
	I0630 20:28:45.693301   43325 out.go:177]   - MINIKUBE_LOCATION=14420
	I0630 20:28:45.694834   43325 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0630 20:28:45.696148   43325 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 20:28:45.697467   43325 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube
	I0630 20:28:45.698758   43325 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0630 20:28:45.700509   43325 config.go:178] Loaded profile config "functional-20220630202638-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 20:28:45.700980   43325 driver.go:360] Setting default libvirt URI to qemu:///system
	I0630 20:28:45.739985   43325 docker.go:137] docker version: linux-20.10.17
	I0630 20:28:45.740115   43325 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0630 20:28:45.847764   43325 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:6 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:34 OomKillDisable:true NGoroutines:40 SystemTime:2022-06-30 20:28:45.769877034 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1012-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexServ
erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662451712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-8 Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Client
Info:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
	I0630 20:28:45.847879   43325 docker.go:254] overlay module found
	I0630 20:28:45.850098   43325 out.go:177] * Utilisation du pilote docker basé sur le profil existant
	I0630 20:28:45.851383   43325 start.go:284] selected driver: docker
	I0630 20:28:45.851397   43325 start.go:808] validating driver "docker" against &{Name:functional-20220630202638-9950 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:functional-20220630202638-9950 Namespace:de
fault APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.24.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false istio:false istio-provisioner:false kong:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-sec
urity-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false volumesnapshots:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0630 20:28:45.851515   43325 start.go:819] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0630 20:28:45.854018   43325 out.go:177] 
	W0630 20:28:45.855434   43325 out.go:239] X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
	X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
	I0630 20:28:45.856817   43325 out.go:177] 

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/InternationalLanguage (0.24s)

                                                
                                    
x
+
TestFunctional/parallel/StatusCmd (1.38s)

                                                
                                                
=== RUN   TestFunctional/parallel/StatusCmd
=== PAUSE TestFunctional/parallel/StatusCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/StatusCmd
functional_test.go:846: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 status

                                                
                                                
=== CONT  TestFunctional/parallel/StatusCmd
functional_test.go:852: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 status -f host:{{.Host}},kublet:{{.Kubelet}},apiserver:{{.APIServer}},kubeconfig:{{.Kubeconfig}}

                                                
                                                
=== CONT  TestFunctional/parallel/StatusCmd
functional_test.go:864: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 status -o json
--- PASS: TestFunctional/parallel/StatusCmd (1.38s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd (13.72s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd
=== PAUSE TestFunctional/parallel/ServiceCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ServiceCmd
functional_test.go:1432: (dbg) Run:  kubectl --context functional-20220630202638-9950 create deployment hello-node --image=k8s.gcr.io/echoserver:1.8
functional_test.go:1438: (dbg) Run:  kubectl --context functional-20220630202638-9950 expose deployment hello-node --type=NodePort --port=8080
functional_test.go:1443: (dbg) TestFunctional/parallel/ServiceCmd: waiting 10m0s for pods matching "app=hello-node" in namespace "default" ...
helpers_test.go:342: "hello-node-54c4b5c49f-h8n5k" [4b66825c-8585-4a1b-8daa-139bfc02546e] Pending / Ready:ContainersNotReady (containers with unready status: [echoserver]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver])

                                                
                                                
=== CONT  TestFunctional/parallel/ServiceCmd
helpers_test.go:342: "hello-node-54c4b5c49f-h8n5k" [4b66825c-8585-4a1b-8daa-139bfc02546e] Running

                                                
                                                
=== CONT  TestFunctional/parallel/ServiceCmd
functional_test.go:1443: (dbg) TestFunctional/parallel/ServiceCmd: app=hello-node healthy within 11.006733195s
functional_test.go:1448: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 service list

                                                
                                                
=== CONT  TestFunctional/parallel/ServiceCmd
functional_test.go:1462: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 service --namespace=default --https --url hello-node

                                                
                                                
=== CONT  TestFunctional/parallel/ServiceCmd
functional_test.go:1475: found endpoint: https://192.168.49.2:30534
functional_test.go:1490: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 service hello-node --url --format={{.IP}}

                                                
                                                
=== CONT  TestFunctional/parallel/ServiceCmd
functional_test.go:1504: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 service hello-node --url

                                                
                                                
=== CONT  TestFunctional/parallel/ServiceCmd
functional_test.go:1510: found endpoint for hello-node: http://192.168.49.2:30534
--- PASS: TestFunctional/parallel/ServiceCmd (13.72s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmdConnect (10.63s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmdConnect
=== PAUSE TestFunctional/parallel/ServiceCmdConnect

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ServiceCmdConnect
functional_test.go:1558: (dbg) Run:  kubectl --context functional-20220630202638-9950 create deployment hello-node-connect --image=k8s.gcr.io/echoserver:1.8

                                                
                                                
=== CONT  TestFunctional/parallel/ServiceCmdConnect
functional_test.go:1564: (dbg) Run:  kubectl --context functional-20220630202638-9950 expose deployment hello-node-connect --type=NodePort --port=8080
functional_test.go:1569: (dbg) TestFunctional/parallel/ServiceCmdConnect: waiting 10m0s for pods matching "app=hello-node-connect" in namespace "default" ...
helpers_test.go:342: "hello-node-connect-578cdc45cb-qqjhb" [223a96f5-80f8-4652-af45-9dd4ca4678e4] Pending / Ready:ContainersNotReady (containers with unready status: [echoserver]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver])

                                                
                                                
=== CONT  TestFunctional/parallel/ServiceCmdConnect
helpers_test.go:342: "hello-node-connect-578cdc45cb-qqjhb" [223a96f5-80f8-4652-af45-9dd4ca4678e4] Running

                                                
                                                
=== CONT  TestFunctional/parallel/ServiceCmdConnect
functional_test.go:1569: (dbg) TestFunctional/parallel/ServiceCmdConnect: app=hello-node-connect healthy within 10.006962481s
functional_test.go:1578: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 service hello-node-connect --url

                                                
                                                
=== CONT  TestFunctional/parallel/ServiceCmdConnect
functional_test.go:1584: found endpoint for hello-node-connect: http://192.168.49.2:30903
functional_test.go:1604: http://192.168.49.2:30903: success! body:

                                                
                                                

                                                
                                                
Hostname: hello-node-connect-578cdc45cb-qqjhb

                                                
                                                
Pod Information:
	-no pod information available-

                                                
                                                
Server values:
	server_version=nginx: 1.13.3 - lua: 10008

                                                
                                                
Request Information:
	client_address=10.244.0.1
	method=GET
	real path=/
	query=
	request_version=1.1
	request_uri=http://192.168.49.2:8080/

                                                
                                                
Request Headers:
	accept-encoding=gzip
	host=192.168.49.2:30903
	user-agent=Go-http-client/1.1

                                                
                                                
Request Body:
	-no body in request-

                                                
                                                
--- PASS: TestFunctional/parallel/ServiceCmdConnect (10.63s)

                                                
                                    
x
+
TestFunctional/parallel/AddonsCmd (0.18s)

                                                
                                                
=== RUN   TestFunctional/parallel/AddonsCmd
=== PAUSE TestFunctional/parallel/AddonsCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/AddonsCmd
functional_test.go:1619: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 addons list
functional_test.go:1631: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 addons list -o json
--- PASS: TestFunctional/parallel/AddonsCmd (0.18s)

                                                
                                    
x
+
TestFunctional/parallel/PersistentVolumeClaim (34.01s)

                                                
                                                
=== RUN   TestFunctional/parallel/PersistentVolumeClaim
=== PAUSE TestFunctional/parallel/PersistentVolumeClaim

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/PersistentVolumeClaim
functional_test_pvc_test.go:44: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 4m0s for pods matching "integration-test=storage-provisioner" in namespace "kube-system" ...
helpers_test.go:342: "storage-provisioner" [0ad7e45f-a54e-4549-a504-8132dc436b2d] Running

                                                
                                                
=== CONT  TestFunctional/parallel/PersistentVolumeClaim
functional_test_pvc_test.go:44: (dbg) TestFunctional/parallel/PersistentVolumeClaim: integration-test=storage-provisioner healthy within 5.00864766s
functional_test_pvc_test.go:49: (dbg) Run:  kubectl --context functional-20220630202638-9950 get storageclass -o=json
functional_test_pvc_test.go:69: (dbg) Run:  kubectl --context functional-20220630202638-9950 apply -f testdata/storage-provisioner/pvc.yaml
functional_test_pvc_test.go:76: (dbg) Run:  kubectl --context functional-20220630202638-9950 get pvc myclaim -o=json
functional_test_pvc_test.go:125: (dbg) Run:  kubectl --context functional-20220630202638-9950 apply -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 3m0s for pods matching "test=storage-provisioner" in namespace "default" ...
helpers_test.go:342: "sp-pod" [6d402ca5-42b2-45bf-b902-95acd8532b05] Pending

                                                
                                                
=== CONT  TestFunctional/parallel/PersistentVolumeClaim
helpers_test.go:342: "sp-pod" [6d402ca5-42b2-45bf-b902-95acd8532b05] Pending / Ready:ContainersNotReady (containers with unready status: [myfrontend]) / ContainersReady:ContainersNotReady (containers with unready status: [myfrontend])

                                                
                                                
=== CONT  TestFunctional/parallel/PersistentVolumeClaim
helpers_test.go:342: "sp-pod" [6d402ca5-42b2-45bf-b902-95acd8532b05] Running

                                                
                                                
=== CONT  TestFunctional/parallel/PersistentVolumeClaim
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: test=storage-provisioner healthy within 11.045700551s
functional_test_pvc_test.go:100: (dbg) Run:  kubectl --context functional-20220630202638-9950 exec sp-pod -- touch /tmp/mount/foo

                                                
                                                
=== CONT  TestFunctional/parallel/PersistentVolumeClaim
functional_test_pvc_test.go:106: (dbg) Run:  kubectl --context functional-20220630202638-9950 delete -f testdata/storage-provisioner/pod.yaml

                                                
                                                
=== CONT  TestFunctional/parallel/PersistentVolumeClaim
functional_test_pvc_test.go:106: (dbg) Done: kubectl --context functional-20220630202638-9950 delete -f testdata/storage-provisioner/pod.yaml: (1.008293058s)
functional_test_pvc_test.go:125: (dbg) Run:  kubectl --context functional-20220630202638-9950 apply -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 3m0s for pods matching "test=storage-provisioner" in namespace "default" ...

                                                
                                                
=== CONT  TestFunctional/parallel/PersistentVolumeClaim
helpers_test.go:342: "sp-pod" [0d4a8e0b-f80c-4f36-89e3-eee5d27edb62] Pending

                                                
                                                
=== CONT  TestFunctional/parallel/PersistentVolumeClaim
helpers_test.go:342: "sp-pod" [0d4a8e0b-f80c-4f36-89e3-eee5d27edb62] Pending / Ready:ContainersNotReady (containers with unready status: [myfrontend]) / ContainersReady:ContainersNotReady (containers with unready status: [myfrontend])

                                                
                                                
=== CONT  TestFunctional/parallel/PersistentVolumeClaim
helpers_test.go:342: "sp-pod" [0d4a8e0b-f80c-4f36-89e3-eee5d27edb62] Running
E0630 20:29:00.447314    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/addons-20220630202117-9950/client.crt: no such file or directory

                                                
                                                
=== CONT  TestFunctional/parallel/PersistentVolumeClaim
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: test=storage-provisioner healthy within 16.008029784s
functional_test_pvc_test.go:114: (dbg) Run:  kubectl --context functional-20220630202638-9950 exec sp-pod -- ls /tmp/mount
--- PASS: TestFunctional/parallel/PersistentVolumeClaim (34.01s)

                                                
                                    
x
+
TestFunctional/parallel/SSHCmd (0.9s)

                                                
                                                
=== RUN   TestFunctional/parallel/SSHCmd
=== PAUSE TestFunctional/parallel/SSHCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/SSHCmd
functional_test.go:1654: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 ssh "echo hello"

                                                
                                                
=== CONT  TestFunctional/parallel/SSHCmd
functional_test.go:1671: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 ssh "cat /etc/hostname"
--- PASS: TestFunctional/parallel/SSHCmd (0.90s)

                                                
                                    
x
+
TestFunctional/parallel/CpCmd (1.9s)

                                                
                                                
=== RUN   TestFunctional/parallel/CpCmd
=== PAUSE TestFunctional/parallel/CpCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/CpCmd
helpers_test.go:554: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 cp testdata/cp-test.txt /home/docker/cp-test.txt
helpers_test.go:532: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 ssh -n functional-20220630202638-9950 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:554: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 cp functional-20220630202638-9950:/home/docker/cp-test.txt /tmp/TestFunctionalparallelCpCmd1233991363/001/cp-test.txt
helpers_test.go:532: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 ssh -n functional-20220630202638-9950 "sudo cat /home/docker/cp-test.txt"
--- PASS: TestFunctional/parallel/CpCmd (1.90s)

                                                
                                    
x
+
TestFunctional/parallel/MySQL (26.66s)

                                                
                                                
=== RUN   TestFunctional/parallel/MySQL
=== PAUSE TestFunctional/parallel/MySQL

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/MySQL
functional_test.go:1719: (dbg) Run:  kubectl --context functional-20220630202638-9950 replace --force -f testdata/mysql.yaml
functional_test.go:1725: (dbg) TestFunctional/parallel/MySQL: waiting 10m0s for pods matching "app=mysql" in namespace "default" ...
helpers_test.go:342: "mysql-67f7d69d8b-6rg5f" [44ae18f4-ca6e-48e8-853e-52479a4ece86] Pending

                                                
                                                
=== CONT  TestFunctional/parallel/MySQL
helpers_test.go:342: "mysql-67f7d69d8b-6rg5f" [44ae18f4-ca6e-48e8-853e-52479a4ece86] Pending / Ready:ContainersNotReady (containers with unready status: [mysql]) / ContainersReady:ContainersNotReady (containers with unready status: [mysql])

                                                
                                                
=== CONT  TestFunctional/parallel/MySQL
helpers_test.go:342: "mysql-67f7d69d8b-6rg5f" [44ae18f4-ca6e-48e8-853e-52479a4ece86] Running

                                                
                                                
=== CONT  TestFunctional/parallel/MySQL
functional_test.go:1725: (dbg) TestFunctional/parallel/MySQL: app=mysql healthy within 17.03976917s
functional_test.go:1733: (dbg) Run:  kubectl --context functional-20220630202638-9950 exec mysql-67f7d69d8b-6rg5f -- mysql -ppassword -e "show databases;"
functional_test.go:1733: (dbg) Non-zero exit: kubectl --context functional-20220630202638-9950 exec mysql-67f7d69d8b-6rg5f -- mysql -ppassword -e "show databases;": exit status 1 (311.88276ms)

                                                
                                                
** stderr ** 
	mysql: [Warning] Using a password on the command line interface can be insecure.
	ERROR 1045 (28000): Access denied for user 'root'@'localhost' (using password: YES)
	command terminated with exit code 1

                                                
                                                
** /stderr **
functional_test.go:1733: (dbg) Run:  kubectl --context functional-20220630202638-9950 exec mysql-67f7d69d8b-6rg5f -- mysql -ppassword -e "show databases;"
functional_test.go:1733: (dbg) Non-zero exit: kubectl --context functional-20220630202638-9950 exec mysql-67f7d69d8b-6rg5f -- mysql -ppassword -e "show databases;": exit status 1 (193.972018ms)

                                                
                                                
** stderr ** 
	mysql: [Warning] Using a password on the command line interface can be insecure.
	ERROR 1045 (28000): Access denied for user 'root'@'localhost' (using password: YES)
	command terminated with exit code 1

                                                
                                                
** /stderr **

                                                
                                                
=== CONT  TestFunctional/parallel/MySQL
functional_test.go:1733: (dbg) Run:  kubectl --context functional-20220630202638-9950 exec mysql-67f7d69d8b-6rg5f -- mysql -ppassword -e "show databases;"
functional_test.go:1733: (dbg) Non-zero exit: kubectl --context functional-20220630202638-9950 exec mysql-67f7d69d8b-6rg5f -- mysql -ppassword -e "show databases;": exit status 1 (269.085934ms)

                                                
                                                
** stderr ** 
	mysql: [Warning] Using a password on the command line interface can be insecure.
	ERROR 1045 (28000): Access denied for user 'root'@'localhost' (using password: YES)
	command terminated with exit code 1

                                                
                                                
** /stderr **

                                                
                                                
=== CONT  TestFunctional/parallel/MySQL
functional_test.go:1733: (dbg) Run:  kubectl --context functional-20220630202638-9950 exec mysql-67f7d69d8b-6rg5f -- mysql -ppassword -e "show databases;"

                                                
                                                
=== CONT  TestFunctional/parallel/MySQL
functional_test.go:1733: (dbg) Non-zero exit: kubectl --context functional-20220630202638-9950 exec mysql-67f7d69d8b-6rg5f -- mysql -ppassword -e "show databases;": exit status 1 (131.891249ms)

                                                
                                                
** stderr ** 
	mysql: [Warning] Using a password on the command line interface can be insecure.
	ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/var/run/mysqld/mysqld.sock' (2)
	command terminated with exit code 1

                                                
                                                
** /stderr **

                                                
                                                
=== CONT  TestFunctional/parallel/MySQL
functional_test.go:1733: (dbg) Run:  kubectl --context functional-20220630202638-9950 exec mysql-67f7d69d8b-6rg5f -- mysql -ppassword -e "show databases;"
--- PASS: TestFunctional/parallel/MySQL (26.66s)

                                                
                                    
x
+
TestFunctional/parallel/FileSync (0.4s)

                                                
                                                
=== RUN   TestFunctional/parallel/FileSync
=== PAUSE TestFunctional/parallel/FileSync

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/FileSync
functional_test.go:1855: Checking for existence of /etc/test/nested/copy/9950/hosts within VM
functional_test.go:1857: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 ssh "sudo cat /etc/test/nested/copy/9950/hosts"
functional_test.go:1862: file sync test content: Test file for checking file sync process
--- PASS: TestFunctional/parallel/FileSync (0.40s)

                                                
                                    
x
+
TestFunctional/parallel/CertSync (2.34s)

                                                
                                                
=== RUN   TestFunctional/parallel/CertSync
=== PAUSE TestFunctional/parallel/CertSync

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/CertSync
functional_test.go:1898: Checking for existence of /etc/ssl/certs/9950.pem within VM
functional_test.go:1899: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 ssh "sudo cat /etc/ssl/certs/9950.pem"
functional_test.go:1898: Checking for existence of /usr/share/ca-certificates/9950.pem within VM
functional_test.go:1899: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 ssh "sudo cat /usr/share/ca-certificates/9950.pem"

                                                
                                                
=== CONT  TestFunctional/parallel/CertSync
functional_test.go:1898: Checking for existence of /etc/ssl/certs/51391683.0 within VM
functional_test.go:1899: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 ssh "sudo cat /etc/ssl/certs/51391683.0"

                                                
                                                
=== CONT  TestFunctional/parallel/CertSync
functional_test.go:1925: Checking for existence of /etc/ssl/certs/99502.pem within VM
functional_test.go:1926: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 ssh "sudo cat /etc/ssl/certs/99502.pem"

                                                
                                                
=== CONT  TestFunctional/parallel/CertSync
functional_test.go:1925: Checking for existence of /usr/share/ca-certificates/99502.pem within VM
functional_test.go:1926: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 ssh "sudo cat /usr/share/ca-certificates/99502.pem"
functional_test.go:1925: Checking for existence of /etc/ssl/certs/3ec20f2e.0 within VM
functional_test.go:1926: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 ssh "sudo cat /etc/ssl/certs/3ec20f2e.0"
--- PASS: TestFunctional/parallel/CertSync (2.34s)

                                                
                                    
x
+
TestFunctional/parallel/NodeLabels (0.07s)

                                                
                                                
=== RUN   TestFunctional/parallel/NodeLabels
=== PAUSE TestFunctional/parallel/NodeLabels

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/NodeLabels
functional_test.go:214: (dbg) Run:  kubectl --context functional-20220630202638-9950 get nodes --output=go-template "--template='{{range $k, $v := (index .items 0).metadata.labels}}{{$k}} {{end}}'"
--- PASS: TestFunctional/parallel/NodeLabels (0.07s)

                                                
                                    
x
+
TestFunctional/parallel/NonActiveRuntimeDisabled (0.8s)

                                                
                                                
=== RUN   TestFunctional/parallel/NonActiveRuntimeDisabled
=== PAUSE TestFunctional/parallel/NonActiveRuntimeDisabled

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/NonActiveRuntimeDisabled
functional_test.go:1953: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 ssh "sudo systemctl is-active docker"

                                                
                                                
=== CONT  TestFunctional/parallel/NonActiveRuntimeDisabled
functional_test.go:1953: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-20220630202638-9950 ssh "sudo systemctl is-active docker": exit status 1 (403.39017ms)

                                                
                                                
-- stdout --
	inactive

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
functional_test.go:1953: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 ssh "sudo systemctl is-active crio"

                                                
                                                
=== CONT  TestFunctional/parallel/NonActiveRuntimeDisabled
functional_test.go:1953: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-20220630202638-9950 ssh "sudo systemctl is-active crio": exit status 1 (392.824094ms)

                                                
                                                
-- stdout --
	inactive

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/NonActiveRuntimeDisabled (0.80s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_not_create (0.65s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_not_create
functional_test.go:1265: (dbg) Run:  out/minikube-linux-amd64 profile lis

                                                
                                                
=== CONT  TestFunctional/parallel/ProfileCmd/profile_not_create
functional_test.go:1270: (dbg) Run:  out/minikube-linux-amd64 profile list --output json
--- PASS: TestFunctional/parallel/ProfileCmd/profile_not_create (0.65s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/StartTunnel
functional_test_tunnel_test.go:127: (dbg) daemon: [out/minikube-linux-amd64 -p functional-20220630202638-9950 tunnel --alsologtostderr]
--- PASS: TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (10.25s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup
functional_test_tunnel_test.go:147: (dbg) Run:  kubectl --context functional-20220630202638-9950 apply -f testdata/testsvc.yaml

                                                
                                                
=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup
functional_test_tunnel_test.go:151: (dbg) TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup: waiting 4m0s for pods matching "run=nginx-svc" in namespace "default" ...
helpers_test.go:342: "nginx-svc" [01776d16-0389-4ebf-b78c-8bf353f54977] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])

                                                
                                                
=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup
helpers_test.go:342: "nginx-svc" [01776d16-0389-4ebf-b78c-8bf353f54977] Running

                                                
                                                
=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup
functional_test_tunnel_test.go:151: (dbg) TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup: run=nginx-svc healthy within 10.017549263s
--- PASS: TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (10.25s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_list (0.48s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_list
functional_test.go:1305: (dbg) Run:  out/minikube-linux-amd64 profile list

                                                
                                                
=== CONT  TestFunctional/parallel/ProfileCmd/profile_list
functional_test.go:1310: Took "408.464912ms" to run "out/minikube-linux-amd64 profile list"
functional_test.go:1319: (dbg) Run:  out/minikube-linux-amd64 profile list -l

                                                
                                                
=== CONT  TestFunctional/parallel/ProfileCmd/profile_list
functional_test.go:1324: Took "76.286498ms" to run "out/minikube-linux-amd64 profile list -l"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_list (0.48s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_json_output (0.48s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_json_output
functional_test.go:1356: (dbg) Run:  out/minikube-linux-amd64 profile list -o json

                                                
                                                
=== CONT  TestFunctional/parallel/ProfileCmd/profile_json_output
functional_test.go:1361: Took "404.686138ms" to run "out/minikube-linux-amd64 profile list -o json"
functional_test.go:1369: (dbg) Run:  out/minikube-linux-amd64 profile list -o json --light
functional_test.go:1374: Took "77.089028ms" to run "out/minikube-linux-amd64 profile list -o json --light"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_json_output (0.48s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP (0.06s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP
functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20220630202638-9950 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}
--- PASS: TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP (0.06s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/AccessDirect (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessDirect
functional_test_tunnel_test.go:234: tunnel at http://10.105.75.135 is working!
--- PASS: TestFunctional/parallel/TunnelCmd/serial/AccessDirect (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.11s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel
functional_test_tunnel_test.go:369: (dbg) stopping [out/minikube-linux-amd64 -p functional-20220630202638-9950 tunnel --alsologtostderr] ...
--- PASS: TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.11s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_changes (0.27s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_changes
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_changes

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_changes
functional_test.go:2045: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_changes (0.27s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.24s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
functional_test.go:2045: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.24s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_clusters (0.24s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_clusters
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_clusters

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_clusters
functional_test.go:2045: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_clusters (0.24s)

                                                
                                    
x
+
TestFunctional/parallel/Version/short (0.08s)

                                                
                                                
=== RUN   TestFunctional/parallel/Version/short
=== PAUSE TestFunctional/parallel/Version/short

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/Version/short
functional_test.go:2182: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 version --short
--- PASS: TestFunctional/parallel/Version/short (0.08s)

                                                
                                    
x
+
TestFunctional/parallel/Version/components (0.67s)

                                                
                                                
=== RUN   TestFunctional/parallel/Version/components
=== PAUSE TestFunctional/parallel/Version/components

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/Version/components
functional_test.go:2196: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 version -o=json --components
--- PASS: TestFunctional/parallel/Version/components (0.67s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListShort (0.27s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListShort
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListShort

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListShort
functional_test.go:256: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 image ls --format short
functional_test.go:261: (dbg) Stdout: out/minikube-linux-amd64 -p functional-20220630202638-9950 image ls --format short:
k8s.gcr.io/pause:latest
k8s.gcr.io/pause:3.7
k8s.gcr.io/pause:3.3
k8s.gcr.io/pause:3.1
k8s.gcr.io/kube-scheduler:v1.24.2
k8s.gcr.io/kube-proxy:v1.24.2
k8s.gcr.io/kube-controller-manager:v1.24.2
k8s.gcr.io/kube-apiserver:v1.24.2
k8s.gcr.io/etcd:3.5.3-0
k8s.gcr.io/echoserver:1.8
k8s.gcr.io/coredns/coredns:v1.8.6
gcr.io/k8s-minikube/storage-provisioner:v5
gcr.io/k8s-minikube/busybox:1.28.4-glibc
gcr.io/google-containers/addon-resizer:functional-20220630202638-9950
docker.io/library/nginx:latest
docker.io/library/nginx:alpine
docker.io/library/mysql:5.7
docker.io/library/minikube-local-cache-test:functional-20220630202638-9950
docker.io/kindest/kindnetd:v20220510-4929dd75
--- PASS: TestFunctional/parallel/ImageCommands/ImageListShort (0.27s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListTable (0.27s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListTable
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListTable

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListTable
functional_test.go:256: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 image ls --format table
functional_test.go:261: (dbg) Stdout: out/minikube-linux-amd64 -p functional-20220630202638-9950 image ls --format table:
|---------------------------------------------|--------------------------------|---------------|--------|
|                    Image                    |              Tag               |   Image ID    |  Size  |
|---------------------------------------------|--------------------------------|---------------|--------|
| k8s.gcr.io/pause                            | 3.7                            | sha256:221177 | 311kB  |
| docker.io/library/mysql                     | 5.7                            | sha256:efa500 | 162MB  |
| k8s.gcr.io/kube-proxy                       | v1.24.2                        | sha256:a63454 | 39.5MB |
| k8s.gcr.io/pause                            | 3.3                            | sha256:0184c1 | 298kB  |
| k8s.gcr.io/kube-scheduler                   | v1.24.2                        | sha256:5d7251 | 15.5MB |
| docker.io/kindest/kindnetd                  | v20220510-4929dd75             | sha256:6fb66c | 45.2MB |
| gcr.io/k8s-minikube/busybox                 | 1.28.4-glibc                   | sha256:56cc51 | 2.4MB  |
| gcr.io/k8s-minikube/storage-provisioner     | v5                             | sha256:6e38f4 | 9.06MB |
| docker.io/library/minikube-local-cache-test | functional-20220630202638-9950 | sha256:abc029 | 1.74kB |
| docker.io/library/nginx                     | latest                         | sha256:55f4b4 | 56.7MB |
| k8s.gcr.io/echoserver                       | 1.8                            | sha256:82e4c8 | 46.2MB |
| k8s.gcr.io/etcd                             | 3.5.3-0                        | sha256:aebe75 | 102MB  |
| k8s.gcr.io/kube-apiserver                   | v1.24.2                        | sha256:d3377f | 33.8MB |
| k8s.gcr.io/kube-controller-manager          | v1.24.2                        | sha256:34cdf9 | 31MB   |
| k8s.gcr.io/pause                            | 3.1                            | sha256:da86e6 | 315kB  |
| k8s.gcr.io/pause                            | latest                         | sha256:350b16 | 72.3kB |
| docker.io/library/nginx                     | alpine                         | sha256:f246e6 | 10.2MB |
| gcr.io/google-containers/addon-resizer      | functional-20220630202638-9950 | sha256:ffd4cf | 10.8MB |
| k8s.gcr.io/coredns/coredns                  | v1.8.6                         | sha256:a4ca41 | 13.6MB |
|---------------------------------------------|--------------------------------|---------------|--------|
E0630 20:29:10.688243    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/addons-20220630202117-9950/client.crt: no such file or directory
--- PASS: TestFunctional/parallel/ImageCommands/ImageListTable (0.27s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListJson (0.26s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListJson
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListJson

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListJson
functional_test.go:256: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 image ls --format json

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListJson
functional_test.go:261: (dbg) Stdout: out/minikube-linux-amd64 -p functional-20220630202638-9950 image ls --format json:
[{"id":"sha256:f246e6f9d0b28d6eb1f7e1f12791f23587c2c6aa42c82aba8d6fe6e2e2de9e95","repoDigests":["docker.io/library/nginx@sha256:8e38930f0390cbd79b2d1528405fb17edcda5f4a30875ecf338ebaa598dc994e"],"repoTags":["docker.io/library/nginx:alpine"],"size":"10190737"},{"id":"sha256:ffd4cfbbe753e62419e129ee2ac618beb94e51baa7471df5038b0b516b59cf91","repoDigests":[],"repoTags":["gcr.io/google-containers/addon-resizer:functional-20220630202638-9950"],"size":"10823156"},{"id":"sha256:a4ca41631cc7ac19ce1be3ebf0314ac5f47af7c711f17066006db82ee3b75b03","repoDigests":["k8s.gcr.io/coredns/coredns@sha256:5b6ec0d6de9baaf3e92d0f66cd96a25b9edbce8716f5f15dcd1a616b3abd590e"],"repoTags":["k8s.gcr.io/coredns/coredns:v1.8.6"],"size":"13585107"},{"id":"sha256:82e4c8a736a4fcf22b5ef9f6a4ff6207064c7187d7694bf97bd561605a538410","repoDigests":["k8s.gcr.io/echoserver@sha256:cb3386f863f6a4b05f33c191361723f9d5927ac287463b1bea633bf859475969"],"repoTags":["k8s.gcr.io/echoserver:1.8"],"size":"46237695"},{"id":"sha256:da86e6ba6ca197bf6bc5e9d9
00febd906b133eaa4750e6bed647b0fbe50ed43e","repoDigests":[],"repoTags":["k8s.gcr.io/pause:3.1"],"size":"315399"},{"id":"sha256:56cc512116c8f894f11ce1995460aef1ee0972d48bc2a3bdb1faaac7c020289c","repoDigests":["gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e"],"repoTags":["gcr.io/k8s-minikube/busybox:1.28.4-glibc"],"size":"2395207"},{"id":"sha256:d3377ffb7177cc4becce8a534d8547aca9530cb30fac9ebe479b31102f1ba503","repoDigests":["k8s.gcr.io/kube-apiserver@sha256:433696d8a90870c405fc2d42020aff0966fb3f1c59bdd1f5077f41335b327c9a"],"repoTags":["k8s.gcr.io/kube-apiserver:v1.24.2"],"size":"33795763"},{"id":"sha256:0184c1613d92931126feb4c548e5da11015513b9e4c104e7305ee8b53b50a9da","repoDigests":[],"repoTags":["k8s.gcr.io/pause:3.3"],"size":"297686"},{"id":"sha256:221177c6082a88ea4f6240ab2450d540955ac6f4d5454f0e15751b653ebda165","repoDigests":["k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c"],"repoTags":["k8s.gcr.io/pause:3.7"],"si
ze":"311278"},{"id":"sha256:350b164e7ae1dcddeffadd65c76226c9b6dc5553f5179153fb0e36b78f2a5e06","repoDigests":[],"repoTags":["k8s.gcr.io/pause:latest"],"size":"72306"},{"id":"sha256:abc0292d7814072d9d74afb2982d9eacbac54c4b62ff926d2e7d0afbf2467d1a","repoDigests":[],"repoTags":["docker.io/library/minikube-local-cache-test:functional-20220630202638-9950"],"size":"1741"},{"id":"sha256:55f4b40fe486a5b734b46bb7bf28f52fa31426bf23be068c8e7b19e58d9b8deb","repoDigests":["docker.io/library/nginx@sha256:10f14ffa93f8dedf1057897b745e5ac72ac5655c299dade0aa434c71557697ea"],"repoTags":["docker.io/library/nginx:latest"],"size":"56748232"},{"id":"sha256:34cdf99b1bb3b3a62c5b4226c3bc0983ab1f13e776269d1872092091b07203df","repoDigests":["k8s.gcr.io/kube-controller-manager@sha256:d255427f14c9236088c22cd94eb434d7c6a05f615636eac0b9681566cd142753"],"repoTags":["k8s.gcr.io/kube-controller-manager:v1.24.2"],"size":"31035052"},{"id":"sha256:a634548d10b032c2a1d704ef9a2ab04c12b0574afe67ee192b196a7f12da9536","repoDigests":["k8s.gcr.io/kube-pro
xy@sha256:7e75c20c0fb0a334fa364546ece4c11a61a7595ce2e27de265cacb4e7ccc7f9f"],"repoTags":["k8s.gcr.io/kube-proxy:v1.24.2"],"size":"39515830"},{"id":"sha256:5d725196c1f47e72d2bc7069776d5928b1fb1e4adf09c18997733099aa3663ac","repoDigests":["k8s.gcr.io/kube-scheduler@sha256:b5bc69ac1e173a58a2b3af11ba65057ff2b71de25d0f93ab947e16714a896a1f"],"repoTags":["k8s.gcr.io/kube-scheduler:v1.24.2"],"size":"15488980"},{"id":"sha256:6fb66cd78abfe9e0735a9a751f2586b7984e0d279e87fa8dd175781de6595627","repoDigests":["docker.io/kindest/kindnetd@sha256:39494477a3fa001aae716b704a8991f4f62d2ccf1aaaa65692da6c805b18856c"],"repoTags":["docker.io/kindest/kindnetd:v20220510-4929dd75"],"size":"45239873"},{"id":"sha256:efa50097efbdef5884e5ebaba4da5899e79609b78cd4fe91b365d5d9d3205188","repoDigests":["docker.io/library/mysql@sha256:8b4b41d530c40d77a3205c53f7ecf1026d735648d9a09777845f305953e5eff5"],"repoTags":["docker.io/library/mysql:5.7"],"size":"162489521"},{"id":"sha256:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562","repo
Digests":["gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944"],"repoTags":["gcr.io/k8s-minikube/storage-provisioner:v5"],"size":"9058936"},{"id":"sha256:aebe758cef4cd05b9f8cee39758227714d02f42ef3088023c1e3cd454f927a2b","repoDigests":["k8s.gcr.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5"],"repoTags":["k8s.gcr.io/etcd:3.5.3-0"],"size":"102143581"}]
--- PASS: TestFunctional/parallel/ImageCommands/ImageListJson (0.26s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListYaml (0.26s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListYaml
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListYaml

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListYaml
functional_test.go:256: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 image ls --format yaml
functional_test.go:261: (dbg) Stdout: out/minikube-linux-amd64 -p functional-20220630202638-9950 image ls --format yaml:
- id: sha256:a634548d10b032c2a1d704ef9a2ab04c12b0574afe67ee192b196a7f12da9536
repoDigests:
- k8s.gcr.io/kube-proxy@sha256:7e75c20c0fb0a334fa364546ece4c11a61a7595ce2e27de265cacb4e7ccc7f9f
repoTags:
- k8s.gcr.io/kube-proxy:v1.24.2
size: "39515830"
- id: sha256:0184c1613d92931126feb4c548e5da11015513b9e4c104e7305ee8b53b50a9da
repoDigests: []
repoTags:
- k8s.gcr.io/pause:3.3
size: "297686"
- id: sha256:221177c6082a88ea4f6240ab2450d540955ac6f4d5454f0e15751b653ebda165
repoDigests:
- k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c
repoTags:
- k8s.gcr.io/pause:3.7
size: "311278"
- id: sha256:350b164e7ae1dcddeffadd65c76226c9b6dc5553f5179153fb0e36b78f2a5e06
repoDigests: []
repoTags:
- k8s.gcr.io/pause:latest
size: "72306"
- id: sha256:f246e6f9d0b28d6eb1f7e1f12791f23587c2c6aa42c82aba8d6fe6e2e2de9e95
repoDigests:
- docker.io/library/nginx@sha256:8e38930f0390cbd79b2d1528405fb17edcda5f4a30875ecf338ebaa598dc994e
repoTags:
- docker.io/library/nginx:alpine
size: "10190737"
- id: sha256:55f4b40fe486a5b734b46bb7bf28f52fa31426bf23be068c8e7b19e58d9b8deb
repoDigests:
- docker.io/library/nginx@sha256:10f14ffa93f8dedf1057897b745e5ac72ac5655c299dade0aa434c71557697ea
repoTags:
- docker.io/library/nginx:latest
size: "56748232"
- id: sha256:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562
repoDigests:
- gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944
repoTags:
- gcr.io/k8s-minikube/storage-provisioner:v5
size: "9058936"
- id: sha256:34cdf99b1bb3b3a62c5b4226c3bc0983ab1f13e776269d1872092091b07203df
repoDigests:
- k8s.gcr.io/kube-controller-manager@sha256:d255427f14c9236088c22cd94eb434d7c6a05f615636eac0b9681566cd142753
repoTags:
- k8s.gcr.io/kube-controller-manager:v1.24.2
size: "31035052"
- id: sha256:82e4c8a736a4fcf22b5ef9f6a4ff6207064c7187d7694bf97bd561605a538410
repoDigests:
- k8s.gcr.io/echoserver@sha256:cb3386f863f6a4b05f33c191361723f9d5927ac287463b1bea633bf859475969
repoTags:
- k8s.gcr.io/echoserver:1.8
size: "46237695"
- id: sha256:aebe758cef4cd05b9f8cee39758227714d02f42ef3088023c1e3cd454f927a2b
repoDigests:
- k8s.gcr.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5
repoTags:
- k8s.gcr.io/etcd:3.5.3-0
size: "102143581"
- id: sha256:d3377ffb7177cc4becce8a534d8547aca9530cb30fac9ebe479b31102f1ba503
repoDigests:
- k8s.gcr.io/kube-apiserver@sha256:433696d8a90870c405fc2d42020aff0966fb3f1c59bdd1f5077f41335b327c9a
repoTags:
- k8s.gcr.io/kube-apiserver:v1.24.2
size: "33795763"
- id: sha256:da86e6ba6ca197bf6bc5e9d900febd906b133eaa4750e6bed647b0fbe50ed43e
repoDigests: []
repoTags:
- k8s.gcr.io/pause:3.1
size: "315399"
- id: sha256:6fb66cd78abfe9e0735a9a751f2586b7984e0d279e87fa8dd175781de6595627
repoDigests:
- docker.io/kindest/kindnetd@sha256:39494477a3fa001aae716b704a8991f4f62d2ccf1aaaa65692da6c805b18856c
repoTags:
- docker.io/kindest/kindnetd:v20220510-4929dd75
size: "45239873"
- id: sha256:efa50097efbdef5884e5ebaba4da5899e79609b78cd4fe91b365d5d9d3205188
repoDigests:
- docker.io/library/mysql@sha256:8b4b41d530c40d77a3205c53f7ecf1026d735648d9a09777845f305953e5eff5
repoTags:
- docker.io/library/mysql:5.7
size: "162489521"
- id: sha256:ffd4cfbbe753e62419e129ee2ac618beb94e51baa7471df5038b0b516b59cf91
repoDigests: []
repoTags:
- gcr.io/google-containers/addon-resizer:functional-20220630202638-9950
size: "10823156"
- id: sha256:56cc512116c8f894f11ce1995460aef1ee0972d48bc2a3bdb1faaac7c020289c
repoDigests:
- gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e
repoTags:
- gcr.io/k8s-minikube/busybox:1.28.4-glibc
size: "2395207"
- id: sha256:abc0292d7814072d9d74afb2982d9eacbac54c4b62ff926d2e7d0afbf2467d1a
repoDigests: []
repoTags:
- docker.io/library/minikube-local-cache-test:functional-20220630202638-9950
size: "1741"
- id: sha256:a4ca41631cc7ac19ce1be3ebf0314ac5f47af7c711f17066006db82ee3b75b03
repoDigests:
- k8s.gcr.io/coredns/coredns@sha256:5b6ec0d6de9baaf3e92d0f66cd96a25b9edbce8716f5f15dcd1a616b3abd590e
repoTags:
- k8s.gcr.io/coredns/coredns:v1.8.6
size: "13585107"
- id: sha256:5d725196c1f47e72d2bc7069776d5928b1fb1e4adf09c18997733099aa3663ac
repoDigests:
- k8s.gcr.io/kube-scheduler@sha256:b5bc69ac1e173a58a2b3af11ba65057ff2b71de25d0f93ab947e16714a896a1f
repoTags:
- k8s.gcr.io/kube-scheduler:v1.24.2
size: "15488980"

                                                
                                                
--- PASS: TestFunctional/parallel/ImageCommands/ImageListYaml (0.26s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageBuild (3.71s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageBuild
=== PAUSE TestFunctional/parallel/ImageCommands/ImageBuild

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageBuild
functional_test.go:303: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 ssh pgrep buildkitd

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageBuild
functional_test.go:303: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-20220630202638-9950 ssh pgrep buildkitd: exit status 1 (386.101888ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test.go:310: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 image build -t localhost/my-image:functional-20220630202638-9950 testdata/build

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageBuild
functional_test.go:310: (dbg) Done: out/minikube-linux-amd64 -p functional-20220630202638-9950 image build -t localhost/my-image:functional-20220630202638-9950 testdata/build: (2.953459193s)
functional_test.go:318: (dbg) Stderr: out/minikube-linux-amd64 -p functional-20220630202638-9950 image build -t localhost/my-image:functional-20220630202638-9950 testdata/build:
#1 [internal] load .dockerignore
#1 transferring context: 2B done
#1 DONE 0.0s

                                                
                                                
#2 [internal] load build definition from Dockerfile
#2 transferring dockerfile: 97B done
#2 DONE 0.0s

                                                
                                                
#3 [internal] load metadata for gcr.io/k8s-minikube/busybox:latest
#3 DONE 1.1s

                                                
                                                
#4 [internal] load build context
#4 transferring context: 62B done
#4 DONE 0.0s

                                                
                                                
#5 [1/3] FROM gcr.io/k8s-minikube/busybox@sha256:ca5ae90100d50772da31f3b5016209e25ad61972404e2ccd83d44f10dee7e79b
#5 resolve gcr.io/k8s-minikube/busybox@sha256:ca5ae90100d50772da31f3b5016209e25ad61972404e2ccd83d44f10dee7e79b 0.0s done
#5 DONE 0.1s

                                                
                                                
#5 [1/3] FROM gcr.io/k8s-minikube/busybox@sha256:ca5ae90100d50772da31f3b5016209e25ad61972404e2ccd83d44f10dee7e79b
#5 sha256:5cc84ad355aaa64f46ea9c7bbcc319a9d808ab15088a27209c9e70ef86e5a2aa 0B / 772.79kB 0.2s
#5 extracting sha256:5cc84ad355aaa64f46ea9c7bbcc319a9d808ab15088a27209c9e70ef86e5a2aa 0.1s done
#5 DONE 0.4s

                                                
                                                
#6 [2/3] RUN true
#6 DONE 0.7s

                                                
                                                
#7 [3/3] ADD content.txt /
#7 DONE 0.1s

                                                
                                                
#8 exporting to image
#8 exporting layers 0.1s done
#8 exporting manifest sha256:e3fcf7ae4da5948027d91cd3c77a4fb8663e765d62ec9d578e9856c66faffb8e done
#8 exporting config sha256:57fd62a5e2d7365025e3392857803726757cbdcc138913af313358186e7afdc4 done
#8 naming to localhost/my-image:functional-20220630202638-9950 done
#8 DONE 0.1s
functional_test.go:443: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 image ls
2022/06/30 20:29:20 [DEBUG] GET http://127.0.0.1:36195/api/v1/namespaces/kubernetes-dashboard/services/http:kubernetes-dashboard:/proxy/
--- PASS: TestFunctional/parallel/ImageCommands/ImageBuild (3.71s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/Setup (1.44s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/Setup
functional_test.go:337: (dbg) Run:  docker pull gcr.io/google-containers/addon-resizer:1.8.8

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/Setup
functional_test.go:337: (dbg) Done: docker pull gcr.io/google-containers/addon-resizer:1.8.8: (1.398084247s)
functional_test.go:342: (dbg) Run:  docker tag gcr.io/google-containers/addon-resizer:1.8.8 gcr.io/google-containers/addon-resizer:functional-20220630202638-9950
--- PASS: TestFunctional/parallel/ImageCommands/Setup (1.44s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageLoadDaemon (6.23s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageLoadDaemon
functional_test.go:350: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 image load --daemon gcr.io/google-containers/addon-resizer:functional-20220630202638-9950

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageLoadDaemon
functional_test.go:350: (dbg) Done: out/minikube-linux-amd64 -p functional-20220630202638-9950 image load --daemon gcr.io/google-containers/addon-resizer:functional-20220630202638-9950: (5.898365479s)
functional_test.go:443: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageLoadDaemon (6.23s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/any-port (18.5s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/any-port
functional_test_mount_test.go:66: (dbg) daemon: [out/minikube-linux-amd64 mount -p functional-20220630202638-9950 /tmp/TestFunctionalparallelMountCmdany-port1192018086/001:/mount-9p --alsologtostderr -v=1]
functional_test_mount_test.go:100: wrote "test-1656620925860839666" to /tmp/TestFunctionalparallelMountCmdany-port1192018086/001/created-by-test
functional_test_mount_test.go:100: wrote "test-1656620925860839666" to /tmp/TestFunctionalparallelMountCmdany-port1192018086/001/created-by-test-removed-by-pod
functional_test_mount_test.go:100: wrote "test-1656620925860839666" to /tmp/TestFunctionalparallelMountCmdany-port1192018086/001/test-1656620925860839666
functional_test_mount_test.go:108: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:108: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-20220630202638-9950 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (417.92131ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test_mount_test.go:108: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 ssh "findmnt -T /mount-9p | grep 9p"

                                                
                                                
=== CONT  TestFunctional/parallel/MountCmd/any-port
functional_test_mount_test.go:122: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 ssh -- ls -la /mount-9p

                                                
                                                
=== CONT  TestFunctional/parallel/MountCmd/any-port
functional_test_mount_test.go:126: guest mount directory contents
total 2
-rw-r--r-- 1 docker docker 24 Jun 30 20:28 created-by-test
-rw-r--r-- 1 docker docker 24 Jun 30 20:28 created-by-test-removed-by-pod
-rw-r--r-- 1 docker docker 24 Jun 30 20:28 test-1656620925860839666
functional_test_mount_test.go:130: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 ssh cat /mount-9p/test-1656620925860839666
functional_test_mount_test.go:141: (dbg) Run:  kubectl --context functional-20220630202638-9950 replace --force -f testdata/busybox-mount-test.yaml

                                                
                                                
=== CONT  TestFunctional/parallel/MountCmd/any-port
functional_test_mount_test.go:146: (dbg) TestFunctional/parallel/MountCmd/any-port: waiting 4m0s for pods matching "integration-test=busybox-mount" in namespace "default" ...

                                                
                                                
=== CONT  TestFunctional/parallel/MountCmd/any-port
helpers_test.go:342: "busybox-mount" [26c2eb2e-cc92-4997-9e63-f6153cc18eee] Pending

                                                
                                                
=== CONT  TestFunctional/parallel/MountCmd/any-port
helpers_test.go:342: "busybox-mount" [26c2eb2e-cc92-4997-9e63-f6153cc18eee] Pending / Ready:ContainersNotReady (containers with unready status: [mount-munger]) / ContainersReady:ContainersNotReady (containers with unready status: [mount-munger])
E0630 20:28:50.204996    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/addons-20220630202117-9950/client.crt: no such file or directory
E0630 20:28:50.211360    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/addons-20220630202117-9950/client.crt: no such file or directory
E0630 20:28:50.221618    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/addons-20220630202117-9950/client.crt: no such file or directory
E0630 20:28:50.241906    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/addons-20220630202117-9950/client.crt: no such file or directory
E0630 20:28:50.282329    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/addons-20220630202117-9950/client.crt: no such file or directory
E0630 20:28:50.362646    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/addons-20220630202117-9950/client.crt: no such file or directory
E0630 20:28:50.523043    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/addons-20220630202117-9950/client.crt: no such file or directory
E0630 20:28:50.844176    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/addons-20220630202117-9950/client.crt: no such file or directory
E0630 20:28:51.485081    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/addons-20220630202117-9950/client.crt: no such file or directory
E0630 20:28:52.765232    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/addons-20220630202117-9950/client.crt: no such file or directory
E0630 20:28:55.326293    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/addons-20220630202117-9950/client.crt: no such file or directory

                                                
                                                
=== CONT  TestFunctional/parallel/MountCmd/any-port
helpers_test.go:342: "busybox-mount" [26c2eb2e-cc92-4997-9e63-f6153cc18eee] Running

                                                
                                                
=== CONT  TestFunctional/parallel/MountCmd/any-port
helpers_test.go:342: "busybox-mount" [26c2eb2e-cc92-4997-9e63-f6153cc18eee] Running: Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted

                                                
                                                
=== CONT  TestFunctional/parallel/MountCmd/any-port
helpers_test.go:342: "busybox-mount" [26c2eb2e-cc92-4997-9e63-f6153cc18eee] Succeeded: Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
functional_test_mount_test.go:146: (dbg) TestFunctional/parallel/MountCmd/any-port: integration-test=busybox-mount healthy within 14.006215797s
functional_test_mount_test.go:162: (dbg) Run:  kubectl --context functional-20220630202638-9950 logs busybox-mount
functional_test_mount_test.go:174: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 ssh stat /mount-9p/created-by-test

                                                
                                                
=== CONT  TestFunctional/parallel/MountCmd/any-port
functional_test_mount_test.go:174: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 ssh stat /mount-9p/created-by-pod

                                                
                                                
=== CONT  TestFunctional/parallel/MountCmd/any-port
functional_test_mount_test.go:83: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 ssh "sudo umount -f /mount-9p"

                                                
                                                
=== CONT  TestFunctional/parallel/MountCmd/any-port
functional_test_mount_test.go:87: (dbg) stopping [out/minikube-linux-amd64 mount -p functional-20220630202638-9950 /tmp/TestFunctionalparallelMountCmdany-port1192018086/001:/mount-9p --alsologtostderr -v=1] ...
--- PASS: TestFunctional/parallel/MountCmd/any-port (18.50s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageReloadDaemon (6.19s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageReloadDaemon
functional_test.go:360: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 image load --daemon gcr.io/google-containers/addon-resizer:functional-20220630202638-9950

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageReloadDaemon
functional_test.go:360: (dbg) Done: out/minikube-linux-amd64 -p functional-20220630202638-9950 image load --daemon gcr.io/google-containers/addon-resizer:functional-20220630202638-9950: (5.925429622s)
functional_test.go:443: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageReloadDaemon (6.19s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (7.56s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon
functional_test.go:230: (dbg) Run:  docker pull gcr.io/google-containers/addon-resizer:1.8.9

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon
functional_test.go:230: (dbg) Done: docker pull gcr.io/google-containers/addon-resizer:1.8.9: (1.450269436s)
functional_test.go:235: (dbg) Run:  docker tag gcr.io/google-containers/addon-resizer:1.8.9 gcr.io/google-containers/addon-resizer:functional-20220630202638-9950
functional_test.go:240: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 image load --daemon gcr.io/google-containers/addon-resizer:functional-20220630202638-9950

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon
functional_test.go:240: (dbg) Done: out/minikube-linux-amd64 -p functional-20220630202638-9950 image load --daemon gcr.io/google-containers/addon-resizer:functional-20220630202638-9950: (5.81102663s)
functional_test.go:443: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (7.56s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageSaveToFile (1.36s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageSaveToFile
functional_test.go:375: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 image save gcr.io/google-containers/addon-resizer:functional-20220630202638-9950 /home/jenkins/workspace/Docker_Linux_containerd_integration/addon-resizer-save.tar

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageSaveToFile
functional_test.go:375: (dbg) Done: out/minikube-linux-amd64 -p functional-20220630202638-9950 image save gcr.io/google-containers/addon-resizer:functional-20220630202638-9950 /home/jenkins/workspace/Docker_Linux_containerd_integration/addon-resizer-save.tar: (1.360274011s)
--- PASS: TestFunctional/parallel/ImageCommands/ImageSaveToFile (1.36s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/specific-port (2.28s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/specific-port
functional_test_mount_test.go:206: (dbg) daemon: [out/minikube-linux-amd64 mount -p functional-20220630202638-9950 /tmp/TestFunctionalparallelMountCmdspecific-port2884874849/001:/mount-9p --alsologtostderr -v=1 --port 46464]
functional_test_mount_test.go:236: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 ssh "findmnt -T /mount-9p | grep 9p"

                                                
                                                
=== CONT  TestFunctional/parallel/MountCmd/specific-port
functional_test_mount_test.go:236: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-20220630202638-9950 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (424.848567ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **

                                                
                                                
=== CONT  TestFunctional/parallel/MountCmd/specific-port
functional_test_mount_test.go:236: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 ssh "findmnt -T /mount-9p | grep 9p"

                                                
                                                
=== CONT  TestFunctional/parallel/MountCmd/specific-port
functional_test_mount_test.go:250: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 ssh -- ls -la /mount-9p

                                                
                                                
=== CONT  TestFunctional/parallel/MountCmd/specific-port
functional_test_mount_test.go:254: guest mount directory contents
total 0
functional_test_mount_test.go:256: (dbg) stopping [out/minikube-linux-amd64 mount -p functional-20220630202638-9950 /tmp/TestFunctionalparallelMountCmdspecific-port2884874849/001:/mount-9p --alsologtostderr -v=1 --port 46464] ...
functional_test_mount_test.go:257: reading mount text
functional_test_mount_test.go:271: done reading mount text
functional_test_mount_test.go:223: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 ssh "sudo umount -f /mount-9p"

                                                
                                                
=== CONT  TestFunctional/parallel/MountCmd/specific-port
functional_test_mount_test.go:223: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-20220630202638-9950 ssh "sudo umount -f /mount-9p": exit status 1 (472.901581ms)

                                                
                                                
-- stdout --
	umount: /mount-9p: not mounted.

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 32

                                                
                                                
** /stderr **
functional_test_mount_test.go:225: "out/minikube-linux-amd64 -p functional-20220630202638-9950 ssh \"sudo umount -f /mount-9p\"": exit status 1
functional_test_mount_test.go:227: (dbg) stopping [out/minikube-linux-amd64 mount -p functional-20220630202638-9950 /tmp/TestFunctionalparallelMountCmdspecific-port2884874849/001:/mount-9p --alsologtostderr -v=1 --port 46464] ...
--- PASS: TestFunctional/parallel/MountCmd/specific-port (2.28s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageRemove (0.62s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageRemove
functional_test.go:387: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 image rm gcr.io/google-containers/addon-resizer:functional-20220630202638-9950

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageRemove
functional_test.go:443: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageRemove (0.62s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageLoadFromFile (1.36s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageLoadFromFile
functional_test.go:404: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 image load /home/jenkins/workspace/Docker_Linux_containerd_integration/addon-resizer-save.tar

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageLoadFromFile
functional_test.go:404: (dbg) Done: out/minikube-linux-amd64 -p functional-20220630202638-9950 image load /home/jenkins/workspace/Docker_Linux_containerd_integration/addon-resizer-save.tar: (1.062316491s)
functional_test.go:443: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageLoadFromFile (1.36s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageSaveDaemon (1.77s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageSaveDaemon
functional_test.go:414: (dbg) Run:  docker rmi gcr.io/google-containers/addon-resizer:functional-20220630202638-9950
functional_test.go:419: (dbg) Run:  out/minikube-linux-amd64 -p functional-20220630202638-9950 image save --daemon gcr.io/google-containers/addon-resizer:functional-20220630202638-9950

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageSaveDaemon
functional_test.go:419: (dbg) Done: out/minikube-linux-amd64 -p functional-20220630202638-9950 image save --daemon gcr.io/google-containers/addon-resizer:functional-20220630202638-9950: (1.687956997s)
functional_test.go:424: (dbg) Run:  docker image inspect gcr.io/google-containers/addon-resizer:functional-20220630202638-9950
--- PASS: TestFunctional/parallel/ImageCommands/ImageSaveDaemon (1.77s)

                                                
                                    
x
+
TestFunctional/delete_addon-resizer_images (0.1s)

                                                
                                                
=== RUN   TestFunctional/delete_addon-resizer_images
functional_test.go:185: (dbg) Run:  docker rmi -f gcr.io/google-containers/addon-resizer:1.8.8
functional_test.go:185: (dbg) Run:  docker rmi -f gcr.io/google-containers/addon-resizer:functional-20220630202638-9950
--- PASS: TestFunctional/delete_addon-resizer_images (0.10s)

                                                
                                    
x
+
TestFunctional/delete_my-image_image (0.03s)

                                                
                                                
=== RUN   TestFunctional/delete_my-image_image
functional_test.go:193: (dbg) Run:  docker rmi -f localhost/my-image:functional-20220630202638-9950
--- PASS: TestFunctional/delete_my-image_image (0.03s)

                                                
                                    
x
+
TestFunctional/delete_minikube_cached_images (0.03s)

                                                
                                                
=== RUN   TestFunctional/delete_minikube_cached_images
functional_test.go:201: (dbg) Run:  docker rmi -f minikube-local-cache-test:functional-20220630202638-9950
--- PASS: TestFunctional/delete_minikube_cached_images (0.03s)

                                                
                                    
x
+
TestIngressAddonLegacy/StartLegacyK8sCluster (68.89s)

                                                
                                                
=== RUN   TestIngressAddonLegacy/StartLegacyK8sCluster
ingress_addon_legacy_test.go:39: (dbg) Run:  out/minikube-linux-amd64 start -p ingress-addon-legacy-20220630202923-9950 --kubernetes-version=v1.18.20 --memory=4096 --wait=true --alsologtostderr -v=5 --driver=docker  --container-runtime=containerd
E0630 20:29:31.169166    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/addons-20220630202117-9950/client.crt: no such file or directory
E0630 20:30:12.129692    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/addons-20220630202117-9950/client.crt: no such file or directory
ingress_addon_legacy_test.go:39: (dbg) Done: out/minikube-linux-amd64 start -p ingress-addon-legacy-20220630202923-9950 --kubernetes-version=v1.18.20 --memory=4096 --wait=true --alsologtostderr -v=5 --driver=docker  --container-runtime=containerd: (1m8.887889322s)
--- PASS: TestIngressAddonLegacy/StartLegacyK8sCluster (68.89s)

                                                
                                    
x
+
TestIngressAddonLegacy/serial/ValidateIngressAddonActivation (14.14s)

                                                
                                                
=== RUN   TestIngressAddonLegacy/serial/ValidateIngressAddonActivation
ingress_addon_legacy_test.go:70: (dbg) Run:  out/minikube-linux-amd64 -p ingress-addon-legacy-20220630202923-9950 addons enable ingress --alsologtostderr -v=5
ingress_addon_legacy_test.go:70: (dbg) Done: out/minikube-linux-amd64 -p ingress-addon-legacy-20220630202923-9950 addons enable ingress --alsologtostderr -v=5: (14.143995118s)
--- PASS: TestIngressAddonLegacy/serial/ValidateIngressAddonActivation (14.14s)

                                                
                                    
x
+
TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation (0.39s)

                                                
                                                
=== RUN   TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation
ingress_addon_legacy_test.go:79: (dbg) Run:  out/minikube-linux-amd64 -p ingress-addon-legacy-20220630202923-9950 addons enable ingress-dns --alsologtostderr -v=5
--- PASS: TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation (0.39s)

                                                
                                    
x
+
TestIngressAddonLegacy/serial/ValidateIngressAddons (43.69s)

                                                
                                                
=== RUN   TestIngressAddonLegacy/serial/ValidateIngressAddons
addons_test.go:164: (dbg) Run:  kubectl --context ingress-addon-legacy-20220630202923-9950 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s
addons_test.go:164: (dbg) Done: kubectl --context ingress-addon-legacy-20220630202923-9950 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s: (16.85936473s)
addons_test.go:184: (dbg) Run:  kubectl --context ingress-addon-legacy-20220630202923-9950 replace --force -f testdata/nginx-ingress-v1beta1.yaml
addons_test.go:197: (dbg) Run:  kubectl --context ingress-addon-legacy-20220630202923-9950 replace --force -f testdata/nginx-pod-svc.yaml
addons_test.go:202: (dbg) TestIngressAddonLegacy/serial/ValidateIngressAddons: waiting 8m0s for pods matching "run=nginx" in namespace "default" ...
helpers_test.go:342: "nginx" [01618b35-2e68-4f88-93e5-967a001b4e5c] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:342: "nginx" [01618b35-2e68-4f88-93e5-967a001b4e5c] Running
addons_test.go:202: (dbg) TestIngressAddonLegacy/serial/ValidateIngressAddons: run=nginx healthy within 10.005310529s
addons_test.go:214: (dbg) Run:  out/minikube-linux-amd64 -p ingress-addon-legacy-20220630202923-9950 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'"
addons_test.go:238: (dbg) Run:  kubectl --context ingress-addon-legacy-20220630202923-9950 replace --force -f testdata/ingress-dns-example-v1beta1.yaml
addons_test.go:243: (dbg) Run:  out/minikube-linux-amd64 -p ingress-addon-legacy-20220630202923-9950 ip
addons_test.go:249: (dbg) Run:  nslookup hello-john.test 192.168.49.2
addons_test.go:258: (dbg) Run:  out/minikube-linux-amd64 -p ingress-addon-legacy-20220630202923-9950 addons disable ingress-dns --alsologtostderr -v=1
addons_test.go:258: (dbg) Done: out/minikube-linux-amd64 -p ingress-addon-legacy-20220630202923-9950 addons disable ingress-dns --alsologtostderr -v=1: (7.675734249s)
addons_test.go:263: (dbg) Run:  out/minikube-linux-amd64 -p ingress-addon-legacy-20220630202923-9950 addons disable ingress --alsologtostderr -v=1
addons_test.go:263: (dbg) Done: out/minikube-linux-amd64 -p ingress-addon-legacy-20220630202923-9950 addons disable ingress --alsologtostderr -v=1: (7.278360358s)
--- PASS: TestIngressAddonLegacy/serial/ValidateIngressAddons (43.69s)

                                                
                                    
x
+
TestJSONOutput/start/Command (45.89s)

                                                
                                                
=== RUN   TestJSONOutput/start/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-amd64 start -p json-output-20220630203134-9950 --output=json --user=testUser --memory=2200 --wait=true --driver=docker  --container-runtime=containerd
E0630 20:31:34.050555    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/addons-20220630202117-9950/client.crt: no such file or directory
json_output_test.go:63: (dbg) Done: out/minikube-linux-amd64 start -p json-output-20220630203134-9950 --output=json --user=testUser --memory=2200 --wait=true --driver=docker  --container-runtime=containerd: (45.887113437s)
--- PASS: TestJSONOutput/start/Command (45.89s)

                                                
                                    
x
+
TestJSONOutput/start/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/Audit
--- PASS: TestJSONOutput/start/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/start/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/start/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/start/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/start/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/start/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/start/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/Command (0.73s)

                                                
                                                
=== RUN   TestJSONOutput/pause/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-amd64 pause -p json-output-20220630203134-9950 --output=json --user=testUser
--- PASS: TestJSONOutput/pause/Command (0.73s)

                                                
                                    
x
+
TestJSONOutput/pause/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/Audit
--- PASS: TestJSONOutput/pause/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/pause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/pause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/Command (0.67s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-amd64 unpause -p json-output-20220630203134-9950 --output=json --user=testUser
--- PASS: TestJSONOutput/unpause/Command (0.67s)

                                                
                                    
x
+
TestJSONOutput/unpause/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/Audit
--- PASS: TestJSONOutput/unpause/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/unpause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/Command (20.22s)

                                                
                                                
=== RUN   TestJSONOutput/stop/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-amd64 stop -p json-output-20220630203134-9950 --output=json --user=testUser
json_output_test.go:63: (dbg) Done: out/minikube-linux-amd64 stop -p json-output-20220630203134-9950 --output=json --user=testUser: (20.21738291s)
--- PASS: TestJSONOutput/stop/Command (20.22s)

                                                
                                    
x
+
TestJSONOutput/stop/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/Audit
--- PASS: TestJSONOutput/stop/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/stop/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/stop/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestErrorJSONOutput (0.31s)

                                                
                                                
=== RUN   TestErrorJSONOutput
json_output_test.go:149: (dbg) Run:  out/minikube-linux-amd64 start -p json-output-error-20220630203246-9950 --memory=2200 --output=json --wait=true --driver=fail
json_output_test.go:149: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p json-output-error-20220630203246-9950 --memory=2200 --output=json --wait=true --driver=fail: exit status 56 (82.729846ms)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"53956c46-1a28-40cb-8a59-89e83ca3ad7a","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[json-output-error-20220630203246-9950] minikube v1.26.0 on Ubuntu 20.04 (kvm/amd64)","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"0a1b0c37-a12c-4944-af94-5fbeea49d826","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=14420"}}
	{"specversion":"1.0","id":"5d9f1602-3709-452c-b8c3-ff64560eaa83","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
	{"specversion":"1.0","id":"c0699564-4bca-4e12-b3fc-2a25b15e84b8","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig"}}
	{"specversion":"1.0","id":"12345f22-a6ea-488e-94eb-25819163b736","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube"}}
	{"specversion":"1.0","id":"8556f290-2ce1-4cf2-9ec7-d3fd8c0b08bf","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-linux-amd64"}}
	{"specversion":"1.0","id":"fc706c07-e9ef-44e3-af7d-2411d9dc11c6","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"","exitcode":"56","issues":"","message":"The driver 'fail' is not supported on linux/amd64","name":"DRV_UNSUPPORTED_OS","url":""}}

                                                
                                                
-- /stdout --
helpers_test.go:175: Cleaning up "json-output-error-20220630203246-9950" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p json-output-error-20220630203246-9950
--- PASS: TestErrorJSONOutput (0.31s)

                                                
                                    
x
+
TestKicCustomNetwork/create_custom_network (36.03s)

                                                
                                                
=== RUN   TestKicCustomNetwork/create_custom_network
kic_custom_network_test.go:57: (dbg) Run:  out/minikube-linux-amd64 start -p docker-network-20220630203246-9950 --network=
kic_custom_network_test.go:57: (dbg) Done: out/minikube-linux-amd64 start -p docker-network-20220630203246-9950 --network=: (33.647036309s)
kic_custom_network_test.go:122: (dbg) Run:  docker network ls --format {{.Name}}
helpers_test.go:175: Cleaning up "docker-network-20220630203246-9950" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p docker-network-20220630203246-9950
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p docker-network-20220630203246-9950: (2.350407621s)
--- PASS: TestKicCustomNetwork/create_custom_network (36.03s)

                                                
                                    
x
+
TestKicCustomNetwork/use_default_bridge_network (30.48s)

                                                
                                                
=== RUN   TestKicCustomNetwork/use_default_bridge_network
kic_custom_network_test.go:57: (dbg) Run:  out/minikube-linux-amd64 start -p docker-network-20220630203322-9950 --network=bridge
E0630 20:33:30.280611    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/functional-20220630202638-9950/client.crt: no such file or directory
E0630 20:33:30.285871    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/functional-20220630202638-9950/client.crt: no such file or directory
E0630 20:33:30.296129    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/functional-20220630202638-9950/client.crt: no such file or directory
E0630 20:33:30.316470    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/functional-20220630202638-9950/client.crt: no such file or directory
E0630 20:33:30.356770    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/functional-20220630202638-9950/client.crt: no such file or directory
E0630 20:33:30.437145    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/functional-20220630202638-9950/client.crt: no such file or directory
E0630 20:33:30.597563    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/functional-20220630202638-9950/client.crt: no such file or directory
E0630 20:33:30.918135    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/functional-20220630202638-9950/client.crt: no such file or directory
E0630 20:33:31.558979    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/functional-20220630202638-9950/client.crt: no such file or directory
E0630 20:33:32.839389    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/functional-20220630202638-9950/client.crt: no such file or directory
E0630 20:33:35.399796    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/functional-20220630202638-9950/client.crt: no such file or directory
E0630 20:33:40.520421    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/functional-20220630202638-9950/client.crt: no such file or directory
E0630 20:33:50.204737    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/addons-20220630202117-9950/client.crt: no such file or directory
E0630 20:33:50.761627    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/functional-20220630202638-9950/client.crt: no such file or directory
kic_custom_network_test.go:57: (dbg) Done: out/minikube-linux-amd64 start -p docker-network-20220630203322-9950 --network=bridge: (28.386201358s)
kic_custom_network_test.go:122: (dbg) Run:  docker network ls --format {{.Name}}
helpers_test.go:175: Cleaning up "docker-network-20220630203322-9950" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p docker-network-20220630203322-9950
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p docker-network-20220630203322-9950: (2.06541625s)
--- PASS: TestKicCustomNetwork/use_default_bridge_network (30.48s)

                                                
                                    
x
+
TestKicExistingNetwork (31.05s)

                                                
                                                
=== RUN   TestKicExistingNetwork
kic_custom_network_test.go:122: (dbg) Run:  docker network ls --format {{.Name}}
kic_custom_network_test.go:93: (dbg) Run:  out/minikube-linux-amd64 start -p existing-network-20220630203353-9950 --network=existing-network
E0630 20:34:11.242792    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/functional-20220630202638-9950/client.crt: no such file or directory
E0630 20:34:17.890960    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/addons-20220630202117-9950/client.crt: no such file or directory
kic_custom_network_test.go:93: (dbg) Done: out/minikube-linux-amd64 start -p existing-network-20220630203353-9950 --network=existing-network: (28.616928977s)
helpers_test.go:175: Cleaning up "existing-network-20220630203353-9950" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p existing-network-20220630203353-9950
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p existing-network-20220630203353-9950: (2.202243361s)
--- PASS: TestKicExistingNetwork (31.05s)

                                                
                                    
x
+
TestKicCustomSubnet (30.76s)

                                                
                                                
=== RUN   TestKicCustomSubnet
kic_custom_network_test.go:112: (dbg) Run:  out/minikube-linux-amd64 start -p custom-subnet-20220630203424-9950 --subnet=192.168.60.0/24
E0630 20:34:52.203842    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/functional-20220630202638-9950/client.crt: no such file or directory
kic_custom_network_test.go:112: (dbg) Done: out/minikube-linux-amd64 start -p custom-subnet-20220630203424-9950 --subnet=192.168.60.0/24: (28.463731423s)
kic_custom_network_test.go:133: (dbg) Run:  docker network inspect custom-subnet-20220630203424-9950 --format "{{(index .IPAM.Config 0).Subnet}}"
helpers_test.go:175: Cleaning up "custom-subnet-20220630203424-9950" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p custom-subnet-20220630203424-9950
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p custom-subnet-20220630203424-9950: (2.260483998s)
--- PASS: TestKicCustomSubnet (30.76s)

                                                
                                    
x
+
TestMainNoArgs (0.07s)

                                                
                                                
=== RUN   TestMainNoArgs
main_test.go:68: (dbg) Run:  out/minikube-linux-amd64
--- PASS: TestMainNoArgs (0.07s)

                                                
                                    
x
+
TestMinikubeProfile (56.94s)

                                                
                                                
=== RUN   TestMinikubeProfile
minikube_profile_test.go:44: (dbg) Run:  out/minikube-linux-amd64 start -p first-20220630203455-9950 --driver=docker  --container-runtime=containerd
minikube_profile_test.go:44: (dbg) Done: out/minikube-linux-amd64 start -p first-20220630203455-9950 --driver=docker  --container-runtime=containerd: (26.080617206s)
minikube_profile_test.go:44: (dbg) Run:  out/minikube-linux-amd64 start -p second-20220630203455-9950 --driver=docker  --container-runtime=containerd
minikube_profile_test.go:44: (dbg) Done: out/minikube-linux-amd64 start -p second-20220630203455-9950 --driver=docker  --container-runtime=containerd: (24.778711225s)
minikube_profile_test.go:51: (dbg) Run:  out/minikube-linux-amd64 profile first-20220630203455-9950
minikube_profile_test.go:55: (dbg) Run:  out/minikube-linux-amd64 profile list -ojson
minikube_profile_test.go:51: (dbg) Run:  out/minikube-linux-amd64 profile second-20220630203455-9950
minikube_profile_test.go:55: (dbg) Run:  out/minikube-linux-amd64 profile list -ojson
E0630 20:35:47.268961    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/ingress-addon-legacy-20220630202923-9950/client.crt: no such file or directory
E0630 20:35:47.274237    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/ingress-addon-legacy-20220630202923-9950/client.crt: no such file or directory
E0630 20:35:47.284498    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/ingress-addon-legacy-20220630202923-9950/client.crt: no such file or directory
E0630 20:35:47.304757    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/ingress-addon-legacy-20220630202923-9950/client.crt: no such file or directory
E0630 20:35:47.345023    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/ingress-addon-legacy-20220630202923-9950/client.crt: no such file or directory
E0630 20:35:47.425387    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/ingress-addon-legacy-20220630202923-9950/client.crt: no such file or directory
helpers_test.go:175: Cleaning up "second-20220630203455-9950" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p second-20220630203455-9950
E0630 20:35:47.586063    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/ingress-addon-legacy-20220630202923-9950/client.crt: no such file or directory
E0630 20:35:47.906820    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/ingress-addon-legacy-20220630202923-9950/client.crt: no such file or directory
E0630 20:35:48.547753    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/ingress-addon-legacy-20220630202923-9950/client.crt: no such file or directory
E0630 20:35:49.828196    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/ingress-addon-legacy-20220630202923-9950/client.crt: no such file or directory
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p second-20220630203455-9950: (2.338332532s)
helpers_test.go:175: Cleaning up "first-20220630203455-9950" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p first-20220630203455-9950
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p first-20220630203455-9950: (2.389400458s)
--- PASS: TestMinikubeProfile (56.94s)

                                                
                                    
x
+
TestMountStart/serial/StartWithMountFirst (5.15s)

                                                
                                                
=== RUN   TestMountStart/serial/StartWithMountFirst
mount_start_test.go:98: (dbg) Run:  out/minikube-linux-amd64 start -p mount-start-1-20220630203552-9950 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=containerd
E0630 20:35:52.389082    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/ingress-addon-legacy-20220630202923-9950/client.crt: no such file or directory
mount_start_test.go:98: (dbg) Done: out/minikube-linux-amd64 start -p mount-start-1-20220630203552-9950 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=containerd: (4.151008789s)
--- PASS: TestMountStart/serial/StartWithMountFirst (5.15s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountFirst (0.36s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountFirst
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-amd64 -p mount-start-1-20220630203552-9950 ssh -- ls /minikube-host
E0630 20:35:57.509433    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/ingress-addon-legacy-20220630202923-9950/client.crt: no such file or directory
--- PASS: TestMountStart/serial/VerifyMountFirst (0.36s)

                                                
                                    
x
+
TestMountStart/serial/StartWithMountSecond (5.11s)

                                                
                                                
=== RUN   TestMountStart/serial/StartWithMountSecond
mount_start_test.go:98: (dbg) Run:  out/minikube-linux-amd64 start -p mount-start-2-20220630203552-9950 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46465 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=containerd
mount_start_test.go:98: (dbg) Done: out/minikube-linux-amd64 start -p mount-start-2-20220630203552-9950 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46465 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=containerd: (4.11057015s)
--- PASS: TestMountStart/serial/StartWithMountSecond (5.11s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountSecond (0.37s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountSecond
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-amd64 -p mount-start-2-20220630203552-9950 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountSecond (0.37s)

                                                
                                    
x
+
TestMountStart/serial/DeleteFirst (1.86s)

                                                
                                                
=== RUN   TestMountStart/serial/DeleteFirst
pause_test.go:132: (dbg) Run:  out/minikube-linux-amd64 delete -p mount-start-1-20220630203552-9950 --alsologtostderr -v=5
pause_test.go:132: (dbg) Done: out/minikube-linux-amd64 delete -p mount-start-1-20220630203552-9950 --alsologtostderr -v=5: (1.863557463s)
--- PASS: TestMountStart/serial/DeleteFirst (1.86s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountPostDelete (0.37s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountPostDelete
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-amd64 -p mount-start-2-20220630203552-9950 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountPostDelete (0.37s)

                                                
                                    
x
+
TestMountStart/serial/Stop (1.29s)

                                                
                                                
=== RUN   TestMountStart/serial/Stop
mount_start_test.go:155: (dbg) Run:  out/minikube-linux-amd64 stop -p mount-start-2-20220630203552-9950
mount_start_test.go:155: (dbg) Done: out/minikube-linux-amd64 stop -p mount-start-2-20220630203552-9950: (1.285075193s)
--- PASS: TestMountStart/serial/Stop (1.29s)

                                                
                                    
x
+
TestMountStart/serial/RestartStopped (6.84s)

                                                
                                                
=== RUN   TestMountStart/serial/RestartStopped
mount_start_test.go:166: (dbg) Run:  out/minikube-linux-amd64 start -p mount-start-2-20220630203552-9950
E0630 20:36:07.750234    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/ingress-addon-legacy-20220630202923-9950/client.crt: no such file or directory
mount_start_test.go:166: (dbg) Done: out/minikube-linux-amd64 start -p mount-start-2-20220630203552-9950: (5.844000635s)
--- PASS: TestMountStart/serial/RestartStopped (6.84s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountPostStop (0.38s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountPostStop
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-amd64 -p mount-start-2-20220630203552-9950 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountPostStop (0.38s)

                                                
                                    
x
+
TestMultiNode/serial/FreshStart2Nodes (82.79s)

                                                
                                                
=== RUN   TestMultiNode/serial/FreshStart2Nodes
multinode_test.go:83: (dbg) Run:  out/minikube-linux-amd64 start -p multinode-20220630203616-9950 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=docker  --container-runtime=containerd
E0630 20:36:28.231109    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/ingress-addon-legacy-20220630202923-9950/client.crt: no such file or directory
E0630 20:37:09.191852    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/ingress-addon-legacy-20220630202923-9950/client.crt: no such file or directory
multinode_test.go:83: (dbg) Done: out/minikube-linux-amd64 start -p multinode-20220630203616-9950 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=docker  --container-runtime=containerd: (1m22.182127238s)
multinode_test.go:89: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20220630203616-9950 status --alsologtostderr
--- PASS: TestMultiNode/serial/FreshStart2Nodes (82.79s)

                                                
                                    
x
+
TestMultiNode/serial/DeployApp2Nodes (4.17s)

                                                
                                                
=== RUN   TestMultiNode/serial/DeployApp2Nodes
multinode_test.go:479: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20220630203616-9950 -- apply -f ./testdata/multinodes/multinode-pod-dns-test.yaml
multinode_test.go:484: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20220630203616-9950 -- rollout status deployment/busybox
multinode_test.go:484: (dbg) Done: out/minikube-linux-amd64 kubectl -p multinode-20220630203616-9950 -- rollout status deployment/busybox: (2.33367483s)
multinode_test.go:490: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20220630203616-9950 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:502: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20220630203616-9950 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:510: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20220630203616-9950 -- exec busybox-d46db594c-kbfrc -- nslookup kubernetes.io
multinode_test.go:510: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20220630203616-9950 -- exec busybox-d46db594c-rtmvx -- nslookup kubernetes.io
multinode_test.go:520: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20220630203616-9950 -- exec busybox-d46db594c-kbfrc -- nslookup kubernetes.default
multinode_test.go:520: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20220630203616-9950 -- exec busybox-d46db594c-rtmvx -- nslookup kubernetes.default
multinode_test.go:528: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20220630203616-9950 -- exec busybox-d46db594c-kbfrc -- nslookup kubernetes.default.svc.cluster.local
multinode_test.go:528: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20220630203616-9950 -- exec busybox-d46db594c-rtmvx -- nslookup kubernetes.default.svc.cluster.local
--- PASS: TestMultiNode/serial/DeployApp2Nodes (4.17s)

                                                
                                    
x
+
TestMultiNode/serial/PingHostFrom2Pods (0.91s)

                                                
                                                
=== RUN   TestMultiNode/serial/PingHostFrom2Pods
multinode_test.go:538: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20220630203616-9950 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:546: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20220630203616-9950 -- exec busybox-d46db594c-kbfrc -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
multinode_test.go:554: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20220630203616-9950 -- exec busybox-d46db594c-kbfrc -- sh -c "ping -c 1 192.168.58.1"
multinode_test.go:546: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20220630203616-9950 -- exec busybox-d46db594c-rtmvx -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
multinode_test.go:554: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20220630203616-9950 -- exec busybox-d46db594c-rtmvx -- sh -c "ping -c 1 192.168.58.1"
--- PASS: TestMultiNode/serial/PingHostFrom2Pods (0.91s)

                                                
                                    
x
+
TestMultiNode/serial/AddNode (31.82s)

                                                
                                                
=== RUN   TestMultiNode/serial/AddNode
multinode_test.go:108: (dbg) Run:  out/minikube-linux-amd64 node add -p multinode-20220630203616-9950 -v 3 --alsologtostderr
multinode_test.go:108: (dbg) Done: out/minikube-linux-amd64 node add -p multinode-20220630203616-9950 -v 3 --alsologtostderr: (31.02188791s)
multinode_test.go:114: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20220630203616-9950 status --alsologtostderr
--- PASS: TestMultiNode/serial/AddNode (31.82s)

                                                
                                    
x
+
TestMultiNode/serial/ProfileList (0.4s)

                                                
                                                
=== RUN   TestMultiNode/serial/ProfileList
multinode_test.go:130: (dbg) Run:  out/minikube-linux-amd64 profile list --output json
--- PASS: TestMultiNode/serial/ProfileList (0.40s)

                                                
                                    
x
+
TestMultiNode/serial/CopyFile (13s)

                                                
                                                
=== RUN   TestMultiNode/serial/CopyFile
multinode_test.go:171: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20220630203616-9950 status --output json --alsologtostderr
helpers_test.go:554: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20220630203616-9950 cp testdata/cp-test.txt multinode-20220630203616-9950:/home/docker/cp-test.txt
helpers_test.go:532: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20220630203616-9950 ssh -n multinode-20220630203616-9950 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:554: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20220630203616-9950 cp multinode-20220630203616-9950:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile1514142239/001/cp-test_multinode-20220630203616-9950.txt
helpers_test.go:532: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20220630203616-9950 ssh -n multinode-20220630203616-9950 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:554: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20220630203616-9950 cp multinode-20220630203616-9950:/home/docker/cp-test.txt multinode-20220630203616-9950-m02:/home/docker/cp-test_multinode-20220630203616-9950_multinode-20220630203616-9950-m02.txt
helpers_test.go:532: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20220630203616-9950 ssh -n multinode-20220630203616-9950 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:532: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20220630203616-9950 ssh -n multinode-20220630203616-9950-m02 "sudo cat /home/docker/cp-test_multinode-20220630203616-9950_multinode-20220630203616-9950-m02.txt"
helpers_test.go:554: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20220630203616-9950 cp multinode-20220630203616-9950:/home/docker/cp-test.txt multinode-20220630203616-9950-m03:/home/docker/cp-test_multinode-20220630203616-9950_multinode-20220630203616-9950-m03.txt
helpers_test.go:532: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20220630203616-9950 ssh -n multinode-20220630203616-9950 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:532: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20220630203616-9950 ssh -n multinode-20220630203616-9950-m03 "sudo cat /home/docker/cp-test_multinode-20220630203616-9950_multinode-20220630203616-9950-m03.txt"
helpers_test.go:554: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20220630203616-9950 cp testdata/cp-test.txt multinode-20220630203616-9950-m02:/home/docker/cp-test.txt
helpers_test.go:532: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20220630203616-9950 ssh -n multinode-20220630203616-9950-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:554: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20220630203616-9950 cp multinode-20220630203616-9950-m02:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile1514142239/001/cp-test_multinode-20220630203616-9950-m02.txt
helpers_test.go:532: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20220630203616-9950 ssh -n multinode-20220630203616-9950-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:554: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20220630203616-9950 cp multinode-20220630203616-9950-m02:/home/docker/cp-test.txt multinode-20220630203616-9950:/home/docker/cp-test_multinode-20220630203616-9950-m02_multinode-20220630203616-9950.txt
helpers_test.go:532: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20220630203616-9950 ssh -n multinode-20220630203616-9950-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:532: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20220630203616-9950 ssh -n multinode-20220630203616-9950 "sudo cat /home/docker/cp-test_multinode-20220630203616-9950-m02_multinode-20220630203616-9950.txt"
helpers_test.go:554: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20220630203616-9950 cp multinode-20220630203616-9950-m02:/home/docker/cp-test.txt multinode-20220630203616-9950-m03:/home/docker/cp-test_multinode-20220630203616-9950-m02_multinode-20220630203616-9950-m03.txt
helpers_test.go:532: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20220630203616-9950 ssh -n multinode-20220630203616-9950-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:532: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20220630203616-9950 ssh -n multinode-20220630203616-9950-m03 "sudo cat /home/docker/cp-test_multinode-20220630203616-9950-m02_multinode-20220630203616-9950-m03.txt"
helpers_test.go:554: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20220630203616-9950 cp testdata/cp-test.txt multinode-20220630203616-9950-m03:/home/docker/cp-test.txt
helpers_test.go:532: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20220630203616-9950 ssh -n multinode-20220630203616-9950-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:554: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20220630203616-9950 cp multinode-20220630203616-9950-m03:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile1514142239/001/cp-test_multinode-20220630203616-9950-m03.txt
helpers_test.go:532: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20220630203616-9950 ssh -n multinode-20220630203616-9950-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:554: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20220630203616-9950 cp multinode-20220630203616-9950-m03:/home/docker/cp-test.txt multinode-20220630203616-9950:/home/docker/cp-test_multinode-20220630203616-9950-m03_multinode-20220630203616-9950.txt
helpers_test.go:532: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20220630203616-9950 ssh -n multinode-20220630203616-9950-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:532: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20220630203616-9950 ssh -n multinode-20220630203616-9950 "sudo cat /home/docker/cp-test_multinode-20220630203616-9950-m03_multinode-20220630203616-9950.txt"
helpers_test.go:554: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20220630203616-9950 cp multinode-20220630203616-9950-m03:/home/docker/cp-test.txt multinode-20220630203616-9950-m02:/home/docker/cp-test_multinode-20220630203616-9950-m03_multinode-20220630203616-9950-m02.txt
helpers_test.go:532: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20220630203616-9950 ssh -n multinode-20220630203616-9950-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:532: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20220630203616-9950 ssh -n multinode-20220630203616-9950-m02 "sudo cat /home/docker/cp-test_multinode-20220630203616-9950-m03_multinode-20220630203616-9950-m02.txt"
--- PASS: TestMultiNode/serial/CopyFile (13.00s)

                                                
                                    
x
+
TestMultiNode/serial/StopNode (2.52s)

                                                
                                                
=== RUN   TestMultiNode/serial/StopNode
multinode_test.go:208: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20220630203616-9950 node stop m03
E0630 20:38:30.280889    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/functional-20220630202638-9950/client.crt: no such file or directory
multinode_test.go:208: (dbg) Done: out/minikube-linux-amd64 -p multinode-20220630203616-9950 node stop m03: (1.281980278s)
multinode_test.go:214: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20220630203616-9950 status
multinode_test.go:214: (dbg) Non-zero exit: out/minikube-linux-amd64 -p multinode-20220630203616-9950 status: exit status 7 (624.636408ms)

                                                
                                                
-- stdout --
	multinode-20220630203616-9950
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	multinode-20220630203616-9950-m02
	type: Worker
	host: Running
	kubelet: Running
	
	multinode-20220630203616-9950-m03
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
multinode_test.go:221: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20220630203616-9950 status --alsologtostderr
E0630 20:38:31.112855    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/ingress-addon-legacy-20220630202923-9950/client.crt: no such file or directory
multinode_test.go:221: (dbg) Non-zero exit: out/minikube-linux-amd64 -p multinode-20220630203616-9950 status --alsologtostderr: exit status 7 (617.273694ms)

                                                
                                                
-- stdout --
	multinode-20220630203616-9950
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	multinode-20220630203616-9950-m02
	type: Worker
	host: Running
	kubelet: Running
	
	multinode-20220630203616-9950-m03
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0630 20:38:31.140172  101413 out.go:296] Setting OutFile to fd 1 ...
	I0630 20:38:31.140307  101413 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 20:38:31.140317  101413 out.go:309] Setting ErrFile to fd 2...
	I0630 20:38:31.140322  101413 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 20:38:31.140426  101413 root.go:329] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/bin
	I0630 20:38:31.140591  101413 out.go:303] Setting JSON to false
	I0630 20:38:31.140608  101413 mustload.go:65] Loading cluster: multinode-20220630203616-9950
	I0630 20:38:31.140912  101413 config.go:178] Loaded profile config "multinode-20220630203616-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 20:38:31.140928  101413 status.go:253] checking status of multinode-20220630203616-9950 ...
	I0630 20:38:31.141352  101413 cli_runner.go:164] Run: docker container inspect multinode-20220630203616-9950 --format={{.State.Status}}
	I0630 20:38:31.174327  101413 status.go:328] multinode-20220630203616-9950 host status = "Running" (err=<nil>)
	I0630 20:38:31.174366  101413 host.go:66] Checking if "multinode-20220630203616-9950" exists ...
	I0630 20:38:31.174619  101413 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-20220630203616-9950
	I0630 20:38:31.208761  101413 host.go:66] Checking if "multinode-20220630203616-9950" exists ...
	I0630 20:38:31.209091  101413 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0630 20:38:31.209146  101413 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-20220630203616-9950
	I0630 20:38:31.242263  101413 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49227 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/multinode-20220630203616-9950/id_rsa Username:docker}
	I0630 20:38:31.325583  101413 ssh_runner.go:195] Run: systemctl --version
	I0630 20:38:31.329114  101413 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 20:38:31.337709  101413 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0630 20:38:31.442130  101413 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:6 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:43 OomKillDisable:true NGoroutines:44 SystemTime:2022-06-30 20:38:31.36793787 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1012-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexServe
rAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662451712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-8 Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] ClientI
nfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
	I0630 20:38:31.442683  101413 kubeconfig.go:92] found "multinode-20220630203616-9950" server: "https://192.168.58.2:8443"
	I0630 20:38:31.442713  101413 api_server.go:165] Checking apiserver status ...
	I0630 20:38:31.442744  101413 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0630 20:38:31.451506  101413 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1230/cgroup
	I0630 20:38:31.458445  101413 api_server.go:181] apiserver freezer: "7:freezer:/docker/7768f79c8b11bf1433a7f5c532ff31bc99576977b951433a1f2144db4264f37c/kubepods/burstable/pod558f8ff08571f09f37bcc0b0787166fc/3518f550ced19a6818052500ad3c3aa8b951cab871efe180f4678f28ce331ca8"
	I0630 20:38:31.458498  101413 ssh_runner.go:195] Run: sudo cat /sys/fs/cgroup/freezer/docker/7768f79c8b11bf1433a7f5c532ff31bc99576977b951433a1f2144db4264f37c/kubepods/burstable/pod558f8ff08571f09f37bcc0b0787166fc/3518f550ced19a6818052500ad3c3aa8b951cab871efe180f4678f28ce331ca8/freezer.state
	I0630 20:38:31.464447  101413 api_server.go:203] freezer state: "THAWED"
	I0630 20:38:31.464477  101413 api_server.go:240] Checking apiserver healthz at https://192.168.58.2:8443/healthz ...
	I0630 20:38:31.469405  101413 api_server.go:266] https://192.168.58.2:8443/healthz returned 200:
	ok
	I0630 20:38:31.469428  101413 status.go:419] multinode-20220630203616-9950 apiserver status = Running (err=<nil>)
	I0630 20:38:31.469439  101413 status.go:255] multinode-20220630203616-9950 status: &{Name:multinode-20220630203616-9950 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0630 20:38:31.469454  101413 status.go:253] checking status of multinode-20220630203616-9950-m02 ...
	I0630 20:38:31.469695  101413 cli_runner.go:164] Run: docker container inspect multinode-20220630203616-9950-m02 --format={{.State.Status}}
	I0630 20:38:31.502585  101413 status.go:328] multinode-20220630203616-9950-m02 host status = "Running" (err=<nil>)
	I0630 20:38:31.502611  101413 host.go:66] Checking if "multinode-20220630203616-9950-m02" exists ...
	I0630 20:38:31.502898  101413 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-20220630203616-9950-m02
	I0630 20:38:31.536168  101413 host.go:66] Checking if "multinode-20220630203616-9950-m02" exists ...
	I0630 20:38:31.536424  101413 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0630 20:38:31.536459  101413 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-20220630203616-9950-m02
	I0630 20:38:31.569608  101413 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49232 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/machines/multinode-20220630203616-9950-m02/id_rsa Username:docker}
	I0630 20:38:31.649918  101413 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0630 20:38:31.658561  101413 status.go:255] multinode-20220630203616-9950-m02 status: &{Name:multinode-20220630203616-9950-m02 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}
	I0630 20:38:31.658607  101413 status.go:253] checking status of multinode-20220630203616-9950-m03 ...
	I0630 20:38:31.658849  101413 cli_runner.go:164] Run: docker container inspect multinode-20220630203616-9950-m03 --format={{.State.Status}}
	I0630 20:38:31.692406  101413 status.go:328] multinode-20220630203616-9950-m03 host status = "Stopped" (err=<nil>)
	I0630 20:38:31.692430  101413 status.go:341] host is not running, skipping remaining checks
	I0630 20:38:31.692441  101413 status.go:255] multinode-20220630203616-9950-m03 status: &{Name:multinode-20220630203616-9950-m03 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
--- PASS: TestMultiNode/serial/StopNode (2.52s)

                                                
                                    
x
+
TestMultiNode/serial/StartAfterStop (31.21s)

                                                
                                                
=== RUN   TestMultiNode/serial/StartAfterStop
multinode_test.go:242: (dbg) Run:  docker version -f {{.Server.Version}}
multinode_test.go:252: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20220630203616-9950 node start m03 --alsologtostderr
E0630 20:38:50.205089    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/addons-20220630202117-9950/client.crt: no such file or directory
E0630 20:38:57.965177    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/functional-20220630202638-9950/client.crt: no such file or directory
multinode_test.go:252: (dbg) Done: out/minikube-linux-amd64 -p multinode-20220630203616-9950 node start m03 --alsologtostderr: (30.32627286s)
multinode_test.go:259: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20220630203616-9950 status
multinode_test.go:273: (dbg) Run:  kubectl get nodes
--- PASS: TestMultiNode/serial/StartAfterStop (31.21s)

                                                
                                    
x
+
TestMultiNode/serial/RestartKeepsNodes (172.26s)

                                                
                                                
=== RUN   TestMultiNode/serial/RestartKeepsNodes
multinode_test.go:281: (dbg) Run:  out/minikube-linux-amd64 node list -p multinode-20220630203616-9950
multinode_test.go:288: (dbg) Run:  out/minikube-linux-amd64 stop -p multinode-20220630203616-9950
multinode_test.go:288: (dbg) Done: out/minikube-linux-amd64 stop -p multinode-20220630203616-9950: (41.319719639s)
multinode_test.go:293: (dbg) Run:  out/minikube-linux-amd64 start -p multinode-20220630203616-9950 --wait=true -v=8 --alsologtostderr
E0630 20:40:47.268573    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/ingress-addon-legacy-20220630202923-9950/client.crt: no such file or directory
E0630 20:41:14.953198    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/ingress-addon-legacy-20220630202923-9950/client.crt: no such file or directory
multinode_test.go:293: (dbg) Done: out/minikube-linux-amd64 start -p multinode-20220630203616-9950 --wait=true -v=8 --alsologtostderr: (2m10.808733259s)
multinode_test.go:298: (dbg) Run:  out/minikube-linux-amd64 node list -p multinode-20220630203616-9950
--- PASS: TestMultiNode/serial/RestartKeepsNodes (172.26s)

                                                
                                    
x
+
TestMultiNode/serial/DeleteNode (5.21s)

                                                
                                                
=== RUN   TestMultiNode/serial/DeleteNode
multinode_test.go:392: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20220630203616-9950 node delete m03
multinode_test.go:392: (dbg) Done: out/minikube-linux-amd64 -p multinode-20220630203616-9950 node delete m03: (4.477524727s)
multinode_test.go:398: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20220630203616-9950 status --alsologtostderr
multinode_test.go:412: (dbg) Run:  docker volume ls
multinode_test.go:422: (dbg) Run:  kubectl get nodes
multinode_test.go:430: (dbg) Run:  kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiNode/serial/DeleteNode (5.21s)

                                                
                                    
x
+
TestMultiNode/serial/StopMultiNode (40.4s)

                                                
                                                
=== RUN   TestMultiNode/serial/StopMultiNode
multinode_test.go:312: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20220630203616-9950 stop
multinode_test.go:312: (dbg) Done: out/minikube-linux-amd64 -p multinode-20220630203616-9950 stop: (40.135753133s)
multinode_test.go:318: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20220630203616-9950 status
multinode_test.go:318: (dbg) Non-zero exit: out/minikube-linux-amd64 -p multinode-20220630203616-9950 status: exit status 7 (130.779205ms)

                                                
                                                
-- stdout --
	multinode-20220630203616-9950
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	multinode-20220630203616-9950-m02
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
multinode_test.go:325: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20220630203616-9950 status --alsologtostderr
multinode_test.go:325: (dbg) Non-zero exit: out/minikube-linux-amd64 -p multinode-20220630203616-9950 status --alsologtostderr: exit status 7 (129.541776ms)

                                                
                                                
-- stdout --
	multinode-20220630203616-9950
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	multinode-20220630203616-9950-m02
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0630 20:42:40.708527  112137 out.go:296] Setting OutFile to fd 1 ...
	I0630 20:42:40.708642  112137 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 20:42:40.708651  112137 out.go:309] Setting ErrFile to fd 2...
	I0630 20:42:40.708656  112137 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 20:42:40.708759  112137 root.go:329] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/bin
	I0630 20:42:40.708928  112137 out.go:303] Setting JSON to false
	I0630 20:42:40.708946  112137 mustload.go:65] Loading cluster: multinode-20220630203616-9950
	I0630 20:42:40.709295  112137 config.go:178] Loaded profile config "multinode-20220630203616-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 20:42:40.709310  112137 status.go:253] checking status of multinode-20220630203616-9950 ...
	I0630 20:42:40.709675  112137 cli_runner.go:164] Run: docker container inspect multinode-20220630203616-9950 --format={{.State.Status}}
	I0630 20:42:40.742523  112137 status.go:328] multinode-20220630203616-9950 host status = "Stopped" (err=<nil>)
	I0630 20:42:40.742548  112137 status.go:341] host is not running, skipping remaining checks
	I0630 20:42:40.742556  112137 status.go:255] multinode-20220630203616-9950 status: &{Name:multinode-20220630203616-9950 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0630 20:42:40.742586  112137 status.go:253] checking status of multinode-20220630203616-9950-m02 ...
	I0630 20:42:40.742873  112137 cli_runner.go:164] Run: docker container inspect multinode-20220630203616-9950-m02 --format={{.State.Status}}
	I0630 20:42:40.774623  112137 status.go:328] multinode-20220630203616-9950-m02 host status = "Stopped" (err=<nil>)
	I0630 20:42:40.774651  112137 status.go:341] host is not running, skipping remaining checks
	I0630 20:42:40.774658  112137 status.go:255] multinode-20220630203616-9950-m02 status: &{Name:multinode-20220630203616-9950-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
--- PASS: TestMultiNode/serial/StopMultiNode (40.40s)

                                                
                                    
x
+
TestMultiNode/serial/RestartMultiNode (99.23s)

                                                
                                                
=== RUN   TestMultiNode/serial/RestartMultiNode
multinode_test.go:342: (dbg) Run:  docker version -f {{.Server.Version}}
multinode_test.go:352: (dbg) Run:  out/minikube-linux-amd64 start -p multinode-20220630203616-9950 --wait=true -v=8 --alsologtostderr --driver=docker  --container-runtime=containerd
E0630 20:43:30.280359    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/functional-20220630202638-9950/client.crt: no such file or directory
E0630 20:43:50.204437    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/addons-20220630202117-9950/client.crt: no such file or directory
multinode_test.go:352: (dbg) Done: out/minikube-linux-amd64 start -p multinode-20220630203616-9950 --wait=true -v=8 --alsologtostderr --driver=docker  --container-runtime=containerd: (1m38.497470175s)
multinode_test.go:358: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20220630203616-9950 status --alsologtostderr
multinode_test.go:372: (dbg) Run:  kubectl get nodes
multinode_test.go:380: (dbg) Run:  kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiNode/serial/RestartMultiNode (99.23s)

                                                
                                    
x
+
TestMultiNode/serial/ValidateNameConflict (38.34s)

                                                
                                                
=== RUN   TestMultiNode/serial/ValidateNameConflict
multinode_test.go:441: (dbg) Run:  out/minikube-linux-amd64 node list -p multinode-20220630203616-9950
multinode_test.go:450: (dbg) Run:  out/minikube-linux-amd64 start -p multinode-20220630203616-9950-m02 --driver=docker  --container-runtime=containerd
multinode_test.go:450: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p multinode-20220630203616-9950-m02 --driver=docker  --container-runtime=containerd: exit status 14 (85.318588ms)

                                                
                                                
-- stdout --
	* [multinode-20220630203616-9950-m02] minikube v1.26.0 on Ubuntu 20.04 (kvm/amd64)
	  - MINIKUBE_LOCATION=14420
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-amd64
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! Profile name 'multinode-20220630203616-9950-m02' is duplicated with machine name 'multinode-20220630203616-9950-m02' in profile 'multinode-20220630203616-9950'
	X Exiting due to MK_USAGE: Profile name should be unique

                                                
                                                
** /stderr **
multinode_test.go:458: (dbg) Run:  out/minikube-linux-amd64 start -p multinode-20220630203616-9950-m03 --driver=docker  --container-runtime=containerd
multinode_test.go:458: (dbg) Done: out/minikube-linux-amd64 start -p multinode-20220630203616-9950-m03 --driver=docker  --container-runtime=containerd: (35.465497332s)
multinode_test.go:465: (dbg) Run:  out/minikube-linux-amd64 node add -p multinode-20220630203616-9950
multinode_test.go:465: (dbg) Non-zero exit: out/minikube-linux-amd64 node add -p multinode-20220630203616-9950: exit status 80 (370.64001ms)

                                                
                                                
-- stdout --
	* Adding node m03 to cluster multinode-20220630203616-9950
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to GUEST_NODE_ADD: Node multinode-20220630203616-9950-m03 already exists in multinode-20220630203616-9950-m03 profile
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│    * Please also attach the following file to the GitHub issue:                             │
	│    * - /tmp/minikube_node_040ea7097fd6ed71e65be9a474587f81f0ccd21d_0.log                    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
multinode_test.go:470: (dbg) Run:  out/minikube-linux-amd64 delete -p multinode-20220630203616-9950-m03
multinode_test.go:470: (dbg) Done: out/minikube-linux-amd64 delete -p multinode-20220630203616-9950-m03: (2.351172441s)
--- PASS: TestMultiNode/serial/ValidateNameConflict (38.34s)

                                                
                                    
x
+
TestPreload (117.1s)

                                                
                                                
=== RUN   TestPreload
preload_test.go:48: (dbg) Run:  out/minikube-linux-amd64 start -p test-preload-20220630204502-9950 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.17.0
E0630 20:45:13.251357    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/addons-20220630202117-9950/client.crt: no such file or directory
E0630 20:45:47.269072    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/ingress-addon-legacy-20220630202923-9950/client.crt: no such file or directory
preload_test.go:48: (dbg) Done: out/minikube-linux-amd64 start -p test-preload-20220630204502-9950 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.17.0: (1m10.102903965s)
preload_test.go:61: (dbg) Run:  out/minikube-linux-amd64 ssh -p test-preload-20220630204502-9950 -- sudo crictl pull gcr.io/k8s-minikube/busybox
preload_test.go:61: (dbg) Done: out/minikube-linux-amd64 ssh -p test-preload-20220630204502-9950 -- sudo crictl pull gcr.io/k8s-minikube/busybox: (1.958927285s)
preload_test.go:71: (dbg) Run:  out/minikube-linux-amd64 start -p test-preload-20220630204502-9950 --memory=2200 --alsologtostderr -v=1 --wait=true --driver=docker  --container-runtime=containerd --kubernetes-version=v1.17.3
preload_test.go:71: (dbg) Done: out/minikube-linux-amd64 start -p test-preload-20220630204502-9950 --memory=2200 --alsologtostderr -v=1 --wait=true --driver=docker  --container-runtime=containerd --kubernetes-version=v1.17.3: (42.057430355s)
preload_test.go:80: (dbg) Run:  out/minikube-linux-amd64 ssh -p test-preload-20220630204502-9950 -- sudo crictl image ls
helpers_test.go:175: Cleaning up "test-preload-20220630204502-9950" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p test-preload-20220630204502-9950
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p test-preload-20220630204502-9950: (2.596210678s)
--- PASS: TestPreload (117.10s)

                                                
                                    
x
+
TestScheduledStopUnix (101.59s)

                                                
                                                
=== RUN   TestScheduledStopUnix
scheduled_stop_test.go:128: (dbg) Run:  out/minikube-linux-amd64 start -p scheduled-stop-20220630204659-9950 --memory=2048 --driver=docker  --container-runtime=containerd
scheduled_stop_test.go:128: (dbg) Done: out/minikube-linux-amd64 start -p scheduled-stop-20220630204659-9950 --memory=2048 --driver=docker  --container-runtime=containerd: (24.585637127s)
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-amd64 stop -p scheduled-stop-20220630204659-9950 --schedule 5m
scheduled_stop_test.go:191: (dbg) Run:  out/minikube-linux-amd64 status --format={{.TimeToStop}} -p scheduled-stop-20220630204659-9950 -n scheduled-stop-20220630204659-9950
scheduled_stop_test.go:169: signal error was:  <nil>
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-amd64 stop -p scheduled-stop-20220630204659-9950 --schedule 15s
scheduled_stop_test.go:169: signal error was:  os: process already finished
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-amd64 stop -p scheduled-stop-20220630204659-9950 --cancel-scheduled
scheduled_stop_test.go:176: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p scheduled-stop-20220630204659-9950 -n scheduled-stop-20220630204659-9950
scheduled_stop_test.go:205: (dbg) Run:  out/minikube-linux-amd64 status -p scheduled-stop-20220630204659-9950
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-amd64 stop -p scheduled-stop-20220630204659-9950 --schedule 15s
scheduled_stop_test.go:169: signal error was:  os: process already finished
E0630 20:48:30.279948    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/functional-20220630202638-9950/client.crt: no such file or directory
scheduled_stop_test.go:205: (dbg) Run:  out/minikube-linux-amd64 status -p scheduled-stop-20220630204659-9950
scheduled_stop_test.go:205: (dbg) Non-zero exit: out/minikube-linux-amd64 status -p scheduled-stop-20220630204659-9950: exit status 7 (97.232873ms)

                                                
                                                
-- stdout --
	scheduled-stop-20220630204659-9950
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
scheduled_stop_test.go:176: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p scheduled-stop-20220630204659-9950 -n scheduled-stop-20220630204659-9950
scheduled_stop_test.go:176: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p scheduled-stop-20220630204659-9950 -n scheduled-stop-20220630204659-9950: exit status 7 (100.564124ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
scheduled_stop_test.go:176: status error: exit status 7 (may be ok)
helpers_test.go:175: Cleaning up "scheduled-stop-20220630204659-9950" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p scheduled-stop-20220630204659-9950
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p scheduled-stop-20220630204659-9950: (5.187986205s)
--- PASS: TestScheduledStopUnix (101.59s)

                                                
                                    
x
+
TestInsufficientStorage (16.91s)

                                                
                                                
=== RUN   TestInsufficientStorage
status_test.go:50: (dbg) Run:  out/minikube-linux-amd64 start -p insufficient-storage-20220630204841-9950 --memory=2048 --output=json --wait=true --driver=docker  --container-runtime=containerd
E0630 20:48:50.205186    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/addons-20220630202117-9950/client.crt: no such file or directory
status_test.go:50: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p insufficient-storage-20220630204841-9950 --memory=2048 --output=json --wait=true --driver=docker  --container-runtime=containerd: exit status 26 (10.127869961s)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"dbf031e5-b3bb-475c-bc6b-1b78d5213bab","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[insufficient-storage-20220630204841-9950] minikube v1.26.0 on Ubuntu 20.04 (kvm/amd64)","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"f36ecfb9-26ef-4094-a8d0-ed186ae144b5","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=14420"}}
	{"specversion":"1.0","id":"4d18f3b4-4f9c-470c-8885-d9046dde82a5","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
	{"specversion":"1.0","id":"5ceb59ed-da4f-4b81-8fec-aed4b57625d9","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig"}}
	{"specversion":"1.0","id":"0cd062e1-e6f0-4b83-b17e-8f03f2bbc491","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube"}}
	{"specversion":"1.0","id":"1d456ea7-245a-4189-b3ad-673230835a1b","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-linux-amd64"}}
	{"specversion":"1.0","id":"8adbcadc-0d51-47a5-b924-2febf3984ea6","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_TEST_STORAGE_CAPACITY=100"}}
	{"specversion":"1.0","id":"a317a191-7311-4eb2-bea9-ab1ae3e2b322","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_TEST_AVAILABLE_STORAGE=19"}}
	{"specversion":"1.0","id":"ec3a2078-4add-4283-9470-ab22651b310d","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Using the docker driver based on user configuration","name":"Selecting Driver","totalsteps":"19"}}
	{"specversion":"1.0","id":"1ffac860-eaef-4325-a2bf-47f6da51dc18","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"Using Docker driver with root privileges"}}
	{"specversion":"1.0","id":"ee346779-0b82-4740-abc4-8f2b1fc2415f","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Starting control plane node insufficient-storage-20220630204841-9950 in cluster insufficient-storage-20220630204841-9950","name":"Starting Node","totalsteps":"19"}}
	{"specversion":"1.0","id":"9a36e9b4-0f57-4bf9-8324-4853a9bbb74d","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"5","message":"Pulling base image ...","name":"Pulling Base Image","totalsteps":"19"}}
	{"specversion":"1.0","id":"de72ea77-8fd9-458f-bcf7-3e542e8cab06","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"8","message":"Creating docker container (CPUs=2, Memory=2048MB) ...","name":"Creating Container","totalsteps":"19"}}
	{"specversion":"1.0","id":"c2f7718c-32cf-4430-a0c9-15ddfc36fb20","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"Try one or more of the following to free up space on the device:\n\t\n\t\t\t1. Run \"docker system prune\" to remove unused Docker data (optionally with \"-a\")\n\t\t\t2. Increase the storage allocated to Docker for Desktop by clicking on:\n\t\t\t\tDocker icon \u003e Preferences \u003e Resources \u003e Disk Image Size\n\t\t\t3. Run \"minikube ssh -- docker system prune\" if using the Docker container runtime","exitcode":"26","issues":"https://github.com/kubernetes/minikube/issues/9024","message":"Docker is out of disk space! (/var is at 100%% of capacity). You can pass '--force' to skip this check.","name":"RSRC_DOCKER_STORAGE","url":""}}

                                                
                                                
-- /stdout --
status_test.go:76: (dbg) Run:  out/minikube-linux-amd64 status -p insufficient-storage-20220630204841-9950 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-amd64 status -p insufficient-storage-20220630204841-9950 --output=json --layout=cluster: exit status 7 (370.168051ms)

                                                
                                                
-- stdout --
	{"Name":"insufficient-storage-20220630204841-9950","StatusCode":507,"StatusName":"InsufficientStorage","StatusDetail":"/var is almost out of disk space","Step":"Creating Container","StepDetail":"Creating docker container (CPUs=2, Memory=2048MB) ...","BinaryVersion":"v1.26.0","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":500,"StatusName":"Error"}},"Nodes":[{"Name":"insufficient-storage-20220630204841-9950","StatusCode":507,"StatusName":"InsufficientStorage","Components":{"apiserver":{"Name":"apiserver","StatusCode":405,"StatusName":"Stopped"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

                                                
                                                
-- /stdout --
** stderr ** 
	E0630 20:48:51.719779  133088 status.go:413] kubeconfig endpoint: extract IP: "insufficient-storage-20220630204841-9950" does not appear in /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig

                                                
                                                
** /stderr **
status_test.go:76: (dbg) Run:  out/minikube-linux-amd64 status -p insufficient-storage-20220630204841-9950 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-amd64 status -p insufficient-storage-20220630204841-9950 --output=json --layout=cluster: exit status 7 (375.043847ms)

                                                
                                                
-- stdout --
	{"Name":"insufficient-storage-20220630204841-9950","StatusCode":507,"StatusName":"InsufficientStorage","StatusDetail":"/var is almost out of disk space","BinaryVersion":"v1.26.0","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":500,"StatusName":"Error"}},"Nodes":[{"Name":"insufficient-storage-20220630204841-9950","StatusCode":507,"StatusName":"InsufficientStorage","Components":{"apiserver":{"Name":"apiserver","StatusCode":405,"StatusName":"Stopped"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

                                                
                                                
-- /stdout --
** stderr ** 
	E0630 20:48:52.094713  133198 status.go:413] kubeconfig endpoint: extract IP: "insufficient-storage-20220630204841-9950" does not appear in /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	E0630 20:48:52.103210  133198 status.go:557] unable to read event log: stat: stat /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/insufficient-storage-20220630204841-9950/events.json: no such file or directory

                                                
                                                
** /stderr **
helpers_test.go:175: Cleaning up "insufficient-storage-20220630204841-9950" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p insufficient-storage-20220630204841-9950
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p insufficient-storage-20220630204841-9950: (6.039979174s)
--- PASS: TestInsufficientStorage (16.91s)

                                                
                                    
x
+
TestRunningBinaryUpgrade (81.54s)

                                                
                                                
=== RUN   TestRunningBinaryUpgrade
=== PAUSE TestRunningBinaryUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestRunningBinaryUpgrade
version_upgrade_test.go:127: (dbg) Run:  /tmp/minikube-v1.16.0.1610417103.exe start -p running-upgrade-20220630205232-9950 --memory=2200 --vm-driver=docker  --container-runtime=containerd

                                                
                                                
=== CONT  TestRunningBinaryUpgrade
version_upgrade_test.go:127: (dbg) Done: /tmp/minikube-v1.16.0.1610417103.exe start -p running-upgrade-20220630205232-9950 --memory=2200 --vm-driver=docker  --container-runtime=containerd: (38.200865161s)
version_upgrade_test.go:137: (dbg) Run:  out/minikube-linux-amd64 start -p running-upgrade-20220630205232-9950 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd

                                                
                                                
=== CONT  TestRunningBinaryUpgrade
version_upgrade_test.go:137: (dbg) Done: out/minikube-linux-amd64 start -p running-upgrade-20220630205232-9950 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (40.41076734s)
helpers_test.go:175: Cleaning up "running-upgrade-20220630205232-9950" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p running-upgrade-20220630205232-9950

                                                
                                                
=== CONT  TestRunningBinaryUpgrade
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p running-upgrade-20220630205232-9950: (2.436905925s)
--- PASS: TestRunningBinaryUpgrade (81.54s)

                                                
                                    
x
+
TestMissingContainerUpgrade (160.59s)

                                                
                                                
=== RUN   TestMissingContainerUpgrade
=== PAUSE TestMissingContainerUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestMissingContainerUpgrade
version_upgrade_test.go:316: (dbg) Run:  /tmp/minikube-v1.9.1.2073382421.exe start -p missing-upgrade-20220630205011-9950 --memory=2200 --driver=docker  --container-runtime=containerd

                                                
                                                
=== CONT  TestMissingContainerUpgrade
version_upgrade_test.go:316: (dbg) Done: /tmp/minikube-v1.9.1.2073382421.exe start -p missing-upgrade-20220630205011-9950 --memory=2200 --driver=docker  --container-runtime=containerd: (1m22.74735892s)
version_upgrade_test.go:325: (dbg) Run:  docker stop missing-upgrade-20220630205011-9950

                                                
                                                
=== CONT  TestMissingContainerUpgrade
version_upgrade_test.go:325: (dbg) Done: docker stop missing-upgrade-20220630205011-9950: (16.109652565s)
version_upgrade_test.go:330: (dbg) Run:  docker rm missing-upgrade-20220630205011-9950
version_upgrade_test.go:336: (dbg) Run:  out/minikube-linux-amd64 start -p missing-upgrade-20220630205011-9950 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
E0630 20:52:10.314079    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/ingress-addon-legacy-20220630202923-9950/client.crt: no such file or directory

                                                
                                                
=== CONT  TestMissingContainerUpgrade
version_upgrade_test.go:336: (dbg) Done: out/minikube-linux-amd64 start -p missing-upgrade-20220630205011-9950 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (53.214411683s)
helpers_test.go:175: Cleaning up "missing-upgrade-20220630205011-9950" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p missing-upgrade-20220630205011-9950
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p missing-upgrade-20220630205011-9950: (7.950586975s)
--- PASS: TestMissingContainerUpgrade (160.59s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartNoK8sWithVersion (0.11s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartNoK8sWithVersion

                                                
                                                
=== CONT  TestNoKubernetes/serial/StartNoK8sWithVersion
no_kubernetes_test.go:83: (dbg) Run:  out/minikube-linux-amd64 start -p NoKubernetes-20220630204858-9950 --no-kubernetes --kubernetes-version=1.20 --driver=docker  --container-runtime=containerd

                                                
                                                
=== CONT  TestNoKubernetes/serial/StartNoK8sWithVersion
no_kubernetes_test.go:83: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p NoKubernetes-20220630204858-9950 --no-kubernetes --kubernetes-version=1.20 --driver=docker  --container-runtime=containerd: exit status 14 (110.116111ms)

                                                
                                                
-- stdout --
	* [NoKubernetes-20220630204858-9950] minikube v1.26.0 on Ubuntu 20.04 (kvm/amd64)
	  - MINIKUBE_LOCATION=14420
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-amd64
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to MK_USAGE: cannot specify --kubernetes-version with --no-kubernetes,
	to unset a global config run:
	
	$ minikube config unset kubernetes-version

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/StartNoK8sWithVersion (0.11s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartWithK8s (36.51s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartWithK8s
no_kubernetes_test.go:95: (dbg) Run:  out/minikube-linux-amd64 start -p NoKubernetes-20220630204858-9950 --driver=docker  --container-runtime=containerd

                                                
                                                
=== CONT  TestNoKubernetes/serial/StartWithK8s
no_kubernetes_test.go:95: (dbg) Done: out/minikube-linux-amd64 start -p NoKubernetes-20220630204858-9950 --driver=docker  --container-runtime=containerd: (36.05981963s)
no_kubernetes_test.go:200: (dbg) Run:  out/minikube-linux-amd64 -p NoKubernetes-20220630204858-9950 status -o json
--- PASS: TestNoKubernetes/serial/StartWithK8s (36.51s)

                                                
                                    
x
+
TestNetworkPlugins/group/false (0.6s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/false
net_test.go:220: (dbg) Run:  out/minikube-linux-amd64 start -p false-20220630204858-9950 --memory=2048 --alsologtostderr --cni=false --driver=docker  --container-runtime=containerd
net_test.go:220: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p false-20220630204858-9950 --memory=2048 --alsologtostderr --cni=false --driver=docker  --container-runtime=containerd: exit status 14 (281.439988ms)

                                                
                                                
-- stdout --
	* [false-20220630204858-9950] minikube v1.26.0 on Ubuntu 20.04 (kvm/amd64)
	  - MINIKUBE_LOCATION=14420
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-amd64
	* Using the docker driver based on user configuration
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0630 20:48:58.806767  134109 out.go:296] Setting OutFile to fd 1 ...
	I0630 20:48:58.806994  134109 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 20:48:58.807010  134109 out.go:309] Setting ErrFile to fd 2...
	I0630 20:48:58.807017  134109 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0630 20:48:58.807467  134109 root.go:329] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/bin
	I0630 20:48:58.807808  134109 out.go:303] Setting JSON to false
	I0630 20:48:58.809194  134109 start.go:115] hostinfo: {"hostname":"ubuntu-20-agent-8","uptime":1891,"bootTime":1656620248,"procs":669,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1012-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0630 20:48:58.809270  134109 start.go:125] virtualization: kvm guest
	I0630 20:48:58.812259  134109 out.go:177] * [false-20220630204858-9950] minikube v1.26.0 on Ubuntu 20.04 (kvm/amd64)
	I0630 20:48:58.814262  134109 out.go:177]   - MINIKUBE_LOCATION=14420
	I0630 20:48:58.814208  134109 notify.go:193] Checking for updates...
	I0630 20:48:58.815786  134109 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0630 20:48:58.817279  134109 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/kubeconfig
	I0630 20:48:58.818665  134109 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube
	I0630 20:48:58.819908  134109 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0630 20:48:58.821469  134109 config.go:178] Loaded profile config "NoKubernetes-20220630204858-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 20:48:58.821570  134109 config.go:178] Loaded profile config "offline-containerd-20220630204858-9950": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.24.2
	I0630 20:48:58.821608  134109 driver.go:360] Setting default libvirt URI to qemu:///system
	I0630 20:48:58.858769  134109 docker.go:137] docker version: linux-20.10.17
	I0630 20:48:58.858883  134109 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0630 20:48:58.985937  134109 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:6 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:24 OomKillDisable:true NGoroutines:34 SystemTime:2022-06-30 20:48:58.890473695 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1012-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexServ
erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662451712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-8 Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Client
Info:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
	I0630 20:48:58.986128  134109 docker.go:254] overlay module found
	I0630 20:48:58.989901  134109 out.go:177] * Using the docker driver based on user configuration
	I0630 20:48:58.992876  134109 start.go:284] selected driver: docker
	I0630 20:48:58.992897  134109 start.go:808] validating driver "docker" against <nil>
	I0630 20:48:58.992933  134109 start.go:819] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0630 20:48:59.003362  134109 out.go:177] 
	W0630 20:48:59.005834  134109 out.go:239] X Exiting due to MK_USAGE: The "containerd" container runtime requires CNI
	X Exiting due to MK_USAGE: The "containerd" container runtime requires CNI
	I0630 20:48:59.007823  134109 out.go:177] 

                                                
                                                
** /stderr **
helpers_test.go:175: Cleaning up "false-20220630204858-9950" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p false-20220630204858-9950
--- PASS: TestNetworkPlugins/group/false (0.60s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartWithStopK8s (17.2s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartWithStopK8s
no_kubernetes_test.go:112: (dbg) Run:  out/minikube-linux-amd64 start -p NoKubernetes-20220630204858-9950 --no-kubernetes --driver=docker  --container-runtime=containerd

                                                
                                                
=== CONT  TestNoKubernetes/serial/StartWithStopK8s
no_kubernetes_test.go:112: (dbg) Done: out/minikube-linux-amd64 start -p NoKubernetes-20220630204858-9950 --no-kubernetes --driver=docker  --container-runtime=containerd: (14.383028463s)
no_kubernetes_test.go:200: (dbg) Run:  out/minikube-linux-amd64 -p NoKubernetes-20220630204858-9950 status -o json
no_kubernetes_test.go:200: (dbg) Non-zero exit: out/minikube-linux-amd64 -p NoKubernetes-20220630204858-9950 status -o json: exit status 2 (472.563807ms)

                                                
                                                
-- stdout --
	{"Name":"NoKubernetes-20220630204858-9950","Host":"Running","Kubelet":"Stopped","APIServer":"Stopped","Kubeconfig":"Configured","Worker":false}

                                                
                                                
-- /stdout --
no_kubernetes_test.go:124: (dbg) Run:  out/minikube-linux-amd64 delete -p NoKubernetes-20220630204858-9950

                                                
                                                
=== CONT  TestNoKubernetes/serial/StartWithStopK8s
no_kubernetes_test.go:124: (dbg) Done: out/minikube-linux-amd64 delete -p NoKubernetes-20220630204858-9950: (2.34466844s)
--- PASS: TestNoKubernetes/serial/StartWithStopK8s (17.20s)

                                                
                                    
x
+
TestNoKubernetes/serial/Start (4.75s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/Start
no_kubernetes_test.go:136: (dbg) Run:  out/minikube-linux-amd64 start -p NoKubernetes-20220630204858-9950 --no-kubernetes --driver=docker  --container-runtime=containerd
E0630 20:49:53.325811    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/functional-20220630202638-9950/client.crt: no such file or directory

                                                
                                                
=== CONT  TestNoKubernetes/serial/Start
no_kubernetes_test.go:136: (dbg) Done: out/minikube-linux-amd64 start -p NoKubernetes-20220630204858-9950 --no-kubernetes --driver=docker  --container-runtime=containerd: (4.748639332s)
--- PASS: TestNoKubernetes/serial/Start (4.75s)

                                                
                                    
x
+
TestNoKubernetes/serial/VerifyK8sNotRunning (0.41s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/VerifyK8sNotRunning
no_kubernetes_test.go:147: (dbg) Run:  out/minikube-linux-amd64 ssh -p NoKubernetes-20220630204858-9950 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:147: (dbg) Non-zero exit: out/minikube-linux-amd64 ssh -p NoKubernetes-20220630204858-9950 "sudo systemctl is-active --quiet service kubelet": exit status 1 (405.491464ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunning (0.41s)

                                                
                                    
x
+
TestNoKubernetes/serial/ProfileList (2.23s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/ProfileList
no_kubernetes_test.go:169: (dbg) Run:  out/minikube-linux-amd64 profile list
no_kubernetes_test.go:179: (dbg) Run:  out/minikube-linux-amd64 profile list --output=json
no_kubernetes_test.go:179: (dbg) Done: out/minikube-linux-amd64 profile list --output=json: (1.416518354s)
--- PASS: TestNoKubernetes/serial/ProfileList (2.23s)

                                                
                                    
x
+
TestNoKubernetes/serial/Stop (3.7s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/Stop
no_kubernetes_test.go:158: (dbg) Run:  out/minikube-linux-amd64 stop -p NoKubernetes-20220630204858-9950
no_kubernetes_test.go:158: (dbg) Done: out/minikube-linux-amd64 stop -p NoKubernetes-20220630204858-9950: (3.697371645s)
--- PASS: TestNoKubernetes/serial/Stop (3.70s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartNoArgs (6.16s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartNoArgs
no_kubernetes_test.go:191: (dbg) Run:  out/minikube-linux-amd64 start -p NoKubernetes-20220630204858-9950 --driver=docker  --container-runtime=containerd

                                                
                                                
=== CONT  TestNoKubernetes/serial/StartNoArgs
no_kubernetes_test.go:191: (dbg) Done: out/minikube-linux-amd64 start -p NoKubernetes-20220630204858-9950 --driver=docker  --container-runtime=containerd: (6.160020759s)
--- PASS: TestNoKubernetes/serial/StartNoArgs (6.16s)

                                                
                                    
x
+
TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.47s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/VerifyK8sNotRunningSecond
no_kubernetes_test.go:147: (dbg) Run:  out/minikube-linux-amd64 ssh -p NoKubernetes-20220630204858-9950 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:147: (dbg) Non-zero exit: out/minikube-linux-amd64 ssh -p NoKubernetes-20220630204858-9950 "sudo systemctl is-active --quiet service kubelet": exit status 1 (467.671457ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.47s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/Setup (0.45s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/Setup
--- PASS: TestStoppedBinaryUpgrade/Setup (0.45s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/Upgrade (137.21s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/Upgrade
version_upgrade_test.go:190: (dbg) Run:  /tmp/minikube-v1.16.0.4183117495.exe start -p stopped-upgrade-20220630205010-9950 --memory=2200 --vm-driver=docker  --container-runtime=containerd

                                                
                                                
=== CONT  TestStoppedBinaryUpgrade/Upgrade
version_upgrade_test.go:190: (dbg) Done: /tmp/minikube-v1.16.0.4183117495.exe start -p stopped-upgrade-20220630205010-9950 --memory=2200 --vm-driver=docker  --container-runtime=containerd: (1m24.681103942s)
version_upgrade_test.go:199: (dbg) Run:  /tmp/minikube-v1.16.0.4183117495.exe -p stopped-upgrade-20220630205010-9950 stop
version_upgrade_test.go:199: (dbg) Done: /tmp/minikube-v1.16.0.4183117495.exe -p stopped-upgrade-20220630205010-9950 stop: (1.271529442s)
version_upgrade_test.go:205: (dbg) Run:  out/minikube-linux-amd64 start -p stopped-upgrade-20220630205010-9950 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd

                                                
                                                
=== CONT  TestStoppedBinaryUpgrade/Upgrade
version_upgrade_test.go:205: (dbg) Done: out/minikube-linux-amd64 start -p stopped-upgrade-20220630205010-9950 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (51.261560274s)
--- PASS: TestStoppedBinaryUpgrade/Upgrade (137.21s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/MinikubeLogs (1.07s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/MinikubeLogs
version_upgrade_test.go:213: (dbg) Run:  out/minikube-linux-amd64 logs -p stopped-upgrade-20220630205010-9950
version_upgrade_test.go:213: (dbg) Done: out/minikube-linux-amd64 logs -p stopped-upgrade-20220630205010-9950: (1.065743663s)
--- PASS: TestStoppedBinaryUpgrade/MinikubeLogs (1.07s)

                                                
                                    
x
+
TestPause/serial/Start (59.88s)

                                                
                                                
=== RUN   TestPause/serial/Start
pause_test.go:80: (dbg) Run:  out/minikube-linux-amd64 start -p pause-20220630205252-9950 --memory=2048 --install-addons=false --wait=all --driver=docker  --container-runtime=containerd

                                                
                                                
=== CONT  TestPause/serial/Start
pause_test.go:80: (dbg) Done: out/minikube-linux-amd64 start -p pause-20220630205252-9950 --memory=2048 --install-addons=false --wait=all --driver=docker  --container-runtime=containerd: (59.880542932s)
--- PASS: TestPause/serial/Start (59.88s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/Start (60.28s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/Start
net_test.go:101: (dbg) Run:  out/minikube-linux-amd64 start -p auto-20220630204858-9950 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --driver=docker  --container-runtime=containerd
E0630 20:53:50.204350    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/addons-20220630202117-9950/client.crt: no such file or directory

                                                
                                                
=== CONT  TestNetworkPlugins/group/auto/Start
net_test.go:101: (dbg) Done: out/minikube-linux-amd64 start -p auto-20220630204858-9950 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --driver=docker  --container-runtime=containerd: (1m0.276906178s)
--- PASS: TestNetworkPlugins/group/auto/Start (60.28s)

                                                
                                    
x
+
TestPause/serial/SecondStartNoReconfiguration (16.09s)

                                                
                                                
=== RUN   TestPause/serial/SecondStartNoReconfiguration
pause_test.go:92: (dbg) Run:  out/minikube-linux-amd64 start -p pause-20220630205252-9950 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd

                                                
                                                
=== CONT  TestPause/serial/SecondStartNoReconfiguration
pause_test.go:92: (dbg) Done: out/minikube-linux-amd64 start -p pause-20220630205252-9950 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (16.069126011s)
--- PASS: TestPause/serial/SecondStartNoReconfiguration (16.09s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/Start (47.46s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/Start
net_test.go:101: (dbg) Run:  out/minikube-linux-amd64 start -p kindnet-20220630204858-9950 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=kindnet --driver=docker  --container-runtime=containerd

                                                
                                                
=== CONT  TestNetworkPlugins/group/kindnet/Start
net_test.go:101: (dbg) Done: out/minikube-linux-amd64 start -p kindnet-20220630204858-9950 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=kindnet --driver=docker  --container-runtime=containerd: (47.455372471s)
--- PASS: TestNetworkPlugins/group/kindnet/Start (47.46s)

                                                
                                    
x
+
TestPause/serial/Pause (0.88s)

                                                
                                                
=== RUN   TestPause/serial/Pause
pause_test.go:110: (dbg) Run:  out/minikube-linux-amd64 pause -p pause-20220630205252-9950 --alsologtostderr -v=5
--- PASS: TestPause/serial/Pause (0.88s)

                                                
                                    
x
+
TestPause/serial/VerifyStatus (0.47s)

                                                
                                                
=== RUN   TestPause/serial/VerifyStatus
status_test.go:76: (dbg) Run:  out/minikube-linux-amd64 status -p pause-20220630205252-9950 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-amd64 status -p pause-20220630205252-9950 --output=json --layout=cluster: exit status 2 (467.506885ms)

                                                
                                                
-- stdout --
	{"Name":"pause-20220630205252-9950","StatusCode":418,"StatusName":"Paused","Step":"Done","StepDetail":"* Paused 8 containers in: kube-system, kubernetes-dashboard, storage-gluster, istio-operator","BinaryVersion":"v1.26.0","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":200,"StatusName":"OK"}},"Nodes":[{"Name":"pause-20220630205252-9950","StatusCode":200,"StatusName":"OK","Components":{"apiserver":{"Name":"apiserver","StatusCode":418,"StatusName":"Paused"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

                                                
                                                
-- /stdout --
--- PASS: TestPause/serial/VerifyStatus (0.47s)

                                                
                                    
x
+
TestPause/serial/Unpause (0.81s)

                                                
                                                
=== RUN   TestPause/serial/Unpause
pause_test.go:121: (dbg) Run:  out/minikube-linux-amd64 unpause -p pause-20220630205252-9950 --alsologtostderr -v=5
--- PASS: TestPause/serial/Unpause (0.81s)

                                                
                                    
x
+
TestPause/serial/PauseAgain (1.08s)

                                                
                                                
=== RUN   TestPause/serial/PauseAgain
pause_test.go:110: (dbg) Run:  out/minikube-linux-amd64 pause -p pause-20220630205252-9950 --alsologtostderr -v=5
pause_test.go:110: (dbg) Done: out/minikube-linux-amd64 pause -p pause-20220630205252-9950 --alsologtostderr -v=5: (1.077672641s)
--- PASS: TestPause/serial/PauseAgain (1.08s)

                                                
                                    
x
+
TestPause/serial/DeletePaused (3.03s)

                                                
                                                
=== RUN   TestPause/serial/DeletePaused
pause_test.go:132: (dbg) Run:  out/minikube-linux-amd64 delete -p pause-20220630205252-9950 --alsologtostderr -v=5
pause_test.go:132: (dbg) Done: out/minikube-linux-amd64 delete -p pause-20220630205252-9950 --alsologtostderr -v=5: (3.030290909s)
--- PASS: TestPause/serial/DeletePaused (3.03s)

                                                
                                    
x
+
TestPause/serial/VerifyDeletedResources (2.5s)

                                                
                                                
=== RUN   TestPause/serial/VerifyDeletedResources
pause_test.go:142: (dbg) Run:  out/minikube-linux-amd64 profile list --output json
pause_test.go:142: (dbg) Done: out/minikube-linux-amd64 profile list --output json: (2.382172434s)
pause_test.go:168: (dbg) Run:  docker ps -a
pause_test.go:173: (dbg) Run:  docker volume inspect pause-20220630205252-9950
pause_test.go:173: (dbg) Non-zero exit: docker volume inspect pause-20220630205252-9950: exit status 1 (37.896378ms)

                                                
                                                
-- stdout --
	[]

                                                
                                                
-- /stdout --
** stderr ** 
	Error: No such volume: pause-20220630205252-9950

                                                
                                                
** /stderr **
pause_test.go:178: (dbg) Run:  docker network ls
--- PASS: TestPause/serial/VerifyDeletedResources (2.50s)

                                                
                                    
x
+
TestNetworkPlugins/group/cilium/Start (68.48s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/cilium/Start
net_test.go:101: (dbg) Run:  out/minikube-linux-amd64 start -p cilium-20220630204859-9950 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=cilium --driver=docker  --container-runtime=containerd

                                                
                                                
=== CONT  TestNetworkPlugins/group/cilium/Start
net_test.go:101: (dbg) Done: out/minikube-linux-amd64 start -p cilium-20220630204859-9950 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=cilium --driver=docker  --container-runtime=containerd: (1m8.47857998s)
--- PASS: TestNetworkPlugins/group/cilium/Start (68.48s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/KubeletFlags (0.47s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/KubeletFlags
net_test.go:122: (dbg) Run:  out/minikube-linux-amd64 ssh -p auto-20220630204858-9950 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/auto/KubeletFlags (0.47s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/NetCatPod (9.37s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/NetCatPod
net_test.go:138: (dbg) Run:  kubectl --context auto-20220630204858-9950 replace --force -f testdata/netcat-deployment.yaml
net_test.go:152: (dbg) TestNetworkPlugins/group/auto/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:342: "netcat-869c55b6dc-n7pp5" [9390cab0-3fc1-4dd8-810b-906f949a0779] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])

                                                
                                                
=== CONT  TestNetworkPlugins/group/auto/NetCatPod
helpers_test.go:342: "netcat-869c55b6dc-n7pp5" [9390cab0-3fc1-4dd8-810b-906f949a0779] Running

                                                
                                                
=== CONT  TestNetworkPlugins/group/auto/NetCatPod
net_test.go:152: (dbg) TestNetworkPlugins/group/auto/NetCatPod: app=netcat healthy within 9.008178262s
--- PASS: TestNetworkPlugins/group/auto/NetCatPod (9.37s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/ControllerPod (5.02s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/ControllerPod
net_test.go:109: (dbg) TestNetworkPlugins/group/kindnet/ControllerPod: waiting 10m0s for pods matching "app=kindnet" in namespace "kube-system" ...
helpers_test.go:342: "kindnet-ztcs5" [15d7ed46-5397-4db6-8977-aae8eba527a8] Running

                                                
                                                
=== CONT  TestNetworkPlugins/group/kindnet/ControllerPod
net_test.go:109: (dbg) TestNetworkPlugins/group/kindnet/ControllerPod: app=kindnet healthy within 5.013831515s
--- PASS: TestNetworkPlugins/group/kindnet/ControllerPod (5.02s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/KubeletFlags (0.39s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/KubeletFlags
net_test.go:122: (dbg) Run:  out/minikube-linux-amd64 ssh -p kindnet-20220630204858-9950 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/kindnet/KubeletFlags (0.39s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/DNS (0.16s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/DNS
net_test.go:169: (dbg) Run:  kubectl --context auto-20220630204858-9950 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/auto/DNS (0.16s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/NetCatPod (10.37s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/NetCatPod
net_test.go:138: (dbg) Run:  kubectl --context kindnet-20220630204858-9950 replace --force -f testdata/netcat-deployment.yaml

                                                
                                                
=== CONT  TestNetworkPlugins/group/kindnet/NetCatPod
net_test.go:152: (dbg) TestNetworkPlugins/group/kindnet/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:342: "netcat-869c55b6dc-bcvmv" [389fa2ab-15c3-4b6b-a2aa-d74a7c326471] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])

                                                
                                                
=== CONT  TestNetworkPlugins/group/kindnet/NetCatPod
helpers_test.go:342: "netcat-869c55b6dc-bcvmv" [389fa2ab-15c3-4b6b-a2aa-d74a7c326471] Running
net_test.go:152: (dbg) TestNetworkPlugins/group/kindnet/NetCatPod: app=netcat healthy within 10.006199389s
--- PASS: TestNetworkPlugins/group/kindnet/NetCatPod (10.37s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/Localhost (0.14s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/Localhost
net_test.go:188: (dbg) Run:  kubectl --context auto-20220630204858-9950 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/auto/Localhost (0.14s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/HairPin (0.12s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/HairPin
net_test.go:238: (dbg) Run:  kubectl --context auto-20220630204858-9950 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/auto/HairPin (0.12s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/DNS (0.19s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/DNS
net_test.go:169: (dbg) Run:  kubectl --context kindnet-20220630204858-9950 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/kindnet/DNS (0.19s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/Localhost (0.16s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/Localhost
net_test.go:188: (dbg) Run:  kubectl --context kindnet-20220630204858-9950 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/kindnet/Localhost (0.16s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/HairPin (0.18s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/HairPin
net_test.go:238: (dbg) Run:  kubectl --context kindnet-20220630204858-9950 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/kindnet/HairPin (0.18s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/Start (299.35s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/Start
net_test.go:101: (dbg) Run:  out/minikube-linux-amd64 start -p enable-default-cni-20220630204858-9950 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --enable-default-cni=true --driver=docker  --container-runtime=containerd

                                                
                                                
=== CONT  TestNetworkPlugins/group/enable-default-cni/Start
net_test.go:101: (dbg) Done: out/minikube-linux-amd64 start -p enable-default-cni-20220630204858-9950 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --enable-default-cni=true --driver=docker  --container-runtime=containerd: (4m59.346238171s)
--- PASS: TestNetworkPlugins/group/enable-default-cni/Start (299.35s)

                                                
                                    
x
+
TestNetworkPlugins/group/cilium/ControllerPod (5.02s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/cilium/ControllerPod
net_test.go:109: (dbg) TestNetworkPlugins/group/cilium/ControllerPod: waiting 10m0s for pods matching "k8s-app=cilium" in namespace "kube-system" ...
helpers_test.go:342: "cilium-mrjh8" [0e31d98e-492e-42f0-91ea-ea8af00727a6] Running
net_test.go:109: (dbg) TestNetworkPlugins/group/cilium/ControllerPod: k8s-app=cilium healthy within 5.014287705s
--- PASS: TestNetworkPlugins/group/cilium/ControllerPod (5.02s)

                                                
                                    
x
+
TestNetworkPlugins/group/cilium/KubeletFlags (0.45s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/cilium/KubeletFlags
net_test.go:122: (dbg) Run:  out/minikube-linux-amd64 ssh -p cilium-20220630204859-9950 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/cilium/KubeletFlags (0.45s)

                                                
                                    
x
+
TestNetworkPlugins/group/cilium/NetCatPod (11.13s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/cilium/NetCatPod
net_test.go:138: (dbg) Run:  kubectl --context cilium-20220630204859-9950 replace --force -f testdata/netcat-deployment.yaml
net_test.go:138: (dbg) Done: kubectl --context cilium-20220630204859-9950 replace --force -f testdata/netcat-deployment.yaml: (1.040992661s)
net_test.go:152: (dbg) TestNetworkPlugins/group/cilium/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:342: "netcat-869c55b6dc-4j4dt" [45dcd7a3-ba3d-4587-a971-7c324583919d] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:342: "netcat-869c55b6dc-4j4dt" [45dcd7a3-ba3d-4587-a971-7c324583919d] Running
net_test.go:152: (dbg) TestNetworkPlugins/group/cilium/NetCatPod: app=netcat healthy within 10.00776979s
--- PASS: TestNetworkPlugins/group/cilium/NetCatPod (11.13s)

                                                
                                    
x
+
TestNetworkPlugins/group/cilium/DNS (0.16s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/cilium/DNS
net_test.go:169: (dbg) Run:  kubectl --context cilium-20220630204859-9950 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/cilium/DNS (0.16s)

                                                
                                    
x
+
TestNetworkPlugins/group/cilium/Localhost (0.12s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/cilium/Localhost
net_test.go:188: (dbg) Run:  kubectl --context cilium-20220630204859-9950 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/cilium/Localhost (0.12s)

                                                
                                    
x
+
TestNetworkPlugins/group/cilium/HairPin (0.13s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/cilium/HairPin
net_test.go:238: (dbg) Run:  kubectl --context cilium-20220630204859-9950 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/cilium/HairPin (0.13s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/Start (40.39s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/Start
net_test.go:101: (dbg) Run:  out/minikube-linux-amd64 start -p bridge-20220630204858-9950 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=bridge --driver=docker  --container-runtime=containerd
E0630 20:55:47.269458    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/ingress-addon-legacy-20220630202923-9950/client.crt: no such file or directory
net_test.go:101: (dbg) Done: out/minikube-linux-amd64 start -p bridge-20220630204858-9950 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=bridge --driver=docker  --container-runtime=containerd: (40.38972975s)
--- PASS: TestNetworkPlugins/group/bridge/Start (40.39s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/KubeletFlags (0.4s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/KubeletFlags
net_test.go:122: (dbg) Run:  out/minikube-linux-amd64 ssh -p bridge-20220630204858-9950 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/bridge/KubeletFlags (0.40s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/NetCatPod (8.22s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/NetCatPod
net_test.go:138: (dbg) Run:  kubectl --context bridge-20220630204858-9950 replace --force -f testdata/netcat-deployment.yaml
net_test.go:152: (dbg) TestNetworkPlugins/group/bridge/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:342: "netcat-869c55b6dc-7247h" [ccab861d-c630-4de8-969f-eefbc3ea2aa1] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:342: "netcat-869c55b6dc-7247h" [ccab861d-c630-4de8-969f-eefbc3ea2aa1] Running
net_test.go:152: (dbg) TestNetworkPlugins/group/bridge/NetCatPod: app=netcat healthy within 8.006430537s
--- PASS: TestNetworkPlugins/group/bridge/NetCatPod (8.22s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/KubeletFlags (0.47s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/KubeletFlags
net_test.go:122: (dbg) Run:  out/minikube-linux-amd64 ssh -p enable-default-cni-20220630204858-9950 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/enable-default-cni/KubeletFlags (0.47s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/NetCatPod (10.24s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/NetCatPod
net_test.go:138: (dbg) Run:  kubectl --context enable-default-cni-20220630204858-9950 replace --force -f testdata/netcat-deployment.yaml
net_test.go:152: (dbg) TestNetworkPlugins/group/enable-default-cni/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:342: "netcat-869c55b6dc-bzssp" [95ab4ed4-3a0e-47d7-ad81-c54d353372a3] Pending

                                                
                                                
=== CONT  TestNetworkPlugins/group/enable-default-cni/NetCatPod
helpers_test.go:342: "netcat-869c55b6dc-bzssp" [95ab4ed4-3a0e-47d7-ad81-c54d353372a3] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])

                                                
                                                
=== CONT  TestNetworkPlugins/group/enable-default-cni/NetCatPod
helpers_test.go:342: "netcat-869c55b6dc-bzssp" [95ab4ed4-3a0e-47d7-ad81-c54d353372a3] Running
net_test.go:152: (dbg) TestNetworkPlugins/group/enable-default-cni/NetCatPod: app=netcat healthy within 10.006494056s
--- PASS: TestNetworkPlugins/group/enable-default-cni/NetCatPod (10.24s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/FirstStart (52.62s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-amd64 start -p no-preload-20220630210237-9950 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.24.2

                                                
                                                
=== CONT  TestStartStop/group/no-preload/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-amd64 start -p no-preload-20220630210237-9950 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.24.2: (52.616856804s)
--- PASS: TestStartStop/group/no-preload/serial/FirstStart (52.62s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/DeployApp (8.33s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context no-preload-20220630210237-9950 create -f testdata/busybox.yaml
E0630 21:03:30.280646    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/functional-20220630202638-9950/client.crt: no such file or directory

                                                
                                                
=== CONT  TestStartStop/group/no-preload/serial/DeployApp
start_stop_delete_test.go:196: (dbg) TestStartStop/group/no-preload/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:342: "busybox" [93cdeeb7-3547-4a71-885f-9f67203b1c38] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])

                                                
                                                
=== CONT  TestStartStop/group/no-preload/serial/DeployApp
helpers_test.go:342: "busybox" [93cdeeb7-3547-4a71-885f-9f67203b1c38] Running

                                                
                                                
=== CONT  TestStartStop/group/no-preload/serial/DeployApp
start_stop_delete_test.go:196: (dbg) TestStartStop/group/no-preload/serial/DeployApp: integration-test=busybox healthy within 8.014307459s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context no-preload-20220630210237-9950 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/no-preload/serial/DeployApp (8.33s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/EnableAddonWhileActive (1.07s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-amd64 addons enable metrics-server -p no-preload-20220630210237-9950 --images=MetricsServer=k8s.gcr.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context no-preload-20220630210237-9950 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/no-preload/serial/EnableAddonWhileActive (1.07s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/Stop (20.58s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-amd64 stop -p no-preload-20220630210237-9950 --alsologtostderr -v=3
E0630 21:03:50.204742    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/addons-20220630202117-9950/client.crt: no such file or directory

                                                
                                                
=== CONT  TestStartStop/group/no-preload/serial/Stop
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-amd64 stop -p no-preload-20220630210237-9950 --alsologtostderr -v=3: (20.578199503s)
--- PASS: TestStartStop/group/no-preload/serial/Stop (20.58s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.24s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-20220630210237-9950 -n no-preload-20220630210237-9950
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-20220630210237-9950 -n no-preload-20220630210237-9950: exit status 7 (112.933151ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-amd64 addons enable dashboard -p no-preload-20220630210237-9950 --images=MetricsScraper=k8s.gcr.io/echoserver:1.4
--- PASS: TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.24s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/SecondStart (312.97s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-amd64 start -p no-preload-20220630210237-9950 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.24.2

                                                
                                                
=== CONT  TestStartStop/group/no-preload/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-amd64 start -p no-preload-20220630210237-9950 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.24.2: (5m12.539277625s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-20220630210237-9950 -n no-preload-20220630210237-9950
--- PASS: TestStartStop/group/no-preload/serial/SecondStart (312.97s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/FirstStart (47.21s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-amd64 start -p newest-cni-20220630210514-9950 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=192.168.111.111/16 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.24.2
E0630 21:05:25.851311    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/cilium-20220630204859-9950/client.crt: no such file or directory
E0630 21:05:47.268597    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/ingress-addon-legacy-20220630202923-9950/client.crt: no such file or directory
E0630 21:05:53.534938    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/cilium-20220630204859-9950/client.crt: no such file or directory
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-amd64 start -p newest-cni-20220630210514-9950 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=192.168.111.111/16 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.24.2: (47.214782039s)
--- PASS: TestStartStop/group/newest-cni/serial/FirstStart (47.21s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/DeployApp (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/DeployApp
--- PASS: TestStartStop/group/newest-cni/serial/DeployApp (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (0.65s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-amd64 addons enable metrics-server -p newest-cni-20220630210514-9950 --images=MetricsServer=k8s.gcr.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:211: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (0.65s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/Stop (20.26s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-amd64 stop -p newest-cni-20220630210514-9950 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-amd64 stop -p newest-cni-20220630210514-9950 --alsologtostderr -v=3: (20.260961757s)
--- PASS: TestStartStop/group/newest-cni/serial/Stop (20.26s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.23s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p newest-cni-20220630210514-9950 -n newest-cni-20220630210514-9950
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p newest-cni-20220630210514-9950 -n newest-cni-20220630210514-9950: exit status 7 (105.873227ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-amd64 addons enable dashboard -p newest-cni-20220630210514-9950 --images=MetricsScraper=k8s.gcr.io/echoserver:1.4
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.23s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/SecondStart (30.73s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-amd64 start -p newest-cni-20220630210514-9950 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=192.168.111.111/16 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.24.2
E0630 21:06:27.108246    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/bridge-20220630204858-9950/client.crt: no such file or directory
E0630 21:06:27.113591    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/bridge-20220630204858-9950/client.crt: no such file or directory
E0630 21:06:27.124369    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/bridge-20220630204858-9950/client.crt: no such file or directory
E0630 21:06:27.145523    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/bridge-20220630204858-9950/client.crt: no such file or directory
E0630 21:06:27.186224    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/bridge-20220630204858-9950/client.crt: no such file or directory
E0630 21:06:27.266335    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/bridge-20220630204858-9950/client.crt: no such file or directory
E0630 21:06:27.426732    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/bridge-20220630204858-9950/client.crt: no such file or directory
E0630 21:06:27.747373    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/bridge-20220630204858-9950/client.crt: no such file or directory
E0630 21:06:28.388408    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/bridge-20220630204858-9950/client.crt: no such file or directory
E0630 21:06:29.669208    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/bridge-20220630204858-9950/client.crt: no such file or directory
E0630 21:06:32.229696    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/bridge-20220630204858-9950/client.crt: no such file or directory
E0630 21:06:33.326253    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/functional-20220630202638-9950/client.crt: no such file or directory
E0630 21:06:37.350689    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/bridge-20220630204858-9950/client.crt: no such file or directory
E0630 21:06:47.591187    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/bridge-20220630204858-9950/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-amd64 start -p newest-cni-20220630210514-9950 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=192.168.111.111/16 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.24.2: (30.308326999s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p newest-cni-20220630210514-9950 -n newest-cni-20220630210514-9950
--- PASS: TestStartStop/group/newest-cni/serial/SecondStart (30.73s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop
start_stop_delete_test.go:273: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/AddonExistsAfterStop
start_stop_delete_test.go:284: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.42s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-amd64 ssh -p newest-cni-20220630210514-9950 "sudo crictl images -o json"
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20220510-4929dd75
--- PASS: TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.42s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/Pause (3.08s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 pause -p newest-cni-20220630210514-9950 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p newest-cni-20220630210514-9950 -n newest-cni-20220630210514-9950
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p newest-cni-20220630210514-9950 -n newest-cni-20220630210514-9950: exit status 2 (406.354486ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p newest-cni-20220630210514-9950 -n newest-cni-20220630210514-9950
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Kubelet}} -p newest-cni-20220630210514-9950 -n newest-cni-20220630210514-9950: exit status 2 (404.126816ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 unpause -p newest-cni-20220630210514-9950 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p newest-cni-20220630210514-9950 -n newest-cni-20220630210514-9950
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p newest-cni-20220630210514-9950 -n newest-cni-20220630210514-9950
--- PASS: TestStartStop/group/newest-cni/serial/Pause (3.08s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (10.01s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/no-preload/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:342: "kubernetes-dashboard-5fd5574d9f-l9njb" [b6f93ef6-1f47-424f-bf2d-abd475af83be] Pending / Ready:ContainersNotReady (containers with unready status: [kubernetes-dashboard]) / ContainersReady:ContainersNotReady (containers with unready status: [kubernetes-dashboard])
helpers_test.go:342: "kubernetes-dashboard-5fd5574d9f-l9njb" [b6f93ef6-1f47-424f-bf2d-abd475af83be] Running
start_stop_delete_test.go:274: (dbg) TestStartStop/group/no-preload/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 10.012706652s
--- PASS: TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (10.01s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/AddonExistsAfterStop (5.07s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/no-preload/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:342: "kubernetes-dashboard-5fd5574d9f-l9njb" [b6f93ef6-1f47-424f-bf2d-abd475af83be] Running
start_stop_delete_test.go:287: (dbg) TestStartStop/group/no-preload/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.007061127s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context no-preload-20220630210237-9950 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/no-preload/serial/AddonExistsAfterStop (5.07s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.43s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-amd64 ssh -p no-preload-20220630210237-9950 "sudo crictl images -o json"
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20220510-4929dd75
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.43s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/Pause (3.33s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 pause -p no-preload-20220630210237-9950 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p no-preload-20220630210237-9950 -n no-preload-20220630210237-9950
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p no-preload-20220630210237-9950 -n no-preload-20220630210237-9950: exit status 2 (406.441813ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p no-preload-20220630210237-9950 -n no-preload-20220630210237-9950
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Kubelet}} -p no-preload-20220630210237-9950 -n no-preload-20220630210237-9950: exit status 2 (422.338972ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 unpause -p no-preload-20220630210237-9950 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p no-preload-20220630210237-9950 -n no-preload-20220630210237-9950
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p no-preload-20220630210237-9950 -n no-preload-20220630210237-9950
--- PASS: TestStartStop/group/no-preload/serial/Pause (3.33s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (0.61s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-amd64 addons enable metrics-server -p old-k8s-version-20220630210005-9950 --images=MetricsServer=k8s.gcr.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context old-k8s-version-20220630210005-9950 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (0.61s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/Stop (1.32s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-amd64 stop -p old-k8s-version-20220630210005-9950 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-amd64 stop -p old-k8s-version-20220630210005-9950 --alsologtostderr -v=3: (1.322154395s)
--- PASS: TestStartStop/group/old-k8s-version/serial/Stop (1.32s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.23s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-20220630210005-9950 -n old-k8s-version-20220630210005-9950
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-20220630210005-9950 -n old-k8s-version-20220630210005-9950: exit status 7 (101.249605ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-amd64 addons enable dashboard -p old-k8s-version-20220630210005-9950 --images=MetricsScraper=k8s.gcr.io/echoserver:1.4
--- PASS: TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.23s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-different-port/serial/EnableAddonWhileActive (0.64s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-different-port/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-amd64 addons enable metrics-server -p default-k8s-different-port-20220630210335-9950 --images=MetricsServer=k8s.gcr.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context default-k8s-different-port-20220630210335-9950 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/default-k8s-different-port/serial/EnableAddonWhileActive (0.64s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-different-port/serial/Stop (20.2s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-different-port/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-amd64 stop -p default-k8s-different-port-20220630210335-9950 --alsologtostderr -v=3
E0630 21:16:48.896036    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/cilium-20220630204859-9950/client.crt: no such file or directory
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-amd64 stop -p default-k8s-different-port-20220630210335-9950 --alsologtostderr -v=3: (20.196103698s)
--- PASS: TestStartStop/group/default-k8s-different-port/serial/Stop (20.20s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-different-port/serial/EnableAddonAfterStop (0.24s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-different-port/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p default-k8s-different-port-20220630210335-9950 -n default-k8s-different-port-20220630210335-9950
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p default-k8s-different-port-20220630210335-9950 -n default-k8s-different-port-20220630210335-9950: exit status 7 (111.252293ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-amd64 addons enable dashboard -p default-k8s-different-port-20220630210335-9950 --images=MetricsScraper=k8s.gcr.io/echoserver:1.4
--- PASS: TestStartStop/group/default-k8s-different-port/serial/EnableAddonAfterStop (0.24s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (0.64s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-amd64 addons enable metrics-server -p embed-certs-20220630210659-9950 --images=MetricsServer=k8s.gcr.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context embed-certs-20220630210659-9950 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (0.64s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/Stop (20.22s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-amd64 stop -p embed-certs-20220630210659-9950 --alsologtostderr -v=3
E0630 21:20:01.427885    9950 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-14420-3397-b28e6de4ba37ffec66170588afce60c61d1bcd44/.minikube/profiles/enable-default-cni-20220630204858-9950/client.crt: no such file or directory
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-amd64 stop -p embed-certs-20220630210659-9950 --alsologtostderr -v=3: (20.224827053s)
--- PASS: TestStartStop/group/embed-certs/serial/Stop (20.22s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.23s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-20220630210659-9950 -n embed-certs-20220630210659-9950
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-20220630210659-9950 -n embed-certs-20220630210659-9950: exit status 7 (101.328471ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-amd64 addons enable dashboard -p embed-certs-20220630210659-9950 --images=MetricsScraper=k8s.gcr.io/echoserver:1.4
--- PASS: TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.23s)

                                                
                                    

Test skip (23/266)

x
+
TestDownloadOnly/v1.16.0/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/cached-images
aaa_download_only_test.go:121: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.16.0/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.16.0/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/binaries
aaa_download_only_test.go:140: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.16.0/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.16.0/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/kubectl
aaa_download_only_test.go:156: Test for darwin and windows
--- SKIP: TestDownloadOnly/v1.16.0/kubectl (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.24.2/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.24.2/cached-images
aaa_download_only_test.go:121: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.24.2/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.24.2/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.24.2/binaries
aaa_download_only_test.go:140: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.24.2/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.24.2/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.24.2/kubectl
aaa_download_only_test.go:156: Test for darwin and windows
--- SKIP: TestDownloadOnly/v1.24.2/kubectl (0.00s)

                                                
                                    
x
+
TestAddons/parallel/Olm (0s)

                                                
                                                
=== RUN   TestAddons/parallel/Olm
=== PAUSE TestAddons/parallel/Olm

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Olm
addons_test.go:450: Skipping OLM addon test until https://github.com/operator-framework/operator-lifecycle-manager/issues/2534 is resolved
--- SKIP: TestAddons/parallel/Olm (0.00s)

                                                
                                    
x
+
TestDockerFlags (0s)

                                                
                                                
=== RUN   TestDockerFlags
docker_test.go:35: skipping: only runs with docker container runtime, currently testing containerd
--- SKIP: TestDockerFlags (0.00s)

                                                
                                    
x
+
TestHyperKitDriverInstallOrUpdate (0s)

                                                
                                                
=== RUN   TestHyperKitDriverInstallOrUpdate
driver_install_or_update_test.go:105: Skip if not darwin.
--- SKIP: TestHyperKitDriverInstallOrUpdate (0.00s)

                                                
                                    
x
+
TestHyperkitDriverSkipUpgrade (0s)

                                                
                                                
=== RUN   TestHyperkitDriverSkipUpgrade
driver_install_or_update_test.go:169: Skip if not darwin.
--- SKIP: TestHyperkitDriverSkipUpgrade (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/DockerEnv (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/DockerEnv
=== PAUSE TestFunctional/parallel/DockerEnv

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DockerEnv
functional_test.go:455: only validate docker env with docker container runtime, currently testing containerd
--- SKIP: TestFunctional/parallel/DockerEnv (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/PodmanEnv (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/PodmanEnv
=== PAUSE TestFunctional/parallel/PodmanEnv

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/PodmanEnv
functional_test.go:542: only validate podman env with docker container runtime, currently testing containerd
--- SKIP: TestFunctional/parallel/PodmanEnv (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig
functional_test_tunnel_test.go:97: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil
functional_test_tunnel_test.go:97: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS
functional_test_tunnel_test.go:97: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (0.00s)

                                                
                                    
x
+
TestGvisorAddon (0s)

                                                
                                                
=== RUN   TestGvisorAddon
gvisor_addon_test.go:34: skipping test because --gvisor=false
--- SKIP: TestGvisorAddon (0.00s)

                                                
                                    
x
+
TestChangeNoneUser (0s)

                                                
                                                
=== RUN   TestChangeNoneUser
none_test.go:38: Only test none driver.
--- SKIP: TestChangeNoneUser (0.00s)

                                                
                                    
x
+
TestScheduledStopWindows (0s)

                                                
                                                
=== RUN   TestScheduledStopWindows
scheduled_stop_test.go:42: test only runs on windows
--- SKIP: TestScheduledStopWindows (0.00s)

                                                
                                    
x
+
TestSkaffold (0s)

                                                
                                                
=== RUN   TestSkaffold
skaffold_test.go:45: skaffold requires docker-env, currently testing containerd container runtime
--- SKIP: TestSkaffold (0.00s)

                                                
                                    
x
+
TestNetworkPlugins/group/kubenet (0.3s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kubenet
net_test.go:91: Skipping the test as containerd container runtimes requires CNI
helpers_test.go:175: Cleaning up "kubenet-20220630204858-9950" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p kubenet-20220630204858-9950
--- SKIP: TestNetworkPlugins/group/kubenet (0.30s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel (0.28s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel
net_test.go:79: flannel is not yet compatible with Docker driver: iptables v1.8.3 (legacy): Couldn't load target `CNI-x': No such file or directory
helpers_test.go:175: Cleaning up "flannel-20220630204858-9950" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p flannel-20220630204858-9950
--- SKIP: TestNetworkPlugins/group/flannel (0.28s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel (0.27s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel
net_test.go:79: flannel is not yet compatible with Docker driver: iptables v1.8.3 (legacy): Couldn't load target `CNI-x': No such file or directory
helpers_test.go:175: Cleaning up "custom-flannel-20220630204859-9950" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p custom-flannel-20220630204859-9950
--- SKIP: TestNetworkPlugins/group/custom-flannel (0.27s)

                                                
                                    
x
+
TestStartStop/group/disable-driver-mounts (0.27s)

                                                
                                                
=== RUN   TestStartStop/group/disable-driver-mounts
=== PAUSE TestStartStop/group/disable-driver-mounts

                                                
                                                

                                                
                                                
=== CONT  TestStartStop/group/disable-driver-mounts
start_stop_delete_test.go:103: skipping TestStartStop/group/disable-driver-mounts - only runs on virtualbox
helpers_test.go:175: Cleaning up "disable-driver-mounts-20220630210659-9950" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p disable-driver-mounts-20220630210659-9950
--- SKIP: TestStartStop/group/disable-driver-mounts (0.27s)

                                                
                                    
Copied to clipboard