=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:184: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-244815 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:184: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-244815 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m32.683486545s)
-- stdout --
* [old-k8s-version-244815] minikube v1.35.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=20400
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/20400-12456/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/20400-12456/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-244815" primary control-plane node in "old-k8s-version-244815" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0211 03:07:43.818157 60206 out.go:345] Setting OutFile to fd 1 ...
I0211 03:07:43.818323 60206 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0211 03:07:43.818336 60206 out.go:358] Setting ErrFile to fd 2...
I0211 03:07:43.818343 60206 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0211 03:07:43.818665 60206 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20400-12456/.minikube/bin
I0211 03:07:43.819472 60206 out.go:352] Setting JSON to false
I0211 03:07:43.820724 60206 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-7","uptime":6615,"bootTime":1739236649,"procs":226,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1075-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0211 03:07:43.820813 60206 start.go:139] virtualization: kvm guest
I0211 03:07:43.823055 60206 out.go:177] * [old-k8s-version-244815] minikube v1.35.0 on Ubuntu 20.04 (kvm/amd64)
I0211 03:07:43.824338 60206 notify.go:220] Checking for updates...
I0211 03:07:43.824346 60206 out.go:177] - MINIKUBE_LOCATION=20400
I0211 03:07:43.825648 60206 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0211 03:07:43.826903 60206 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/20400-12456/kubeconfig
I0211 03:07:43.828048 60206 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/20400-12456/.minikube
I0211 03:07:43.829211 60206 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0211 03:07:43.830344 60206 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0211 03:07:43.832107 60206 config.go:182] Loaded profile config "cert-expiration-411526": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.1
I0211 03:07:43.832261 60206 config.go:182] Loaded profile config "kubernetes-upgrade-241335": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0211 03:07:43.832409 60206 config.go:182] Loaded profile config "stopped-upgrade-285044": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.24.1
I0211 03:07:43.832516 60206 driver.go:394] Setting default libvirt URI to qemu:///system
I0211 03:07:43.869016 60206 out.go:177] * Using the kvm2 driver based on user configuration
I0211 03:07:43.870286 60206 start.go:297] selected driver: kvm2
I0211 03:07:43.870304 60206 start.go:901] validating driver "kvm2" against <nil>
I0211 03:07:43.870319 60206 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0211 03:07:43.871409 60206 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0211 03:07:43.871521 60206 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/20400-12456/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0211 03:07:43.889228 60206 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.35.0
I0211 03:07:43.889285 60206 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0211 03:07:43.889611 60206 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0211 03:07:43.889658 60206 cni.go:84] Creating CNI manager for ""
I0211 03:07:43.889721 60206 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0211 03:07:43.889737 60206 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0211 03:07:43.889803 60206 start.go:340] cluster config:
{Name:old-k8s-version-244815 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-244815 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRI
Socket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:
0 GPUs: AutoPauseInterval:1m0s}
I0211 03:07:43.889932 60206 iso.go:125] acquiring lock: {Name:mkf866c6e52b4efa55cc59a9f329105471716f9f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0211 03:07:43.891650 60206 out.go:177] * Starting "old-k8s-version-244815" primary control-plane node in "old-k8s-version-244815" cluster
I0211 03:07:43.892815 60206 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0211 03:07:43.892867 60206 preload.go:146] Found local preload: /home/jenkins/minikube-integration/20400-12456/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0211 03:07:43.892882 60206 cache.go:56] Caching tarball of preloaded images
I0211 03:07:43.892988 60206 preload.go:172] Found /home/jenkins/minikube-integration/20400-12456/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0211 03:07:43.893003 60206 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0211 03:07:43.893137 60206 profile.go:143] Saving config to /home/jenkins/minikube-integration/20400-12456/.minikube/profiles/old-k8s-version-244815/config.json ...
I0211 03:07:43.893167 60206 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20400-12456/.minikube/profiles/old-k8s-version-244815/config.json: {Name:mk21212be90c06ca8d8a3694b48ce28e8528523b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0211 03:07:43.893358 60206 start.go:360] acquireMachinesLock for old-k8s-version-244815: {Name:mk0cbf79bfabdb28d0a301765db34c154a72eff0 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0211 03:07:43.893432 60206 start.go:364] duration metric: took 41.474µs to acquireMachinesLock for "old-k8s-version-244815"
I0211 03:07:43.893461 60206 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-244815 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-versi
on-244815 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMir
ror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0211 03:07:43.893550 60206 start.go:125] createHost starting for "" (driver="kvm2")
I0211 03:07:43.895005 60206 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0211 03:07:43.895194 60206 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0211 03:07:43.895249 60206 main.go:141] libmachine: Launching plugin server for driver kvm2
I0211 03:07:43.910696 60206 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44625
I0211 03:07:43.911240 60206 main.go:141] libmachine: () Calling .GetVersion
I0211 03:07:43.911938 60206 main.go:141] libmachine: Using API Version 1
I0211 03:07:43.911964 60206 main.go:141] libmachine: () Calling .SetConfigRaw
I0211 03:07:43.912398 60206 main.go:141] libmachine: () Calling .GetMachineName
I0211 03:07:43.912650 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetMachineName
I0211 03:07:43.912831 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .DriverName
I0211 03:07:43.912985 60206 start.go:159] libmachine.API.Create for "old-k8s-version-244815" (driver="kvm2")
I0211 03:07:43.913029 60206 client.go:168] LocalClient.Create starting
I0211 03:07:43.913069 60206 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20400-12456/.minikube/certs/ca.pem
I0211 03:07:43.913129 60206 main.go:141] libmachine: Decoding PEM data...
I0211 03:07:43.913155 60206 main.go:141] libmachine: Parsing certificate...
I0211 03:07:43.913218 60206 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20400-12456/.minikube/certs/cert.pem
I0211 03:07:43.913248 60206 main.go:141] libmachine: Decoding PEM data...
I0211 03:07:43.913264 60206 main.go:141] libmachine: Parsing certificate...
I0211 03:07:43.913297 60206 main.go:141] libmachine: Running pre-create checks...
I0211 03:07:43.913313 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .PreCreateCheck
I0211 03:07:43.913659 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetConfigRaw
I0211 03:07:43.914077 60206 main.go:141] libmachine: Creating machine...
I0211 03:07:43.914092 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .Create
I0211 03:07:43.914241 60206 main.go:141] libmachine: (old-k8s-version-244815) creating KVM machine...
I0211 03:07:43.914256 60206 main.go:141] libmachine: (old-k8s-version-244815) creating network...
I0211 03:07:43.915729 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | found existing default KVM network
I0211 03:07:43.917864 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | I0211 03:07:43.917675 60230 network.go:206] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc00020b7f0}
I0211 03:07:43.917898 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | created network xml:
I0211 03:07:43.917912 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | <network>
I0211 03:07:43.917921 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | <name>mk-old-k8s-version-244815</name>
I0211 03:07:43.917931 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | <dns enable='no'/>
I0211 03:07:43.917937 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG |
I0211 03:07:43.917948 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | <ip address='192.168.39.1' netmask='255.255.255.0'>
I0211 03:07:43.917956 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | <dhcp>
I0211 03:07:43.917974 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | <range start='192.168.39.2' end='192.168.39.253'/>
I0211 03:07:43.917990 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | </dhcp>
I0211 03:07:43.917998 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | </ip>
I0211 03:07:43.918007 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG |
I0211 03:07:43.918014 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | </network>
I0211 03:07:43.918020 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG |
I0211 03:07:43.923128 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | trying to create private KVM network mk-old-k8s-version-244815 192.168.39.0/24...
I0211 03:07:43.997948 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | private KVM network mk-old-k8s-version-244815 192.168.39.0/24 created
I0211 03:07:43.997998 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | I0211 03:07:43.997915 60230 common.go:144] Making disk image using store path: /home/jenkins/minikube-integration/20400-12456/.minikube
I0211 03:07:43.998015 60206 main.go:141] libmachine: (old-k8s-version-244815) setting up store path in /home/jenkins/minikube-integration/20400-12456/.minikube/machines/old-k8s-version-244815 ...
I0211 03:07:43.998042 60206 main.go:141] libmachine: (old-k8s-version-244815) building disk image from file:///home/jenkins/minikube-integration/20400-12456/.minikube/cache/iso/amd64/minikube-v1.35.0-amd64.iso
I0211 03:07:43.998160 60206 main.go:141] libmachine: (old-k8s-version-244815) Downloading /home/jenkins/minikube-integration/20400-12456/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/20400-12456/.minikube/cache/iso/amd64/minikube-v1.35.0-amd64.iso...
I0211 03:07:44.264191 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | I0211 03:07:44.264023 60230 common.go:151] Creating ssh key: /home/jenkins/minikube-integration/20400-12456/.minikube/machines/old-k8s-version-244815/id_rsa...
I0211 03:07:44.481267 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | I0211 03:07:44.481098 60230 common.go:157] Creating raw disk image: /home/jenkins/minikube-integration/20400-12456/.minikube/machines/old-k8s-version-244815/old-k8s-version-244815.rawdisk...
I0211 03:07:44.481304 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | Writing magic tar header
I0211 03:07:44.481327 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | Writing SSH key tar header
I0211 03:07:44.481339 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | I0211 03:07:44.481289 60230 common.go:171] Fixing permissions on /home/jenkins/minikube-integration/20400-12456/.minikube/machines/old-k8s-version-244815 ...
I0211 03:07:44.481464 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20400-12456/.minikube/machines/old-k8s-version-244815
I0211 03:07:44.481515 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20400-12456/.minikube/machines
I0211 03:07:44.481535 60206 main.go:141] libmachine: (old-k8s-version-244815) setting executable bit set on /home/jenkins/minikube-integration/20400-12456/.minikube/machines/old-k8s-version-244815 (perms=drwx------)
I0211 03:07:44.481562 60206 main.go:141] libmachine: (old-k8s-version-244815) setting executable bit set on /home/jenkins/minikube-integration/20400-12456/.minikube/machines (perms=drwxr-xr-x)
I0211 03:07:44.481585 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20400-12456/.minikube
I0211 03:07:44.481601 60206 main.go:141] libmachine: (old-k8s-version-244815) setting executable bit set on /home/jenkins/minikube-integration/20400-12456/.minikube (perms=drwxr-xr-x)
I0211 03:07:44.481621 60206 main.go:141] libmachine: (old-k8s-version-244815) setting executable bit set on /home/jenkins/minikube-integration/20400-12456 (perms=drwxrwxr-x)
I0211 03:07:44.481636 60206 main.go:141] libmachine: (old-k8s-version-244815) setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0211 03:07:44.481653 60206 main.go:141] libmachine: (old-k8s-version-244815) setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0211 03:07:44.481682 60206 main.go:141] libmachine: (old-k8s-version-244815) creating domain...
I0211 03:07:44.481697 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20400-12456
I0211 03:07:44.481714 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | checking permissions on dir: /home/jenkins/minikube-integration
I0211 03:07:44.481729 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | checking permissions on dir: /home/jenkins
I0211 03:07:44.481739 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | checking permissions on dir: /home
I0211 03:07:44.481753 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | skipping /home - not owner
I0211 03:07:44.482827 60206 main.go:141] libmachine: (old-k8s-version-244815) define libvirt domain using xml:
I0211 03:07:44.482863 60206 main.go:141] libmachine: (old-k8s-version-244815) <domain type='kvm'>
I0211 03:07:44.482903 60206 main.go:141] libmachine: (old-k8s-version-244815) <name>old-k8s-version-244815</name>
I0211 03:07:44.482920 60206 main.go:141] libmachine: (old-k8s-version-244815) <memory unit='MiB'>2200</memory>
I0211 03:07:44.482933 60206 main.go:141] libmachine: (old-k8s-version-244815) <vcpu>2</vcpu>
I0211 03:07:44.482943 60206 main.go:141] libmachine: (old-k8s-version-244815) <features>
I0211 03:07:44.482953 60206 main.go:141] libmachine: (old-k8s-version-244815) <acpi/>
I0211 03:07:44.482963 60206 main.go:141] libmachine: (old-k8s-version-244815) <apic/>
I0211 03:07:44.482978 60206 main.go:141] libmachine: (old-k8s-version-244815) <pae/>
I0211 03:07:44.482988 60206 main.go:141] libmachine: (old-k8s-version-244815)
I0211 03:07:44.483004 60206 main.go:141] libmachine: (old-k8s-version-244815) </features>
I0211 03:07:44.483015 60206 main.go:141] libmachine: (old-k8s-version-244815) <cpu mode='host-passthrough'>
I0211 03:07:44.483029 60206 main.go:141] libmachine: (old-k8s-version-244815)
I0211 03:07:44.483039 60206 main.go:141] libmachine: (old-k8s-version-244815) </cpu>
I0211 03:07:44.483048 60206 main.go:141] libmachine: (old-k8s-version-244815) <os>
I0211 03:07:44.483058 60206 main.go:141] libmachine: (old-k8s-version-244815) <type>hvm</type>
I0211 03:07:44.483071 60206 main.go:141] libmachine: (old-k8s-version-244815) <boot dev='cdrom'/>
I0211 03:07:44.483082 60206 main.go:141] libmachine: (old-k8s-version-244815) <boot dev='hd'/>
I0211 03:07:44.483111 60206 main.go:141] libmachine: (old-k8s-version-244815) <bootmenu enable='no'/>
I0211 03:07:44.483136 60206 main.go:141] libmachine: (old-k8s-version-244815) </os>
I0211 03:07:44.483151 60206 main.go:141] libmachine: (old-k8s-version-244815) <devices>
I0211 03:07:44.483164 60206 main.go:141] libmachine: (old-k8s-version-244815) <disk type='file' device='cdrom'>
I0211 03:07:44.483182 60206 main.go:141] libmachine: (old-k8s-version-244815) <source file='/home/jenkins/minikube-integration/20400-12456/.minikube/machines/old-k8s-version-244815/boot2docker.iso'/>
I0211 03:07:44.483193 60206 main.go:141] libmachine: (old-k8s-version-244815) <target dev='hdc' bus='scsi'/>
I0211 03:07:44.483202 60206 main.go:141] libmachine: (old-k8s-version-244815) <readonly/>
I0211 03:07:44.483215 60206 main.go:141] libmachine: (old-k8s-version-244815) </disk>
I0211 03:07:44.483229 60206 main.go:141] libmachine: (old-k8s-version-244815) <disk type='file' device='disk'>
I0211 03:07:44.483296 60206 main.go:141] libmachine: (old-k8s-version-244815) <driver name='qemu' type='raw' cache='default' io='threads' />
I0211 03:07:44.483317 60206 main.go:141] libmachine: (old-k8s-version-244815) <source file='/home/jenkins/minikube-integration/20400-12456/.minikube/machines/old-k8s-version-244815/old-k8s-version-244815.rawdisk'/>
I0211 03:07:44.483328 60206 main.go:141] libmachine: (old-k8s-version-244815) <target dev='hda' bus='virtio'/>
I0211 03:07:44.483341 60206 main.go:141] libmachine: (old-k8s-version-244815) </disk>
I0211 03:07:44.483353 60206 main.go:141] libmachine: (old-k8s-version-244815) <interface type='network'>
I0211 03:07:44.483375 60206 main.go:141] libmachine: (old-k8s-version-244815) <source network='mk-old-k8s-version-244815'/>
I0211 03:07:44.483388 60206 main.go:141] libmachine: (old-k8s-version-244815) <model type='virtio'/>
I0211 03:07:44.483402 60206 main.go:141] libmachine: (old-k8s-version-244815) </interface>
I0211 03:07:44.483423 60206 main.go:141] libmachine: (old-k8s-version-244815) <interface type='network'>
I0211 03:07:44.483442 60206 main.go:141] libmachine: (old-k8s-version-244815) <source network='default'/>
I0211 03:07:44.483455 60206 main.go:141] libmachine: (old-k8s-version-244815) <model type='virtio'/>
I0211 03:07:44.483466 60206 main.go:141] libmachine: (old-k8s-version-244815) </interface>
I0211 03:07:44.483479 60206 main.go:141] libmachine: (old-k8s-version-244815) <serial type='pty'>
I0211 03:07:44.483490 60206 main.go:141] libmachine: (old-k8s-version-244815) <target port='0'/>
I0211 03:07:44.483502 60206 main.go:141] libmachine: (old-k8s-version-244815) </serial>
I0211 03:07:44.483515 60206 main.go:141] libmachine: (old-k8s-version-244815) <console type='pty'>
I0211 03:07:44.483528 60206 main.go:141] libmachine: (old-k8s-version-244815) <target type='serial' port='0'/>
I0211 03:07:44.483536 60206 main.go:141] libmachine: (old-k8s-version-244815) </console>
I0211 03:07:44.483549 60206 main.go:141] libmachine: (old-k8s-version-244815) <rng model='virtio'>
I0211 03:07:44.483562 60206 main.go:141] libmachine: (old-k8s-version-244815) <backend model='random'>/dev/random</backend>
I0211 03:07:44.483574 60206 main.go:141] libmachine: (old-k8s-version-244815) </rng>
I0211 03:07:44.483589 60206 main.go:141] libmachine: (old-k8s-version-244815)
I0211 03:07:44.483600 60206 main.go:141] libmachine: (old-k8s-version-244815)
I0211 03:07:44.483608 60206 main.go:141] libmachine: (old-k8s-version-244815) </devices>
I0211 03:07:44.483627 60206 main.go:141] libmachine: (old-k8s-version-244815) </domain>
I0211 03:07:44.483637 60206 main.go:141] libmachine: (old-k8s-version-244815)
I0211 03:07:44.488568 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | domain old-k8s-version-244815 has defined MAC address 52:54:00:70:82:cd in network default
I0211 03:07:44.489201 60206 main.go:141] libmachine: (old-k8s-version-244815) starting domain...
I0211 03:07:44.489221 60206 main.go:141] libmachine: (old-k8s-version-244815) ensuring networks are active...
I0211 03:07:44.489234 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | domain old-k8s-version-244815 has defined MAC address 52:54:00:5e:6f:f7 in network mk-old-k8s-version-244815
I0211 03:07:44.490077 60206 main.go:141] libmachine: (old-k8s-version-244815) Ensuring network default is active
I0211 03:07:44.490439 60206 main.go:141] libmachine: (old-k8s-version-244815) Ensuring network mk-old-k8s-version-244815 is active
I0211 03:07:44.491049 60206 main.go:141] libmachine: (old-k8s-version-244815) getting domain XML...
I0211 03:07:44.491874 60206 main.go:141] libmachine: (old-k8s-version-244815) creating domain...
I0211 03:07:45.767354 60206 main.go:141] libmachine: (old-k8s-version-244815) waiting for IP...
I0211 03:07:45.768323 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | domain old-k8s-version-244815 has defined MAC address 52:54:00:5e:6f:f7 in network mk-old-k8s-version-244815
I0211 03:07:45.768841 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | unable to find current IP address of domain old-k8s-version-244815 in network mk-old-k8s-version-244815
I0211 03:07:45.768907 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | I0211 03:07:45.768836 60230 retry.go:31] will retry after 258.626527ms: waiting for domain to come up
I0211 03:07:46.029311 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | domain old-k8s-version-244815 has defined MAC address 52:54:00:5e:6f:f7 in network mk-old-k8s-version-244815
I0211 03:07:46.029864 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | unable to find current IP address of domain old-k8s-version-244815 in network mk-old-k8s-version-244815
I0211 03:07:46.029905 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | I0211 03:07:46.029852 60230 retry.go:31] will retry after 258.036304ms: waiting for domain to come up
I0211 03:07:46.289058 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | domain old-k8s-version-244815 has defined MAC address 52:54:00:5e:6f:f7 in network mk-old-k8s-version-244815
I0211 03:07:46.289529 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | unable to find current IP address of domain old-k8s-version-244815 in network mk-old-k8s-version-244815
I0211 03:07:46.289634 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | I0211 03:07:46.289507 60230 retry.go:31] will retry after 486.820956ms: waiting for domain to come up
I0211 03:07:46.778125 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | domain old-k8s-version-244815 has defined MAC address 52:54:00:5e:6f:f7 in network mk-old-k8s-version-244815
I0211 03:07:46.778622 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | unable to find current IP address of domain old-k8s-version-244815 in network mk-old-k8s-version-244815
I0211 03:07:46.778655 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | I0211 03:07:46.778599 60230 retry.go:31] will retry after 600.448569ms: waiting for domain to come up
I0211 03:07:47.380970 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | domain old-k8s-version-244815 has defined MAC address 52:54:00:5e:6f:f7 in network mk-old-k8s-version-244815
I0211 03:07:47.381537 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | unable to find current IP address of domain old-k8s-version-244815 in network mk-old-k8s-version-244815
I0211 03:07:47.381589 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | I0211 03:07:47.381517 60230 retry.go:31] will retry after 536.710117ms: waiting for domain to come up
I0211 03:07:47.920573 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | domain old-k8s-version-244815 has defined MAC address 52:54:00:5e:6f:f7 in network mk-old-k8s-version-244815
I0211 03:07:47.921090 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | unable to find current IP address of domain old-k8s-version-244815 in network mk-old-k8s-version-244815
I0211 03:07:47.921150 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | I0211 03:07:47.921071 60230 retry.go:31] will retry after 759.536718ms: waiting for domain to come up
I0211 03:07:48.681892 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | domain old-k8s-version-244815 has defined MAC address 52:54:00:5e:6f:f7 in network mk-old-k8s-version-244815
I0211 03:07:48.682434 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | unable to find current IP address of domain old-k8s-version-244815 in network mk-old-k8s-version-244815
I0211 03:07:48.682465 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | I0211 03:07:48.682403 60230 retry.go:31] will retry after 1.044619581s: waiting for domain to come up
I0211 03:07:49.728328 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | domain old-k8s-version-244815 has defined MAC address 52:54:00:5e:6f:f7 in network mk-old-k8s-version-244815
I0211 03:07:49.728921 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | unable to find current IP address of domain old-k8s-version-244815 in network mk-old-k8s-version-244815
I0211 03:07:49.728947 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | I0211 03:07:49.728885 60230 retry.go:31] will retry after 1.017398761s: waiting for domain to come up
I0211 03:07:50.748004 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | domain old-k8s-version-244815 has defined MAC address 52:54:00:5e:6f:f7 in network mk-old-k8s-version-244815
I0211 03:07:50.748485 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | unable to find current IP address of domain old-k8s-version-244815 in network mk-old-k8s-version-244815
I0211 03:07:50.748527 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | I0211 03:07:50.748463 60230 retry.go:31] will retry after 1.625616563s: waiting for domain to come up
I0211 03:07:52.375736 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | domain old-k8s-version-244815 has defined MAC address 52:54:00:5e:6f:f7 in network mk-old-k8s-version-244815
I0211 03:07:52.376264 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | unable to find current IP address of domain old-k8s-version-244815 in network mk-old-k8s-version-244815
I0211 03:07:52.376292 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | I0211 03:07:52.376238 60230 retry.go:31] will retry after 1.56383072s: waiting for domain to come up
I0211 03:07:53.941705 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | domain old-k8s-version-244815 has defined MAC address 52:54:00:5e:6f:f7 in network mk-old-k8s-version-244815
I0211 03:07:53.942301 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | unable to find current IP address of domain old-k8s-version-244815 in network mk-old-k8s-version-244815
I0211 03:07:53.942374 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | I0211 03:07:53.942289 60230 retry.go:31] will retry after 2.260396512s: waiting for domain to come up
I0211 03:07:56.204068 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | domain old-k8s-version-244815 has defined MAC address 52:54:00:5e:6f:f7 in network mk-old-k8s-version-244815
I0211 03:07:56.204418 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | unable to find current IP address of domain old-k8s-version-244815 in network mk-old-k8s-version-244815
I0211 03:07:56.204450 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | I0211 03:07:56.204371 60230 retry.go:31] will retry after 2.622298529s: waiting for domain to come up
I0211 03:07:58.935734 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | domain old-k8s-version-244815 has defined MAC address 52:54:00:5e:6f:f7 in network mk-old-k8s-version-244815
I0211 03:07:58.936151 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | unable to find current IP address of domain old-k8s-version-244815 in network mk-old-k8s-version-244815
I0211 03:07:58.936222 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | I0211 03:07:58.936135 60230 retry.go:31] will retry after 3.938434562s: waiting for domain to come up
I0211 03:08:02.875868 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | domain old-k8s-version-244815 has defined MAC address 52:54:00:5e:6f:f7 in network mk-old-k8s-version-244815
I0211 03:08:02.876332 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | unable to find current IP address of domain old-k8s-version-244815 in network mk-old-k8s-version-244815
I0211 03:08:02.876360 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | I0211 03:08:02.876311 60230 retry.go:31] will retry after 3.777960543s: waiting for domain to come up
I0211 03:08:06.657489 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | domain old-k8s-version-244815 has defined MAC address 52:54:00:5e:6f:f7 in network mk-old-k8s-version-244815
I0211 03:08:06.658040 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | domain old-k8s-version-244815 has current primary IP address 192.168.39.206 and MAC address 52:54:00:5e:6f:f7 in network mk-old-k8s-version-244815
I0211 03:08:06.658066 60206 main.go:141] libmachine: (old-k8s-version-244815) found domain IP: 192.168.39.206
I0211 03:08:06.658086 60206 main.go:141] libmachine: (old-k8s-version-244815) reserving static IP address...
I0211 03:08:06.658453 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-244815", mac: "52:54:00:5e:6f:f7", ip: "192.168.39.206"} in network mk-old-k8s-version-244815
I0211 03:08:06.731415 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | Getting to WaitForSSH function...
I0211 03:08:06.731450 60206 main.go:141] libmachine: (old-k8s-version-244815) reserved static IP address 192.168.39.206 for domain old-k8s-version-244815
I0211 03:08:06.731536 60206 main.go:141] libmachine: (old-k8s-version-244815) waiting for SSH...
I0211 03:08:06.733773 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | domain old-k8s-version-244815 has defined MAC address 52:54:00:5e:6f:f7 in network mk-old-k8s-version-244815
I0211 03:08:06.734100 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5e:6f:f7", ip: ""} in network mk-old-k8s-version-244815: {Iface:virbr1 ExpiryTime:2025-02-11 04:07:58 +0000 UTC Type:0 Mac:52:54:00:5e:6f:f7 Iaid: IPaddr:192.168.39.206 Prefix:24 Hostname:minikube Clientid:01:52:54:00:5e:6f:f7}
I0211 03:08:06.734148 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | domain old-k8s-version-244815 has defined IP address 192.168.39.206 and MAC address 52:54:00:5e:6f:f7 in network mk-old-k8s-version-244815
I0211 03:08:06.734291 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | Using SSH client type: external
I0211 03:08:06.734314 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | Using SSH private key: /home/jenkins/minikube-integration/20400-12456/.minikube/machines/old-k8s-version-244815/id_rsa (-rw-------)
I0211 03:08:06.734358 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.206 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/20400-12456/.minikube/machines/old-k8s-version-244815/id_rsa -p 22] /usr/bin/ssh <nil>}
I0211 03:08:06.734371 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | About to run SSH command:
I0211 03:08:06.734399 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | exit 0
I0211 03:08:06.854434 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | SSH cmd err, output: <nil>:
I0211 03:08:06.854706 60206 main.go:141] libmachine: (old-k8s-version-244815) KVM machine creation complete
I0211 03:08:06.855022 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetConfigRaw
I0211 03:08:06.855519 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .DriverName
I0211 03:08:06.855693 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .DriverName
I0211 03:08:06.855908 60206 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0211 03:08:06.855920 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetState
I0211 03:08:06.857391 60206 main.go:141] libmachine: Detecting operating system of created instance...
I0211 03:08:06.857407 60206 main.go:141] libmachine: Waiting for SSH to be available...
I0211 03:08:06.857414 60206 main.go:141] libmachine: Getting to WaitForSSH function...
I0211 03:08:06.857422 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetSSHHostname
I0211 03:08:06.859819 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | domain old-k8s-version-244815 has defined MAC address 52:54:00:5e:6f:f7 in network mk-old-k8s-version-244815
I0211 03:08:06.860203 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5e:6f:f7", ip: ""} in network mk-old-k8s-version-244815: {Iface:virbr1 ExpiryTime:2025-02-11 04:07:58 +0000 UTC Type:0 Mac:52:54:00:5e:6f:f7 Iaid: IPaddr:192.168.39.206 Prefix:24 Hostname:old-k8s-version-244815 Clientid:01:52:54:00:5e:6f:f7}
I0211 03:08:06.860232 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | domain old-k8s-version-244815 has defined IP address 192.168.39.206 and MAC address 52:54:00:5e:6f:f7 in network mk-old-k8s-version-244815
I0211 03:08:06.860412 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetSSHPort
I0211 03:08:06.860593 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetSSHKeyPath
I0211 03:08:06.860715 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetSSHKeyPath
I0211 03:08:06.860861 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetSSHUsername
I0211 03:08:06.861006 60206 main.go:141] libmachine: Using SSH client type: native
I0211 03:08:06.861183 60206 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x865ca0] 0x868980 <nil> [] 0s} 192.168.39.206 22 <nil> <nil>}
I0211 03:08:06.861201 60206 main.go:141] libmachine: About to run SSH command:
exit 0
I0211 03:08:06.957787 60206 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0211 03:08:06.957813 60206 main.go:141] libmachine: Detecting the provisioner...
I0211 03:08:06.957832 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetSSHHostname
I0211 03:08:06.960734 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | domain old-k8s-version-244815 has defined MAC address 52:54:00:5e:6f:f7 in network mk-old-k8s-version-244815
I0211 03:08:06.961086 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5e:6f:f7", ip: ""} in network mk-old-k8s-version-244815: {Iface:virbr1 ExpiryTime:2025-02-11 04:07:58 +0000 UTC Type:0 Mac:52:54:00:5e:6f:f7 Iaid: IPaddr:192.168.39.206 Prefix:24 Hostname:old-k8s-version-244815 Clientid:01:52:54:00:5e:6f:f7}
I0211 03:08:06.961110 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | domain old-k8s-version-244815 has defined IP address 192.168.39.206 and MAC address 52:54:00:5e:6f:f7 in network mk-old-k8s-version-244815
I0211 03:08:06.961251 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetSSHPort
I0211 03:08:06.961416 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetSSHKeyPath
I0211 03:08:06.961564 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetSSHKeyPath
I0211 03:08:06.961732 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetSSHUsername
I0211 03:08:06.961899 60206 main.go:141] libmachine: Using SSH client type: native
I0211 03:08:06.962057 60206 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x865ca0] 0x868980 <nil> [] 0s} 192.168.39.206 22 <nil> <nil>}
I0211 03:08:06.962067 60206 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0211 03:08:07.058915 60206 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0211 03:08:07.058986 60206 main.go:141] libmachine: found compatible host: buildroot
I0211 03:08:07.058995 60206 main.go:141] libmachine: Provisioning with buildroot...
I0211 03:08:07.059005 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetMachineName
I0211 03:08:07.059219 60206 buildroot.go:166] provisioning hostname "old-k8s-version-244815"
I0211 03:08:07.059242 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetMachineName
I0211 03:08:07.059402 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetSSHHostname
I0211 03:08:07.061932 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | domain old-k8s-version-244815 has defined MAC address 52:54:00:5e:6f:f7 in network mk-old-k8s-version-244815
I0211 03:08:07.062254 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5e:6f:f7", ip: ""} in network mk-old-k8s-version-244815: {Iface:virbr1 ExpiryTime:2025-02-11 04:07:58 +0000 UTC Type:0 Mac:52:54:00:5e:6f:f7 Iaid: IPaddr:192.168.39.206 Prefix:24 Hostname:old-k8s-version-244815 Clientid:01:52:54:00:5e:6f:f7}
I0211 03:08:07.062277 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | domain old-k8s-version-244815 has defined IP address 192.168.39.206 and MAC address 52:54:00:5e:6f:f7 in network mk-old-k8s-version-244815
I0211 03:08:07.062388 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetSSHPort
I0211 03:08:07.062558 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetSSHKeyPath
I0211 03:08:07.062704 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetSSHKeyPath
I0211 03:08:07.062842 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetSSHUsername
I0211 03:08:07.063011 60206 main.go:141] libmachine: Using SSH client type: native
I0211 03:08:07.063169 60206 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x865ca0] 0x868980 <nil> [] 0s} 192.168.39.206 22 <nil> <nil>}
I0211 03:08:07.063181 60206 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-244815 && echo "old-k8s-version-244815" | sudo tee /etc/hostname
I0211 03:08:07.171292 60206 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-244815
I0211 03:08:07.171324 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetSSHHostname
I0211 03:08:07.174763 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | domain old-k8s-version-244815 has defined MAC address 52:54:00:5e:6f:f7 in network mk-old-k8s-version-244815
I0211 03:08:07.175152 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5e:6f:f7", ip: ""} in network mk-old-k8s-version-244815: {Iface:virbr1 ExpiryTime:2025-02-11 04:07:58 +0000 UTC Type:0 Mac:52:54:00:5e:6f:f7 Iaid: IPaddr:192.168.39.206 Prefix:24 Hostname:old-k8s-version-244815 Clientid:01:52:54:00:5e:6f:f7}
I0211 03:08:07.175183 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | domain old-k8s-version-244815 has defined IP address 192.168.39.206 and MAC address 52:54:00:5e:6f:f7 in network mk-old-k8s-version-244815
I0211 03:08:07.175311 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetSSHPort
I0211 03:08:07.175499 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetSSHKeyPath
I0211 03:08:07.175663 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetSSHKeyPath
I0211 03:08:07.175800 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetSSHUsername
I0211 03:08:07.175968 60206 main.go:141] libmachine: Using SSH client type: native
I0211 03:08:07.176152 60206 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x865ca0] 0x868980 <nil> [] 0s} 192.168.39.206 22 <nil> <nil>}
I0211 03:08:07.176169 60206 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-244815' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-244815/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-244815' | sudo tee -a /etc/hosts;
fi
fi
I0211 03:08:07.278314 60206 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0211 03:08:07.278346 60206 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/20400-12456/.minikube CaCertPath:/home/jenkins/minikube-integration/20400-12456/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20400-12456/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20400-12456/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20400-12456/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20400-12456/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20400-12456/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20400-12456/.minikube}
I0211 03:08:07.278381 60206 buildroot.go:174] setting up certificates
I0211 03:08:07.278397 60206 provision.go:84] configureAuth start
I0211 03:08:07.278407 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetMachineName
I0211 03:08:07.278723 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetIP
I0211 03:08:07.281426 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | domain old-k8s-version-244815 has defined MAC address 52:54:00:5e:6f:f7 in network mk-old-k8s-version-244815
I0211 03:08:07.281823 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5e:6f:f7", ip: ""} in network mk-old-k8s-version-244815: {Iface:virbr1 ExpiryTime:2025-02-11 04:07:58 +0000 UTC Type:0 Mac:52:54:00:5e:6f:f7 Iaid: IPaddr:192.168.39.206 Prefix:24 Hostname:old-k8s-version-244815 Clientid:01:52:54:00:5e:6f:f7}
I0211 03:08:07.281851 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | domain old-k8s-version-244815 has defined IP address 192.168.39.206 and MAC address 52:54:00:5e:6f:f7 in network mk-old-k8s-version-244815
I0211 03:08:07.282022 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetSSHHostname
I0211 03:08:07.284211 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | domain old-k8s-version-244815 has defined MAC address 52:54:00:5e:6f:f7 in network mk-old-k8s-version-244815
I0211 03:08:07.284533 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5e:6f:f7", ip: ""} in network mk-old-k8s-version-244815: {Iface:virbr1 ExpiryTime:2025-02-11 04:07:58 +0000 UTC Type:0 Mac:52:54:00:5e:6f:f7 Iaid: IPaddr:192.168.39.206 Prefix:24 Hostname:old-k8s-version-244815 Clientid:01:52:54:00:5e:6f:f7}
I0211 03:08:07.284569 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | domain old-k8s-version-244815 has defined IP address 192.168.39.206 and MAC address 52:54:00:5e:6f:f7 in network mk-old-k8s-version-244815
I0211 03:08:07.284671 60206 provision.go:143] copyHostCerts
I0211 03:08:07.284722 60206 exec_runner.go:144] found /home/jenkins/minikube-integration/20400-12456/.minikube/key.pem, removing ...
I0211 03:08:07.284738 60206 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20400-12456/.minikube/key.pem
I0211 03:08:07.284788 60206 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20400-12456/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20400-12456/.minikube/key.pem (1679 bytes)
I0211 03:08:07.284864 60206 exec_runner.go:144] found /home/jenkins/minikube-integration/20400-12456/.minikube/ca.pem, removing ...
I0211 03:08:07.284871 60206 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20400-12456/.minikube/ca.pem
I0211 03:08:07.284890 60206 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20400-12456/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20400-12456/.minikube/ca.pem (1078 bytes)
I0211 03:08:07.284938 60206 exec_runner.go:144] found /home/jenkins/minikube-integration/20400-12456/.minikube/cert.pem, removing ...
I0211 03:08:07.284945 60206 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20400-12456/.minikube/cert.pem
I0211 03:08:07.284960 60206 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20400-12456/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20400-12456/.minikube/cert.pem (1123 bytes)
I0211 03:08:07.285001 60206 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20400-12456/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20400-12456/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20400-12456/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-244815 san=[127.0.0.1 192.168.39.206 localhost minikube old-k8s-version-244815]
I0211 03:08:07.375928 60206 provision.go:177] copyRemoteCerts
I0211 03:08:07.375988 60206 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0211 03:08:07.376010 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetSSHHostname
I0211 03:08:07.378796 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | domain old-k8s-version-244815 has defined MAC address 52:54:00:5e:6f:f7 in network mk-old-k8s-version-244815
I0211 03:08:07.379160 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5e:6f:f7", ip: ""} in network mk-old-k8s-version-244815: {Iface:virbr1 ExpiryTime:2025-02-11 04:07:58 +0000 UTC Type:0 Mac:52:54:00:5e:6f:f7 Iaid: IPaddr:192.168.39.206 Prefix:24 Hostname:old-k8s-version-244815 Clientid:01:52:54:00:5e:6f:f7}
I0211 03:08:07.379199 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | domain old-k8s-version-244815 has defined IP address 192.168.39.206 and MAC address 52:54:00:5e:6f:f7 in network mk-old-k8s-version-244815
I0211 03:08:07.379359 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetSSHPort
I0211 03:08:07.379515 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetSSHKeyPath
I0211 03:08:07.379633 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetSSHUsername
I0211 03:08:07.379738 60206 sshutil.go:53] new ssh client: &{IP:192.168.39.206 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20400-12456/.minikube/machines/old-k8s-version-244815/id_rsa Username:docker}
I0211 03:08:07.460530 60206 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20400-12456/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0211 03:08:07.483255 60206 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20400-12456/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0211 03:08:07.504694 60206 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20400-12456/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0211 03:08:07.526289 60206 provision.go:87] duration metric: took 247.879299ms to configureAuth
I0211 03:08:07.526318 60206 buildroot.go:189] setting minikube options for container-runtime
I0211 03:08:07.526486 60206 config.go:182] Loaded profile config "old-k8s-version-244815": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0211 03:08:07.526561 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetSSHHostname
I0211 03:08:07.528993 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | domain old-k8s-version-244815 has defined MAC address 52:54:00:5e:6f:f7 in network mk-old-k8s-version-244815
I0211 03:08:07.529283 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5e:6f:f7", ip: ""} in network mk-old-k8s-version-244815: {Iface:virbr1 ExpiryTime:2025-02-11 04:07:58 +0000 UTC Type:0 Mac:52:54:00:5e:6f:f7 Iaid: IPaddr:192.168.39.206 Prefix:24 Hostname:old-k8s-version-244815 Clientid:01:52:54:00:5e:6f:f7}
I0211 03:08:07.529324 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | domain old-k8s-version-244815 has defined IP address 192.168.39.206 and MAC address 52:54:00:5e:6f:f7 in network mk-old-k8s-version-244815
I0211 03:08:07.529429 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetSSHPort
I0211 03:08:07.529585 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetSSHKeyPath
I0211 03:08:07.529709 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetSSHKeyPath
I0211 03:08:07.529891 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetSSHUsername
I0211 03:08:07.530057 60206 main.go:141] libmachine: Using SSH client type: native
I0211 03:08:07.530214 60206 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x865ca0] 0x868980 <nil> [] 0s} 192.168.39.206 22 <nil> <nil>}
I0211 03:08:07.530228 60206 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0211 03:08:07.744329 60206 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0211 03:08:07.744354 60206 main.go:141] libmachine: Checking connection to Docker...
I0211 03:08:07.744361 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetURL
I0211 03:08:07.745646 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | using libvirt version 6000000
I0211 03:08:07.747707 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | domain old-k8s-version-244815 has defined MAC address 52:54:00:5e:6f:f7 in network mk-old-k8s-version-244815
I0211 03:08:07.748034 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5e:6f:f7", ip: ""} in network mk-old-k8s-version-244815: {Iface:virbr1 ExpiryTime:2025-02-11 04:07:58 +0000 UTC Type:0 Mac:52:54:00:5e:6f:f7 Iaid: IPaddr:192.168.39.206 Prefix:24 Hostname:old-k8s-version-244815 Clientid:01:52:54:00:5e:6f:f7}
I0211 03:08:07.748063 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | domain old-k8s-version-244815 has defined IP address 192.168.39.206 and MAC address 52:54:00:5e:6f:f7 in network mk-old-k8s-version-244815
I0211 03:08:07.748202 60206 main.go:141] libmachine: Docker is up and running!
I0211 03:08:07.748214 60206 main.go:141] libmachine: Reticulating splines...
I0211 03:08:07.748223 60206 client.go:171] duration metric: took 23.83518079s to LocalClient.Create
I0211 03:08:07.748248 60206 start.go:167] duration metric: took 23.835264325s to libmachine.API.Create "old-k8s-version-244815"
I0211 03:08:07.748260 60206 start.go:293] postStartSetup for "old-k8s-version-244815" (driver="kvm2")
I0211 03:08:07.748273 60206 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0211 03:08:07.748296 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .DriverName
I0211 03:08:07.748504 60206 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0211 03:08:07.748534 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetSSHHostname
I0211 03:08:07.750477 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | domain old-k8s-version-244815 has defined MAC address 52:54:00:5e:6f:f7 in network mk-old-k8s-version-244815
I0211 03:08:07.750809 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5e:6f:f7", ip: ""} in network mk-old-k8s-version-244815: {Iface:virbr1 ExpiryTime:2025-02-11 04:07:58 +0000 UTC Type:0 Mac:52:54:00:5e:6f:f7 Iaid: IPaddr:192.168.39.206 Prefix:24 Hostname:old-k8s-version-244815 Clientid:01:52:54:00:5e:6f:f7}
I0211 03:08:07.750837 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | domain old-k8s-version-244815 has defined IP address 192.168.39.206 and MAC address 52:54:00:5e:6f:f7 in network mk-old-k8s-version-244815
I0211 03:08:07.750933 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetSSHPort
I0211 03:08:07.751100 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetSSHKeyPath
I0211 03:08:07.751243 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetSSHUsername
I0211 03:08:07.751380 60206 sshutil.go:53] new ssh client: &{IP:192.168.39.206 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20400-12456/.minikube/machines/old-k8s-version-244815/id_rsa Username:docker}
I0211 03:08:07.828443 60206 ssh_runner.go:195] Run: cat /etc/os-release
I0211 03:08:07.832183 60206 info.go:137] Remote host: Buildroot 2023.02.9
I0211 03:08:07.832203 60206 filesync.go:126] Scanning /home/jenkins/minikube-integration/20400-12456/.minikube/addons for local assets ...
I0211 03:08:07.832250 60206 filesync.go:126] Scanning /home/jenkins/minikube-integration/20400-12456/.minikube/files for local assets ...
I0211 03:08:07.832327 60206 filesync.go:149] local asset: /home/jenkins/minikube-integration/20400-12456/.minikube/files/etc/ssl/certs/196452.pem -> 196452.pem in /etc/ssl/certs
I0211 03:08:07.832423 60206 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0211 03:08:07.841069 60206 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20400-12456/.minikube/files/etc/ssl/certs/196452.pem --> /etc/ssl/certs/196452.pem (1708 bytes)
I0211 03:08:07.862167 60206 start.go:296] duration metric: took 113.896546ms for postStartSetup
I0211 03:08:07.862210 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetConfigRaw
I0211 03:08:07.862825 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetIP
I0211 03:08:07.865400 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | domain old-k8s-version-244815 has defined MAC address 52:54:00:5e:6f:f7 in network mk-old-k8s-version-244815
I0211 03:08:07.865701 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5e:6f:f7", ip: ""} in network mk-old-k8s-version-244815: {Iface:virbr1 ExpiryTime:2025-02-11 04:07:58 +0000 UTC Type:0 Mac:52:54:00:5e:6f:f7 Iaid: IPaddr:192.168.39.206 Prefix:24 Hostname:old-k8s-version-244815 Clientid:01:52:54:00:5e:6f:f7}
I0211 03:08:07.865739 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | domain old-k8s-version-244815 has defined IP address 192.168.39.206 and MAC address 52:54:00:5e:6f:f7 in network mk-old-k8s-version-244815
I0211 03:08:07.865919 60206 profile.go:143] Saving config to /home/jenkins/minikube-integration/20400-12456/.minikube/profiles/old-k8s-version-244815/config.json ...
I0211 03:08:07.866114 60206 start.go:128] duration metric: took 23.972552671s to createHost
I0211 03:08:07.866141 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetSSHHostname
I0211 03:08:07.868106 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | domain old-k8s-version-244815 has defined MAC address 52:54:00:5e:6f:f7 in network mk-old-k8s-version-244815
I0211 03:08:07.868428 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5e:6f:f7", ip: ""} in network mk-old-k8s-version-244815: {Iface:virbr1 ExpiryTime:2025-02-11 04:07:58 +0000 UTC Type:0 Mac:52:54:00:5e:6f:f7 Iaid: IPaddr:192.168.39.206 Prefix:24 Hostname:old-k8s-version-244815 Clientid:01:52:54:00:5e:6f:f7}
I0211 03:08:07.868464 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | domain old-k8s-version-244815 has defined IP address 192.168.39.206 and MAC address 52:54:00:5e:6f:f7 in network mk-old-k8s-version-244815
I0211 03:08:07.868606 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetSSHPort
I0211 03:08:07.868768 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetSSHKeyPath
I0211 03:08:07.868890 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetSSHKeyPath
I0211 03:08:07.869002 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetSSHUsername
I0211 03:08:07.869146 60206 main.go:141] libmachine: Using SSH client type: native
I0211 03:08:07.869317 60206 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x865ca0] 0x868980 <nil> [] 0s} 192.168.39.206 22 <nil> <nil>}
I0211 03:08:07.869340 60206 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0211 03:08:07.963560 60206 main.go:141] libmachine: SSH cmd err, output: <nil>: 1739243287.939211016
I0211 03:08:07.963585 60206 fix.go:216] guest clock: 1739243287.939211016
I0211 03:08:07.963594 60206 fix.go:229] Guest: 2025-02-11 03:08:07.939211016 +0000 UTC Remote: 2025-02-11 03:08:07.866128612 +0000 UTC m=+24.099729581 (delta=73.082404ms)
I0211 03:08:07.963638 60206 fix.go:200] guest clock delta is within tolerance: 73.082404ms
I0211 03:08:07.963646 60206 start.go:83] releasing machines lock for "old-k8s-version-244815", held for 24.070199002s
I0211 03:08:07.963676 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .DriverName
I0211 03:08:07.963907 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetIP
I0211 03:08:07.966739 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | domain old-k8s-version-244815 has defined MAC address 52:54:00:5e:6f:f7 in network mk-old-k8s-version-244815
I0211 03:08:07.967201 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5e:6f:f7", ip: ""} in network mk-old-k8s-version-244815: {Iface:virbr1 ExpiryTime:2025-02-11 04:07:58 +0000 UTC Type:0 Mac:52:54:00:5e:6f:f7 Iaid: IPaddr:192.168.39.206 Prefix:24 Hostname:old-k8s-version-244815 Clientid:01:52:54:00:5e:6f:f7}
I0211 03:08:07.967230 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | domain old-k8s-version-244815 has defined IP address 192.168.39.206 and MAC address 52:54:00:5e:6f:f7 in network mk-old-k8s-version-244815
I0211 03:08:07.967453 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .DriverName
I0211 03:08:07.967936 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .DriverName
I0211 03:08:07.968134 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .DriverName
I0211 03:08:07.968200 60206 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0211 03:08:07.968255 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetSSHHostname
I0211 03:08:07.968430 60206 ssh_runner.go:195] Run: cat /version.json
I0211 03:08:07.968459 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetSSHHostname
I0211 03:08:07.971033 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | domain old-k8s-version-244815 has defined MAC address 52:54:00:5e:6f:f7 in network mk-old-k8s-version-244815
I0211 03:08:07.971368 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | domain old-k8s-version-244815 has defined MAC address 52:54:00:5e:6f:f7 in network mk-old-k8s-version-244815
I0211 03:08:07.971493 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5e:6f:f7", ip: ""} in network mk-old-k8s-version-244815: {Iface:virbr1 ExpiryTime:2025-02-11 04:07:58 +0000 UTC Type:0 Mac:52:54:00:5e:6f:f7 Iaid: IPaddr:192.168.39.206 Prefix:24 Hostname:old-k8s-version-244815 Clientid:01:52:54:00:5e:6f:f7}
I0211 03:08:07.971526 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | domain old-k8s-version-244815 has defined IP address 192.168.39.206 and MAC address 52:54:00:5e:6f:f7 in network mk-old-k8s-version-244815
I0211 03:08:07.971654 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetSSHPort
I0211 03:08:07.971804 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5e:6f:f7", ip: ""} in network mk-old-k8s-version-244815: {Iface:virbr1 ExpiryTime:2025-02-11 04:07:58 +0000 UTC Type:0 Mac:52:54:00:5e:6f:f7 Iaid: IPaddr:192.168.39.206 Prefix:24 Hostname:old-k8s-version-244815 Clientid:01:52:54:00:5e:6f:f7}
I0211 03:08:07.971824 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetSSHKeyPath
I0211 03:08:07.971825 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | domain old-k8s-version-244815 has defined IP address 192.168.39.206 and MAC address 52:54:00:5e:6f:f7 in network mk-old-k8s-version-244815
I0211 03:08:07.971954 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetSSHPort
I0211 03:08:07.972019 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetSSHUsername
I0211 03:08:07.972098 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetSSHKeyPath
I0211 03:08:07.972190 60206 sshutil.go:53] new ssh client: &{IP:192.168.39.206 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20400-12456/.minikube/machines/old-k8s-version-244815/id_rsa Username:docker}
I0211 03:08:07.972242 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetSSHUsername
I0211 03:08:07.972361 60206 sshutil.go:53] new ssh client: &{IP:192.168.39.206 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20400-12456/.minikube/machines/old-k8s-version-244815/id_rsa Username:docker}
I0211 03:08:08.071098 60206 ssh_runner.go:195] Run: systemctl --version
I0211 03:08:08.076912 60206 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0211 03:08:08.227859 60206 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0211 03:08:08.233222 60206 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0211 03:08:08.233287 60206 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0211 03:08:08.249178 60206 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0211 03:08:08.249201 60206 start.go:495] detecting cgroup driver to use...
I0211 03:08:08.249267 60206 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0211 03:08:08.266200 60206 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0211 03:08:08.279556 60206 docker.go:217] disabling cri-docker service (if available) ...
I0211 03:08:08.279610 60206 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0211 03:08:08.292713 60206 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0211 03:08:08.305577 60206 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0211 03:08:08.422157 60206 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0211 03:08:08.575466 60206 docker.go:233] disabling docker service ...
I0211 03:08:08.575543 60206 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0211 03:08:08.589017 60206 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0211 03:08:08.601101 60206 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0211 03:08:08.738472 60206 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0211 03:08:08.858684 60206 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0211 03:08:08.872622 60206 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0211 03:08:08.890560 60206 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0211 03:08:08.890632 60206 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0211 03:08:08.901185 60206 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0211 03:08:08.901269 60206 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0211 03:08:08.911599 60206 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0211 03:08:08.922040 60206 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0211 03:08:08.932226 60206 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0211 03:08:08.942535 60206 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0211 03:08:08.951649 60206 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0211 03:08:08.951694 60206 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0211 03:08:08.971507 60206 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0211 03:08:08.981842 60206 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0211 03:08:09.106851 60206 ssh_runner.go:195] Run: sudo systemctl restart crio
I0211 03:08:09.207145 60206 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0211 03:08:09.207210 60206 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0211 03:08:09.213377 60206 start.go:563] Will wait 60s for crictl version
I0211 03:08:09.213453 60206 ssh_runner.go:195] Run: which crictl
I0211 03:08:09.217182 60206 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0211 03:08:09.262516 60206 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0211 03:08:09.262602 60206 ssh_runner.go:195] Run: crio --version
I0211 03:08:09.288775 60206 ssh_runner.go:195] Run: crio --version
I0211 03:08:09.317909 60206 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0211 03:08:09.319226 60206 main.go:141] libmachine: (old-k8s-version-244815) Calling .GetIP
I0211 03:08:09.322482 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | domain old-k8s-version-244815 has defined MAC address 52:54:00:5e:6f:f7 in network mk-old-k8s-version-244815
I0211 03:08:09.322910 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5e:6f:f7", ip: ""} in network mk-old-k8s-version-244815: {Iface:virbr1 ExpiryTime:2025-02-11 04:07:58 +0000 UTC Type:0 Mac:52:54:00:5e:6f:f7 Iaid: IPaddr:192.168.39.206 Prefix:24 Hostname:old-k8s-version-244815 Clientid:01:52:54:00:5e:6f:f7}
I0211 03:08:09.322942 60206 main.go:141] libmachine: (old-k8s-version-244815) DBG | domain old-k8s-version-244815 has defined IP address 192.168.39.206 and MAC address 52:54:00:5e:6f:f7 in network mk-old-k8s-version-244815
I0211 03:08:09.323207 60206 ssh_runner.go:195] Run: grep 192.168.39.1 host.minikube.internal$ /etc/hosts
I0211 03:08:09.327176 60206 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0211 03:08:09.338891 60206 kubeadm.go:883] updating cluster {Name:old-k8s-version-244815 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-244815 Namespace
:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.206 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror:
DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0211 03:08:09.339020 60206 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0211 03:08:09.339079 60206 ssh_runner.go:195] Run: sudo crictl images --output json
I0211 03:08:09.373905 60206 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0211 03:08:09.373976 60206 ssh_runner.go:195] Run: which lz4
I0211 03:08:09.378013 60206 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0211 03:08:09.382299 60206 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0211 03:08:09.382340 60206 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20400-12456/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0211 03:08:10.892123 60206 crio.go:462] duration metric: took 1.514141663s to copy over tarball
I0211 03:08:10.892202 60206 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0211 03:08:13.497429 60206 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.60520369s)
I0211 03:08:13.497455 60206 crio.go:469] duration metric: took 2.605302555s to extract the tarball
I0211 03:08:13.497462 60206 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0211 03:08:13.539306 60206 ssh_runner.go:195] Run: sudo crictl images --output json
I0211 03:08:13.581307 60206 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0211 03:08:13.581334 60206 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0211 03:08:13.581401 60206 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0211 03:08:13.581452 60206 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0211 03:08:13.581462 60206 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0211 03:08:13.581484 60206 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I0211 03:08:13.581501 60206 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I0211 03:08:13.581403 60206 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0211 03:08:13.581571 60206 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0211 03:08:13.581466 60206 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0211 03:08:13.582892 60206 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0211 03:08:13.582916 60206 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0211 03:08:13.582922 60206 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0211 03:08:13.582924 60206 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0211 03:08:13.582994 60206 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0211 03:08:13.582994 60206 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0211 03:08:13.583168 60206 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0211 03:08:13.583417 60206 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0211 03:08:13.729242 60206 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0211 03:08:13.732655 60206 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0211 03:08:13.733392 60206 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0211 03:08:13.742696 60206 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0211 03:08:13.757672 60206 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0211 03:08:13.764440 60206 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0211 03:08:13.766972 60206 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0211 03:08:13.853718 60206 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0211 03:08:13.853769 60206 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0211 03:08:13.853826 60206 ssh_runner.go:195] Run: which crictl
I0211 03:08:13.877765 60206 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0211 03:08:13.877803 60206 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0211 03:08:13.877821 60206 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0211 03:08:13.877834 60206 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0211 03:08:13.877881 60206 ssh_runner.go:195] Run: which crictl
I0211 03:08:13.877881 60206 ssh_runner.go:195] Run: which crictl
I0211 03:08:13.903152 60206 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0211 03:08:13.903173 60206 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0211 03:08:13.903206 60206 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0211 03:08:13.903206 60206 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0211 03:08:13.903254 60206 ssh_runner.go:195] Run: which crictl
I0211 03:08:13.903254 60206 ssh_runner.go:195] Run: which crictl
I0211 03:08:13.912436 60206 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0211 03:08:13.912450 60206 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0211 03:08:13.912477 60206 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0211 03:08:13.912495 60206 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0211 03:08:13.912527 60206 ssh_runner.go:195] Run: which crictl
I0211 03:08:13.912526 60206 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0211 03:08:13.912535 60206 ssh_runner.go:195] Run: which crictl
I0211 03:08:13.912552 60206 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0211 03:08:13.912600 60206 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0211 03:08:13.912605 60206 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0211 03:08:13.912627 60206 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0211 03:08:13.928149 60206 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0211 03:08:13.928159 60206 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0211 03:08:14.011736 60206 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0211 03:08:14.057512 60206 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0211 03:08:14.057587 60206 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0211 03:08:14.084993 60206 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0211 03:08:14.084993 60206 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0211 03:08:14.085068 60206 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0211 03:08:14.140278 60206 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0211 03:08:14.140321 60206 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0211 03:08:14.215057 60206 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0211 03:08:14.215143 60206 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0211 03:08:14.224576 60206 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0211 03:08:14.224609 60206 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0211 03:08:14.224638 60206 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0211 03:08:14.256422 60206 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0211 03:08:14.288522 60206 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20400-12456/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0211 03:08:14.332251 60206 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20400-12456/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0211 03:08:14.359917 60206 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20400-12456/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0211 03:08:14.369539 60206 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20400-12456/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0211 03:08:14.369547 60206 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20400-12456/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0211 03:08:14.376705 60206 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20400-12456/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0211 03:08:14.385806 60206 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20400-12456/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0211 03:08:14.512338 60206 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0211 03:08:14.651938 60206 cache_images.go:92] duration metric: took 1.070586497s to LoadCachedImages
W0211 03:08:14.652102 60206 out.go:270] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20400-12456/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20400-12456/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0: no such file or directory
I0211 03:08:14.652128 60206 kubeadm.go:934] updating node { 192.168.39.206 8443 v1.20.0 crio true true} ...
I0211 03:08:14.652245 60206 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-244815 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.39.206
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-244815 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0211 03:08:14.652332 60206 ssh_runner.go:195] Run: crio config
I0211 03:08:14.701069 60206 cni.go:84] Creating CNI manager for ""
I0211 03:08:14.701104 60206 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0211 03:08:14.701115 60206 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0211 03:08:14.701140 60206 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.206 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-244815 NodeName:old-k8s-version-244815 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.206"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.206 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0211 03:08:14.701277 60206 kubeadm.go:195] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.39.206
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-244815"
kubeletExtraArgs:
node-ip: 192.168.39.206
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.39.206"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0211 03:08:14.701334 60206 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0211 03:08:14.710760 60206 binaries.go:44] Found k8s binaries, skipping transfer
I0211 03:08:14.710832 60206 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0211 03:08:14.719663 60206 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0211 03:08:14.735976 60206 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0211 03:08:14.751761 60206 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2123 bytes)
I0211 03:08:14.767612 60206 ssh_runner.go:195] Run: grep 192.168.39.206 control-plane.minikube.internal$ /etc/hosts
I0211 03:08:14.771100 60206 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.206 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0211 03:08:14.782157 60206 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0211 03:08:14.891084 60206 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0211 03:08:14.908068 60206 certs.go:68] Setting up /home/jenkins/minikube-integration/20400-12456/.minikube/profiles/old-k8s-version-244815 for IP: 192.168.39.206
I0211 03:08:14.908087 60206 certs.go:194] generating shared ca certs ...
I0211 03:08:14.908103 60206 certs.go:226] acquiring lock for ca certs: {Name:mk14e70e4f3b98aff6eac535114852cc1d70eb3a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0211 03:08:14.908239 60206 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20400-12456/.minikube/ca.key
I0211 03:08:14.908310 60206 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20400-12456/.minikube/proxy-client-ca.key
I0211 03:08:14.908327 60206 certs.go:256] generating profile certs ...
I0211 03:08:14.908397 60206 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/20400-12456/.minikube/profiles/old-k8s-version-244815/client.key
I0211 03:08:14.908415 60206 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20400-12456/.minikube/profiles/old-k8s-version-244815/client.crt with IP's: []
I0211 03:08:15.238501 60206 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20400-12456/.minikube/profiles/old-k8s-version-244815/client.crt ...
I0211 03:08:15.238529 60206 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20400-12456/.minikube/profiles/old-k8s-version-244815/client.crt: {Name:mkf907a3ce1d7dab3d96caf9173af06977fd3fa7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0211 03:08:15.238726 60206 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20400-12456/.minikube/profiles/old-k8s-version-244815/client.key ...
I0211 03:08:15.238745 60206 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20400-12456/.minikube/profiles/old-k8s-version-244815/client.key: {Name:mkbc15cdd29653c583dc0cc126a1f659c6732e1b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0211 03:08:15.238860 60206 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/20400-12456/.minikube/profiles/old-k8s-version-244815/apiserver.key.717128d0
I0211 03:08:15.238899 60206 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20400-12456/.minikube/profiles/old-k8s-version-244815/apiserver.crt.717128d0 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.206]
I0211 03:08:15.367725 60206 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20400-12456/.minikube/profiles/old-k8s-version-244815/apiserver.crt.717128d0 ...
I0211 03:08:15.367755 60206 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20400-12456/.minikube/profiles/old-k8s-version-244815/apiserver.crt.717128d0: {Name:mkfaceeb91905cbadb702224f6d8f57762ba9eb2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0211 03:08:15.367934 60206 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20400-12456/.minikube/profiles/old-k8s-version-244815/apiserver.key.717128d0 ...
I0211 03:08:15.367957 60206 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20400-12456/.minikube/profiles/old-k8s-version-244815/apiserver.key.717128d0: {Name:mk1394f7773bf6b8c0ce1f747cc37bfe30d6c072 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0211 03:08:15.368058 60206 certs.go:381] copying /home/jenkins/minikube-integration/20400-12456/.minikube/profiles/old-k8s-version-244815/apiserver.crt.717128d0 -> /home/jenkins/minikube-integration/20400-12456/.minikube/profiles/old-k8s-version-244815/apiserver.crt
I0211 03:08:15.368164 60206 certs.go:385] copying /home/jenkins/minikube-integration/20400-12456/.minikube/profiles/old-k8s-version-244815/apiserver.key.717128d0 -> /home/jenkins/minikube-integration/20400-12456/.minikube/profiles/old-k8s-version-244815/apiserver.key
I0211 03:08:15.368250 60206 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/20400-12456/.minikube/profiles/old-k8s-version-244815/proxy-client.key
I0211 03:08:15.368272 60206 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20400-12456/.minikube/profiles/old-k8s-version-244815/proxy-client.crt with IP's: []
I0211 03:08:15.605524 60206 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20400-12456/.minikube/profiles/old-k8s-version-244815/proxy-client.crt ...
I0211 03:08:15.605556 60206 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20400-12456/.minikube/profiles/old-k8s-version-244815/proxy-client.crt: {Name:mk1c95f7745ad6ba80a10d38d83c27aa6a7b9ddb Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0211 03:08:15.605747 60206 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20400-12456/.minikube/profiles/old-k8s-version-244815/proxy-client.key ...
I0211 03:08:15.605765 60206 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20400-12456/.minikube/profiles/old-k8s-version-244815/proxy-client.key: {Name:mk3b90768531416dd03a8f32d17882bdc44b2af5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0211 03:08:15.606024 60206 certs.go:484] found cert: /home/jenkins/minikube-integration/20400-12456/.minikube/certs/19645.pem (1338 bytes)
W0211 03:08:15.606063 60206 certs.go:480] ignoring /home/jenkins/minikube-integration/20400-12456/.minikube/certs/19645_empty.pem, impossibly tiny 0 bytes
I0211 03:08:15.606074 60206 certs.go:484] found cert: /home/jenkins/minikube-integration/20400-12456/.minikube/certs/ca-key.pem (1675 bytes)
I0211 03:08:15.606093 60206 certs.go:484] found cert: /home/jenkins/minikube-integration/20400-12456/.minikube/certs/ca.pem (1078 bytes)
I0211 03:08:15.606121 60206 certs.go:484] found cert: /home/jenkins/minikube-integration/20400-12456/.minikube/certs/cert.pem (1123 bytes)
I0211 03:08:15.606142 60206 certs.go:484] found cert: /home/jenkins/minikube-integration/20400-12456/.minikube/certs/key.pem (1679 bytes)
I0211 03:08:15.606180 60206 certs.go:484] found cert: /home/jenkins/minikube-integration/20400-12456/.minikube/files/etc/ssl/certs/196452.pem (1708 bytes)
I0211 03:08:15.606731 60206 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20400-12456/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0211 03:08:15.630974 60206 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20400-12456/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0211 03:08:15.652627 60206 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20400-12456/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0211 03:08:15.675555 60206 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20400-12456/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0211 03:08:15.697246 60206 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20400-12456/.minikube/profiles/old-k8s-version-244815/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0211 03:08:15.721214 60206 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20400-12456/.minikube/profiles/old-k8s-version-244815/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0211 03:08:15.742609 60206 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20400-12456/.minikube/profiles/old-k8s-version-244815/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0211 03:08:15.769666 60206 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20400-12456/.minikube/profiles/old-k8s-version-244815/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0211 03:08:15.802936 60206 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20400-12456/.minikube/files/etc/ssl/certs/196452.pem --> /usr/share/ca-certificates/196452.pem (1708 bytes)
I0211 03:08:15.828183 60206 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20400-12456/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0211 03:08:15.849190 60206 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20400-12456/.minikube/certs/19645.pem --> /usr/share/ca-certificates/19645.pem (1338 bytes)
I0211 03:08:15.870151 60206 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0211 03:08:15.885036 60206 ssh_runner.go:195] Run: openssl version
I0211 03:08:15.890349 60206 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/196452.pem && ln -fs /usr/share/ca-certificates/196452.pem /etc/ssl/certs/196452.pem"
I0211 03:08:15.899791 60206 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/196452.pem
I0211 03:08:15.903824 60206 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Feb 11 02:09 /usr/share/ca-certificates/196452.pem
I0211 03:08:15.903881 60206 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/196452.pem
I0211 03:08:15.909189 60206 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/196452.pem /etc/ssl/certs/3ec20f2e.0"
I0211 03:08:15.918931 60206 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0211 03:08:15.929304 60206 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0211 03:08:15.933690 60206 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Feb 11 02:02 /usr/share/ca-certificates/minikubeCA.pem
I0211 03:08:15.933734 60206 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0211 03:08:15.939101 60206 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0211 03:08:15.949247 60206 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/19645.pem && ln -fs /usr/share/ca-certificates/19645.pem /etc/ssl/certs/19645.pem"
I0211 03:08:15.959750 60206 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/19645.pem
I0211 03:08:15.964016 60206 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Feb 11 02:09 /usr/share/ca-certificates/19645.pem
I0211 03:08:15.964072 60206 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/19645.pem
I0211 03:08:15.969632 60206 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/19645.pem /etc/ssl/certs/51391683.0"
I0211 03:08:15.980529 60206 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0211 03:08:15.984753 60206 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0211 03:08:15.984810 60206 kubeadm.go:392] StartCluster: {Name:old-k8s-version-244815 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-244815 Namespace:de
fault APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.206 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Dis
ableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0211 03:08:15.984899 60206 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0211 03:08:15.984951 60206 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0211 03:08:16.024943 60206 cri.go:89] found id: ""
I0211 03:08:16.025003 60206 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0211 03:08:16.034934 60206 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0211 03:08:16.044283 60206 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0211 03:08:16.054035 60206 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0211 03:08:16.054060 60206 kubeadm.go:157] found existing configuration files:
I0211 03:08:16.054121 60206 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0211 03:08:16.064967 60206 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0211 03:08:16.065021 60206 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0211 03:08:16.073543 60206 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0211 03:08:16.081678 60206 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0211 03:08:16.081733 60206 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0211 03:08:16.090111 60206 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0211 03:08:16.098058 60206 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0211 03:08:16.098110 60206 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0211 03:08:16.106299 60206 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0211 03:08:16.114234 60206 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0211 03:08:16.114287 60206 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0211 03:08:16.122272 60206 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0211 03:08:16.374359 60206 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0211 03:10:14.092931 60206 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0211 03:10:14.093032 60206 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0211 03:10:14.094533 60206 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0211 03:10:14.094647 60206 kubeadm.go:310] [preflight] Running pre-flight checks
I0211 03:10:14.094759 60206 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0211 03:10:14.094915 60206 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0211 03:10:14.095061 60206 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0211 03:10:14.095163 60206 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0211 03:10:14.097197 60206 out.go:235] - Generating certificates and keys ...
I0211 03:10:14.097296 60206 kubeadm.go:310] [certs] Using existing ca certificate authority
I0211 03:10:14.097400 60206 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0211 03:10:14.097502 60206 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0211 03:10:14.097588 60206 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0211 03:10:14.097673 60206 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0211 03:10:14.097732 60206 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0211 03:10:14.097814 60206 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0211 03:10:14.097967 60206 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-244815] and IPs [192.168.39.206 127.0.0.1 ::1]
I0211 03:10:14.098042 60206 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0211 03:10:14.098245 60206 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-244815] and IPs [192.168.39.206 127.0.0.1 ::1]
I0211 03:10:14.098344 60206 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0211 03:10:14.098441 60206 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0211 03:10:14.098514 60206 kubeadm.go:310] [certs] Generating "sa" key and public key
I0211 03:10:14.098595 60206 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0211 03:10:14.098643 60206 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0211 03:10:14.098689 60206 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0211 03:10:14.098758 60206 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0211 03:10:14.098805 60206 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0211 03:10:14.098936 60206 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0211 03:10:14.099075 60206 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0211 03:10:14.099144 60206 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0211 03:10:14.099236 60206 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0211 03:10:14.100728 60206 out.go:235] - Booting up control plane ...
I0211 03:10:14.100821 60206 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0211 03:10:14.100926 60206 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0211 03:10:14.101028 60206 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0211 03:10:14.101147 60206 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0211 03:10:14.101376 60206 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0211 03:10:14.101452 60206 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0211 03:10:14.101557 60206 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0211 03:10:14.101754 60206 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0211 03:10:14.101860 60206 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0211 03:10:14.102031 60206 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0211 03:10:14.102125 60206 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0211 03:10:14.102328 60206 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0211 03:10:14.102437 60206 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0211 03:10:14.102676 60206 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0211 03:10:14.102768 60206 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0211 03:10:14.103009 60206 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0211 03:10:14.103026 60206 kubeadm.go:310]
I0211 03:10:14.103086 60206 kubeadm.go:310] Unfortunately, an error has occurred:
I0211 03:10:14.103150 60206 kubeadm.go:310] timed out waiting for the condition
I0211 03:10:14.103159 60206 kubeadm.go:310]
I0211 03:10:14.103214 60206 kubeadm.go:310] This error is likely caused by:
I0211 03:10:14.103262 60206 kubeadm.go:310] - The kubelet is not running
I0211 03:10:14.103422 60206 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0211 03:10:14.103444 60206 kubeadm.go:310]
I0211 03:10:14.103568 60206 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0211 03:10:14.103617 60206 kubeadm.go:310] - 'systemctl status kubelet'
I0211 03:10:14.103671 60206 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0211 03:10:14.103680 60206 kubeadm.go:310]
I0211 03:10:14.103803 60206 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0211 03:10:14.103921 60206 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0211 03:10:14.103935 60206 kubeadm.go:310]
I0211 03:10:14.104027 60206 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0211 03:10:14.104106 60206 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0211 03:10:14.104192 60206 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0211 03:10:14.104278 60206 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0211 03:10:14.104315 60206 kubeadm.go:310]
W0211 03:10:14.104395 60206 out.go:270] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-244815] and IPs [192.168.39.206 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-244815] and IPs [192.168.39.206 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-244815] and IPs [192.168.39.206 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-244815] and IPs [192.168.39.206 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0211 03:10:14.104434 60206 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0211 03:10:19.446320 60206 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (5.341860105s)
I0211 03:10:19.446404 60206 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0211 03:10:19.460190 60206 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0211 03:10:19.469243 60206 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0211 03:10:19.469266 60206 kubeadm.go:157] found existing configuration files:
I0211 03:10:19.469317 60206 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0211 03:10:19.478394 60206 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0211 03:10:19.478443 60206 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0211 03:10:19.487183 60206 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0211 03:10:19.495288 60206 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0211 03:10:19.495344 60206 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0211 03:10:19.504506 60206 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0211 03:10:19.513123 60206 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0211 03:10:19.513178 60206 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0211 03:10:19.521849 60206 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0211 03:10:19.529691 60206 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0211 03:10:19.529737 60206 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0211 03:10:19.538252 60206 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0211 03:10:19.744438 60206 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0211 03:12:15.818754 60206 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0211 03:12:15.819015 60206 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0211 03:12:15.820839 60206 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0211 03:12:15.820902 60206 kubeadm.go:310] [preflight] Running pre-flight checks
I0211 03:12:15.821005 60206 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0211 03:12:15.821193 60206 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0211 03:12:15.821319 60206 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0211 03:12:15.821448 60206 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0211 03:12:15.823059 60206 out.go:235] - Generating certificates and keys ...
I0211 03:12:15.823169 60206 kubeadm.go:310] [certs] Using existing ca certificate authority
I0211 03:12:15.823279 60206 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0211 03:12:15.823397 60206 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0211 03:12:15.823496 60206 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0211 03:12:15.823596 60206 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0211 03:12:15.823691 60206 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0211 03:12:15.823796 60206 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0211 03:12:15.823883 60206 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0211 03:12:15.824009 60206 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0211 03:12:15.824112 60206 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0211 03:12:15.824168 60206 kubeadm.go:310] [certs] Using the existing "sa" key
I0211 03:12:15.824246 60206 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0211 03:12:15.824318 60206 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0211 03:12:15.824387 60206 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0211 03:12:15.824458 60206 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0211 03:12:15.824528 60206 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0211 03:12:15.824661 60206 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0211 03:12:15.824798 60206 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0211 03:12:15.824872 60206 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0211 03:12:15.824970 60206 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0211 03:12:15.826183 60206 out.go:235] - Booting up control plane ...
I0211 03:12:15.826253 60206 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0211 03:12:15.826314 60206 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0211 03:12:15.826391 60206 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0211 03:12:15.826512 60206 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0211 03:12:15.826732 60206 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0211 03:12:15.826800 60206 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0211 03:12:15.826938 60206 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0211 03:12:15.827203 60206 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0211 03:12:15.827298 60206 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0211 03:12:15.827538 60206 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0211 03:12:15.827620 60206 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0211 03:12:15.827823 60206 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0211 03:12:15.827934 60206 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0211 03:12:15.828204 60206 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0211 03:12:15.828289 60206 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0211 03:12:15.828466 60206 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0211 03:12:15.828476 60206 kubeadm.go:310]
I0211 03:12:15.828531 60206 kubeadm.go:310] Unfortunately, an error has occurred:
I0211 03:12:15.828586 60206 kubeadm.go:310] timed out waiting for the condition
I0211 03:12:15.828601 60206 kubeadm.go:310]
I0211 03:12:15.828654 60206 kubeadm.go:310] This error is likely caused by:
I0211 03:12:15.828702 60206 kubeadm.go:310] - The kubelet is not running
I0211 03:12:15.828859 60206 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0211 03:12:15.828876 60206 kubeadm.go:310]
I0211 03:12:15.829027 60206 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0211 03:12:15.829080 60206 kubeadm.go:310] - 'systemctl status kubelet'
I0211 03:12:15.829128 60206 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0211 03:12:15.829143 60206 kubeadm.go:310]
I0211 03:12:15.829294 60206 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0211 03:12:15.829426 60206 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0211 03:12:15.829438 60206 kubeadm.go:310]
I0211 03:12:15.829571 60206 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0211 03:12:15.829700 60206 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0211 03:12:15.829803 60206 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0211 03:12:15.829887 60206 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0211 03:12:15.829919 60206 kubeadm.go:310]
I0211 03:12:15.829945 60206 kubeadm.go:394] duration metric: took 3m59.84513826s to StartCluster
I0211 03:12:15.829988 60206 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0211 03:12:15.830036 60206 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0211 03:12:15.876003 60206 cri.go:89] found id: ""
I0211 03:12:15.876028 60206 logs.go:282] 0 containers: []
W0211 03:12:15.876039 60206 logs.go:284] No container was found matching "kube-apiserver"
I0211 03:12:15.876046 60206 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0211 03:12:15.876110 60206 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0211 03:12:15.909740 60206 cri.go:89] found id: ""
I0211 03:12:15.909769 60206 logs.go:282] 0 containers: []
W0211 03:12:15.909782 60206 logs.go:284] No container was found matching "etcd"
I0211 03:12:15.909791 60206 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0211 03:12:15.909876 60206 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0211 03:12:15.942687 60206 cri.go:89] found id: ""
I0211 03:12:15.942717 60206 logs.go:282] 0 containers: []
W0211 03:12:15.942728 60206 logs.go:284] No container was found matching "coredns"
I0211 03:12:15.942735 60206 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0211 03:12:15.942805 60206 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0211 03:12:15.983221 60206 cri.go:89] found id: ""
I0211 03:12:15.983247 60206 logs.go:282] 0 containers: []
W0211 03:12:15.983257 60206 logs.go:284] No container was found matching "kube-scheduler"
I0211 03:12:15.983264 60206 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0211 03:12:15.983323 60206 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0211 03:12:16.016097 60206 cri.go:89] found id: ""
I0211 03:12:16.016130 60206 logs.go:282] 0 containers: []
W0211 03:12:16.016143 60206 logs.go:284] No container was found matching "kube-proxy"
I0211 03:12:16.016152 60206 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0211 03:12:16.016213 60206 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0211 03:12:16.049017 60206 cri.go:89] found id: ""
I0211 03:12:16.049051 60206 logs.go:282] 0 containers: []
W0211 03:12:16.049064 60206 logs.go:284] No container was found matching "kube-controller-manager"
I0211 03:12:16.049073 60206 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0211 03:12:16.049135 60206 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0211 03:12:16.082424 60206 cri.go:89] found id: ""
I0211 03:12:16.082457 60206 logs.go:282] 0 containers: []
W0211 03:12:16.082472 60206 logs.go:284] No container was found matching "kindnet"
I0211 03:12:16.082485 60206 logs.go:123] Gathering logs for kubelet ...
I0211 03:12:16.082499 60206 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0211 03:12:16.132502 60206 logs.go:123] Gathering logs for dmesg ...
I0211 03:12:16.132537 60206 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0211 03:12:16.147941 60206 logs.go:123] Gathering logs for describe nodes ...
I0211 03:12:16.147977 60206 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0211 03:12:16.267533 60206 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0211 03:12:16.267559 60206 logs.go:123] Gathering logs for CRI-O ...
I0211 03:12:16.267574 60206 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0211 03:12:16.388931 60206 logs.go:123] Gathering logs for container status ...
I0211 03:12:16.388970 60206 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0211 03:12:16.431142 60206 out.go:418] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0211 03:12:16.431223 60206 out.go:270] *
*
W0211 03:12:16.431282 60206 out.go:270] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0211 03:12:16.431299 60206 out.go:270] *
*
W0211 03:12:16.432466 60206 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0211 03:12:16.435876 60206 out.go:201]
W0211 03:12:16.436937 60206 out.go:270] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0211 03:12:16.436980 60206 out.go:270] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0211 03:12:16.437003 60206 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0211 03:12:16.438395 60206 out.go:201]
** /stderr **
start_stop_delete_test.go:186: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-244815 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-244815 -n old-k8s-version-244815
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-244815 -n old-k8s-version-244815: exit status 6 (250.565287ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0211 03:12:16.717762 62822 status.go:458] kubeconfig endpoint: get endpoint: "old-k8s-version-244815" does not appear in /home/jenkins/minikube-integration/20400-12456/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-244815" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (272.98s)