=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-402923 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-402923 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m44.365043497s)
-- stdout --
* [old-k8s-version-402923] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=17991
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/17991-75602/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/17991-75602/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-402923" primary control-plane node in "old-k8s-version-402923" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0316 00:06:19.154878 120517 out.go:291] Setting OutFile to fd 1 ...
I0316 00:06:19.154991 120517 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0316 00:06:19.155000 120517 out.go:304] Setting ErrFile to fd 2...
I0316 00:06:19.155004 120517 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0316 00:06:19.155208 120517 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17991-75602/.minikube/bin
I0316 00:06:19.155928 120517 out.go:298] Setting JSON to false
I0316 00:06:19.157019 120517 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-7","uptime":10129,"bootTime":1710537450,"procs":214,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1053-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0316 00:06:19.157082 120517 start.go:139] virtualization: kvm guest
I0316 00:06:19.159444 120517 out.go:177] * [old-k8s-version-402923] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
I0316 00:06:19.160819 120517 out.go:177] - MINIKUBE_LOCATION=17991
I0316 00:06:19.161016 120517 notify.go:220] Checking for updates...
I0316 00:06:19.162113 120517 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0316 00:06:19.163255 120517 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/17991-75602/kubeconfig
I0316 00:06:19.164468 120517 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/17991-75602/.minikube
I0316 00:06:19.165763 120517 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0316 00:06:19.166985 120517 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0316 00:06:19.168785 120517 config.go:182] Loaded profile config "cert-expiration-982877": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0316 00:06:19.168932 120517 config.go:182] Loaded profile config "cert-options-313368": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0316 00:06:19.169044 120517 config.go:182] Loaded profile config "kubernetes-upgrade-209767": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.29.0-rc.2
I0316 00:06:19.169173 120517 driver.go:392] Setting default libvirt URI to qemu:///system
I0316 00:06:19.210267 120517 out.go:177] * Using the kvm2 driver based on user configuration
I0316 00:06:19.211559 120517 start.go:297] selected driver: kvm2
I0316 00:06:19.211579 120517 start.go:901] validating driver "kvm2" against <nil>
I0316 00:06:19.211594 120517 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0316 00:06:19.212656 120517 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0316 00:06:19.212744 120517 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/17991-75602/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0316 00:06:19.227761 120517 install.go:137] /home/jenkins/minikube-integration/17991-75602/.minikube/bin/docker-machine-driver-kvm2 version is 1.32.0
I0316 00:06:19.227802 120517 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0316 00:06:19.228005 120517 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0316 00:06:19.228065 120517 cni.go:84] Creating CNI manager for ""
I0316 00:06:19.228077 120517 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0316 00:06:19.228085 120517 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0316 00:06:19.228140 120517 start.go:340] cluster config:
{Name:old-k8s-version-402923 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-402923 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0316 00:06:19.228225 120517 iso.go:125] acquiring lock: {Name:mk679f027f9e50ee78a0d1853e4c249f45d74b45 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0316 00:06:19.229959 120517 out.go:177] * Starting "old-k8s-version-402923" primary control-plane node in "old-k8s-version-402923" cluster
I0316 00:06:19.231157 120517 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0316 00:06:19.231191 120517 preload.go:147] Found local preload: /home/jenkins/minikube-integration/17991-75602/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0316 00:06:19.231201 120517 cache.go:56] Caching tarball of preloaded images
I0316 00:06:19.231286 120517 preload.go:173] Found /home/jenkins/minikube-integration/17991-75602/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0316 00:06:19.231300 120517 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0316 00:06:19.231429 120517 profile.go:142] Saving config to /home/jenkins/minikube-integration/17991-75602/.minikube/profiles/old-k8s-version-402923/config.json ...
I0316 00:06:19.231453 120517 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17991-75602/.minikube/profiles/old-k8s-version-402923/config.json: {Name:mkdb7a6d9b30d2c855c641324acec232649ebbe2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0316 00:06:19.231607 120517 start.go:360] acquireMachinesLock for old-k8s-version-402923: {Name:mk0262afd87806fa1c563f43ca618d569f9ce09a Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0316 00:06:32.296521 120517 start.go:364] duration metric: took 13.064885629s to acquireMachinesLock for "old-k8s-version-402923"
I0316 00:06:32.296590 120517 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-402923 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17991/minikube-v1.32.1-1710520390-17991-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-402923 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0316 00:06:32.296757 120517 start.go:125] createHost starting for "" (driver="kvm2")
I0316 00:06:32.299042 120517 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0316 00:06:32.299243 120517 main.go:141] libmachine: Found binary path at /home/jenkins/minikube-integration/17991-75602/.minikube/bin/docker-machine-driver-kvm2
I0316 00:06:32.299290 120517 main.go:141] libmachine: Launching plugin server for driver kvm2
I0316 00:06:32.318632 120517 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35667
I0316 00:06:32.319114 120517 main.go:141] libmachine: () Calling .GetVersion
I0316 00:06:32.319843 120517 main.go:141] libmachine: Using API Version 1
I0316 00:06:32.319873 120517 main.go:141] libmachine: () Calling .SetConfigRaw
I0316 00:06:32.320207 120517 main.go:141] libmachine: () Calling .GetMachineName
I0316 00:06:32.320425 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetMachineName
I0316 00:06:32.320609 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .DriverName
I0316 00:06:32.320813 120517 start.go:159] libmachine.API.Create for "old-k8s-version-402923" (driver="kvm2")
I0316 00:06:32.320845 120517 client.go:168] LocalClient.Create starting
I0316 00:06:32.320880 120517 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/17991-75602/.minikube/certs/ca.pem
I0316 00:06:32.320929 120517 main.go:141] libmachine: Decoding PEM data...
I0316 00:06:32.320954 120517 main.go:141] libmachine: Parsing certificate...
I0316 00:06:32.321018 120517 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/17991-75602/.minikube/certs/cert.pem
I0316 00:06:32.321038 120517 main.go:141] libmachine: Decoding PEM data...
I0316 00:06:32.321057 120517 main.go:141] libmachine: Parsing certificate...
I0316 00:06:32.321073 120517 main.go:141] libmachine: Running pre-create checks...
I0316 00:06:32.321082 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .PreCreateCheck
I0316 00:06:32.321475 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetConfigRaw
I0316 00:06:32.321871 120517 main.go:141] libmachine: Creating machine...
I0316 00:06:32.321886 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .Create
I0316 00:06:32.321983 120517 main.go:141] libmachine: (old-k8s-version-402923) Creating KVM machine...
I0316 00:06:32.323197 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | found existing default KVM network
I0316 00:06:32.324673 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | I0316 00:06:32.324457 120798 network.go:209] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000015e30}
I0316 00:06:32.330588 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | trying to create private KVM network mk-old-k8s-version-402923 192.168.39.0/24...
I0316 00:06:32.399265 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | private KVM network mk-old-k8s-version-402923 192.168.39.0/24 created
I0316 00:06:32.399299 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | I0316 00:06:32.399221 120798 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/17991-75602/.minikube
I0316 00:06:32.399314 120517 main.go:141] libmachine: (old-k8s-version-402923) Setting up store path in /home/jenkins/minikube-integration/17991-75602/.minikube/machines/old-k8s-version-402923 ...
I0316 00:06:32.399355 120517 main.go:141] libmachine: (old-k8s-version-402923) Building disk image from file:///home/jenkins/minikube-integration/17991-75602/.minikube/cache/iso/amd64/minikube-v1.32.1-1710520390-17991-amd64.iso
I0316 00:06:32.399430 120517 main.go:141] libmachine: (old-k8s-version-402923) Downloading /home/jenkins/minikube-integration/17991-75602/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/17991-75602/.minikube/cache/iso/amd64/minikube-v1.32.1-1710520390-17991-amd64.iso...
I0316 00:06:32.650493 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | I0316 00:06:32.650376 120798 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/17991-75602/.minikube/machines/old-k8s-version-402923/id_rsa...
I0316 00:06:32.966422 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | I0316 00:06:32.966296 120798 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/17991-75602/.minikube/machines/old-k8s-version-402923/old-k8s-version-402923.rawdisk...
I0316 00:06:32.966453 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | Writing magic tar header
I0316 00:06:32.966482 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | Writing SSH key tar header
I0316 00:06:32.966513 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | I0316 00:06:32.966461 120798 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/17991-75602/.minikube/machines/old-k8s-version-402923 ...
I0316 00:06:32.966645 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17991-75602/.minikube/machines/old-k8s-version-402923
I0316 00:06:32.966680 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17991-75602/.minikube/machines
I0316 00:06:32.966696 120517 main.go:141] libmachine: (old-k8s-version-402923) Setting executable bit set on /home/jenkins/minikube-integration/17991-75602/.minikube/machines/old-k8s-version-402923 (perms=drwx------)
I0316 00:06:32.966715 120517 main.go:141] libmachine: (old-k8s-version-402923) Setting executable bit set on /home/jenkins/minikube-integration/17991-75602/.minikube/machines (perms=drwxr-xr-x)
I0316 00:06:32.966727 120517 main.go:141] libmachine: (old-k8s-version-402923) Setting executable bit set on /home/jenkins/minikube-integration/17991-75602/.minikube (perms=drwxr-xr-x)
I0316 00:06:32.966741 120517 main.go:141] libmachine: (old-k8s-version-402923) Setting executable bit set on /home/jenkins/minikube-integration/17991-75602 (perms=drwxrwxr-x)
I0316 00:06:32.966758 120517 main.go:141] libmachine: (old-k8s-version-402923) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0316 00:06:32.966788 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17991-75602/.minikube
I0316 00:06:32.966810 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17991-75602
I0316 00:06:32.966822 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0316 00:06:32.966834 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | Checking permissions on dir: /home/jenkins
I0316 00:06:32.966855 120517 main.go:141] libmachine: (old-k8s-version-402923) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0316 00:06:32.966877 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | Checking permissions on dir: /home
I0316 00:06:32.966887 120517 main.go:141] libmachine: (old-k8s-version-402923) Creating domain...
I0316 00:06:32.966902 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | Skipping /home - not owner
I0316 00:06:32.968131 120517 main.go:141] libmachine: (old-k8s-version-402923) define libvirt domain using xml:
I0316 00:06:32.968155 120517 main.go:141] libmachine: (old-k8s-version-402923) <domain type='kvm'>
I0316 00:06:32.968166 120517 main.go:141] libmachine: (old-k8s-version-402923) <name>old-k8s-version-402923</name>
I0316 00:06:32.968174 120517 main.go:141] libmachine: (old-k8s-version-402923) <memory unit='MiB'>2200</memory>
I0316 00:06:32.968182 120517 main.go:141] libmachine: (old-k8s-version-402923) <vcpu>2</vcpu>
I0316 00:06:32.968205 120517 main.go:141] libmachine: (old-k8s-version-402923) <features>
I0316 00:06:32.968218 120517 main.go:141] libmachine: (old-k8s-version-402923) <acpi/>
I0316 00:06:32.968224 120517 main.go:141] libmachine: (old-k8s-version-402923) <apic/>
I0316 00:06:32.968231 120517 main.go:141] libmachine: (old-k8s-version-402923) <pae/>
I0316 00:06:32.968238 120517 main.go:141] libmachine: (old-k8s-version-402923)
I0316 00:06:32.968247 120517 main.go:141] libmachine: (old-k8s-version-402923) </features>
I0316 00:06:32.968262 120517 main.go:141] libmachine: (old-k8s-version-402923) <cpu mode='host-passthrough'>
I0316 00:06:32.968273 120517 main.go:141] libmachine: (old-k8s-version-402923)
I0316 00:06:32.968285 120517 main.go:141] libmachine: (old-k8s-version-402923) </cpu>
I0316 00:06:32.968298 120517 main.go:141] libmachine: (old-k8s-version-402923) <os>
I0316 00:06:32.968307 120517 main.go:141] libmachine: (old-k8s-version-402923) <type>hvm</type>
I0316 00:06:32.968322 120517 main.go:141] libmachine: (old-k8s-version-402923) <boot dev='cdrom'/>
I0316 00:06:32.968329 120517 main.go:141] libmachine: (old-k8s-version-402923) <boot dev='hd'/>
I0316 00:06:32.968337 120517 main.go:141] libmachine: (old-k8s-version-402923) <bootmenu enable='no'/>
I0316 00:06:32.968343 120517 main.go:141] libmachine: (old-k8s-version-402923) </os>
I0316 00:06:32.968351 120517 main.go:141] libmachine: (old-k8s-version-402923) <devices>
I0316 00:06:32.968359 120517 main.go:141] libmachine: (old-k8s-version-402923) <disk type='file' device='cdrom'>
I0316 00:06:32.968374 120517 main.go:141] libmachine: (old-k8s-version-402923) <source file='/home/jenkins/minikube-integration/17991-75602/.minikube/machines/old-k8s-version-402923/boot2docker.iso'/>
I0316 00:06:32.968387 120517 main.go:141] libmachine: (old-k8s-version-402923) <target dev='hdc' bus='scsi'/>
I0316 00:06:32.968403 120517 main.go:141] libmachine: (old-k8s-version-402923) <readonly/>
I0316 00:06:32.968417 120517 main.go:141] libmachine: (old-k8s-version-402923) </disk>
I0316 00:06:32.968429 120517 main.go:141] libmachine: (old-k8s-version-402923) <disk type='file' device='disk'>
I0316 00:06:32.968440 120517 main.go:141] libmachine: (old-k8s-version-402923) <driver name='qemu' type='raw' cache='default' io='threads' />
I0316 00:06:32.968458 120517 main.go:141] libmachine: (old-k8s-version-402923) <source file='/home/jenkins/minikube-integration/17991-75602/.minikube/machines/old-k8s-version-402923/old-k8s-version-402923.rawdisk'/>
I0316 00:06:32.968467 120517 main.go:141] libmachine: (old-k8s-version-402923) <target dev='hda' bus='virtio'/>
I0316 00:06:32.968486 120517 main.go:141] libmachine: (old-k8s-version-402923) </disk>
I0316 00:06:32.968502 120517 main.go:141] libmachine: (old-k8s-version-402923) <interface type='network'>
I0316 00:06:32.968511 120517 main.go:141] libmachine: (old-k8s-version-402923) <source network='mk-old-k8s-version-402923'/>
I0316 00:06:32.968517 120517 main.go:141] libmachine: (old-k8s-version-402923) <model type='virtio'/>
I0316 00:06:32.968532 120517 main.go:141] libmachine: (old-k8s-version-402923) </interface>
I0316 00:06:32.968539 120517 main.go:141] libmachine: (old-k8s-version-402923) <interface type='network'>
I0316 00:06:32.968555 120517 main.go:141] libmachine: (old-k8s-version-402923) <source network='default'/>
I0316 00:06:32.968569 120517 main.go:141] libmachine: (old-k8s-version-402923) <model type='virtio'/>
I0316 00:06:32.968581 120517 main.go:141] libmachine: (old-k8s-version-402923) </interface>
I0316 00:06:32.968589 120517 main.go:141] libmachine: (old-k8s-version-402923) <serial type='pty'>
I0316 00:06:32.968598 120517 main.go:141] libmachine: (old-k8s-version-402923) <target port='0'/>
I0316 00:06:32.968612 120517 main.go:141] libmachine: (old-k8s-version-402923) </serial>
I0316 00:06:32.968621 120517 main.go:141] libmachine: (old-k8s-version-402923) <console type='pty'>
I0316 00:06:32.968629 120517 main.go:141] libmachine: (old-k8s-version-402923) <target type='serial' port='0'/>
I0316 00:06:32.968665 120517 main.go:141] libmachine: (old-k8s-version-402923) </console>
I0316 00:06:32.968690 120517 main.go:141] libmachine: (old-k8s-version-402923) <rng model='virtio'>
I0316 00:06:32.968704 120517 main.go:141] libmachine: (old-k8s-version-402923) <backend model='random'>/dev/random</backend>
I0316 00:06:32.968712 120517 main.go:141] libmachine: (old-k8s-version-402923) </rng>
I0316 00:06:32.968722 120517 main.go:141] libmachine: (old-k8s-version-402923)
I0316 00:06:32.968746 120517 main.go:141] libmachine: (old-k8s-version-402923)
I0316 00:06:32.968773 120517 main.go:141] libmachine: (old-k8s-version-402923) </devices>
I0316 00:06:32.968791 120517 main.go:141] libmachine: (old-k8s-version-402923) </domain>
I0316 00:06:32.968799 120517 main.go:141] libmachine: (old-k8s-version-402923)
I0316 00:06:32.973218 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | domain old-k8s-version-402923 has defined MAC address 52:54:00:8b:19:2a in network default
I0316 00:06:32.973921 120517 main.go:141] libmachine: (old-k8s-version-402923) Ensuring networks are active...
I0316 00:06:32.973948 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | domain old-k8s-version-402923 has defined MAC address 52:54:00:0d:b3:2b in network mk-old-k8s-version-402923
I0316 00:06:32.974757 120517 main.go:141] libmachine: (old-k8s-version-402923) Ensuring network default is active
I0316 00:06:32.975104 120517 main.go:141] libmachine: (old-k8s-version-402923) Ensuring network mk-old-k8s-version-402923 is active
I0316 00:06:32.975708 120517 main.go:141] libmachine: (old-k8s-version-402923) Getting domain xml...
I0316 00:06:32.976585 120517 main.go:141] libmachine: (old-k8s-version-402923) Creating domain...
I0316 00:06:34.300640 120517 main.go:141] libmachine: (old-k8s-version-402923) Waiting to get IP...
I0316 00:06:34.301573 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | domain old-k8s-version-402923 has defined MAC address 52:54:00:0d:b3:2b in network mk-old-k8s-version-402923
I0316 00:06:34.302054 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | unable to find current IP address of domain old-k8s-version-402923 in network mk-old-k8s-version-402923
I0316 00:06:34.302094 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | I0316 00:06:34.302038 120798 retry.go:31] will retry after 291.989094ms: waiting for machine to come up
I0316 00:06:34.595834 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | domain old-k8s-version-402923 has defined MAC address 52:54:00:0d:b3:2b in network mk-old-k8s-version-402923
I0316 00:06:34.596444 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | unable to find current IP address of domain old-k8s-version-402923 in network mk-old-k8s-version-402923
I0316 00:06:34.596499 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | I0316 00:06:34.596407 120798 retry.go:31] will retry after 245.39827ms: waiting for machine to come up
I0316 00:06:34.844033 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | domain old-k8s-version-402923 has defined MAC address 52:54:00:0d:b3:2b in network mk-old-k8s-version-402923
I0316 00:06:34.844540 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | unable to find current IP address of domain old-k8s-version-402923 in network mk-old-k8s-version-402923
I0316 00:06:34.844565 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | I0316 00:06:34.844496 120798 retry.go:31] will retry after 451.667552ms: waiting for machine to come up
I0316 00:06:35.298412 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | domain old-k8s-version-402923 has defined MAC address 52:54:00:0d:b3:2b in network mk-old-k8s-version-402923
I0316 00:06:35.298905 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | unable to find current IP address of domain old-k8s-version-402923 in network mk-old-k8s-version-402923
I0316 00:06:35.298941 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | I0316 00:06:35.298850 120798 retry.go:31] will retry after 448.805662ms: waiting for machine to come up
I0316 00:06:35.750003 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | domain old-k8s-version-402923 has defined MAC address 52:54:00:0d:b3:2b in network mk-old-k8s-version-402923
I0316 00:06:35.750460 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | unable to find current IP address of domain old-k8s-version-402923 in network mk-old-k8s-version-402923
I0316 00:06:35.750497 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | I0316 00:06:35.750408 120798 retry.go:31] will retry after 603.661067ms: waiting for machine to come up
I0316 00:06:36.355121 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | domain old-k8s-version-402923 has defined MAC address 52:54:00:0d:b3:2b in network mk-old-k8s-version-402923
I0316 00:06:36.355556 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | unable to find current IP address of domain old-k8s-version-402923 in network mk-old-k8s-version-402923
I0316 00:06:36.355583 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | I0316 00:06:36.355507 120798 retry.go:31] will retry after 699.589708ms: waiting for machine to come up
I0316 00:06:37.056464 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | domain old-k8s-version-402923 has defined MAC address 52:54:00:0d:b3:2b in network mk-old-k8s-version-402923
I0316 00:06:37.057111 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | unable to find current IP address of domain old-k8s-version-402923 in network mk-old-k8s-version-402923
I0316 00:06:37.057145 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | I0316 00:06:37.057049 120798 retry.go:31] will retry after 804.683956ms: waiting for machine to come up
I0316 00:06:37.863549 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | domain old-k8s-version-402923 has defined MAC address 52:54:00:0d:b3:2b in network mk-old-k8s-version-402923
I0316 00:06:37.863976 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | unable to find current IP address of domain old-k8s-version-402923 in network mk-old-k8s-version-402923
I0316 00:06:37.863996 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | I0316 00:06:37.863957 120798 retry.go:31] will retry after 1.420003056s: waiting for machine to come up
I0316 00:06:39.285412 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | domain old-k8s-version-402923 has defined MAC address 52:54:00:0d:b3:2b in network mk-old-k8s-version-402923
I0316 00:06:39.285970 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | unable to find current IP address of domain old-k8s-version-402923 in network mk-old-k8s-version-402923
I0316 00:06:39.285999 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | I0316 00:06:39.285923 120798 retry.go:31] will retry after 1.553432194s: waiting for machine to come up
I0316 00:06:40.842088 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | domain old-k8s-version-402923 has defined MAC address 52:54:00:0d:b3:2b in network mk-old-k8s-version-402923
I0316 00:06:40.842651 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | unable to find current IP address of domain old-k8s-version-402923 in network mk-old-k8s-version-402923
I0316 00:06:40.842681 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | I0316 00:06:40.842600 120798 retry.go:31] will retry after 1.479864987s: waiting for machine to come up
I0316 00:06:42.323940 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | domain old-k8s-version-402923 has defined MAC address 52:54:00:0d:b3:2b in network mk-old-k8s-version-402923
I0316 00:06:42.324372 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | unable to find current IP address of domain old-k8s-version-402923 in network mk-old-k8s-version-402923
I0316 00:06:42.324398 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | I0316 00:06:42.324343 120798 retry.go:31] will retry after 2.688971456s: waiting for machine to come up
I0316 00:06:45.015535 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | domain old-k8s-version-402923 has defined MAC address 52:54:00:0d:b3:2b in network mk-old-k8s-version-402923
I0316 00:06:45.016115 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | unable to find current IP address of domain old-k8s-version-402923 in network mk-old-k8s-version-402923
I0316 00:06:45.016143 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | I0316 00:06:45.016064 120798 retry.go:31] will retry after 3.45172657s: waiting for machine to come up
I0316 00:06:48.469967 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | domain old-k8s-version-402923 has defined MAC address 52:54:00:0d:b3:2b in network mk-old-k8s-version-402923
I0316 00:06:48.470627 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | unable to find current IP address of domain old-k8s-version-402923 in network mk-old-k8s-version-402923
I0316 00:06:48.470675 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | I0316 00:06:48.470601 120798 retry.go:31] will retry after 3.585583111s: waiting for machine to come up
I0316 00:06:52.060308 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | domain old-k8s-version-402923 has defined MAC address 52:54:00:0d:b3:2b in network mk-old-k8s-version-402923
I0316 00:06:52.060764 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | unable to find current IP address of domain old-k8s-version-402923 in network mk-old-k8s-version-402923
I0316 00:06:52.060782 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | I0316 00:06:52.060737 120798 retry.go:31] will retry after 3.733293602s: waiting for machine to come up
I0316 00:06:55.798157 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | domain old-k8s-version-402923 has defined MAC address 52:54:00:0d:b3:2b in network mk-old-k8s-version-402923
I0316 00:06:55.798651 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | domain old-k8s-version-402923 has current primary IP address 192.168.39.107 and MAC address 52:54:00:0d:b3:2b in network mk-old-k8s-version-402923
I0316 00:06:55.798680 120517 main.go:141] libmachine: (old-k8s-version-402923) Found IP for machine: 192.168.39.107
I0316 00:06:55.798726 120517 main.go:141] libmachine: (old-k8s-version-402923) Reserving static IP address...
I0316 00:06:55.799221 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-402923", mac: "52:54:00:0d:b3:2b", ip: "192.168.39.107"} in network mk-old-k8s-version-402923
I0316 00:06:55.875299 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | Getting to WaitForSSH function...
I0316 00:06:55.875351 120517 main.go:141] libmachine: (old-k8s-version-402923) Reserved static IP address: 192.168.39.107
I0316 00:06:55.875366 120517 main.go:141] libmachine: (old-k8s-version-402923) Waiting for SSH to be available...
I0316 00:06:55.877903 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | domain old-k8s-version-402923 has defined MAC address 52:54:00:0d:b3:2b in network mk-old-k8s-version-402923
I0316 00:06:55.878378 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:b3:2b", ip: ""} in network mk-old-k8s-version-402923: {Iface:virbr1 ExpiryTime:2024-03-16 01:06:48 +0000 UTC Type:0 Mac:52:54:00:0d:b3:2b Iaid: IPaddr:192.168.39.107 Prefix:24 Hostname:minikube Clientid:01:52:54:00:0d:b3:2b}
I0316 00:06:55.878424 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | domain old-k8s-version-402923 has defined IP address 192.168.39.107 and MAC address 52:54:00:0d:b3:2b in network mk-old-k8s-version-402923
I0316 00:06:55.878526 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | Using SSH client type: external
I0316 00:06:55.878559 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | Using SSH private key: /home/jenkins/minikube-integration/17991-75602/.minikube/machines/old-k8s-version-402923/id_rsa (-rw-------)
I0316 00:06:55.878596 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.107 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/17991-75602/.minikube/machines/old-k8s-version-402923/id_rsa -p 22] /usr/bin/ssh <nil>}
I0316 00:06:55.878612 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | About to run SSH command:
I0316 00:06:55.878637 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | exit 0
I0316 00:06:56.011149 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | SSH cmd err, output: <nil>:
I0316 00:06:56.011473 120517 main.go:141] libmachine: (old-k8s-version-402923) KVM machine creation complete!
I0316 00:06:56.011798 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetConfigRaw
I0316 00:06:56.012517 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .DriverName
I0316 00:06:56.012735 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .DriverName
I0316 00:06:56.012943 120517 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0316 00:06:56.012960 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetState
I0316 00:06:56.014204 120517 main.go:141] libmachine: Detecting operating system of created instance...
I0316 00:06:56.014219 120517 main.go:141] libmachine: Waiting for SSH to be available...
I0316 00:06:56.014225 120517 main.go:141] libmachine: Getting to WaitForSSH function...
I0316 00:06:56.014232 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetSSHHostname
I0316 00:06:56.016623 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | domain old-k8s-version-402923 has defined MAC address 52:54:00:0d:b3:2b in network mk-old-k8s-version-402923
I0316 00:06:56.017013 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:b3:2b", ip: ""} in network mk-old-k8s-version-402923: {Iface:virbr1 ExpiryTime:2024-03-16 01:06:48 +0000 UTC Type:0 Mac:52:54:00:0d:b3:2b Iaid: IPaddr:192.168.39.107 Prefix:24 Hostname:old-k8s-version-402923 Clientid:01:52:54:00:0d:b3:2b}
I0316 00:06:56.017058 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | domain old-k8s-version-402923 has defined IP address 192.168.39.107 and MAC address 52:54:00:0d:b3:2b in network mk-old-k8s-version-402923
I0316 00:06:56.017212 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetSSHPort
I0316 00:06:56.017381 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetSSHKeyPath
I0316 00:06:56.017527 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetSSHKeyPath
I0316 00:06:56.017637 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetSSHUsername
I0316 00:06:56.017852 120517 main.go:141] libmachine: Using SSH client type: native
I0316 00:06:56.018100 120517 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4a0] 0x830200 <nil> [] 0s} 192.168.39.107 22 <nil> <nil>}
I0316 00:06:56.018117 120517 main.go:141] libmachine: About to run SSH command:
exit 0
I0316 00:06:56.126514 120517 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0316 00:06:56.126546 120517 main.go:141] libmachine: Detecting the provisioner...
I0316 00:06:56.126556 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetSSHHostname
I0316 00:06:56.129289 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | domain old-k8s-version-402923 has defined MAC address 52:54:00:0d:b3:2b in network mk-old-k8s-version-402923
I0316 00:06:56.129677 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:b3:2b", ip: ""} in network mk-old-k8s-version-402923: {Iface:virbr1 ExpiryTime:2024-03-16 01:06:48 +0000 UTC Type:0 Mac:52:54:00:0d:b3:2b Iaid: IPaddr:192.168.39.107 Prefix:24 Hostname:old-k8s-version-402923 Clientid:01:52:54:00:0d:b3:2b}
I0316 00:06:56.129715 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | domain old-k8s-version-402923 has defined IP address 192.168.39.107 and MAC address 52:54:00:0d:b3:2b in network mk-old-k8s-version-402923
I0316 00:06:56.129793 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetSSHPort
I0316 00:06:56.130009 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetSSHKeyPath
I0316 00:06:56.130179 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetSSHKeyPath
I0316 00:06:56.130297 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetSSHUsername
I0316 00:06:56.130460 120517 main.go:141] libmachine: Using SSH client type: native
I0316 00:06:56.130631 120517 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4a0] 0x830200 <nil> [] 0s} 192.168.39.107 22 <nil> <nil>}
I0316 00:06:56.130642 120517 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0316 00:06:56.244330 120517 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0316 00:06:56.244424 120517 main.go:141] libmachine: found compatible host: buildroot
I0316 00:06:56.244435 120517 main.go:141] libmachine: Provisioning with buildroot...
I0316 00:06:56.244443 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetMachineName
I0316 00:06:56.244706 120517 buildroot.go:166] provisioning hostname "old-k8s-version-402923"
I0316 00:06:56.244736 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetMachineName
I0316 00:06:56.244917 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetSSHHostname
I0316 00:06:56.247565 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | domain old-k8s-version-402923 has defined MAC address 52:54:00:0d:b3:2b in network mk-old-k8s-version-402923
I0316 00:06:56.247853 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:b3:2b", ip: ""} in network mk-old-k8s-version-402923: {Iface:virbr1 ExpiryTime:2024-03-16 01:06:48 +0000 UTC Type:0 Mac:52:54:00:0d:b3:2b Iaid: IPaddr:192.168.39.107 Prefix:24 Hostname:old-k8s-version-402923 Clientid:01:52:54:00:0d:b3:2b}
I0316 00:06:56.247894 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | domain old-k8s-version-402923 has defined IP address 192.168.39.107 and MAC address 52:54:00:0d:b3:2b in network mk-old-k8s-version-402923
I0316 00:06:56.248035 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetSSHPort
I0316 00:06:56.248214 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetSSHKeyPath
I0316 00:06:56.248349 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetSSHKeyPath
I0316 00:06:56.248478 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetSSHUsername
I0316 00:06:56.248638 120517 main.go:141] libmachine: Using SSH client type: native
I0316 00:06:56.248868 120517 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4a0] 0x830200 <nil> [] 0s} 192.168.39.107 22 <nil> <nil>}
I0316 00:06:56.248888 120517 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-402923 && echo "old-k8s-version-402923" | sudo tee /etc/hostname
I0316 00:06:56.369647 120517 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-402923
I0316 00:06:56.369698 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetSSHHostname
I0316 00:06:56.372441 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | domain old-k8s-version-402923 has defined MAC address 52:54:00:0d:b3:2b in network mk-old-k8s-version-402923
I0316 00:06:56.372796 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:b3:2b", ip: ""} in network mk-old-k8s-version-402923: {Iface:virbr1 ExpiryTime:2024-03-16 01:06:48 +0000 UTC Type:0 Mac:52:54:00:0d:b3:2b Iaid: IPaddr:192.168.39.107 Prefix:24 Hostname:old-k8s-version-402923 Clientid:01:52:54:00:0d:b3:2b}
I0316 00:06:56.372824 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | domain old-k8s-version-402923 has defined IP address 192.168.39.107 and MAC address 52:54:00:0d:b3:2b in network mk-old-k8s-version-402923
I0316 00:06:56.373019 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetSSHPort
I0316 00:06:56.373222 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetSSHKeyPath
I0316 00:06:56.373411 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetSSHKeyPath
I0316 00:06:56.373560 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetSSHUsername
I0316 00:06:56.373738 120517 main.go:141] libmachine: Using SSH client type: native
I0316 00:06:56.373949 120517 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4a0] 0x830200 <nil> [] 0s} 192.168.39.107 22 <nil> <nil>}
I0316 00:06:56.373986 120517 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-402923' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-402923/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-402923' | sudo tee -a /etc/hosts;
fi
fi
I0316 00:06:56.492359 120517 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0316 00:06:56.492386 120517 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17991-75602/.minikube CaCertPath:/home/jenkins/minikube-integration/17991-75602/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17991-75602/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17991-75602/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17991-75602/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17991-75602/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17991-75602/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17991-75602/.minikube}
I0316 00:06:56.492413 120517 buildroot.go:174] setting up certificates
I0316 00:06:56.492424 120517 provision.go:84] configureAuth start
I0316 00:06:56.492438 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetMachineName
I0316 00:06:56.492695 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetIP
I0316 00:06:56.495435 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | domain old-k8s-version-402923 has defined MAC address 52:54:00:0d:b3:2b in network mk-old-k8s-version-402923
I0316 00:06:56.495748 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:b3:2b", ip: ""} in network mk-old-k8s-version-402923: {Iface:virbr1 ExpiryTime:2024-03-16 01:06:48 +0000 UTC Type:0 Mac:52:54:00:0d:b3:2b Iaid: IPaddr:192.168.39.107 Prefix:24 Hostname:old-k8s-version-402923 Clientid:01:52:54:00:0d:b3:2b}
I0316 00:06:56.495777 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | domain old-k8s-version-402923 has defined IP address 192.168.39.107 and MAC address 52:54:00:0d:b3:2b in network mk-old-k8s-version-402923
I0316 00:06:56.495886 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetSSHHostname
I0316 00:06:56.497864 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | domain old-k8s-version-402923 has defined MAC address 52:54:00:0d:b3:2b in network mk-old-k8s-version-402923
I0316 00:06:56.498188 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:b3:2b", ip: ""} in network mk-old-k8s-version-402923: {Iface:virbr1 ExpiryTime:2024-03-16 01:06:48 +0000 UTC Type:0 Mac:52:54:00:0d:b3:2b Iaid: IPaddr:192.168.39.107 Prefix:24 Hostname:old-k8s-version-402923 Clientid:01:52:54:00:0d:b3:2b}
I0316 00:06:56.498230 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | domain old-k8s-version-402923 has defined IP address 192.168.39.107 and MAC address 52:54:00:0d:b3:2b in network mk-old-k8s-version-402923
I0316 00:06:56.498358 120517 provision.go:143] copyHostCerts
I0316 00:06:56.498431 120517 exec_runner.go:144] found /home/jenkins/minikube-integration/17991-75602/.minikube/ca.pem, removing ...
I0316 00:06:56.498444 120517 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17991-75602/.minikube/ca.pem
I0316 00:06:56.498503 120517 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17991-75602/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17991-75602/.minikube/ca.pem (1082 bytes)
I0316 00:06:56.498622 120517 exec_runner.go:144] found /home/jenkins/minikube-integration/17991-75602/.minikube/cert.pem, removing ...
I0316 00:06:56.498634 120517 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17991-75602/.minikube/cert.pem
I0316 00:06:56.498669 120517 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17991-75602/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17991-75602/.minikube/cert.pem (1123 bytes)
I0316 00:06:56.498748 120517 exec_runner.go:144] found /home/jenkins/minikube-integration/17991-75602/.minikube/key.pem, removing ...
I0316 00:06:56.498757 120517 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17991-75602/.minikube/key.pem
I0316 00:06:56.498805 120517 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17991-75602/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17991-75602/.minikube/key.pem (1675 bytes)
I0316 00:06:56.498873 120517 provision.go:117] generating server cert: /home/jenkins/minikube-integration/17991-75602/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17991-75602/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17991-75602/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-402923 san=[127.0.0.1 192.168.39.107 localhost minikube old-k8s-version-402923]
I0316 00:06:56.611091 120517 provision.go:177] copyRemoteCerts
I0316 00:06:56.611188 120517 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0316 00:06:56.611225 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetSSHHostname
I0316 00:06:56.613825 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | domain old-k8s-version-402923 has defined MAC address 52:54:00:0d:b3:2b in network mk-old-k8s-version-402923
I0316 00:06:56.614133 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:b3:2b", ip: ""} in network mk-old-k8s-version-402923: {Iface:virbr1 ExpiryTime:2024-03-16 01:06:48 +0000 UTC Type:0 Mac:52:54:00:0d:b3:2b Iaid: IPaddr:192.168.39.107 Prefix:24 Hostname:old-k8s-version-402923 Clientid:01:52:54:00:0d:b3:2b}
I0316 00:06:56.614167 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | domain old-k8s-version-402923 has defined IP address 192.168.39.107 and MAC address 52:54:00:0d:b3:2b in network mk-old-k8s-version-402923
I0316 00:06:56.614319 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetSSHPort
I0316 00:06:56.614498 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetSSHKeyPath
I0316 00:06:56.614660 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetSSHUsername
I0316 00:06:56.614785 120517 sshutil.go:53] new ssh client: &{IP:192.168.39.107 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17991-75602/.minikube/machines/old-k8s-version-402923/id_rsa Username:docker}
I0316 00:06:56.697870 120517 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17991-75602/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0316 00:06:56.724012 120517 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17991-75602/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0316 00:06:56.748937 120517 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17991-75602/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0316 00:06:56.773597 120517 provision.go:87] duration metric: took 281.158579ms to configureAuth
I0316 00:06:56.773648 120517 buildroot.go:189] setting minikube options for container-runtime
I0316 00:06:56.773867 120517 config.go:182] Loaded profile config "old-k8s-version-402923": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0316 00:06:56.773980 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetSSHHostname
I0316 00:06:56.776614 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | domain old-k8s-version-402923 has defined MAC address 52:54:00:0d:b3:2b in network mk-old-k8s-version-402923
I0316 00:06:56.776923 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:b3:2b", ip: ""} in network mk-old-k8s-version-402923: {Iface:virbr1 ExpiryTime:2024-03-16 01:06:48 +0000 UTC Type:0 Mac:52:54:00:0d:b3:2b Iaid: IPaddr:192.168.39.107 Prefix:24 Hostname:old-k8s-version-402923 Clientid:01:52:54:00:0d:b3:2b}
I0316 00:06:56.776960 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | domain old-k8s-version-402923 has defined IP address 192.168.39.107 and MAC address 52:54:00:0d:b3:2b in network mk-old-k8s-version-402923
I0316 00:06:56.777059 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetSSHPort
I0316 00:06:56.777283 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetSSHKeyPath
I0316 00:06:56.777463 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetSSHKeyPath
I0316 00:06:56.777593 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetSSHUsername
I0316 00:06:56.777800 120517 main.go:141] libmachine: Using SSH client type: native
I0316 00:06:56.778009 120517 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4a0] 0x830200 <nil> [] 0s} 192.168.39.107 22 <nil> <nil>}
I0316 00:06:56.778030 120517 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0316 00:06:57.059821 120517 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0316 00:06:57.059851 120517 main.go:141] libmachine: Checking connection to Docker...
I0316 00:06:57.059863 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetURL
I0316 00:06:57.061133 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | Using libvirt version 6000000
I0316 00:06:57.063218 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | domain old-k8s-version-402923 has defined MAC address 52:54:00:0d:b3:2b in network mk-old-k8s-version-402923
I0316 00:06:57.063593 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:b3:2b", ip: ""} in network mk-old-k8s-version-402923: {Iface:virbr1 ExpiryTime:2024-03-16 01:06:48 +0000 UTC Type:0 Mac:52:54:00:0d:b3:2b Iaid: IPaddr:192.168.39.107 Prefix:24 Hostname:old-k8s-version-402923 Clientid:01:52:54:00:0d:b3:2b}
I0316 00:06:57.063629 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | domain old-k8s-version-402923 has defined IP address 192.168.39.107 and MAC address 52:54:00:0d:b3:2b in network mk-old-k8s-version-402923
I0316 00:06:57.063764 120517 main.go:141] libmachine: Docker is up and running!
I0316 00:06:57.063779 120517 main.go:141] libmachine: Reticulating splines...
I0316 00:06:57.063786 120517 client.go:171] duration metric: took 24.742934382s to LocalClient.Create
I0316 00:06:57.063810 120517 start.go:167] duration metric: took 24.743000512s to libmachine.API.Create "old-k8s-version-402923"
I0316 00:06:57.063819 120517 start.go:293] postStartSetup for "old-k8s-version-402923" (driver="kvm2")
I0316 00:06:57.063832 120517 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0316 00:06:57.063850 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .DriverName
I0316 00:06:57.064096 120517 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0316 00:06:57.064122 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetSSHHostname
I0316 00:06:57.066266 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | domain old-k8s-version-402923 has defined MAC address 52:54:00:0d:b3:2b in network mk-old-k8s-version-402923
I0316 00:06:57.066556 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:b3:2b", ip: ""} in network mk-old-k8s-version-402923: {Iface:virbr1 ExpiryTime:2024-03-16 01:06:48 +0000 UTC Type:0 Mac:52:54:00:0d:b3:2b Iaid: IPaddr:192.168.39.107 Prefix:24 Hostname:old-k8s-version-402923 Clientid:01:52:54:00:0d:b3:2b}
I0316 00:06:57.066593 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | domain old-k8s-version-402923 has defined IP address 192.168.39.107 and MAC address 52:54:00:0d:b3:2b in network mk-old-k8s-version-402923
I0316 00:06:57.066781 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetSSHPort
I0316 00:06:57.066974 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetSSHKeyPath
I0316 00:06:57.067148 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetSSHUsername
I0316 00:06:57.067272 120517 sshutil.go:53] new ssh client: &{IP:192.168.39.107 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17991-75602/.minikube/machines/old-k8s-version-402923/id_rsa Username:docker}
I0316 00:06:57.150934 120517 ssh_runner.go:195] Run: cat /etc/os-release
I0316 00:06:57.155767 120517 info.go:137] Remote host: Buildroot 2023.02.9
I0316 00:06:57.155791 120517 filesync.go:126] Scanning /home/jenkins/minikube-integration/17991-75602/.minikube/addons for local assets ...
I0316 00:06:57.155863 120517 filesync.go:126] Scanning /home/jenkins/minikube-integration/17991-75602/.minikube/files for local assets ...
I0316 00:06:57.155967 120517 filesync.go:149] local asset: /home/jenkins/minikube-integration/17991-75602/.minikube/files/etc/ssl/certs/828702.pem -> 828702.pem in /etc/ssl/certs
I0316 00:06:57.156095 120517 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0316 00:06:57.166526 120517 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17991-75602/.minikube/files/etc/ssl/certs/828702.pem --> /etc/ssl/certs/828702.pem (1708 bytes)
I0316 00:06:57.191084 120517 start.go:296] duration metric: took 127.245599ms for postStartSetup
I0316 00:06:57.191148 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetConfigRaw
I0316 00:06:57.191742 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetIP
I0316 00:06:57.194944 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | domain old-k8s-version-402923 has defined MAC address 52:54:00:0d:b3:2b in network mk-old-k8s-version-402923
I0316 00:06:57.195304 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:b3:2b", ip: ""} in network mk-old-k8s-version-402923: {Iface:virbr1 ExpiryTime:2024-03-16 01:06:48 +0000 UTC Type:0 Mac:52:54:00:0d:b3:2b Iaid: IPaddr:192.168.39.107 Prefix:24 Hostname:old-k8s-version-402923 Clientid:01:52:54:00:0d:b3:2b}
I0316 00:06:57.195350 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | domain old-k8s-version-402923 has defined IP address 192.168.39.107 and MAC address 52:54:00:0d:b3:2b in network mk-old-k8s-version-402923
I0316 00:06:57.195595 120517 profile.go:142] Saving config to /home/jenkins/minikube-integration/17991-75602/.minikube/profiles/old-k8s-version-402923/config.json ...
I0316 00:06:57.195800 120517 start.go:128] duration metric: took 24.899028853s to createHost
I0316 00:06:57.195829 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetSSHHostname
I0316 00:06:57.197849 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | domain old-k8s-version-402923 has defined MAC address 52:54:00:0d:b3:2b in network mk-old-k8s-version-402923
I0316 00:06:57.198094 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:b3:2b", ip: ""} in network mk-old-k8s-version-402923: {Iface:virbr1 ExpiryTime:2024-03-16 01:06:48 +0000 UTC Type:0 Mac:52:54:00:0d:b3:2b Iaid: IPaddr:192.168.39.107 Prefix:24 Hostname:old-k8s-version-402923 Clientid:01:52:54:00:0d:b3:2b}
I0316 00:06:57.198126 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | domain old-k8s-version-402923 has defined IP address 192.168.39.107 and MAC address 52:54:00:0d:b3:2b in network mk-old-k8s-version-402923
I0316 00:06:57.198255 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetSSHPort
I0316 00:06:57.198430 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetSSHKeyPath
I0316 00:06:57.198588 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetSSHKeyPath
I0316 00:06:57.198718 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetSSHUsername
I0316 00:06:57.198872 120517 main.go:141] libmachine: Using SSH client type: native
I0316 00:06:57.199041 120517 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4a0] 0x830200 <nil> [] 0s} 192.168.39.107 22 <nil> <nil>}
I0316 00:06:57.199054 120517 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0316 00:06:57.308017 120517 main.go:141] libmachine: SSH cmd err, output: <nil>: 1710547617.291374497
I0316 00:06:57.308050 120517 fix.go:216] guest clock: 1710547617.291374497
I0316 00:06:57.308062 120517 fix.go:229] Guest: 2024-03-16 00:06:57.291374497 +0000 UTC Remote: 2024-03-16 00:06:57.195812305 +0000 UTC m=+38.097389487 (delta=95.562192ms)
I0316 00:06:57.308095 120517 fix.go:200] guest clock delta is within tolerance: 95.562192ms
I0316 00:06:57.308108 120517 start.go:83] releasing machines lock for "old-k8s-version-402923", held for 25.01154557s
I0316 00:06:57.308147 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .DriverName
I0316 00:06:57.308422 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetIP
I0316 00:06:57.311302 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | domain old-k8s-version-402923 has defined MAC address 52:54:00:0d:b3:2b in network mk-old-k8s-version-402923
I0316 00:06:57.311661 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:b3:2b", ip: ""} in network mk-old-k8s-version-402923: {Iface:virbr1 ExpiryTime:2024-03-16 01:06:48 +0000 UTC Type:0 Mac:52:54:00:0d:b3:2b Iaid: IPaddr:192.168.39.107 Prefix:24 Hostname:old-k8s-version-402923 Clientid:01:52:54:00:0d:b3:2b}
I0316 00:06:57.311703 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | domain old-k8s-version-402923 has defined IP address 192.168.39.107 and MAC address 52:54:00:0d:b3:2b in network mk-old-k8s-version-402923
I0316 00:06:57.311786 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .DriverName
I0316 00:06:57.312282 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .DriverName
I0316 00:06:57.312487 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .DriverName
I0316 00:06:57.312596 120517 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0316 00:06:57.312648 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetSSHHostname
I0316 00:06:57.312778 120517 ssh_runner.go:195] Run: cat /version.json
I0316 00:06:57.312802 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetSSHHostname
I0316 00:06:57.315548 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | domain old-k8s-version-402923 has defined MAC address 52:54:00:0d:b3:2b in network mk-old-k8s-version-402923
I0316 00:06:57.315744 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | domain old-k8s-version-402923 has defined MAC address 52:54:00:0d:b3:2b in network mk-old-k8s-version-402923
I0316 00:06:57.315926 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:b3:2b", ip: ""} in network mk-old-k8s-version-402923: {Iface:virbr1 ExpiryTime:2024-03-16 01:06:48 +0000 UTC Type:0 Mac:52:54:00:0d:b3:2b Iaid: IPaddr:192.168.39.107 Prefix:24 Hostname:old-k8s-version-402923 Clientid:01:52:54:00:0d:b3:2b}
I0316 00:06:57.315950 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | domain old-k8s-version-402923 has defined IP address 192.168.39.107 and MAC address 52:54:00:0d:b3:2b in network mk-old-k8s-version-402923
I0316 00:06:57.316198 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetSSHPort
I0316 00:06:57.316212 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:b3:2b", ip: ""} in network mk-old-k8s-version-402923: {Iface:virbr1 ExpiryTime:2024-03-16 01:06:48 +0000 UTC Type:0 Mac:52:54:00:0d:b3:2b Iaid: IPaddr:192.168.39.107 Prefix:24 Hostname:old-k8s-version-402923 Clientid:01:52:54:00:0d:b3:2b}
I0316 00:06:57.316247 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | domain old-k8s-version-402923 has defined IP address 192.168.39.107 and MAC address 52:54:00:0d:b3:2b in network mk-old-k8s-version-402923
I0316 00:06:57.316401 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetSSHKeyPath
I0316 00:06:57.316403 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetSSHPort
I0316 00:06:57.316562 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetSSHKeyPath
I0316 00:06:57.316595 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetSSHUsername
I0316 00:06:57.316704 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetSSHUsername
I0316 00:06:57.316711 120517 sshutil.go:53] new ssh client: &{IP:192.168.39.107 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17991-75602/.minikube/machines/old-k8s-version-402923/id_rsa Username:docker}
I0316 00:06:57.316796 120517 sshutil.go:53] new ssh client: &{IP:192.168.39.107 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17991-75602/.minikube/machines/old-k8s-version-402923/id_rsa Username:docker}
I0316 00:06:57.396622 120517 ssh_runner.go:195] Run: systemctl --version
I0316 00:06:57.424548 120517 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0316 00:06:57.585850 120517 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0316 00:06:57.592074 120517 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0316 00:06:57.592136 120517 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0316 00:06:57.609885 120517 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0316 00:06:57.609910 120517 start.go:494] detecting cgroup driver to use...
I0316 00:06:57.609982 120517 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0316 00:06:57.627831 120517 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0316 00:06:57.642606 120517 docker.go:217] disabling cri-docker service (if available) ...
I0316 00:06:57.642679 120517 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0316 00:06:57.657565 120517 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0316 00:06:57.671720 120517 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0316 00:06:57.795568 120517 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0316 00:06:57.961206 120517 docker.go:233] disabling docker service ...
I0316 00:06:57.961276 120517 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0316 00:06:57.981228 120517 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0316 00:06:57.994830 120517 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0316 00:06:58.132050 120517 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0316 00:06:58.286594 120517 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0316 00:06:58.302061 120517 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0316 00:06:58.321442 120517 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0316 00:06:58.321502 120517 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0316 00:06:58.332210 120517 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0316 00:06:58.332275 120517 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0316 00:06:58.342555 120517 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0316 00:06:58.352746 120517 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0316 00:06:58.362817 120517 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0316 00:06:58.373497 120517 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0316 00:06:58.382955 120517 crio.go:148] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0316 00:06:58.383012 120517 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0316 00:06:58.395450 120517 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0316 00:06:58.406626 120517 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0316 00:06:58.545711 120517 ssh_runner.go:195] Run: sudo systemctl restart crio
I0316 00:06:58.710242 120517 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0316 00:06:58.710328 120517 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0316 00:06:58.716597 120517 start.go:562] Will wait 60s for crictl version
I0316 00:06:58.716668 120517 ssh_runner.go:195] Run: which crictl
I0316 00:06:58.721655 120517 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0316 00:06:58.762768 120517 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0316 00:06:58.762865 120517 ssh_runner.go:195] Run: crio --version
I0316 00:06:58.794603 120517 ssh_runner.go:195] Run: crio --version
I0316 00:06:58.828649 120517 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0316 00:06:58.830053 120517 main.go:141] libmachine: (old-k8s-version-402923) Calling .GetIP
I0316 00:06:58.833183 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | domain old-k8s-version-402923 has defined MAC address 52:54:00:0d:b3:2b in network mk-old-k8s-version-402923
I0316 00:06:58.833574 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:b3:2b", ip: ""} in network mk-old-k8s-version-402923: {Iface:virbr1 ExpiryTime:2024-03-16 01:06:48 +0000 UTC Type:0 Mac:52:54:00:0d:b3:2b Iaid: IPaddr:192.168.39.107 Prefix:24 Hostname:old-k8s-version-402923 Clientid:01:52:54:00:0d:b3:2b}
I0316 00:06:58.833605 120517 main.go:141] libmachine: (old-k8s-version-402923) DBG | domain old-k8s-version-402923 has defined IP address 192.168.39.107 and MAC address 52:54:00:0d:b3:2b in network mk-old-k8s-version-402923
I0316 00:06:58.833793 120517 ssh_runner.go:195] Run: grep 192.168.39.1 host.minikube.internal$ /etc/hosts
I0316 00:06:58.838134 120517 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0316 00:06:58.851566 120517 kubeadm.go:877] updating cluster {Name:old-k8s-version-402923 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17991/minikube-v1.32.1-1710520390-17991-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-402923 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.107 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] M
ountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0316 00:06:58.851705 120517 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0316 00:06:58.851775 120517 ssh_runner.go:195] Run: sudo crictl images --output json
I0316 00:06:58.886934 120517 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0316 00:06:58.887009 120517 ssh_runner.go:195] Run: which lz4
I0316 00:06:58.891613 120517 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0316 00:06:58.896325 120517 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0316 00:06:58.896356 120517 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17991-75602/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0316 00:07:00.769649 120517 crio.go:444] duration metric: took 1.878079896s to copy over tarball
I0316 00:07:00.769723 120517 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0316 00:07:03.445589 120517 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.675828131s)
I0316 00:07:03.445683 120517 crio.go:451] duration metric: took 2.67600398s to extract the tarball
I0316 00:07:03.445711 120517 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0316 00:07:03.491165 120517 ssh_runner.go:195] Run: sudo crictl images --output json
I0316 00:07:03.549799 120517 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0316 00:07:03.549849 120517 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0316 00:07:03.549961 120517 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0316 00:07:03.549963 120517 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0316 00:07:03.549963 120517 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0316 00:07:03.550034 120517 image.go:134] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0316 00:07:03.550078 120517 image.go:134] retrieving image: registry.k8s.io/pause:3.2
I0316 00:07:03.549994 120517 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0316 00:07:03.550020 120517 image.go:134] retrieving image: registry.k8s.io/coredns:1.7.0
I0316 00:07:03.550156 120517 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0316 00:07:03.551699 120517 image.go:177] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0316 00:07:03.551713 120517 image.go:177] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0316 00:07:03.551712 120517 image.go:177] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0316 00:07:03.551717 120517 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0316 00:07:03.551734 120517 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0316 00:07:03.551751 120517 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0316 00:07:03.551758 120517 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0316 00:07:03.552046 120517 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0316 00:07:03.706372 120517 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0316 00:07:03.706372 120517 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0316 00:07:03.709472 120517 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0316 00:07:03.710870 120517 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0316 00:07:03.716088 120517 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0316 00:07:03.721072 120517 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0316 00:07:03.723460 120517 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0316 00:07:03.878231 120517 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0316 00:07:03.878290 120517 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0316 00:07:03.878338 120517 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0316 00:07:03.878353 120517 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0316 00:07:03.878406 120517 ssh_runner.go:195] Run: which crictl
I0316 00:07:03.878422 120517 ssh_runner.go:195] Run: which crictl
I0316 00:07:03.878260 120517 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0316 00:07:03.878476 120517 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0316 00:07:03.878510 120517 ssh_runner.go:195] Run: which crictl
I0316 00:07:03.909672 120517 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0316 00:07:03.909695 120517 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0316 00:07:03.909728 120517 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0316 00:07:03.909739 120517 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0316 00:07:03.909752 120517 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0316 00:07:03.909780 120517 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0316 00:07:03.909783 120517 ssh_runner.go:195] Run: which crictl
I0316 00:07:03.909829 120517 ssh_runner.go:195] Run: which crictl
I0316 00:07:03.909783 120517 ssh_runner.go:195] Run: which crictl
I0316 00:07:03.915090 120517 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0316 00:07:03.915108 120517 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0316 00:07:03.915159 120517 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0316 00:07:03.915171 120517 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0316 00:07:03.915232 120517 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0316 00:07:03.915271 120517 ssh_runner.go:195] Run: which crictl
I0316 00:07:03.915455 120517 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0316 00:07:03.921853 120517 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0316 00:07:03.921952 120517 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0316 00:07:04.060174 120517 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17991-75602/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0316 00:07:04.060193 120517 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17991-75602/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0316 00:07:04.060297 120517 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0316 00:07:04.060332 120517 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17991-75602/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0316 00:07:04.060369 120517 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17991-75602/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0316 00:07:04.060384 120517 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17991-75602/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0316 00:07:04.060417 120517 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17991-75602/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0316 00:07:04.095528 120517 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17991-75602/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0316 00:07:04.186050 120517 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0316 00:07:04.408460 120517 cache_images.go:92] duration metric: took 858.583082ms to LoadCachedImages
W0316 00:07:04.408561 120517 out.go:239] X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/17991-75602/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0: no such file or directory
X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/17991-75602/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0: no such file or directory
I0316 00:07:04.408579 120517 kubeadm.go:928] updating node { 192.168.39.107 8443 v1.20.0 crio true true} ...
I0316 00:07:04.408722 120517 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-402923 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.39.107
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-402923 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0316 00:07:04.408823 120517 ssh_runner.go:195] Run: crio config
I0316 00:07:04.461472 120517 cni.go:84] Creating CNI manager for ""
I0316 00:07:04.461499 120517 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0316 00:07:04.461512 120517 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0316 00:07:04.461538 120517 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.107 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-402923 NodeName:old-k8s-version-402923 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.107"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.107 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0316 00:07:04.461714 120517 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.39.107
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-402923"
kubeletExtraArgs:
node-ip: 192.168.39.107
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.39.107"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0316 00:07:04.461786 120517 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0316 00:07:04.473706 120517 binaries.go:44] Found k8s binaries, skipping transfer
I0316 00:07:04.473781 120517 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0316 00:07:04.485343 120517 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0316 00:07:04.504988 120517 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0316 00:07:04.524439 120517 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2123 bytes)
I0316 00:07:04.543091 120517 ssh_runner.go:195] Run: grep 192.168.39.107 control-plane.minikube.internal$ /etc/hosts
I0316 00:07:04.547248 120517 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.107 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0316 00:07:04.560488 120517 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0316 00:07:04.708338 120517 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0316 00:07:04.730313 120517 certs.go:68] Setting up /home/jenkins/minikube-integration/17991-75602/.minikube/profiles/old-k8s-version-402923 for IP: 192.168.39.107
I0316 00:07:04.730339 120517 certs.go:194] generating shared ca certs ...
I0316 00:07:04.730360 120517 certs.go:226] acquiring lock for ca certs: {Name:mkcca74edf7bce7ac702ff9d2c53a73917773a33 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0316 00:07:04.730513 120517 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/17991-75602/.minikube/ca.key
I0316 00:07:04.730586 120517 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/17991-75602/.minikube/proxy-client-ca.key
I0316 00:07:04.730602 120517 certs.go:256] generating profile certs ...
I0316 00:07:04.730681 120517 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/17991-75602/.minikube/profiles/old-k8s-version-402923/client.key
I0316 00:07:04.730698 120517 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17991-75602/.minikube/profiles/old-k8s-version-402923/client.crt with IP's: []
I0316 00:07:04.912721 120517 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17991-75602/.minikube/profiles/old-k8s-version-402923/client.crt ...
I0316 00:07:04.912753 120517 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17991-75602/.minikube/profiles/old-k8s-version-402923/client.crt: {Name:mka13d4a6845e10e1f9c346ea283018d773bec23 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0316 00:07:04.912959 120517 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17991-75602/.minikube/profiles/old-k8s-version-402923/client.key ...
I0316 00:07:04.912982 120517 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17991-75602/.minikube/profiles/old-k8s-version-402923/client.key: {Name:mk59cf4521a43cce7d8681d2ed16c0f52e7ab703 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0316 00:07:04.913097 120517 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/17991-75602/.minikube/profiles/old-k8s-version-402923/apiserver.key.467cf8c5
I0316 00:07:04.913118 120517 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17991-75602/.minikube/profiles/old-k8s-version-402923/apiserver.crt.467cf8c5 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.107]
I0316 00:07:05.032905 120517 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17991-75602/.minikube/profiles/old-k8s-version-402923/apiserver.crt.467cf8c5 ...
I0316 00:07:05.032938 120517 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17991-75602/.minikube/profiles/old-k8s-version-402923/apiserver.crt.467cf8c5: {Name:mk8e9f2a094f09e042ef92a026cf82afcf543c8d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0316 00:07:05.033129 120517 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17991-75602/.minikube/profiles/old-k8s-version-402923/apiserver.key.467cf8c5 ...
I0316 00:07:05.033149 120517 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17991-75602/.minikube/profiles/old-k8s-version-402923/apiserver.key.467cf8c5: {Name:mk2cccd707b7dd3d13edbd0254dc1646a5f0806c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0316 00:07:05.033254 120517 certs.go:381] copying /home/jenkins/minikube-integration/17991-75602/.minikube/profiles/old-k8s-version-402923/apiserver.crt.467cf8c5 -> /home/jenkins/minikube-integration/17991-75602/.minikube/profiles/old-k8s-version-402923/apiserver.crt
I0316 00:07:05.033393 120517 certs.go:385] copying /home/jenkins/minikube-integration/17991-75602/.minikube/profiles/old-k8s-version-402923/apiserver.key.467cf8c5 -> /home/jenkins/minikube-integration/17991-75602/.minikube/profiles/old-k8s-version-402923/apiserver.key
I0316 00:07:05.033483 120517 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/17991-75602/.minikube/profiles/old-k8s-version-402923/proxy-client.key
I0316 00:07:05.033508 120517 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17991-75602/.minikube/profiles/old-k8s-version-402923/proxy-client.crt with IP's: []
I0316 00:07:05.334313 120517 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17991-75602/.minikube/profiles/old-k8s-version-402923/proxy-client.crt ...
I0316 00:07:05.334356 120517 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17991-75602/.minikube/profiles/old-k8s-version-402923/proxy-client.crt: {Name:mkabaf8077097d186fec4dcdca86a4d065b1d8de Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0316 00:07:05.334556 120517 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17991-75602/.minikube/profiles/old-k8s-version-402923/proxy-client.key ...
I0316 00:07:05.334578 120517 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17991-75602/.minikube/profiles/old-k8s-version-402923/proxy-client.key: {Name:mke6ab3919686aa50015135154ecaf2921eda38a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0316 00:07:05.334793 120517 certs.go:484] found cert: /home/jenkins/minikube-integration/17991-75602/.minikube/certs/82870.pem (1338 bytes)
W0316 00:07:05.334850 120517 certs.go:480] ignoring /home/jenkins/minikube-integration/17991-75602/.minikube/certs/82870_empty.pem, impossibly tiny 0 bytes
I0316 00:07:05.334868 120517 certs.go:484] found cert: /home/jenkins/minikube-integration/17991-75602/.minikube/certs/ca-key.pem (1675 bytes)
I0316 00:07:05.334920 120517 certs.go:484] found cert: /home/jenkins/minikube-integration/17991-75602/.minikube/certs/ca.pem (1082 bytes)
I0316 00:07:05.334957 120517 certs.go:484] found cert: /home/jenkins/minikube-integration/17991-75602/.minikube/certs/cert.pem (1123 bytes)
I0316 00:07:05.334995 120517 certs.go:484] found cert: /home/jenkins/minikube-integration/17991-75602/.minikube/certs/key.pem (1675 bytes)
I0316 00:07:05.335069 120517 certs.go:484] found cert: /home/jenkins/minikube-integration/17991-75602/.minikube/files/etc/ssl/certs/828702.pem (1708 bytes)
I0316 00:07:05.335736 120517 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17991-75602/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0316 00:07:05.363739 120517 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17991-75602/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0316 00:07:05.394805 120517 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17991-75602/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0316 00:07:05.421478 120517 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17991-75602/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0316 00:07:05.447264 120517 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17991-75602/.minikube/profiles/old-k8s-version-402923/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0316 00:07:05.474643 120517 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17991-75602/.minikube/profiles/old-k8s-version-402923/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0316 00:07:05.505988 120517 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17991-75602/.minikube/profiles/old-k8s-version-402923/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0316 00:07:05.535136 120517 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17991-75602/.minikube/profiles/old-k8s-version-402923/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0316 00:07:05.568662 120517 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17991-75602/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0316 00:07:05.600190 120517 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17991-75602/.minikube/certs/82870.pem --> /usr/share/ca-certificates/82870.pem (1338 bytes)
I0316 00:07:05.636556 120517 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17991-75602/.minikube/files/etc/ssl/certs/828702.pem --> /usr/share/ca-certificates/828702.pem (1708 bytes)
I0316 00:07:05.662725 120517 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0316 00:07:05.680978 120517 ssh_runner.go:195] Run: openssl version
I0316 00:07:05.687220 120517 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/828702.pem && ln -fs /usr/share/ca-certificates/828702.pem /etc/ssl/certs/828702.pem"
I0316 00:07:05.699501 120517 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/828702.pem
I0316 00:07:05.705959 120517 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Mar 15 23:06 /usr/share/ca-certificates/828702.pem
I0316 00:07:05.706014 120517 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/828702.pem
I0316 00:07:05.714082 120517 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/828702.pem /etc/ssl/certs/3ec20f2e.0"
I0316 00:07:05.730581 120517 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0316 00:07:05.746175 120517 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0316 00:07:05.750934 120517 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Mar 15 22:57 /usr/share/ca-certificates/minikubeCA.pem
I0316 00:07:05.751007 120517 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0316 00:07:05.757353 120517 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0316 00:07:05.769224 120517 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/82870.pem && ln -fs /usr/share/ca-certificates/82870.pem /etc/ssl/certs/82870.pem"
I0316 00:07:05.781101 120517 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/82870.pem
I0316 00:07:05.786363 120517 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Mar 15 23:06 /usr/share/ca-certificates/82870.pem
I0316 00:07:05.786437 120517 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/82870.pem
I0316 00:07:05.792562 120517 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/82870.pem /etc/ssl/certs/51391683.0"
I0316 00:07:05.804437 120517 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0316 00:07:05.808794 120517 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0316 00:07:05.808860 120517 kubeadm.go:391] StartCluster: {Name:old-k8s-version-402923 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17991/minikube-v1.32.1-1710520390-17991-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-402923 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.107 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Moun
tPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0316 00:07:05.808962 120517 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0316 00:07:05.809034 120517 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0316 00:07:05.846481 120517 cri.go:89] found id: ""
I0316 00:07:05.846570 120517 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0316 00:07:05.857715 120517 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0316 00:07:05.869291 120517 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0316 00:07:05.881144 120517 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0316 00:07:05.881163 120517 kubeadm.go:156] found existing configuration files:
I0316 00:07:05.881215 120517 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0316 00:07:05.894418 120517 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0316 00:07:05.894504 120517 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0316 00:07:05.908057 120517 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0316 00:07:05.918131 120517 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0316 00:07:05.918195 120517 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0316 00:07:05.928387 120517 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0316 00:07:05.938227 120517 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0316 00:07:05.938289 120517 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0316 00:07:05.948981 120517 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0316 00:07:05.961399 120517 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0316 00:07:05.961466 120517 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0316 00:07:05.973877 120517 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0316 00:07:06.085973 120517 kubeadm.go:309] [init] Using Kubernetes version: v1.20.0
I0316 00:07:06.086061 120517 kubeadm.go:309] [preflight] Running pre-flight checks
I0316 00:07:06.233617 120517 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0316 00:07:06.233798 120517 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0316 00:07:06.233960 120517 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0316 00:07:06.476813 120517 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0316 00:07:06.563943 120517 out.go:204] - Generating certificates and keys ...
I0316 00:07:06.564115 120517 kubeadm.go:309] [certs] Using existing ca certificate authority
I0316 00:07:06.564209 120517 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0316 00:07:06.768145 120517 kubeadm.go:309] [certs] Generating "apiserver-kubelet-client" certificate and key
I0316 00:07:07.008494 120517 kubeadm.go:309] [certs] Generating "front-proxy-ca" certificate and key
I0316 00:07:07.472262 120517 kubeadm.go:309] [certs] Generating "front-proxy-client" certificate and key
I0316 00:07:07.706268 120517 kubeadm.go:309] [certs] Generating "etcd/ca" certificate and key
I0316 00:07:07.849566 120517 kubeadm.go:309] [certs] Generating "etcd/server" certificate and key
I0316 00:07:07.849757 120517 kubeadm.go:309] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-402923] and IPs [192.168.39.107 127.0.0.1 ::1]
I0316 00:07:07.939571 120517 kubeadm.go:309] [certs] Generating "etcd/peer" certificate and key
I0316 00:07:07.939800 120517 kubeadm.go:309] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-402923] and IPs [192.168.39.107 127.0.0.1 ::1]
I0316 00:07:08.002185 120517 kubeadm.go:309] [certs] Generating "etcd/healthcheck-client" certificate and key
I0316 00:07:08.194726 120517 kubeadm.go:309] [certs] Generating "apiserver-etcd-client" certificate and key
I0316 00:07:08.351471 120517 kubeadm.go:309] [certs] Generating "sa" key and public key
I0316 00:07:08.351777 120517 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0316 00:07:08.442602 120517 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0316 00:07:08.621649 120517 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0316 00:07:09.264747 120517 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0316 00:07:09.385315 120517 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0316 00:07:09.408688 120517 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0316 00:07:09.410381 120517 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0316 00:07:09.410460 120517 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0316 00:07:09.558764 120517 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0316 00:07:09.560696 120517 out.go:204] - Booting up control plane ...
I0316 00:07:09.560842 120517 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0316 00:07:09.583267 120517 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0316 00:07:09.585601 120517 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0316 00:07:09.589699 120517 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0316 00:07:09.592299 120517 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0316 00:07:49.592795 120517 kubeadm.go:309] [kubelet-check] Initial timeout of 40s passed.
I0316 00:07:49.594074 120517 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0316 00:07:49.594287 120517 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0316 00:07:54.594939 120517 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0316 00:07:54.595194 120517 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0316 00:08:04.596571 120517 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0316 00:08:04.596821 120517 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0316 00:08:24.598739 120517 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0316 00:08:24.598998 120517 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0316 00:09:04.597304 120517 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0316 00:09:04.597637 120517 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0316 00:09:04.597663 120517 kubeadm.go:309]
I0316 00:09:04.597727 120517 kubeadm.go:309] Unfortunately, an error has occurred:
I0316 00:09:04.597792 120517 kubeadm.go:309] timed out waiting for the condition
I0316 00:09:04.597805 120517 kubeadm.go:309]
I0316 00:09:04.597848 120517 kubeadm.go:309] This error is likely caused by:
I0316 00:09:04.597914 120517 kubeadm.go:309] - The kubelet is not running
I0316 00:09:04.598118 120517 kubeadm.go:309] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0316 00:09:04.598142 120517 kubeadm.go:309]
I0316 00:09:04.598281 120517 kubeadm.go:309] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0316 00:09:04.598324 120517 kubeadm.go:309] - 'systemctl status kubelet'
I0316 00:09:04.598370 120517 kubeadm.go:309] - 'journalctl -xeu kubelet'
I0316 00:09:04.598379 120517 kubeadm.go:309]
I0316 00:09:04.598537 120517 kubeadm.go:309] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0316 00:09:04.598658 120517 kubeadm.go:309] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0316 00:09:04.598679 120517 kubeadm.go:309]
I0316 00:09:04.598815 120517 kubeadm.go:309] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0316 00:09:04.598962 120517 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0316 00:09:04.599058 120517 kubeadm.go:309] Once you have found the failing container, you can inspect its logs with:
I0316 00:09:04.599120 120517 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0316 00:09:04.599129 120517 kubeadm.go:309]
I0316 00:09:04.599812 120517 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0316 00:09:04.599920 120517 kubeadm.go:309] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0316 00:09:04.600001 120517 kubeadm.go:309] To see the stack trace of this error execute with --v=5 or higher
W0316 00:09:04.600186 120517 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-402923] and IPs [192.168.39.107 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-402923] and IPs [192.168.39.107 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-402923] and IPs [192.168.39.107 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-402923] and IPs [192.168.39.107 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0316 00:09:04.600236 120517 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0316 00:09:06.278429 120517 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (1.678155291s)
I0316 00:09:06.278524 120517 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0316 00:09:06.294404 120517 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0316 00:09:06.308839 120517 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0316 00:09:06.308860 120517 kubeadm.go:156] found existing configuration files:
I0316 00:09:06.308925 120517 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0316 00:09:06.322086 120517 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0316 00:09:06.322174 120517 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0316 00:09:06.335843 120517 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0316 00:09:06.345945 120517 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0316 00:09:06.346016 120517 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0316 00:09:06.356543 120517 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0316 00:09:06.365899 120517 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0316 00:09:06.365972 120517 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0316 00:09:06.377329 120517 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0316 00:09:06.388721 120517 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0316 00:09:06.388784 120517 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0316 00:09:06.402961 120517 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0316 00:09:06.494323 120517 kubeadm.go:309] [init] Using Kubernetes version: v1.20.0
I0316 00:09:06.494423 120517 kubeadm.go:309] [preflight] Running pre-flight checks
I0316 00:09:06.675818 120517 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0316 00:09:06.675963 120517 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0316 00:09:06.676087 120517 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0316 00:09:06.865422 120517 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0316 00:09:06.867369 120517 out.go:204] - Generating certificates and keys ...
I0316 00:09:06.867475 120517 kubeadm.go:309] [certs] Using existing ca certificate authority
I0316 00:09:06.867561 120517 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0316 00:09:06.867683 120517 kubeadm.go:309] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0316 00:09:06.867749 120517 kubeadm.go:309] [certs] Using existing front-proxy-ca certificate authority
I0316 00:09:06.867815 120517 kubeadm.go:309] [certs] Using existing front-proxy-client certificate and key on disk
I0316 00:09:06.867863 120517 kubeadm.go:309] [certs] Using existing etcd/ca certificate authority
I0316 00:09:06.867916 120517 kubeadm.go:309] [certs] Using existing etcd/server certificate and key on disk
I0316 00:09:06.867971 120517 kubeadm.go:309] [certs] Using existing etcd/peer certificate and key on disk
I0316 00:09:06.868208 120517 kubeadm.go:309] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0316 00:09:06.869273 120517 kubeadm.go:309] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0316 00:09:06.869543 120517 kubeadm.go:309] [certs] Using the existing "sa" key
I0316 00:09:06.869708 120517 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0316 00:09:07.103048 120517 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0316 00:09:07.169367 120517 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0316 00:09:07.417342 120517 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0316 00:09:07.642561 120517 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0316 00:09:07.658220 120517 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0316 00:09:07.660279 120517 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0316 00:09:07.660348 120517 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0316 00:09:07.822343 120517 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0316 00:09:07.824237 120517 out.go:204] - Booting up control plane ...
I0316 00:09:07.824372 120517 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0316 00:09:07.824479 120517 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0316 00:09:07.826099 120517 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0316 00:09:07.826804 120517 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0316 00:09:07.829660 120517 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0316 00:09:47.831788 120517 kubeadm.go:309] [kubelet-check] Initial timeout of 40s passed.
I0316 00:09:47.832327 120517 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0316 00:09:47.832569 120517 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0316 00:09:52.833226 120517 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0316 00:09:52.833468 120517 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0316 00:10:02.834489 120517 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0316 00:10:02.834680 120517 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0316 00:10:22.835868 120517 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0316 00:10:22.836118 120517 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0316 00:11:02.835582 120517 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0316 00:11:02.835755 120517 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0316 00:11:02.835764 120517 kubeadm.go:309]
I0316 00:11:02.835813 120517 kubeadm.go:309] Unfortunately, an error has occurred:
I0316 00:11:02.835848 120517 kubeadm.go:309] timed out waiting for the condition
I0316 00:11:02.835854 120517 kubeadm.go:309]
I0316 00:11:02.835887 120517 kubeadm.go:309] This error is likely caused by:
I0316 00:11:02.835942 120517 kubeadm.go:309] - The kubelet is not running
I0316 00:11:02.836045 120517 kubeadm.go:309] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0316 00:11:02.836054 120517 kubeadm.go:309]
I0316 00:11:02.836180 120517 kubeadm.go:309] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0316 00:11:02.836224 120517 kubeadm.go:309] - 'systemctl status kubelet'
I0316 00:11:02.836251 120517 kubeadm.go:309] - 'journalctl -xeu kubelet'
I0316 00:11:02.836258 120517 kubeadm.go:309]
I0316 00:11:02.836342 120517 kubeadm.go:309] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0316 00:11:02.836406 120517 kubeadm.go:309] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0316 00:11:02.836412 120517 kubeadm.go:309]
I0316 00:11:02.836510 120517 kubeadm.go:309] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0316 00:11:02.836579 120517 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0316 00:11:02.836647 120517 kubeadm.go:309] Once you have found the failing container, you can inspect its logs with:
I0316 00:11:02.836714 120517 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0316 00:11:02.836733 120517 kubeadm.go:309]
I0316 00:11:02.838236 120517 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0316 00:11:02.838321 120517 kubeadm.go:309] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0316 00:11:02.838396 120517 kubeadm.go:309] To see the stack trace of this error execute with --v=5 or higher
I0316 00:11:02.838467 120517 kubeadm.go:393] duration metric: took 3m57.029616306s to StartCluster
I0316 00:11:02.838531 120517 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0316 00:11:02.838588 120517 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0316 00:11:02.892005 120517 cri.go:89] found id: ""
I0316 00:11:02.892038 120517 logs.go:276] 0 containers: []
W0316 00:11:02.892047 120517 logs.go:278] No container was found matching "kube-apiserver"
I0316 00:11:02.892055 120517 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0316 00:11:02.892128 120517 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0316 00:11:02.937526 120517 cri.go:89] found id: ""
I0316 00:11:02.937559 120517 logs.go:276] 0 containers: []
W0316 00:11:02.937580 120517 logs.go:278] No container was found matching "etcd"
I0316 00:11:02.937604 120517 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0316 00:11:02.937679 120517 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0316 00:11:02.975229 120517 cri.go:89] found id: ""
I0316 00:11:02.975257 120517 logs.go:276] 0 containers: []
W0316 00:11:02.975266 120517 logs.go:278] No container was found matching "coredns"
I0316 00:11:02.975274 120517 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0316 00:11:02.975354 120517 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0316 00:11:03.011531 120517 cri.go:89] found id: ""
I0316 00:11:03.011562 120517 logs.go:276] 0 containers: []
W0316 00:11:03.011579 120517 logs.go:278] No container was found matching "kube-scheduler"
I0316 00:11:03.011585 120517 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0316 00:11:03.011635 120517 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0316 00:11:03.048521 120517 cri.go:89] found id: ""
I0316 00:11:03.048556 120517 logs.go:276] 0 containers: []
W0316 00:11:03.048568 120517 logs.go:278] No container was found matching "kube-proxy"
I0316 00:11:03.048575 120517 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0316 00:11:03.048642 120517 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0316 00:11:03.086335 120517 cri.go:89] found id: ""
I0316 00:11:03.086368 120517 logs.go:276] 0 containers: []
W0316 00:11:03.086378 120517 logs.go:278] No container was found matching "kube-controller-manager"
I0316 00:11:03.086385 120517 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0316 00:11:03.086446 120517 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0316 00:11:03.122965 120517 cri.go:89] found id: ""
I0316 00:11:03.123002 120517 logs.go:276] 0 containers: []
W0316 00:11:03.123014 120517 logs.go:278] No container was found matching "kindnet"
I0316 00:11:03.123028 120517 logs.go:123] Gathering logs for dmesg ...
I0316 00:11:03.123053 120517 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0316 00:11:03.136623 120517 logs.go:123] Gathering logs for describe nodes ...
I0316 00:11:03.136658 120517 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0316 00:11:03.247462 120517 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0316 00:11:03.247487 120517 logs.go:123] Gathering logs for CRI-O ...
I0316 00:11:03.247502 120517 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0316 00:11:03.344197 120517 logs.go:123] Gathering logs for container status ...
I0316 00:11:03.344240 120517 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0316 00:11:03.390367 120517 logs.go:123] Gathering logs for kubelet ...
I0316 00:11:03.390428 120517 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0316 00:11:03.444584 120517 out.go:364] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0316 00:11:03.444639 120517 out.go:239] *
*
W0316 00:11:03.444707 120517 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0316 00:11:03.444737 120517 out.go:239] *
*
W0316 00:11:03.445583 120517 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0316 00:11:03.448926 120517 out.go:177]
W0316 00:11:03.450803 120517 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0316 00:11:03.450843 120517 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0316 00:11:03.450865 120517 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0316 00:11:03.452357 120517 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-402923 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-402923 -n old-k8s-version-402923
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-402923 -n old-k8s-version-402923: exit status 6 (251.451974ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0316 00:11:03.749393 123046 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-402923" does not appear in /home/jenkins/minikube-integration/17991-75602/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-402923" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (284.67s)