=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-101261 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-101261 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m25.193226601s)
-- stdout --
* [old-k8s-version-101261] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=19313
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19313-5960/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19313-5960/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-101261" primary control-plane node in "old-k8s-version-101261" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0722 11:41:08.672466 55745 out.go:291] Setting OutFile to fd 1 ...
I0722 11:41:08.672610 55745 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0722 11:41:08.672622 55745 out.go:304] Setting ErrFile to fd 2...
I0722 11:41:08.672628 55745 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0722 11:41:08.672903 55745 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19313-5960/.minikube/bin
I0722 11:41:08.673693 55745 out.go:298] Setting JSON to false
I0722 11:41:08.675020 55745 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-13","uptime":5021,"bootTime":1721643448,"procs":213,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1062-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0722 11:41:08.675093 55745 start.go:139] virtualization: kvm guest
I0722 11:41:08.677283 55745 out.go:177] * [old-k8s-version-101261] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
I0722 11:41:08.678537 55745 out.go:177] - MINIKUBE_LOCATION=19313
I0722 11:41:08.678616 55745 notify.go:220] Checking for updates...
I0722 11:41:08.681120 55745 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0722 11:41:08.682479 55745 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19313-5960/kubeconfig
I0722 11:41:08.683803 55745 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19313-5960/.minikube
I0722 11:41:08.685069 55745 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0722 11:41:08.686250 55745 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0722 11:41:08.687890 55745 config.go:182] Loaded profile config "cert-expiration-467176": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3
I0722 11:41:08.688024 55745 config.go:182] Loaded profile config "cert-options-435680": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3
I0722 11:41:08.688142 55745 config.go:182] Loaded profile config "kubernetes-upgrade-651148": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0722 11:41:08.688254 55745 driver.go:392] Setting default libvirt URI to qemu:///system
I0722 11:41:08.729938 55745 out.go:177] * Using the kvm2 driver based on user configuration
I0722 11:41:08.731188 55745 start.go:297] selected driver: kvm2
I0722 11:41:08.731207 55745 start.go:901] validating driver "kvm2" against <nil>
I0722 11:41:08.731221 55745 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0722 11:41:08.732257 55745 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0722 11:41:08.732352 55745 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19313-5960/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0722 11:41:08.750996 55745 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.1
I0722 11:41:08.751051 55745 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0722 11:41:08.751352 55745 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0722 11:41:08.751396 55745 cni.go:84] Creating CNI manager for ""
I0722 11:41:08.751406 55745 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0722 11:41:08.751419 55745 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0722 11:41:08.751511 55745 start.go:340] cluster config:
{Name:old-k8s-version-101261 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-101261 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0722 11:41:08.751657 55745 iso.go:125] acquiring lock: {Name:mkff6d703f1e15441ac9b34db115c0580bd0e3eb Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0722 11:41:08.753405 55745 out.go:177] * Starting "old-k8s-version-101261" primary control-plane node in "old-k8s-version-101261" cluster
I0722 11:41:08.754704 55745 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0722 11:41:08.754744 55745 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19313-5960/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0722 11:41:08.754756 55745 cache.go:56] Caching tarball of preloaded images
I0722 11:41:08.754842 55745 preload.go:172] Found /home/jenkins/minikube-integration/19313-5960/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0722 11:41:08.754854 55745 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0722 11:41:08.754984 55745 profile.go:143] Saving config to /home/jenkins/minikube-integration/19313-5960/.minikube/profiles/old-k8s-version-101261/config.json ...
I0722 11:41:08.755011 55745 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19313-5960/.minikube/profiles/old-k8s-version-101261/config.json: {Name:mkf08068672b537d68ff00f04b778294df433e60 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0722 11:41:08.755191 55745 start.go:360] acquireMachinesLock for old-k8s-version-101261: {Name:mkb47562c13010c82c8cc12e8c5b700833b1d9dc Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0722 11:41:08.755244 55745 start.go:364] duration metric: took 29.944µs to acquireMachinesLock for "old-k8s-version-101261"
I0722 11:41:08.755266 55745 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-101261 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19298/minikube-v1.33.1-1721324531-19298-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-101261 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0722 11:41:08.755349 55745 start.go:125] createHost starting for "" (driver="kvm2")
I0722 11:41:08.757108 55745 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0722 11:41:08.757277 55745 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0722 11:41:08.757326 55745 main.go:141] libmachine: Launching plugin server for driver kvm2
I0722 11:41:08.774987 55745 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39781
I0722 11:41:08.775492 55745 main.go:141] libmachine: () Calling .GetVersion
I0722 11:41:08.776114 55745 main.go:141] libmachine: Using API Version 1
I0722 11:41:08.776135 55745 main.go:141] libmachine: () Calling .SetConfigRaw
I0722 11:41:08.776493 55745 main.go:141] libmachine: () Calling .GetMachineName
I0722 11:41:08.776710 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetMachineName
I0722 11:41:08.776860 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .DriverName
I0722 11:41:08.777065 55745 start.go:159] libmachine.API.Create for "old-k8s-version-101261" (driver="kvm2")
I0722 11:41:08.777097 55745 client.go:168] LocalClient.Create starting
I0722 11:41:08.777132 55745 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19313-5960/.minikube/certs/ca.pem
I0722 11:41:08.777172 55745 main.go:141] libmachine: Decoding PEM data...
I0722 11:41:08.777193 55745 main.go:141] libmachine: Parsing certificate...
I0722 11:41:08.777254 55745 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19313-5960/.minikube/certs/cert.pem
I0722 11:41:08.777279 55745 main.go:141] libmachine: Decoding PEM data...
I0722 11:41:08.777295 55745 main.go:141] libmachine: Parsing certificate...
I0722 11:41:08.777319 55745 main.go:141] libmachine: Running pre-create checks...
I0722 11:41:08.777332 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .PreCreateCheck
I0722 11:41:08.777727 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetConfigRaw
I0722 11:41:08.778191 55745 main.go:141] libmachine: Creating machine...
I0722 11:41:08.778207 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .Create
I0722 11:41:08.778338 55745 main.go:141] libmachine: (old-k8s-version-101261) Creating KVM machine...
I0722 11:41:08.779729 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | found existing default KVM network
I0722 11:41:08.781250 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | I0722 11:41:08.781103 55767 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr4 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:36:a5:f9} reservation:<nil>}
I0722 11:41:08.782830 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | I0722 11:41:08.782716 55767 network.go:206] using free private subnet 192.168.50.0/24: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc00010ff80}
I0722 11:41:08.782899 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | created network xml:
I0722 11:41:08.782916 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | <network>
I0722 11:41:08.782925 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | <name>mk-old-k8s-version-101261</name>
I0722 11:41:08.782932 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | <dns enable='no'/>
I0722 11:41:08.782941 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG |
I0722 11:41:08.782950 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | <ip address='192.168.50.1' netmask='255.255.255.0'>
I0722 11:41:08.782969 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | <dhcp>
I0722 11:41:08.782981 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | <range start='192.168.50.2' end='192.168.50.253'/>
I0722 11:41:08.782991 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | </dhcp>
I0722 11:41:08.782997 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | </ip>
I0722 11:41:08.783005 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG |
I0722 11:41:08.783010 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | </network>
I0722 11:41:08.783020 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG |
I0722 11:41:08.789695 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | trying to create private KVM network mk-old-k8s-version-101261 192.168.50.0/24...
I0722 11:41:08.871417 55745 main.go:141] libmachine: (old-k8s-version-101261) Setting up store path in /home/jenkins/minikube-integration/19313-5960/.minikube/machines/old-k8s-version-101261 ...
I0722 11:41:08.871462 55745 main.go:141] libmachine: (old-k8s-version-101261) Building disk image from file:///home/jenkins/minikube-integration/19313-5960/.minikube/cache/iso/amd64/minikube-v1.33.1-1721324531-19298-amd64.iso
I0722 11:41:08.871485 55745 main.go:141] libmachine: (old-k8s-version-101261) Downloading /home/jenkins/minikube-integration/19313-5960/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19313-5960/.minikube/cache/iso/amd64/minikube-v1.33.1-1721324531-19298-amd64.iso...
I0722 11:41:08.871502 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | private KVM network mk-old-k8s-version-101261 192.168.50.0/24 created
I0722 11:41:08.871518 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | I0722 11:41:08.871322 55767 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19313-5960/.minikube
I0722 11:41:09.148962 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | I0722 11:41:09.148809 55767 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19313-5960/.minikube/machines/old-k8s-version-101261/id_rsa...
I0722 11:41:09.392134 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | I0722 11:41:09.391986 55767 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19313-5960/.minikube/machines/old-k8s-version-101261/old-k8s-version-101261.rawdisk...
I0722 11:41:09.392172 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | Writing magic tar header
I0722 11:41:09.392194 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | Writing SSH key tar header
I0722 11:41:09.392207 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | I0722 11:41:09.392129 55767 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19313-5960/.minikube/machines/old-k8s-version-101261 ...
I0722 11:41:09.392301 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19313-5960/.minikube/machines/old-k8s-version-101261
I0722 11:41:09.392335 55745 main.go:141] libmachine: (old-k8s-version-101261) Setting executable bit set on /home/jenkins/minikube-integration/19313-5960/.minikube/machines/old-k8s-version-101261 (perms=drwx------)
I0722 11:41:09.392348 55745 main.go:141] libmachine: (old-k8s-version-101261) Setting executable bit set on /home/jenkins/minikube-integration/19313-5960/.minikube/machines (perms=drwxr-xr-x)
I0722 11:41:09.392359 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19313-5960/.minikube/machines
I0722 11:41:09.392413 55745 main.go:141] libmachine: (old-k8s-version-101261) Setting executable bit set on /home/jenkins/minikube-integration/19313-5960/.minikube (perms=drwxr-xr-x)
I0722 11:41:09.392445 55745 main.go:141] libmachine: (old-k8s-version-101261) Setting executable bit set on /home/jenkins/minikube-integration/19313-5960 (perms=drwxrwxr-x)
I0722 11:41:09.392483 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19313-5960/.minikube
I0722 11:41:09.392506 55745 main.go:141] libmachine: (old-k8s-version-101261) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0722 11:41:09.392520 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19313-5960
I0722 11:41:09.392541 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0722 11:41:09.392554 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | Checking permissions on dir: /home/jenkins
I0722 11:41:09.392565 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | Checking permissions on dir: /home
I0722 11:41:09.392577 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | Skipping /home - not owner
I0722 11:41:09.392609 55745 main.go:141] libmachine: (old-k8s-version-101261) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0722 11:41:09.392625 55745 main.go:141] libmachine: (old-k8s-version-101261) Creating domain...
I0722 11:41:09.393621 55745 main.go:141] libmachine: (old-k8s-version-101261) define libvirt domain using xml:
I0722 11:41:09.393652 55745 main.go:141] libmachine: (old-k8s-version-101261) <domain type='kvm'>
I0722 11:41:09.393662 55745 main.go:141] libmachine: (old-k8s-version-101261) <name>old-k8s-version-101261</name>
I0722 11:41:09.393677 55745 main.go:141] libmachine: (old-k8s-version-101261) <memory unit='MiB'>2200</memory>
I0722 11:41:09.393692 55745 main.go:141] libmachine: (old-k8s-version-101261) <vcpu>2</vcpu>
I0722 11:41:09.393702 55745 main.go:141] libmachine: (old-k8s-version-101261) <features>
I0722 11:41:09.393714 55745 main.go:141] libmachine: (old-k8s-version-101261) <acpi/>
I0722 11:41:09.393725 55745 main.go:141] libmachine: (old-k8s-version-101261) <apic/>
I0722 11:41:09.393741 55745 main.go:141] libmachine: (old-k8s-version-101261) <pae/>
I0722 11:41:09.393753 55745 main.go:141] libmachine: (old-k8s-version-101261)
I0722 11:41:09.393765 55745 main.go:141] libmachine: (old-k8s-version-101261) </features>
I0722 11:41:09.393775 55745 main.go:141] libmachine: (old-k8s-version-101261) <cpu mode='host-passthrough'>
I0722 11:41:09.393784 55745 main.go:141] libmachine: (old-k8s-version-101261)
I0722 11:41:09.393805 55745 main.go:141] libmachine: (old-k8s-version-101261) </cpu>
I0722 11:41:09.393817 55745 main.go:141] libmachine: (old-k8s-version-101261) <os>
I0722 11:41:09.393828 55745 main.go:141] libmachine: (old-k8s-version-101261) <type>hvm</type>
I0722 11:41:09.393840 55745 main.go:141] libmachine: (old-k8s-version-101261) <boot dev='cdrom'/>
I0722 11:41:09.393850 55745 main.go:141] libmachine: (old-k8s-version-101261) <boot dev='hd'/>
I0722 11:41:09.393863 55745 main.go:141] libmachine: (old-k8s-version-101261) <bootmenu enable='no'/>
I0722 11:41:09.393876 55745 main.go:141] libmachine: (old-k8s-version-101261) </os>
I0722 11:41:09.393908 55745 main.go:141] libmachine: (old-k8s-version-101261) <devices>
I0722 11:41:09.393940 55745 main.go:141] libmachine: (old-k8s-version-101261) <disk type='file' device='cdrom'>
I0722 11:41:09.393959 55745 main.go:141] libmachine: (old-k8s-version-101261) <source file='/home/jenkins/minikube-integration/19313-5960/.minikube/machines/old-k8s-version-101261/boot2docker.iso'/>
I0722 11:41:09.393971 55745 main.go:141] libmachine: (old-k8s-version-101261) <target dev='hdc' bus='scsi'/>
I0722 11:41:09.393980 55745 main.go:141] libmachine: (old-k8s-version-101261) <readonly/>
I0722 11:41:09.393990 55745 main.go:141] libmachine: (old-k8s-version-101261) </disk>
I0722 11:41:09.394000 55745 main.go:141] libmachine: (old-k8s-version-101261) <disk type='file' device='disk'>
I0722 11:41:09.394016 55745 main.go:141] libmachine: (old-k8s-version-101261) <driver name='qemu' type='raw' cache='default' io='threads' />
I0722 11:41:09.394043 55745 main.go:141] libmachine: (old-k8s-version-101261) <source file='/home/jenkins/minikube-integration/19313-5960/.minikube/machines/old-k8s-version-101261/old-k8s-version-101261.rawdisk'/>
I0722 11:41:09.394053 55745 main.go:141] libmachine: (old-k8s-version-101261) <target dev='hda' bus='virtio'/>
I0722 11:41:09.394067 55745 main.go:141] libmachine: (old-k8s-version-101261) </disk>
I0722 11:41:09.394075 55745 main.go:141] libmachine: (old-k8s-version-101261) <interface type='network'>
I0722 11:41:09.394087 55745 main.go:141] libmachine: (old-k8s-version-101261) <source network='mk-old-k8s-version-101261'/>
I0722 11:41:09.394098 55745 main.go:141] libmachine: (old-k8s-version-101261) <model type='virtio'/>
I0722 11:41:09.394110 55745 main.go:141] libmachine: (old-k8s-version-101261) </interface>
I0722 11:41:09.394121 55745 main.go:141] libmachine: (old-k8s-version-101261) <interface type='network'>
I0722 11:41:09.394131 55745 main.go:141] libmachine: (old-k8s-version-101261) <source network='default'/>
I0722 11:41:09.394141 55745 main.go:141] libmachine: (old-k8s-version-101261) <model type='virtio'/>
I0722 11:41:09.394153 55745 main.go:141] libmachine: (old-k8s-version-101261) </interface>
I0722 11:41:09.394164 55745 main.go:141] libmachine: (old-k8s-version-101261) <serial type='pty'>
I0722 11:41:09.394176 55745 main.go:141] libmachine: (old-k8s-version-101261) <target port='0'/>
I0722 11:41:09.394200 55745 main.go:141] libmachine: (old-k8s-version-101261) </serial>
I0722 11:41:09.394212 55745 main.go:141] libmachine: (old-k8s-version-101261) <console type='pty'>
I0722 11:41:09.394223 55745 main.go:141] libmachine: (old-k8s-version-101261) <target type='serial' port='0'/>
I0722 11:41:09.394234 55745 main.go:141] libmachine: (old-k8s-version-101261) </console>
I0722 11:41:09.394243 55745 main.go:141] libmachine: (old-k8s-version-101261) <rng model='virtio'>
I0722 11:41:09.394253 55745 main.go:141] libmachine: (old-k8s-version-101261) <backend model='random'>/dev/random</backend>
I0722 11:41:09.394269 55745 main.go:141] libmachine: (old-k8s-version-101261) </rng>
I0722 11:41:09.394281 55745 main.go:141] libmachine: (old-k8s-version-101261)
I0722 11:41:09.394290 55745 main.go:141] libmachine: (old-k8s-version-101261)
I0722 11:41:09.394300 55745 main.go:141] libmachine: (old-k8s-version-101261) </devices>
I0722 11:41:09.394307 55745 main.go:141] libmachine: (old-k8s-version-101261) </domain>
I0722 11:41:09.394317 55745 main.go:141] libmachine: (old-k8s-version-101261)
I0722 11:41:09.397812 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | domain old-k8s-version-101261 has defined MAC address 52:54:00:20:d0:cc in network default
I0722 11:41:09.398345 55745 main.go:141] libmachine: (old-k8s-version-101261) Ensuring networks are active...
I0722 11:41:09.398372 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | domain old-k8s-version-101261 has defined MAC address 52:54:00:e5:34:9a in network mk-old-k8s-version-101261
I0722 11:41:09.398886 55745 main.go:141] libmachine: (old-k8s-version-101261) Ensuring network default is active
I0722 11:41:09.399167 55745 main.go:141] libmachine: (old-k8s-version-101261) Ensuring network mk-old-k8s-version-101261 is active
I0722 11:41:09.399616 55745 main.go:141] libmachine: (old-k8s-version-101261) Getting domain xml...
I0722 11:41:09.400309 55745 main.go:141] libmachine: (old-k8s-version-101261) Creating domain...
I0722 11:41:10.746212 55745 main.go:141] libmachine: (old-k8s-version-101261) Waiting to get IP...
I0722 11:41:10.746975 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | domain old-k8s-version-101261 has defined MAC address 52:54:00:e5:34:9a in network mk-old-k8s-version-101261
I0722 11:41:10.747398 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | unable to find current IP address of domain old-k8s-version-101261 in network mk-old-k8s-version-101261
I0722 11:41:10.747429 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | I0722 11:41:10.747376 55767 retry.go:31] will retry after 304.507247ms: waiting for machine to come up
I0722 11:41:11.053863 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | domain old-k8s-version-101261 has defined MAC address 52:54:00:e5:34:9a in network mk-old-k8s-version-101261
I0722 11:41:11.054370 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | unable to find current IP address of domain old-k8s-version-101261 in network mk-old-k8s-version-101261
I0722 11:41:11.054395 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | I0722 11:41:11.054330 55767 retry.go:31] will retry after 349.842586ms: waiting for machine to come up
I0722 11:41:11.405850 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | domain old-k8s-version-101261 has defined MAC address 52:54:00:e5:34:9a in network mk-old-k8s-version-101261
I0722 11:41:11.406331 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | unable to find current IP address of domain old-k8s-version-101261 in network mk-old-k8s-version-101261
I0722 11:41:11.406359 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | I0722 11:41:11.406283 55767 retry.go:31] will retry after 477.196921ms: waiting for machine to come up
I0722 11:41:11.885065 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | domain old-k8s-version-101261 has defined MAC address 52:54:00:e5:34:9a in network mk-old-k8s-version-101261
I0722 11:41:11.885612 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | unable to find current IP address of domain old-k8s-version-101261 in network mk-old-k8s-version-101261
I0722 11:41:11.885640 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | I0722 11:41:11.885567 55767 retry.go:31] will retry after 432.069094ms: waiting for machine to come up
I0722 11:41:12.318981 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | domain old-k8s-version-101261 has defined MAC address 52:54:00:e5:34:9a in network mk-old-k8s-version-101261
I0722 11:41:12.319665 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | unable to find current IP address of domain old-k8s-version-101261 in network mk-old-k8s-version-101261
I0722 11:41:12.319693 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | I0722 11:41:12.319614 55767 retry.go:31] will retry after 665.03878ms: waiting for machine to come up
I0722 11:41:12.986364 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | domain old-k8s-version-101261 has defined MAC address 52:54:00:e5:34:9a in network mk-old-k8s-version-101261
I0722 11:41:12.986911 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | unable to find current IP address of domain old-k8s-version-101261 in network mk-old-k8s-version-101261
I0722 11:41:12.986941 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | I0722 11:41:12.986860 55767 retry.go:31] will retry after 631.844142ms: waiting for machine to come up
I0722 11:41:13.620340 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | domain old-k8s-version-101261 has defined MAC address 52:54:00:e5:34:9a in network mk-old-k8s-version-101261
I0722 11:41:13.620761 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | unable to find current IP address of domain old-k8s-version-101261 in network mk-old-k8s-version-101261
I0722 11:41:13.620791 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | I0722 11:41:13.620722 55767 retry.go:31] will retry after 1.115172243s: waiting for machine to come up
I0722 11:41:14.737377 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | domain old-k8s-version-101261 has defined MAC address 52:54:00:e5:34:9a in network mk-old-k8s-version-101261
I0722 11:41:14.737792 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | unable to find current IP address of domain old-k8s-version-101261 in network mk-old-k8s-version-101261
I0722 11:41:14.737815 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | I0722 11:41:14.737758 55767 retry.go:31] will retry after 1.27680297s: waiting for machine to come up
I0722 11:41:16.016331 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | domain old-k8s-version-101261 has defined MAC address 52:54:00:e5:34:9a in network mk-old-k8s-version-101261
I0722 11:41:16.016935 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | unable to find current IP address of domain old-k8s-version-101261 in network mk-old-k8s-version-101261
I0722 11:41:16.016966 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | I0722 11:41:16.016863 55767 retry.go:31] will retry after 1.675507518s: waiting for machine to come up
I0722 11:41:17.693831 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | domain old-k8s-version-101261 has defined MAC address 52:54:00:e5:34:9a in network mk-old-k8s-version-101261
I0722 11:41:17.694448 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | unable to find current IP address of domain old-k8s-version-101261 in network mk-old-k8s-version-101261
I0722 11:41:17.694484 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | I0722 11:41:17.694392 55767 retry.go:31] will retry after 1.58500428s: waiting for machine to come up
I0722 11:41:19.280898 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | domain old-k8s-version-101261 has defined MAC address 52:54:00:e5:34:9a in network mk-old-k8s-version-101261
I0722 11:41:19.281502 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | unable to find current IP address of domain old-k8s-version-101261 in network mk-old-k8s-version-101261
I0722 11:41:19.281565 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | I0722 11:41:19.281458 55767 retry.go:31] will retry after 2.231096441s: waiting for machine to come up
I0722 11:41:21.514159 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | domain old-k8s-version-101261 has defined MAC address 52:54:00:e5:34:9a in network mk-old-k8s-version-101261
I0722 11:41:21.514585 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | unable to find current IP address of domain old-k8s-version-101261 in network mk-old-k8s-version-101261
I0722 11:41:21.514615 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | I0722 11:41:21.514528 55767 retry.go:31] will retry after 3.483044023s: waiting for machine to come up
I0722 11:41:24.999993 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | domain old-k8s-version-101261 has defined MAC address 52:54:00:e5:34:9a in network mk-old-k8s-version-101261
I0722 11:41:25.000525 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | unable to find current IP address of domain old-k8s-version-101261 in network mk-old-k8s-version-101261
I0722 11:41:25.000550 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | I0722 11:41:25.000485 55767 retry.go:31] will retry after 3.433084672s: waiting for machine to come up
I0722 11:41:28.437469 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | domain old-k8s-version-101261 has defined MAC address 52:54:00:e5:34:9a in network mk-old-k8s-version-101261
I0722 11:41:28.438145 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | domain old-k8s-version-101261 has current primary IP address 192.168.50.51 and MAC address 52:54:00:e5:34:9a in network mk-old-k8s-version-101261
I0722 11:41:28.438208 55745 main.go:141] libmachine: (old-k8s-version-101261) Found IP for machine: 192.168.50.51
I0722 11:41:28.438233 55745 main.go:141] libmachine: (old-k8s-version-101261) Reserving static IP address...
I0722 11:41:28.438610 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-101261", mac: "52:54:00:e5:34:9a", ip: "192.168.50.51"} in network mk-old-k8s-version-101261
I0722 11:41:28.519697 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | Getting to WaitForSSH function...
I0722 11:41:28.519730 55745 main.go:141] libmachine: (old-k8s-version-101261) Reserved static IP address: 192.168.50.51
I0722 11:41:28.519750 55745 main.go:141] libmachine: (old-k8s-version-101261) Waiting for SSH to be available...
I0722 11:41:28.522379 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | domain old-k8s-version-101261 has defined MAC address 52:54:00:e5:34:9a in network mk-old-k8s-version-101261
I0722 11:41:28.522899 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e5:34:9a", ip: ""} in network mk-old-k8s-version-101261: {Iface:virbr2 ExpiryTime:2024-07-22 12:41:23 +0000 UTC Type:0 Mac:52:54:00:e5:34:9a Iaid: IPaddr:192.168.50.51 Prefix:24 Hostname:minikube Clientid:01:52:54:00:e5:34:9a}
I0722 11:41:28.522941 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | domain old-k8s-version-101261 has defined IP address 192.168.50.51 and MAC address 52:54:00:e5:34:9a in network mk-old-k8s-version-101261
I0722 11:41:28.523023 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | Using SSH client type: external
I0722 11:41:28.523052 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | Using SSH private key: /home/jenkins/minikube-integration/19313-5960/.minikube/machines/old-k8s-version-101261/id_rsa (-rw-------)
I0722 11:41:28.523099 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.50.51 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19313-5960/.minikube/machines/old-k8s-version-101261/id_rsa -p 22] /usr/bin/ssh <nil>}
I0722 11:41:28.523117 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | About to run SSH command:
I0722 11:41:28.523127 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | exit 0
I0722 11:41:28.652524 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | SSH cmd err, output: <nil>:
I0722 11:41:28.652763 55745 main.go:141] libmachine: (old-k8s-version-101261) KVM machine creation complete!
I0722 11:41:28.653054 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetConfigRaw
I0722 11:41:28.653586 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .DriverName
I0722 11:41:28.653787 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .DriverName
I0722 11:41:28.653943 55745 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0722 11:41:28.653956 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetState
I0722 11:41:28.655206 55745 main.go:141] libmachine: Detecting operating system of created instance...
I0722 11:41:28.655220 55745 main.go:141] libmachine: Waiting for SSH to be available...
I0722 11:41:28.655228 55745 main.go:141] libmachine: Getting to WaitForSSH function...
I0722 11:41:28.655236 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetSSHHostname
I0722 11:41:28.657542 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | domain old-k8s-version-101261 has defined MAC address 52:54:00:e5:34:9a in network mk-old-k8s-version-101261
I0722 11:41:28.657935 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e5:34:9a", ip: ""} in network mk-old-k8s-version-101261: {Iface:virbr2 ExpiryTime:2024-07-22 12:41:23 +0000 UTC Type:0 Mac:52:54:00:e5:34:9a Iaid: IPaddr:192.168.50.51 Prefix:24 Hostname:old-k8s-version-101261 Clientid:01:52:54:00:e5:34:9a}
I0722 11:41:28.657963 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | domain old-k8s-version-101261 has defined IP address 192.168.50.51 and MAC address 52:54:00:e5:34:9a in network mk-old-k8s-version-101261
I0722 11:41:28.658105 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetSSHPort
I0722 11:41:28.658283 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetSSHKeyPath
I0722 11:41:28.658445 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetSSHKeyPath
I0722 11:41:28.658564 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetSSHUsername
I0722 11:41:28.658748 55745 main.go:141] libmachine: Using SSH client type: native
I0722 11:41:28.658969 55745 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.50.51 22 <nil> <nil>}
I0722 11:41:28.658982 55745 main.go:141] libmachine: About to run SSH command:
exit 0
I0722 11:41:28.775586 55745 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0722 11:41:28.775611 55745 main.go:141] libmachine: Detecting the provisioner...
I0722 11:41:28.775621 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetSSHHostname
I0722 11:41:28.778384 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | domain old-k8s-version-101261 has defined MAC address 52:54:00:e5:34:9a in network mk-old-k8s-version-101261
I0722 11:41:28.778704 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e5:34:9a", ip: ""} in network mk-old-k8s-version-101261: {Iface:virbr2 ExpiryTime:2024-07-22 12:41:23 +0000 UTC Type:0 Mac:52:54:00:e5:34:9a Iaid: IPaddr:192.168.50.51 Prefix:24 Hostname:old-k8s-version-101261 Clientid:01:52:54:00:e5:34:9a}
I0722 11:41:28.778732 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | domain old-k8s-version-101261 has defined IP address 192.168.50.51 and MAC address 52:54:00:e5:34:9a in network mk-old-k8s-version-101261
I0722 11:41:28.778878 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetSSHPort
I0722 11:41:28.779067 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetSSHKeyPath
I0722 11:41:28.779206 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetSSHKeyPath
I0722 11:41:28.779333 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetSSHUsername
I0722 11:41:28.779488 55745 main.go:141] libmachine: Using SSH client type: native
I0722 11:41:28.779640 55745 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.50.51 22 <nil> <nil>}
I0722 11:41:28.779650 55745 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0722 11:41:28.889057 55745 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0722 11:41:28.889149 55745 main.go:141] libmachine: found compatible host: buildroot
I0722 11:41:28.889162 55745 main.go:141] libmachine: Provisioning with buildroot...
I0722 11:41:28.889174 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetMachineName
I0722 11:41:28.889440 55745 buildroot.go:166] provisioning hostname "old-k8s-version-101261"
I0722 11:41:28.889465 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetMachineName
I0722 11:41:28.889607 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetSSHHostname
I0722 11:41:28.891903 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | domain old-k8s-version-101261 has defined MAC address 52:54:00:e5:34:9a in network mk-old-k8s-version-101261
I0722 11:41:28.892243 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e5:34:9a", ip: ""} in network mk-old-k8s-version-101261: {Iface:virbr2 ExpiryTime:2024-07-22 12:41:23 +0000 UTC Type:0 Mac:52:54:00:e5:34:9a Iaid: IPaddr:192.168.50.51 Prefix:24 Hostname:old-k8s-version-101261 Clientid:01:52:54:00:e5:34:9a}
I0722 11:41:28.892266 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | domain old-k8s-version-101261 has defined IP address 192.168.50.51 and MAC address 52:54:00:e5:34:9a in network mk-old-k8s-version-101261
I0722 11:41:28.892398 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetSSHPort
I0722 11:41:28.892556 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetSSHKeyPath
I0722 11:41:28.892684 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetSSHKeyPath
I0722 11:41:28.892789 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetSSHUsername
I0722 11:41:28.892951 55745 main.go:141] libmachine: Using SSH client type: native
I0722 11:41:28.893118 55745 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.50.51 22 <nil> <nil>}
I0722 11:41:28.893130 55745 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-101261 && echo "old-k8s-version-101261" | sudo tee /etc/hostname
I0722 11:41:29.018321 55745 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-101261
I0722 11:41:29.018353 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetSSHHostname
I0722 11:41:29.020992 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | domain old-k8s-version-101261 has defined MAC address 52:54:00:e5:34:9a in network mk-old-k8s-version-101261
I0722 11:41:29.021350 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e5:34:9a", ip: ""} in network mk-old-k8s-version-101261: {Iface:virbr2 ExpiryTime:2024-07-22 12:41:23 +0000 UTC Type:0 Mac:52:54:00:e5:34:9a Iaid: IPaddr:192.168.50.51 Prefix:24 Hostname:old-k8s-version-101261 Clientid:01:52:54:00:e5:34:9a}
I0722 11:41:29.021389 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | domain old-k8s-version-101261 has defined IP address 192.168.50.51 and MAC address 52:54:00:e5:34:9a in network mk-old-k8s-version-101261
I0722 11:41:29.021580 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetSSHPort
I0722 11:41:29.021780 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetSSHKeyPath
I0722 11:41:29.021952 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetSSHKeyPath
I0722 11:41:29.022108 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetSSHUsername
I0722 11:41:29.022272 55745 main.go:141] libmachine: Using SSH client type: native
I0722 11:41:29.022474 55745 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.50.51 22 <nil> <nil>}
I0722 11:41:29.022505 55745 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-101261' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-101261/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-101261' | sudo tee -a /etc/hosts;
fi
fi
I0722 11:41:29.140785 55745 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0722 11:41:29.140811 55745 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19313-5960/.minikube CaCertPath:/home/jenkins/minikube-integration/19313-5960/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19313-5960/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19313-5960/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19313-5960/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19313-5960/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19313-5960/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19313-5960/.minikube}
I0722 11:41:29.140831 55745 buildroot.go:174] setting up certificates
I0722 11:41:29.140841 55745 provision.go:84] configureAuth start
I0722 11:41:29.140853 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetMachineName
I0722 11:41:29.141119 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetIP
I0722 11:41:29.143665 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | domain old-k8s-version-101261 has defined MAC address 52:54:00:e5:34:9a in network mk-old-k8s-version-101261
I0722 11:41:29.144066 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e5:34:9a", ip: ""} in network mk-old-k8s-version-101261: {Iface:virbr2 ExpiryTime:2024-07-22 12:41:23 +0000 UTC Type:0 Mac:52:54:00:e5:34:9a Iaid: IPaddr:192.168.50.51 Prefix:24 Hostname:old-k8s-version-101261 Clientid:01:52:54:00:e5:34:9a}
I0722 11:41:29.144084 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | domain old-k8s-version-101261 has defined IP address 192.168.50.51 and MAC address 52:54:00:e5:34:9a in network mk-old-k8s-version-101261
I0722 11:41:29.144224 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetSSHHostname
I0722 11:41:29.146290 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | domain old-k8s-version-101261 has defined MAC address 52:54:00:e5:34:9a in network mk-old-k8s-version-101261
I0722 11:41:29.146603 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e5:34:9a", ip: ""} in network mk-old-k8s-version-101261: {Iface:virbr2 ExpiryTime:2024-07-22 12:41:23 +0000 UTC Type:0 Mac:52:54:00:e5:34:9a Iaid: IPaddr:192.168.50.51 Prefix:24 Hostname:old-k8s-version-101261 Clientid:01:52:54:00:e5:34:9a}
I0722 11:41:29.146635 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | domain old-k8s-version-101261 has defined IP address 192.168.50.51 and MAC address 52:54:00:e5:34:9a in network mk-old-k8s-version-101261
I0722 11:41:29.146769 55745 provision.go:143] copyHostCerts
I0722 11:41:29.146827 55745 exec_runner.go:144] found /home/jenkins/minikube-integration/19313-5960/.minikube/ca.pem, removing ...
I0722 11:41:29.146839 55745 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19313-5960/.minikube/ca.pem
I0722 11:41:29.146915 55745 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19313-5960/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19313-5960/.minikube/ca.pem (1082 bytes)
I0722 11:41:29.146997 55745 exec_runner.go:144] found /home/jenkins/minikube-integration/19313-5960/.minikube/cert.pem, removing ...
I0722 11:41:29.147005 55745 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19313-5960/.minikube/cert.pem
I0722 11:41:29.147023 55745 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19313-5960/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19313-5960/.minikube/cert.pem (1123 bytes)
I0722 11:41:29.147081 55745 exec_runner.go:144] found /home/jenkins/minikube-integration/19313-5960/.minikube/key.pem, removing ...
I0722 11:41:29.147088 55745 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19313-5960/.minikube/key.pem
I0722 11:41:29.147105 55745 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19313-5960/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19313-5960/.minikube/key.pem (1679 bytes)
I0722 11:41:29.147147 55745 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19313-5960/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19313-5960/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19313-5960/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-101261 san=[127.0.0.1 192.168.50.51 localhost minikube old-k8s-version-101261]
I0722 11:41:29.477369 55745 provision.go:177] copyRemoteCerts
I0722 11:41:29.477426 55745 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0722 11:41:29.477465 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetSSHHostname
I0722 11:41:29.480203 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | domain old-k8s-version-101261 has defined MAC address 52:54:00:e5:34:9a in network mk-old-k8s-version-101261
I0722 11:41:29.480575 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e5:34:9a", ip: ""} in network mk-old-k8s-version-101261: {Iface:virbr2 ExpiryTime:2024-07-22 12:41:23 +0000 UTC Type:0 Mac:52:54:00:e5:34:9a Iaid: IPaddr:192.168.50.51 Prefix:24 Hostname:old-k8s-version-101261 Clientid:01:52:54:00:e5:34:9a}
I0722 11:41:29.480610 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | domain old-k8s-version-101261 has defined IP address 192.168.50.51 and MAC address 52:54:00:e5:34:9a in network mk-old-k8s-version-101261
I0722 11:41:29.480750 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetSSHPort
I0722 11:41:29.480936 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetSSHKeyPath
I0722 11:41:29.481091 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetSSHUsername
I0722 11:41:29.481261 55745 sshutil.go:53] new ssh client: &{IP:192.168.50.51 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19313-5960/.minikube/machines/old-k8s-version-101261/id_rsa Username:docker}
I0722 11:41:29.566881 55745 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-5960/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0722 11:41:29.590788 55745 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-5960/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0722 11:41:29.613489 55745 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-5960/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0722 11:41:29.636914 55745 provision.go:87] duration metric: took 496.062226ms to configureAuth
I0722 11:41:29.636941 55745 buildroot.go:189] setting minikube options for container-runtime
I0722 11:41:29.637076 55745 config.go:182] Loaded profile config "old-k8s-version-101261": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0722 11:41:29.637136 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetSSHHostname
I0722 11:41:29.639412 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | domain old-k8s-version-101261 has defined MAC address 52:54:00:e5:34:9a in network mk-old-k8s-version-101261
I0722 11:41:29.639699 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e5:34:9a", ip: ""} in network mk-old-k8s-version-101261: {Iface:virbr2 ExpiryTime:2024-07-22 12:41:23 +0000 UTC Type:0 Mac:52:54:00:e5:34:9a Iaid: IPaddr:192.168.50.51 Prefix:24 Hostname:old-k8s-version-101261 Clientid:01:52:54:00:e5:34:9a}
I0722 11:41:29.639726 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | domain old-k8s-version-101261 has defined IP address 192.168.50.51 and MAC address 52:54:00:e5:34:9a in network mk-old-k8s-version-101261
I0722 11:41:29.639892 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetSSHPort
I0722 11:41:29.640103 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetSSHKeyPath
I0722 11:41:29.640278 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetSSHKeyPath
I0722 11:41:29.640453 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetSSHUsername
I0722 11:41:29.640639 55745 main.go:141] libmachine: Using SSH client type: native
I0722 11:41:29.640834 55745 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.50.51 22 <nil> <nil>}
I0722 11:41:29.640850 55745 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0722 11:41:29.911956 55745 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0722 11:41:29.911980 55745 main.go:141] libmachine: Checking connection to Docker...
I0722 11:41:29.911988 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetURL
I0722 11:41:29.913283 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | Using libvirt version 6000000
I0722 11:41:29.915294 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | domain old-k8s-version-101261 has defined MAC address 52:54:00:e5:34:9a in network mk-old-k8s-version-101261
I0722 11:41:29.915621 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e5:34:9a", ip: ""} in network mk-old-k8s-version-101261: {Iface:virbr2 ExpiryTime:2024-07-22 12:41:23 +0000 UTC Type:0 Mac:52:54:00:e5:34:9a Iaid: IPaddr:192.168.50.51 Prefix:24 Hostname:old-k8s-version-101261 Clientid:01:52:54:00:e5:34:9a}
I0722 11:41:29.915667 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | domain old-k8s-version-101261 has defined IP address 192.168.50.51 and MAC address 52:54:00:e5:34:9a in network mk-old-k8s-version-101261
I0722 11:41:29.915824 55745 main.go:141] libmachine: Docker is up and running!
I0722 11:41:29.915839 55745 main.go:141] libmachine: Reticulating splines...
I0722 11:41:29.915846 55745 client.go:171] duration metric: took 21.138738979s to LocalClient.Create
I0722 11:41:29.915877 55745 start.go:167] duration metric: took 21.13880562s to libmachine.API.Create "old-k8s-version-101261"
I0722 11:41:29.915893 55745 start.go:293] postStartSetup for "old-k8s-version-101261" (driver="kvm2")
I0722 11:41:29.915909 55745 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0722 11:41:29.915925 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .DriverName
I0722 11:41:29.916132 55745 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0722 11:41:29.916154 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetSSHHostname
I0722 11:41:29.918248 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | domain old-k8s-version-101261 has defined MAC address 52:54:00:e5:34:9a in network mk-old-k8s-version-101261
I0722 11:41:29.918517 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e5:34:9a", ip: ""} in network mk-old-k8s-version-101261: {Iface:virbr2 ExpiryTime:2024-07-22 12:41:23 +0000 UTC Type:0 Mac:52:54:00:e5:34:9a Iaid: IPaddr:192.168.50.51 Prefix:24 Hostname:old-k8s-version-101261 Clientid:01:52:54:00:e5:34:9a}
I0722 11:41:29.918546 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | domain old-k8s-version-101261 has defined IP address 192.168.50.51 and MAC address 52:54:00:e5:34:9a in network mk-old-k8s-version-101261
I0722 11:41:29.918656 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetSSHPort
I0722 11:41:29.918815 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetSSHKeyPath
I0722 11:41:29.918957 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetSSHUsername
I0722 11:41:29.919096 55745 sshutil.go:53] new ssh client: &{IP:192.168.50.51 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19313-5960/.minikube/machines/old-k8s-version-101261/id_rsa Username:docker}
I0722 11:41:30.007161 55745 ssh_runner.go:195] Run: cat /etc/os-release
I0722 11:41:30.011532 55745 info.go:137] Remote host: Buildroot 2023.02.9
I0722 11:41:30.011552 55745 filesync.go:126] Scanning /home/jenkins/minikube-integration/19313-5960/.minikube/addons for local assets ...
I0722 11:41:30.011606 55745 filesync.go:126] Scanning /home/jenkins/minikube-integration/19313-5960/.minikube/files for local assets ...
I0722 11:41:30.011712 55745 filesync.go:149] local asset: /home/jenkins/minikube-integration/19313-5960/.minikube/files/etc/ssl/certs/130982.pem -> 130982.pem in /etc/ssl/certs
I0722 11:41:30.011833 55745 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0722 11:41:30.021177 55745 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-5960/.minikube/files/etc/ssl/certs/130982.pem --> /etc/ssl/certs/130982.pem (1708 bytes)
I0722 11:41:30.045476 55745 start.go:296] duration metric: took 129.571112ms for postStartSetup
I0722 11:41:30.045533 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetConfigRaw
I0722 11:41:30.046100 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetIP
I0722 11:41:30.048500 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | domain old-k8s-version-101261 has defined MAC address 52:54:00:e5:34:9a in network mk-old-k8s-version-101261
I0722 11:41:30.048838 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e5:34:9a", ip: ""} in network mk-old-k8s-version-101261: {Iface:virbr2 ExpiryTime:2024-07-22 12:41:23 +0000 UTC Type:0 Mac:52:54:00:e5:34:9a Iaid: IPaddr:192.168.50.51 Prefix:24 Hostname:old-k8s-version-101261 Clientid:01:52:54:00:e5:34:9a}
I0722 11:41:30.048859 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | domain old-k8s-version-101261 has defined IP address 192.168.50.51 and MAC address 52:54:00:e5:34:9a in network mk-old-k8s-version-101261
I0722 11:41:30.049162 55745 profile.go:143] Saving config to /home/jenkins/minikube-integration/19313-5960/.minikube/profiles/old-k8s-version-101261/config.json ...
I0722 11:41:30.049398 55745 start.go:128] duration metric: took 21.294036936s to createHost
I0722 11:41:30.049428 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetSSHHostname
I0722 11:41:30.051665 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | domain old-k8s-version-101261 has defined MAC address 52:54:00:e5:34:9a in network mk-old-k8s-version-101261
I0722 11:41:30.052012 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e5:34:9a", ip: ""} in network mk-old-k8s-version-101261: {Iface:virbr2 ExpiryTime:2024-07-22 12:41:23 +0000 UTC Type:0 Mac:52:54:00:e5:34:9a Iaid: IPaddr:192.168.50.51 Prefix:24 Hostname:old-k8s-version-101261 Clientid:01:52:54:00:e5:34:9a}
I0722 11:41:30.052043 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | domain old-k8s-version-101261 has defined IP address 192.168.50.51 and MAC address 52:54:00:e5:34:9a in network mk-old-k8s-version-101261
I0722 11:41:30.052172 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetSSHPort
I0722 11:41:30.052372 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetSSHKeyPath
I0722 11:41:30.052557 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetSSHKeyPath
I0722 11:41:30.052719 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetSSHUsername
I0722 11:41:30.052883 55745 main.go:141] libmachine: Using SSH client type: native
I0722 11:41:30.053082 55745 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.50.51 22 <nil> <nil>}
I0722 11:41:30.053094 55745 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0722 11:41:30.164721 55745 main.go:141] libmachine: SSH cmd err, output: <nil>: 1721648490.134733613
I0722 11:41:30.164743 55745 fix.go:216] guest clock: 1721648490.134733613
I0722 11:41:30.164750 55745 fix.go:229] Guest: 2024-07-22 11:41:30.134733613 +0000 UTC Remote: 2024-07-22 11:41:30.049414602 +0000 UTC m=+21.427208854 (delta=85.319011ms)
I0722 11:41:30.164785 55745 fix.go:200] guest clock delta is within tolerance: 85.319011ms
I0722 11:41:30.164792 55745 start.go:83] releasing machines lock for "old-k8s-version-101261", held for 21.409537006s
I0722 11:41:30.164827 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .DriverName
I0722 11:41:30.165051 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetIP
I0722 11:41:30.167650 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | domain old-k8s-version-101261 has defined MAC address 52:54:00:e5:34:9a in network mk-old-k8s-version-101261
I0722 11:41:30.168030 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e5:34:9a", ip: ""} in network mk-old-k8s-version-101261: {Iface:virbr2 ExpiryTime:2024-07-22 12:41:23 +0000 UTC Type:0 Mac:52:54:00:e5:34:9a Iaid: IPaddr:192.168.50.51 Prefix:24 Hostname:old-k8s-version-101261 Clientid:01:52:54:00:e5:34:9a}
I0722 11:41:30.168057 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | domain old-k8s-version-101261 has defined IP address 192.168.50.51 and MAC address 52:54:00:e5:34:9a in network mk-old-k8s-version-101261
I0722 11:41:30.168208 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .DriverName
I0722 11:41:30.168679 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .DriverName
I0722 11:41:30.168853 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .DriverName
I0722 11:41:30.168941 55745 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0722 11:41:30.168985 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetSSHHostname
I0722 11:41:30.169069 55745 ssh_runner.go:195] Run: cat /version.json
I0722 11:41:30.169092 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetSSHHostname
I0722 11:41:30.171622 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | domain old-k8s-version-101261 has defined MAC address 52:54:00:e5:34:9a in network mk-old-k8s-version-101261
I0722 11:41:30.171974 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | domain old-k8s-version-101261 has defined MAC address 52:54:00:e5:34:9a in network mk-old-k8s-version-101261
I0722 11:41:30.172019 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e5:34:9a", ip: ""} in network mk-old-k8s-version-101261: {Iface:virbr2 ExpiryTime:2024-07-22 12:41:23 +0000 UTC Type:0 Mac:52:54:00:e5:34:9a Iaid: IPaddr:192.168.50.51 Prefix:24 Hostname:old-k8s-version-101261 Clientid:01:52:54:00:e5:34:9a}
I0722 11:41:30.172045 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | domain old-k8s-version-101261 has defined IP address 192.168.50.51 and MAC address 52:54:00:e5:34:9a in network mk-old-k8s-version-101261
I0722 11:41:30.172205 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetSSHPort
I0722 11:41:30.172397 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetSSHKeyPath
I0722 11:41:30.172564 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetSSHUsername
I0722 11:41:30.172612 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e5:34:9a", ip: ""} in network mk-old-k8s-version-101261: {Iface:virbr2 ExpiryTime:2024-07-22 12:41:23 +0000 UTC Type:0 Mac:52:54:00:e5:34:9a Iaid: IPaddr:192.168.50.51 Prefix:24 Hostname:old-k8s-version-101261 Clientid:01:52:54:00:e5:34:9a}
I0722 11:41:30.172634 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | domain old-k8s-version-101261 has defined IP address 192.168.50.51 and MAC address 52:54:00:e5:34:9a in network mk-old-k8s-version-101261
I0722 11:41:30.172707 55745 sshutil.go:53] new ssh client: &{IP:192.168.50.51 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19313-5960/.minikube/machines/old-k8s-version-101261/id_rsa Username:docker}
I0722 11:41:30.172799 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetSSHPort
I0722 11:41:30.172936 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetSSHKeyPath
I0722 11:41:30.173065 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetSSHUsername
I0722 11:41:30.173219 55745 sshutil.go:53] new ssh client: &{IP:192.168.50.51 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19313-5960/.minikube/machines/old-k8s-version-101261/id_rsa Username:docker}
I0722 11:41:30.278465 55745 ssh_runner.go:195] Run: systemctl --version
I0722 11:41:30.284733 55745 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0722 11:41:30.450634 55745 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0722 11:41:30.457196 55745 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0722 11:41:30.457270 55745 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0722 11:41:30.481510 55745 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0722 11:41:30.481537 55745 start.go:495] detecting cgroup driver to use...
I0722 11:41:30.481619 55745 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0722 11:41:30.502441 55745 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0722 11:41:30.515809 55745 docker.go:217] disabling cri-docker service (if available) ...
I0722 11:41:30.515853 55745 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0722 11:41:30.529754 55745 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0722 11:41:30.545476 55745 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0722 11:41:30.680962 55745 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0722 11:41:30.835193 55745 docker.go:233] disabling docker service ...
I0722 11:41:30.835246 55745 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0722 11:41:30.853799 55745 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0722 11:41:30.866668 55745 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0722 11:41:31.011041 55745 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0722 11:41:31.150521 55745 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0722 11:41:31.164081 55745 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0722 11:41:31.182375 55745 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0722 11:41:31.182438 55745 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0722 11:41:31.192594 55745 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0722 11:41:31.192650 55745 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0722 11:41:31.203323 55745 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0722 11:41:31.213328 55745 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0722 11:41:31.223725 55745 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0722 11:41:31.236113 55745 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0722 11:41:31.245773 55745 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0722 11:41:31.245829 55745 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0722 11:41:31.260067 55745 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0722 11:41:31.269570 55745 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0722 11:41:31.395416 55745 ssh_runner.go:195] Run: sudo systemctl restart crio
I0722 11:41:31.540817 55745 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0722 11:41:31.540912 55745 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0722 11:41:31.545664 55745 start.go:563] Will wait 60s for crictl version
I0722 11:41:31.545724 55745 ssh_runner.go:195] Run: which crictl
I0722 11:41:31.549280 55745 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0722 11:41:31.596199 55745 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0722 11:41:31.596291 55745 ssh_runner.go:195] Run: crio --version
I0722 11:41:31.631851 55745 ssh_runner.go:195] Run: crio --version
I0722 11:41:31.661902 55745 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0722 11:41:31.663153 55745 main.go:141] libmachine: (old-k8s-version-101261) Calling .GetIP
I0722 11:41:31.666326 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | domain old-k8s-version-101261 has defined MAC address 52:54:00:e5:34:9a in network mk-old-k8s-version-101261
I0722 11:41:31.666814 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e5:34:9a", ip: ""} in network mk-old-k8s-version-101261: {Iface:virbr2 ExpiryTime:2024-07-22 12:41:23 +0000 UTC Type:0 Mac:52:54:00:e5:34:9a Iaid: IPaddr:192.168.50.51 Prefix:24 Hostname:old-k8s-version-101261 Clientid:01:52:54:00:e5:34:9a}
I0722 11:41:31.666866 55745 main.go:141] libmachine: (old-k8s-version-101261) DBG | domain old-k8s-version-101261 has defined IP address 192.168.50.51 and MAC address 52:54:00:e5:34:9a in network mk-old-k8s-version-101261
I0722 11:41:31.667220 55745 ssh_runner.go:195] Run: grep 192.168.50.1 host.minikube.internal$ /etc/hosts
I0722 11:41:31.671480 55745 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.50.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0722 11:41:31.683865 55745 kubeadm.go:883] updating cluster {Name:old-k8s-version-101261 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19298/minikube-v1.33.1-1721324531-19298-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-101261 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.50.51 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mo
untPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0722 11:41:31.683996 55745 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0722 11:41:31.684051 55745 ssh_runner.go:195] Run: sudo crictl images --output json
I0722 11:41:31.715808 55745 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0722 11:41:31.715886 55745 ssh_runner.go:195] Run: which lz4
I0722 11:41:31.720355 55745 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0722 11:41:31.724333 55745 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0722 11:41:31.724368 55745 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-5960/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0722 11:41:33.411957 55745 crio.go:462] duration metric: took 1.691633489s to copy over tarball
I0722 11:41:33.412033 55745 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0722 11:41:36.004744 55745 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.59267833s)
I0722 11:41:36.004778 55745 crio.go:469] duration metric: took 2.592793925s to extract the tarball
I0722 11:41:36.004786 55745 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0722 11:41:36.049470 55745 ssh_runner.go:195] Run: sudo crictl images --output json
I0722 11:41:36.094634 55745 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0722 11:41:36.094658 55745 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0722 11:41:36.094741 55745 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0722 11:41:36.094775 55745 image.go:134] retrieving image: registry.k8s.io/pause:3.2
I0722 11:41:36.094979 55745 image.go:134] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0722 11:41:36.095000 55745 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0722 11:41:36.095086 55745 image.go:134] retrieving image: registry.k8s.io/coredns:1.7.0
I0722 11:41:36.094981 55745 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0722 11:41:36.094983 55745 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0722 11:41:36.094737 55745 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0722 11:41:36.096208 55745 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0722 11:41:36.096248 55745 image.go:177] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0722 11:41:36.096209 55745 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0722 11:41:36.096274 55745 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0722 11:41:36.096284 55745 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0722 11:41:36.096210 55745 image.go:177] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0722 11:41:36.096302 55745 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0722 11:41:36.096312 55745 image.go:177] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0722 11:41:36.263510 55745 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0722 11:41:36.265196 55745 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0722 11:41:36.266546 55745 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0722 11:41:36.275758 55745 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0722 11:41:36.284304 55745 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0722 11:41:36.293462 55745 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0722 11:41:36.359241 55745 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0722 11:41:36.359300 55745 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0722 11:41:36.359355 55745 ssh_runner.go:195] Run: which crictl
I0722 11:41:36.385172 55745 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0722 11:41:36.404187 55745 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0722 11:41:36.404236 55745 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0722 11:41:36.404287 55745 ssh_runner.go:195] Run: which crictl
I0722 11:41:36.412757 55745 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0722 11:41:36.427827 55745 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0722 11:41:36.427870 55745 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0722 11:41:36.427899 55745 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0722 11:41:36.427903 55745 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0722 11:41:36.427947 55745 ssh_runner.go:195] Run: which crictl
I0722 11:41:36.427987 55745 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0722 11:41:36.427947 55745 ssh_runner.go:195] Run: which crictl
I0722 11:41:36.428023 55745 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0722 11:41:36.428084 55745 ssh_runner.go:195] Run: which crictl
I0722 11:41:36.470200 55745 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0722 11:41:36.470249 55745 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0722 11:41:36.470254 55745 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0722 11:41:36.470282 55745 ssh_runner.go:195] Run: which crictl
I0722 11:41:36.496118 55745 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0722 11:41:36.496174 55745 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0722 11:41:36.496197 55745 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0722 11:41:36.496215 55745 ssh_runner.go:195] Run: which crictl
I0722 11:41:36.608882 55745 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0722 11:41:36.608941 55745 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0722 11:41:36.608958 55745 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0722 11:41:36.609032 55745 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19313-5960/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0722 11:41:36.609033 55745 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0722 11:41:36.609068 55745 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0722 11:41:36.609091 55745 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19313-5960/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0722 11:41:36.737963 55745 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19313-5960/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0722 11:41:36.737980 55745 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19313-5960/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0722 11:41:36.738035 55745 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19313-5960/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0722 11:41:36.738082 55745 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19313-5960/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0722 11:41:36.738147 55745 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19313-5960/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0722 11:41:36.738183 55745 cache_images.go:92] duration metric: took 643.512118ms to LoadCachedImages
W0722 11:41:36.738239 55745 out.go:239] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19313-5960/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19313-5960/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0: no such file or directory
I0722 11:41:36.738251 55745 kubeadm.go:934] updating node { 192.168.50.51 8443 v1.20.0 crio true true} ...
I0722 11:41:36.738372 55745 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-101261 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.50.51
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-101261 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0722 11:41:36.738445 55745 ssh_runner.go:195] Run: crio config
I0722 11:41:36.790707 55745 cni.go:84] Creating CNI manager for ""
I0722 11:41:36.790736 55745 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0722 11:41:36.790750 55745 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0722 11:41:36.790766 55745 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.50.51 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-101261 NodeName:old-k8s-version-101261 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.50.51"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.50.51 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt Stati
cPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0722 11:41:36.790901 55745 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.50.51
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-101261"
kubeletExtraArgs:
node-ip: 192.168.50.51
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.50.51"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0722 11:41:36.790961 55745 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0722 11:41:36.801815 55745 binaries.go:44] Found k8s binaries, skipping transfer
I0722 11:41:36.801912 55745 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0722 11:41:36.812596 55745 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (429 bytes)
I0722 11:41:36.829924 55745 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0722 11:41:36.848510 55745 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2120 bytes)
I0722 11:41:36.866574 55745 ssh_runner.go:195] Run: grep 192.168.50.51 control-plane.minikube.internal$ /etc/hosts
I0722 11:41:36.870598 55745 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.50.51 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0722 11:41:36.884141 55745 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0722 11:41:37.011261 55745 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0722 11:41:37.029583 55745 certs.go:68] Setting up /home/jenkins/minikube-integration/19313-5960/.minikube/profiles/old-k8s-version-101261 for IP: 192.168.50.51
I0722 11:41:37.029604 55745 certs.go:194] generating shared ca certs ...
I0722 11:41:37.029624 55745 certs.go:226] acquiring lock for ca certs: {Name:mkd084ec5fec65793ddf74f7d182bb8e425e2073 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0722 11:41:37.029789 55745 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19313-5960/.minikube/ca.key
I0722 11:41:37.029840 55745 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19313-5960/.minikube/proxy-client-ca.key
I0722 11:41:37.029852 55745 certs.go:256] generating profile certs ...
I0722 11:41:37.029914 55745 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19313-5960/.minikube/profiles/old-k8s-version-101261/client.key
I0722 11:41:37.029932 55745 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19313-5960/.minikube/profiles/old-k8s-version-101261/client.crt with IP's: []
I0722 11:41:37.204999 55745 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19313-5960/.minikube/profiles/old-k8s-version-101261/client.crt ...
I0722 11:41:37.205035 55745 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19313-5960/.minikube/profiles/old-k8s-version-101261/client.crt: {Name:mkff86fd37df28e2f2c7c96fd028952c59b00293 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0722 11:41:37.205222 55745 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19313-5960/.minikube/profiles/old-k8s-version-101261/client.key ...
I0722 11:41:37.205248 55745 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19313-5960/.minikube/profiles/old-k8s-version-101261/client.key: {Name:mkd8750fd68e67f4122af9bc367d32d6fd6cb774 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0722 11:41:37.205353 55745 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19313-5960/.minikube/profiles/old-k8s-version-101261/apiserver.key.455618c3
I0722 11:41:37.205375 55745 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19313-5960/.minikube/profiles/old-k8s-version-101261/apiserver.crt.455618c3 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.50.51]
I0722 11:41:37.582514 55745 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19313-5960/.minikube/profiles/old-k8s-version-101261/apiserver.crt.455618c3 ...
I0722 11:41:37.582545 55745 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19313-5960/.minikube/profiles/old-k8s-version-101261/apiserver.crt.455618c3: {Name:mk14868bcbaa78ca65d613f3eaf6854d6eee1f1d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0722 11:41:37.582713 55745 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19313-5960/.minikube/profiles/old-k8s-version-101261/apiserver.key.455618c3 ...
I0722 11:41:37.582728 55745 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19313-5960/.minikube/profiles/old-k8s-version-101261/apiserver.key.455618c3: {Name:mk68fbb88c60be4a8b5351c16fdb8c2282090c01 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0722 11:41:37.582795 55745 certs.go:381] copying /home/jenkins/minikube-integration/19313-5960/.minikube/profiles/old-k8s-version-101261/apiserver.crt.455618c3 -> /home/jenkins/minikube-integration/19313-5960/.minikube/profiles/old-k8s-version-101261/apiserver.crt
I0722 11:41:37.582862 55745 certs.go:385] copying /home/jenkins/minikube-integration/19313-5960/.minikube/profiles/old-k8s-version-101261/apiserver.key.455618c3 -> /home/jenkins/minikube-integration/19313-5960/.minikube/profiles/old-k8s-version-101261/apiserver.key
I0722 11:41:37.582915 55745 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19313-5960/.minikube/profiles/old-k8s-version-101261/proxy-client.key
I0722 11:41:37.582930 55745 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19313-5960/.minikube/profiles/old-k8s-version-101261/proxy-client.crt with IP's: []
I0722 11:41:37.642750 55745 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19313-5960/.minikube/profiles/old-k8s-version-101261/proxy-client.crt ...
I0722 11:41:37.642774 55745 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19313-5960/.minikube/profiles/old-k8s-version-101261/proxy-client.crt: {Name:mk97d22708e509be77571d259f5197995be66fa6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0722 11:41:37.642919 55745 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19313-5960/.minikube/profiles/old-k8s-version-101261/proxy-client.key ...
I0722 11:41:37.642931 55745 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19313-5960/.minikube/profiles/old-k8s-version-101261/proxy-client.key: {Name:mk480b866b25c15691d1645d68c70b1e30760092 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0722 11:41:37.643110 55745 certs.go:484] found cert: /home/jenkins/minikube-integration/19313-5960/.minikube/certs/13098.pem (1338 bytes)
W0722 11:41:37.643148 55745 certs.go:480] ignoring /home/jenkins/minikube-integration/19313-5960/.minikube/certs/13098_empty.pem, impossibly tiny 0 bytes
I0722 11:41:37.643165 55745 certs.go:484] found cert: /home/jenkins/minikube-integration/19313-5960/.minikube/certs/ca-key.pem (1675 bytes)
I0722 11:41:37.643188 55745 certs.go:484] found cert: /home/jenkins/minikube-integration/19313-5960/.minikube/certs/ca.pem (1082 bytes)
I0722 11:41:37.643210 55745 certs.go:484] found cert: /home/jenkins/minikube-integration/19313-5960/.minikube/certs/cert.pem (1123 bytes)
I0722 11:41:37.643230 55745 certs.go:484] found cert: /home/jenkins/minikube-integration/19313-5960/.minikube/certs/key.pem (1679 bytes)
I0722 11:41:37.643266 55745 certs.go:484] found cert: /home/jenkins/minikube-integration/19313-5960/.minikube/files/etc/ssl/certs/130982.pem (1708 bytes)
I0722 11:41:37.643833 55745 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-5960/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0722 11:41:37.670662 55745 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-5960/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0722 11:41:37.694220 55745 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-5960/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0722 11:41:37.717209 55745 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-5960/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0722 11:41:37.740672 55745 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-5960/.minikube/profiles/old-k8s-version-101261/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0722 11:41:37.764691 55745 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-5960/.minikube/profiles/old-k8s-version-101261/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0722 11:41:37.788902 55745 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-5960/.minikube/profiles/old-k8s-version-101261/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0722 11:41:37.812352 55745 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-5960/.minikube/profiles/old-k8s-version-101261/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0722 11:41:37.835363 55745 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-5960/.minikube/files/etc/ssl/certs/130982.pem --> /usr/share/ca-certificates/130982.pem (1708 bytes)
I0722 11:41:37.860787 55745 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-5960/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0722 11:41:37.885327 55745 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-5960/.minikube/certs/13098.pem --> /usr/share/ca-certificates/13098.pem (1338 bytes)
I0722 11:41:37.925237 55745 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0722 11:41:37.948649 55745 ssh_runner.go:195] Run: openssl version
I0722 11:41:37.954532 55745 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/13098.pem && ln -fs /usr/share/ca-certificates/13098.pem /etc/ssl/certs/13098.pem"
I0722 11:41:37.973172 55745 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/13098.pem
I0722 11:41:37.979108 55745 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jul 22 10:41 /usr/share/ca-certificates/13098.pem
I0722 11:41:37.979174 55745 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/13098.pem
I0722 11:41:37.985802 55745 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/13098.pem /etc/ssl/certs/51391683.0"
I0722 11:41:37.996168 55745 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/130982.pem && ln -fs /usr/share/ca-certificates/130982.pem /etc/ssl/certs/130982.pem"
I0722 11:41:38.006828 55745 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/130982.pem
I0722 11:41:38.011138 55745 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jul 22 10:41 /usr/share/ca-certificates/130982.pem
I0722 11:41:38.011192 55745 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/130982.pem
I0722 11:41:38.016859 55745 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/130982.pem /etc/ssl/certs/3ec20f2e.0"
I0722 11:41:38.027545 55745 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0722 11:41:38.037854 55745 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0722 11:41:38.042153 55745 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jul 22 10:29 /usr/share/ca-certificates/minikubeCA.pem
I0722 11:41:38.042215 55745 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0722 11:41:38.048045 55745 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0722 11:41:38.060410 55745 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0722 11:41:38.064882 55745 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0722 11:41:38.064959 55745 kubeadm.go:392] StartCluster: {Name:old-k8s-version-101261 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19298/minikube-v1.33.1-1721324531-19298-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-101261 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.50.51 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0722 11:41:38.065063 55745 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0722 11:41:38.065138 55745 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0722 11:41:38.108911 55745 cri.go:89] found id: ""
I0722 11:41:38.108982 55745 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0722 11:41:38.119824 55745 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0722 11:41:38.129585 55745 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0722 11:41:38.139297 55745 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0722 11:41:38.139320 55745 kubeadm.go:157] found existing configuration files:
I0722 11:41:38.139366 55745 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0722 11:41:38.148779 55745 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0722 11:41:38.148837 55745 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0722 11:41:38.158541 55745 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0722 11:41:38.167745 55745 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0722 11:41:38.167797 55745 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0722 11:41:38.177499 55745 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0722 11:41:38.186990 55745 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0722 11:41:38.187056 55745 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0722 11:41:38.196915 55745 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0722 11:41:38.206405 55745 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0722 11:41:38.206450 55745 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0722 11:41:38.217221 55745 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0722 11:41:38.340151 55745 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0722 11:41:38.340309 55745 kubeadm.go:310] [preflight] Running pre-flight checks
I0722 11:41:38.492826 55745 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0722 11:41:38.492994 55745 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0722 11:41:38.493168 55745 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0722 11:41:38.675803 55745 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0722 11:41:38.755348 55745 out.go:204] - Generating certificates and keys ...
I0722 11:41:38.755482 55745 kubeadm.go:310] [certs] Using existing ca certificate authority
I0722 11:41:38.755630 55745 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0722 11:41:38.810869 55745 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0722 11:41:38.922818 55745 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0722 11:41:39.044038 55745 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0722 11:41:39.447666 55745 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0722 11:41:39.770338 55745 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0722 11:41:39.770647 55745 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-101261] and IPs [192.168.50.51 127.0.0.1 ::1]
I0722 11:41:40.008166 55745 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0722 11:41:40.008435 55745 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-101261] and IPs [192.168.50.51 127.0.0.1 ::1]
I0722 11:41:40.320175 55745 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0722 11:41:40.551350 55745 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0722 11:41:40.649220 55745 kubeadm.go:310] [certs] Generating "sa" key and public key
I0722 11:41:40.649490 55745 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0722 11:41:40.750407 55745 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0722 11:41:40.924713 55745 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0722 11:41:41.223779 55745 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0722 11:41:41.305629 55745 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0722 11:41:41.322525 55745 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0722 11:41:41.324879 55745 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0722 11:41:41.325063 55745 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0722 11:41:41.443995 55745 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0722 11:41:41.445583 55745 out.go:204] - Booting up control plane ...
I0722 11:41:41.445717 55745 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0722 11:41:41.465778 55745 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0722 11:41:41.467134 55745 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0722 11:41:41.468850 55745 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0722 11:41:41.472571 55745 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0722 11:42:21.465376 55745 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0722 11:42:21.466360 55745 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0722 11:42:21.466615 55745 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0722 11:42:26.467241 55745 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0722 11:42:26.467578 55745 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0722 11:42:36.466519 55745 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0722 11:42:36.466739 55745 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0722 11:42:56.465610 55745 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0722 11:42:56.465819 55745 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0722 11:43:36.467508 55745 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0722 11:43:36.467757 55745 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0722 11:43:36.467772 55745 kubeadm.go:310]
I0722 11:43:36.467815 55745 kubeadm.go:310] Unfortunately, an error has occurred:
I0722 11:43:36.467890 55745 kubeadm.go:310] timed out waiting for the condition
I0722 11:43:36.467924 55745 kubeadm.go:310]
I0722 11:43:36.467979 55745 kubeadm.go:310] This error is likely caused by:
I0722 11:43:36.468023 55745 kubeadm.go:310] - The kubelet is not running
I0722 11:43:36.468171 55745 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0722 11:43:36.468186 55745 kubeadm.go:310]
I0722 11:43:36.468333 55745 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0722 11:43:36.468413 55745 kubeadm.go:310] - 'systemctl status kubelet'
I0722 11:43:36.468460 55745 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0722 11:43:36.468476 55745 kubeadm.go:310]
I0722 11:43:36.468647 55745 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0722 11:43:36.468780 55745 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0722 11:43:36.468800 55745 kubeadm.go:310]
I0722 11:43:36.468981 55745 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0722 11:43:36.469128 55745 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0722 11:43:36.469228 55745 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0722 11:43:36.469436 55745 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0722 11:43:36.469462 55745 kubeadm.go:310]
I0722 11:43:36.470017 55745 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0722 11:43:36.470130 55745 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0722 11:43:36.470224 55745 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
W0722 11:43:36.470385 55745 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-101261] and IPs [192.168.50.51 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-101261] and IPs [192.168.50.51 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-101261] and IPs [192.168.50.51 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-101261] and IPs [192.168.50.51 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0722 11:43:36.470448 55745 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0722 11:43:36.948327 55745 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0722 11:43:36.964309 55745 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0722 11:43:36.977739 55745 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0722 11:43:36.977757 55745 kubeadm.go:157] found existing configuration files:
I0722 11:43:36.977799 55745 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0722 11:43:36.990338 55745 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0722 11:43:36.990406 55745 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0722 11:43:37.000554 55745 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0722 11:43:37.010564 55745 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0722 11:43:37.010634 55745 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0722 11:43:37.021699 55745 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0722 11:43:37.034478 55745 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0722 11:43:37.034535 55745 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0722 11:43:37.047497 55745 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0722 11:43:37.058817 55745 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0722 11:43:37.058869 55745 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0722 11:43:37.071355 55745 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0722 11:43:37.155275 55745 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0722 11:43:37.155474 55745 kubeadm.go:310] [preflight] Running pre-flight checks
I0722 11:43:37.305952 55745 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0722 11:43:37.306139 55745 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0722 11:43:37.306282 55745 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0722 11:43:37.474827 55745 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0722 11:43:37.476598 55745 out.go:204] - Generating certificates and keys ...
I0722 11:43:37.476768 55745 kubeadm.go:310] [certs] Using existing ca certificate authority
I0722 11:43:37.476928 55745 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0722 11:43:37.477140 55745 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0722 11:43:37.477296 55745 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0722 11:43:37.477481 55745 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0722 11:43:37.477633 55745 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0722 11:43:37.477796 55745 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0722 11:43:37.477961 55745 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0722 11:43:37.478195 55745 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0722 11:43:37.478390 55745 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0722 11:43:37.478786 55745 kubeadm.go:310] [certs] Using the existing "sa" key
I0722 11:43:37.478887 55745 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0722 11:43:37.529823 55745 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0722 11:43:37.600191 55745 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0722 11:43:37.876685 55745 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0722 11:43:37.990967 55745 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0722 11:43:38.010792 55745 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0722 11:43:38.012471 55745 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0722 11:43:38.012576 55745 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0722 11:43:38.141445 55745 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0722 11:43:38.143270 55745 out.go:204] - Booting up control plane ...
I0722 11:43:38.143389 55745 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0722 11:43:38.143487 55745 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0722 11:43:38.144463 55745 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0722 11:43:38.145792 55745 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0722 11:43:38.149351 55745 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0722 11:44:18.153777 55745 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0722 11:44:18.153883 55745 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0722 11:44:18.154173 55745 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0722 11:44:23.154210 55745 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0722 11:44:23.154491 55745 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0722 11:44:33.155535 55745 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0722 11:44:33.155753 55745 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0722 11:44:53.154768 55745 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0722 11:44:53.155065 55745 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0722 11:45:33.153963 55745 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0722 11:45:33.154222 55745 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0722 11:45:33.154239 55745 kubeadm.go:310]
I0722 11:45:33.154307 55745 kubeadm.go:310] Unfortunately, an error has occurred:
I0722 11:45:33.154352 55745 kubeadm.go:310] timed out waiting for the condition
I0722 11:45:33.154360 55745 kubeadm.go:310]
I0722 11:45:33.154420 55745 kubeadm.go:310] This error is likely caused by:
I0722 11:45:33.154476 55745 kubeadm.go:310] - The kubelet is not running
I0722 11:45:33.154612 55745 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0722 11:45:33.154622 55745 kubeadm.go:310]
I0722 11:45:33.154794 55745 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0722 11:45:33.154868 55745 kubeadm.go:310] - 'systemctl status kubelet'
I0722 11:45:33.154930 55745 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0722 11:45:33.154940 55745 kubeadm.go:310]
I0722 11:45:33.155055 55745 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0722 11:45:33.155167 55745 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0722 11:45:33.155176 55745 kubeadm.go:310]
I0722 11:45:33.155301 55745 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0722 11:45:33.155412 55745 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0722 11:45:33.155531 55745 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0722 11:45:33.155625 55745 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0722 11:45:33.155636 55745 kubeadm.go:310]
I0722 11:45:33.156634 55745 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0722 11:45:33.156782 55745 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0722 11:45:33.156894 55745 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0722 11:45:33.156974 55745 kubeadm.go:394] duration metric: took 3m55.09201942s to StartCluster
I0722 11:45:33.157048 55745 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0722 11:45:33.157133 55745 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0722 11:45:33.213447 55745 cri.go:89] found id: ""
I0722 11:45:33.213482 55745 logs.go:276] 0 containers: []
W0722 11:45:33.213493 55745 logs.go:278] No container was found matching "kube-apiserver"
I0722 11:45:33.213502 55745 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0722 11:45:33.213564 55745 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0722 11:45:33.254628 55745 cri.go:89] found id: ""
I0722 11:45:33.254659 55745 logs.go:276] 0 containers: []
W0722 11:45:33.254669 55745 logs.go:278] No container was found matching "etcd"
I0722 11:45:33.254677 55745 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0722 11:45:33.254743 55745 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0722 11:45:33.305173 55745 cri.go:89] found id: ""
I0722 11:45:33.305196 55745 logs.go:276] 0 containers: []
W0722 11:45:33.305203 55745 logs.go:278] No container was found matching "coredns"
I0722 11:45:33.305210 55745 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0722 11:45:33.305266 55745 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0722 11:45:33.346167 55745 cri.go:89] found id: ""
I0722 11:45:33.346197 55745 logs.go:276] 0 containers: []
W0722 11:45:33.346212 55745 logs.go:278] No container was found matching "kube-scheduler"
I0722 11:45:33.346220 55745 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0722 11:45:33.346284 55745 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0722 11:45:33.387495 55745 cri.go:89] found id: ""
I0722 11:45:33.387522 55745 logs.go:276] 0 containers: []
W0722 11:45:33.387529 55745 logs.go:278] No container was found matching "kube-proxy"
I0722 11:45:33.387536 55745 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0722 11:45:33.387587 55745 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0722 11:45:33.426118 55745 cri.go:89] found id: ""
I0722 11:45:33.426149 55745 logs.go:276] 0 containers: []
W0722 11:45:33.426159 55745 logs.go:278] No container was found matching "kube-controller-manager"
I0722 11:45:33.426167 55745 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0722 11:45:33.426245 55745 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0722 11:45:33.462394 55745 cri.go:89] found id: ""
I0722 11:45:33.462425 55745 logs.go:276] 0 containers: []
W0722 11:45:33.462437 55745 logs.go:278] No container was found matching "kindnet"
I0722 11:45:33.462447 55745 logs.go:123] Gathering logs for kubelet ...
I0722 11:45:33.462462 55745 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0722 11:45:33.514012 55745 logs.go:123] Gathering logs for dmesg ...
I0722 11:45:33.514035 55745 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0722 11:45:33.530645 55745 logs.go:123] Gathering logs for describe nodes ...
I0722 11:45:33.530673 55745 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0722 11:45:33.650829 55745 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0722 11:45:33.650853 55745 logs.go:123] Gathering logs for CRI-O ...
I0722 11:45:33.650867 55745 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0722 11:45:33.753292 55745 logs.go:123] Gathering logs for container status ...
I0722 11:45:33.753327 55745 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0722 11:45:33.799846 55745 out.go:364] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0722 11:45:33.799891 55745 out.go:239] *
*
W0722 11:45:33.799959 55745 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0722 11:45:33.799987 55745 out.go:239] *
*
W0722 11:45:33.800902 55745 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0722 11:45:33.803908 55745 out.go:177]
W0722 11:45:33.805063 55745 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0722 11:45:33.805117 55745 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0722 11:45:33.805142 55745 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0722 11:45:33.806528 55745 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-101261 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-101261 -n old-k8s-version-101261
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-101261 -n old-k8s-version-101261: exit status 6 (252.796575ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0722 11:45:34.092042 58607 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-101261" does not appear in /home/jenkins/minikube-integration/19313-5960/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-101261" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (265.49s)