=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:184: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-405646 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:184: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-405646 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (5m35.074815036s)
-- stdout --
* [old-k8s-version-405646] minikube v1.35.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=20598
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/20598-242355/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/20598-242355/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-405646" primary control-plane node in "old-k8s-version-405646" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0407 14:04:18.466941 297880 out.go:345] Setting OutFile to fd 1 ...
I0407 14:04:18.467103 297880 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0407 14:04:18.467116 297880 out.go:358] Setting ErrFile to fd 2...
I0407 14:04:18.467125 297880 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0407 14:04:18.467311 297880 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20598-242355/.minikube/bin
I0407 14:04:18.467994 297880 out.go:352] Setting JSON to false
I0407 14:04:18.469178 297880 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-3","uptime":20805,"bootTime":1744013853,"procs":289,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1078-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0407 14:04:18.469244 297880 start.go:139] virtualization: kvm guest
I0407 14:04:18.471159 297880 out.go:177] * [old-k8s-version-405646] minikube v1.35.0 on Ubuntu 20.04 (kvm/amd64)
I0407 14:04:18.472563 297880 out.go:177] - MINIKUBE_LOCATION=20598
I0407 14:04:18.472592 297880 notify.go:220] Checking for updates...
I0407 14:04:18.475009 297880 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0407 14:04:18.476262 297880 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/20598-242355/kubeconfig
I0407 14:04:18.477369 297880 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/20598-242355/.minikube
I0407 14:04:18.478665 297880 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0407 14:04:18.479903 297880 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0407 14:04:18.481483 297880 config.go:182] Loaded profile config "calico-471753": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.2
I0407 14:04:18.481595 297880 config.go:182] Loaded profile config "custom-flannel-471753": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.2
I0407 14:04:18.481673 297880 config.go:182] Loaded profile config "kindnet-471753": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.2
I0407 14:04:18.481753 297880 driver.go:394] Setting default libvirt URI to qemu:///system
I0407 14:04:18.521980 297880 out.go:177] * Using the kvm2 driver based on user configuration
I0407 14:04:18.523331 297880 start.go:297] selected driver: kvm2
I0407 14:04:18.523350 297880 start.go:901] validating driver "kvm2" against <nil>
I0407 14:04:18.523361 297880 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0407 14:04:18.524025 297880 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0407 14:04:18.524097 297880 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/20598-242355/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0407 14:04:18.539984 297880 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.35.0
I0407 14:04:18.540042 297880 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0407 14:04:18.540348 297880 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0407 14:04:18.540393 297880 cni.go:84] Creating CNI manager for ""
I0407 14:04:18.540465 297880 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0407 14:04:18.540478 297880 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0407 14:04:18.540541 297880 start.go:340] cluster config:
{Name:old-k8s-version-405646 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1743675393-20591@sha256:8de8167e280414c9d16e4c3da59bc85bc7c9cc24228af995863fc7bcabfcf727 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-405646 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0407 14:04:18.540729 297880 iso.go:125] acquiring lock: {Name:mk6d72e1b2a59d3c4dd958601dac3ffc7df02d9c Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0407 14:04:18.542512 297880 out.go:177] * Starting "old-k8s-version-405646" primary control-plane node in "old-k8s-version-405646" cluster
I0407 14:04:18.544178 297880 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0407 14:04:18.544229 297880 preload.go:146] Found local preload: /home/jenkins/minikube-integration/20598-242355/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0407 14:04:18.544240 297880 cache.go:56] Caching tarball of preloaded images
I0407 14:04:18.544377 297880 preload.go:172] Found /home/jenkins/minikube-integration/20598-242355/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0407 14:04:18.544399 297880 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0407 14:04:18.544545 297880 profile.go:143] Saving config to /home/jenkins/minikube-integration/20598-242355/.minikube/profiles/old-k8s-version-405646/config.json ...
I0407 14:04:18.544576 297880 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20598-242355/.minikube/profiles/old-k8s-version-405646/config.json: {Name:mk73781e24e79431662888866304d507d7d82690 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0407 14:04:18.544734 297880 start.go:360] acquireMachinesLock for old-k8s-version-405646: {Name:mkbc0d9211b04d7c322a45485d144adcd6ee59fe Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0407 14:05:13.369513 297880 start.go:364] duration metric: took 54.824748831s to acquireMachinesLock for "old-k8s-version-405646"
I0407 14:05:13.369593 297880 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-405646 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1743675393-20591@sha256:8de8167e280414c9d16e4c3da59bc85bc7c9cc24228af995863fc7bcabfcf727 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 C
lusterName:old-k8s-version-405646 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p M
ountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0407 14:05:13.369677 297880 start.go:125] createHost starting for "" (driver="kvm2")
I0407 14:05:13.371233 297880 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0407 14:05:13.371417 297880 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0407 14:05:13.371480 297880 main.go:141] libmachine: Launching plugin server for driver kvm2
I0407 14:05:13.389864 297880 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33911
I0407 14:05:13.390396 297880 main.go:141] libmachine: () Calling .GetVersion
I0407 14:05:13.391037 297880 main.go:141] libmachine: Using API Version 1
I0407 14:05:13.391058 297880 main.go:141] libmachine: () Calling .SetConfigRaw
I0407 14:05:13.391424 297880 main.go:141] libmachine: () Calling .GetMachineName
I0407 14:05:13.391643 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetMachineName
I0407 14:05:13.391837 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .DriverName
I0407 14:05:13.392009 297880 start.go:159] libmachine.API.Create for "old-k8s-version-405646" (driver="kvm2")
I0407 14:05:13.392046 297880 client.go:168] LocalClient.Create starting
I0407 14:05:13.392101 297880 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20598-242355/.minikube/certs/ca.pem
I0407 14:05:13.392150 297880 main.go:141] libmachine: Decoding PEM data...
I0407 14:05:13.392178 297880 main.go:141] libmachine: Parsing certificate...
I0407 14:05:13.392285 297880 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20598-242355/.minikube/certs/cert.pem
I0407 14:05:13.392331 297880 main.go:141] libmachine: Decoding PEM data...
I0407 14:05:13.392350 297880 main.go:141] libmachine: Parsing certificate...
I0407 14:05:13.392375 297880 main.go:141] libmachine: Running pre-create checks...
I0407 14:05:13.392398 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .PreCreateCheck
I0407 14:05:13.392819 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetConfigRaw
I0407 14:05:13.393307 297880 main.go:141] libmachine: Creating machine...
I0407 14:05:13.393327 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .Create
I0407 14:05:13.393499 297880 main.go:141] libmachine: (old-k8s-version-405646) creating KVM machine...
I0407 14:05:13.393519 297880 main.go:141] libmachine: (old-k8s-version-405646) creating network...
I0407 14:05:13.394874 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | found existing default KVM network
I0407 14:05:13.395957 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | I0407 14:05:13.395789 298507 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:b9:e2:6d} reservation:<nil>}
I0407 14:05:13.396643 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | I0407 14:05:13.396549 298507 network.go:211] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr2 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:5f:c5:6c} reservation:<nil>}
I0407 14:05:13.397422 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | I0407 14:05:13.397325 298507 network.go:211] skipping subnet 192.168.61.0/24 that is taken: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName:virbr3 IfaceIPv4:192.168.61.1 IfaceMTU:1500 IfaceMAC:52:54:00:25:11:95} reservation:<nil>}
I0407 14:05:13.398506 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | I0407 14:05:13.398420 298507 network.go:206] using free private subnet 192.168.72.0/24: &{IP:192.168.72.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.72.0/24 Gateway:192.168.72.1 ClientMin:192.168.72.2 ClientMax:192.168.72.254 Broadcast:192.168.72.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000352a50}
I0407 14:05:13.398541 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | created network xml:
I0407 14:05:13.398553 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | <network>
I0407 14:05:13.398562 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | <name>mk-old-k8s-version-405646</name>
I0407 14:05:13.398571 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | <dns enable='no'/>
I0407 14:05:13.398582 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG |
I0407 14:05:13.398597 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | <ip address='192.168.72.1' netmask='255.255.255.0'>
I0407 14:05:13.398608 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | <dhcp>
I0407 14:05:13.398618 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | <range start='192.168.72.2' end='192.168.72.253'/>
I0407 14:05:13.398624 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | </dhcp>
I0407 14:05:13.398633 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | </ip>
I0407 14:05:13.398639 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG |
I0407 14:05:13.398651 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | </network>
I0407 14:05:13.398657 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG |
I0407 14:05:13.404253 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | trying to create private KVM network mk-old-k8s-version-405646 192.168.72.0/24...
I0407 14:05:13.482723 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | private KVM network mk-old-k8s-version-405646 192.168.72.0/24 created
I0407 14:05:13.482760 297880 main.go:141] libmachine: (old-k8s-version-405646) setting up store path in /home/jenkins/minikube-integration/20598-242355/.minikube/machines/old-k8s-version-405646 ...
I0407 14:05:13.482773 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | I0407 14:05:13.482688 298507 common.go:144] Making disk image using store path: /home/jenkins/minikube-integration/20598-242355/.minikube
I0407 14:05:13.482807 297880 main.go:141] libmachine: (old-k8s-version-405646) building disk image from file:///home/jenkins/minikube-integration/20598-242355/.minikube/cache/iso/amd64/minikube-v1.35.0-amd64.iso
I0407 14:05:13.482925 297880 main.go:141] libmachine: (old-k8s-version-405646) Downloading /home/jenkins/minikube-integration/20598-242355/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/20598-242355/.minikube/cache/iso/amd64/minikube-v1.35.0-amd64.iso...
I0407 14:05:13.766568 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | I0407 14:05:13.766426 298507 common.go:151] Creating ssh key: /home/jenkins/minikube-integration/20598-242355/.minikube/machines/old-k8s-version-405646/id_rsa...
I0407 14:05:13.897009 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | I0407 14:05:13.896876 298507 common.go:157] Creating raw disk image: /home/jenkins/minikube-integration/20598-242355/.minikube/machines/old-k8s-version-405646/old-k8s-version-405646.rawdisk...
I0407 14:05:13.897046 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | Writing magic tar header
I0407 14:05:13.897069 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | Writing SSH key tar header
I0407 14:05:13.897097 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | I0407 14:05:13.897027 298507 common.go:171] Fixing permissions on /home/jenkins/minikube-integration/20598-242355/.minikube/machines/old-k8s-version-405646 ...
I0407 14:05:13.897212 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20598-242355/.minikube/machines/old-k8s-version-405646
I0407 14:05:13.897284 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20598-242355/.minikube/machines
I0407 14:05:13.897306 297880 main.go:141] libmachine: (old-k8s-version-405646) setting executable bit set on /home/jenkins/minikube-integration/20598-242355/.minikube/machines/old-k8s-version-405646 (perms=drwx------)
I0407 14:05:13.897320 297880 main.go:141] libmachine: (old-k8s-version-405646) setting executable bit set on /home/jenkins/minikube-integration/20598-242355/.minikube/machines (perms=drwxr-xr-x)
I0407 14:05:13.897330 297880 main.go:141] libmachine: (old-k8s-version-405646) setting executable bit set on /home/jenkins/minikube-integration/20598-242355/.minikube (perms=drwxr-xr-x)
I0407 14:05:13.897353 297880 main.go:141] libmachine: (old-k8s-version-405646) setting executable bit set on /home/jenkins/minikube-integration/20598-242355 (perms=drwxrwxr-x)
I0407 14:05:13.897368 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20598-242355/.minikube
I0407 14:05:13.897378 297880 main.go:141] libmachine: (old-k8s-version-405646) setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0407 14:05:13.897389 297880 main.go:141] libmachine: (old-k8s-version-405646) setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0407 14:05:13.897400 297880 main.go:141] libmachine: (old-k8s-version-405646) creating domain...
I0407 14:05:13.897414 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20598-242355
I0407 14:05:13.897424 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | checking permissions on dir: /home/jenkins/minikube-integration
I0407 14:05:13.897433 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | checking permissions on dir: /home/jenkins
I0407 14:05:13.897449 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | checking permissions on dir: /home
I0407 14:05:13.897460 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | skipping /home - not owner
I0407 14:05:13.898537 297880 main.go:141] libmachine: (old-k8s-version-405646) define libvirt domain using xml:
I0407 14:05:13.898557 297880 main.go:141] libmachine: (old-k8s-version-405646) <domain type='kvm'>
I0407 14:05:13.898567 297880 main.go:141] libmachine: (old-k8s-version-405646) <name>old-k8s-version-405646</name>
I0407 14:05:13.898580 297880 main.go:141] libmachine: (old-k8s-version-405646) <memory unit='MiB'>2200</memory>
I0407 14:05:13.898592 297880 main.go:141] libmachine: (old-k8s-version-405646) <vcpu>2</vcpu>
I0407 14:05:13.898611 297880 main.go:141] libmachine: (old-k8s-version-405646) <features>
I0407 14:05:13.898627 297880 main.go:141] libmachine: (old-k8s-version-405646) <acpi/>
I0407 14:05:13.898634 297880 main.go:141] libmachine: (old-k8s-version-405646) <apic/>
I0407 14:05:13.898641 297880 main.go:141] libmachine: (old-k8s-version-405646) <pae/>
I0407 14:05:13.898653 297880 main.go:141] libmachine: (old-k8s-version-405646)
I0407 14:05:13.898660 297880 main.go:141] libmachine: (old-k8s-version-405646) </features>
I0407 14:05:13.898676 297880 main.go:141] libmachine: (old-k8s-version-405646) <cpu mode='host-passthrough'>
I0407 14:05:13.898687 297880 main.go:141] libmachine: (old-k8s-version-405646)
I0407 14:05:13.898693 297880 main.go:141] libmachine: (old-k8s-version-405646) </cpu>
I0407 14:05:13.898704 297880 main.go:141] libmachine: (old-k8s-version-405646) <os>
I0407 14:05:13.898714 297880 main.go:141] libmachine: (old-k8s-version-405646) <type>hvm</type>
I0407 14:05:13.898723 297880 main.go:141] libmachine: (old-k8s-version-405646) <boot dev='cdrom'/>
I0407 14:05:13.898733 297880 main.go:141] libmachine: (old-k8s-version-405646) <boot dev='hd'/>
I0407 14:05:13.898752 297880 main.go:141] libmachine: (old-k8s-version-405646) <bootmenu enable='no'/>
I0407 14:05:13.898772 297880 main.go:141] libmachine: (old-k8s-version-405646) </os>
I0407 14:05:13.898780 297880 main.go:141] libmachine: (old-k8s-version-405646) <devices>
I0407 14:05:13.898786 297880 main.go:141] libmachine: (old-k8s-version-405646) <disk type='file' device='cdrom'>
I0407 14:05:13.898824 297880 main.go:141] libmachine: (old-k8s-version-405646) <source file='/home/jenkins/minikube-integration/20598-242355/.minikube/machines/old-k8s-version-405646/boot2docker.iso'/>
I0407 14:05:13.898852 297880 main.go:141] libmachine: (old-k8s-version-405646) <target dev='hdc' bus='scsi'/>
I0407 14:05:13.898865 297880 main.go:141] libmachine: (old-k8s-version-405646) <readonly/>
I0407 14:05:13.898886 297880 main.go:141] libmachine: (old-k8s-version-405646) </disk>
I0407 14:05:13.898894 297880 main.go:141] libmachine: (old-k8s-version-405646) <disk type='file' device='disk'>
I0407 14:05:13.898900 297880 main.go:141] libmachine: (old-k8s-version-405646) <driver name='qemu' type='raw' cache='default' io='threads' />
I0407 14:05:13.898908 297880 main.go:141] libmachine: (old-k8s-version-405646) <source file='/home/jenkins/minikube-integration/20598-242355/.minikube/machines/old-k8s-version-405646/old-k8s-version-405646.rawdisk'/>
I0407 14:05:13.898916 297880 main.go:141] libmachine: (old-k8s-version-405646) <target dev='hda' bus='virtio'/>
I0407 14:05:13.898921 297880 main.go:141] libmachine: (old-k8s-version-405646) </disk>
I0407 14:05:13.898928 297880 main.go:141] libmachine: (old-k8s-version-405646) <interface type='network'>
I0407 14:05:13.898934 297880 main.go:141] libmachine: (old-k8s-version-405646) <source network='mk-old-k8s-version-405646'/>
I0407 14:05:13.898941 297880 main.go:141] libmachine: (old-k8s-version-405646) <model type='virtio'/>
I0407 14:05:13.898948 297880 main.go:141] libmachine: (old-k8s-version-405646) </interface>
I0407 14:05:13.898959 297880 main.go:141] libmachine: (old-k8s-version-405646) <interface type='network'>
I0407 14:05:13.898967 297880 main.go:141] libmachine: (old-k8s-version-405646) <source network='default'/>
I0407 14:05:13.898976 297880 main.go:141] libmachine: (old-k8s-version-405646) <model type='virtio'/>
I0407 14:05:13.898983 297880 main.go:141] libmachine: (old-k8s-version-405646) </interface>
I0407 14:05:13.898990 297880 main.go:141] libmachine: (old-k8s-version-405646) <serial type='pty'>
I0407 14:05:13.898998 297880 main.go:141] libmachine: (old-k8s-version-405646) <target port='0'/>
I0407 14:05:13.899005 297880 main.go:141] libmachine: (old-k8s-version-405646) </serial>
I0407 14:05:13.899010 297880 main.go:141] libmachine: (old-k8s-version-405646) <console type='pty'>
I0407 14:05:13.899017 297880 main.go:141] libmachine: (old-k8s-version-405646) <target type='serial' port='0'/>
I0407 14:05:13.899022 297880 main.go:141] libmachine: (old-k8s-version-405646) </console>
I0407 14:05:13.899029 297880 main.go:141] libmachine: (old-k8s-version-405646) <rng model='virtio'>
I0407 14:05:13.899040 297880 main.go:141] libmachine: (old-k8s-version-405646) <backend model='random'>/dev/random</backend>
I0407 14:05:13.899046 297880 main.go:141] libmachine: (old-k8s-version-405646) </rng>
I0407 14:05:13.899051 297880 main.go:141] libmachine: (old-k8s-version-405646)
I0407 14:05:13.899057 297880 main.go:141] libmachine: (old-k8s-version-405646)
I0407 14:05:13.899062 297880 main.go:141] libmachine: (old-k8s-version-405646) </devices>
I0407 14:05:13.899065 297880 main.go:141] libmachine: (old-k8s-version-405646) </domain>
I0407 14:05:13.899075 297880 main.go:141] libmachine: (old-k8s-version-405646)
I0407 14:05:13.924243 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | domain old-k8s-version-405646 has defined MAC address 52:54:00:55:01:32 in network default
I0407 14:05:13.924959 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | domain old-k8s-version-405646 has defined MAC address 52:54:00:54:a4:af in network mk-old-k8s-version-405646
I0407 14:05:13.924980 297880 main.go:141] libmachine: (old-k8s-version-405646) starting domain...
I0407 14:05:13.924986 297880 main.go:141] libmachine: (old-k8s-version-405646) ensuring networks are active...
I0407 14:05:13.926147 297880 main.go:141] libmachine: (old-k8s-version-405646) Ensuring network default is active
I0407 14:05:13.926586 297880 main.go:141] libmachine: (old-k8s-version-405646) Ensuring network mk-old-k8s-version-405646 is active
I0407 14:05:13.927321 297880 main.go:141] libmachine: (old-k8s-version-405646) getting domain XML...
I0407 14:05:13.928219 297880 main.go:141] libmachine: (old-k8s-version-405646) creating domain...
I0407 14:05:15.481791 297880 main.go:141] libmachine: (old-k8s-version-405646) waiting for IP...
I0407 14:05:15.482964 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | domain old-k8s-version-405646 has defined MAC address 52:54:00:54:a4:af in network mk-old-k8s-version-405646
I0407 14:05:15.483652 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | unable to find current IP address of domain old-k8s-version-405646 in network mk-old-k8s-version-405646
I0407 14:05:15.483678 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | I0407 14:05:15.483614 298507 retry.go:31] will retry after 254.808839ms: waiting for domain to come up
I0407 14:05:15.740406 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | domain old-k8s-version-405646 has defined MAC address 52:54:00:54:a4:af in network mk-old-k8s-version-405646
I0407 14:05:15.741306 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | unable to find current IP address of domain old-k8s-version-405646 in network mk-old-k8s-version-405646
I0407 14:05:15.741365 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | I0407 14:05:15.741276 298507 retry.go:31] will retry after 371.195285ms: waiting for domain to come up
I0407 14:05:16.114800 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | domain old-k8s-version-405646 has defined MAC address 52:54:00:54:a4:af in network mk-old-k8s-version-405646
I0407 14:05:16.115631 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | unable to find current IP address of domain old-k8s-version-405646 in network mk-old-k8s-version-405646
I0407 14:05:16.115661 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | I0407 14:05:16.115610 298507 retry.go:31] will retry after 464.118515ms: waiting for domain to come up
I0407 14:05:16.581460 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | domain old-k8s-version-405646 has defined MAC address 52:54:00:54:a4:af in network mk-old-k8s-version-405646
I0407 14:05:16.582128 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | unable to find current IP address of domain old-k8s-version-405646 in network mk-old-k8s-version-405646
I0407 14:05:16.582184 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | I0407 14:05:16.582095 298507 retry.go:31] will retry after 528.050928ms: waiting for domain to come up
I0407 14:05:17.112061 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | domain old-k8s-version-405646 has defined MAC address 52:54:00:54:a4:af in network mk-old-k8s-version-405646
I0407 14:05:17.112738 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | unable to find current IP address of domain old-k8s-version-405646 in network mk-old-k8s-version-405646
I0407 14:05:17.112769 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | I0407 14:05:17.112702 298507 retry.go:31] will retry after 479.768573ms: waiting for domain to come up
I0407 14:05:17.594322 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | domain old-k8s-version-405646 has defined MAC address 52:54:00:54:a4:af in network mk-old-k8s-version-405646
I0407 14:05:17.594820 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | unable to find current IP address of domain old-k8s-version-405646 in network mk-old-k8s-version-405646
I0407 14:05:17.594879 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | I0407 14:05:17.594799 298507 retry.go:31] will retry after 655.219269ms: waiting for domain to come up
I0407 14:05:18.251282 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | domain old-k8s-version-405646 has defined MAC address 52:54:00:54:a4:af in network mk-old-k8s-version-405646
I0407 14:05:18.251881 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | unable to find current IP address of domain old-k8s-version-405646 in network mk-old-k8s-version-405646
I0407 14:05:18.251934 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | I0407 14:05:18.251836 298507 retry.go:31] will retry after 914.908353ms: waiting for domain to come up
I0407 14:05:19.168958 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | domain old-k8s-version-405646 has defined MAC address 52:54:00:54:a4:af in network mk-old-k8s-version-405646
I0407 14:05:19.169523 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | unable to find current IP address of domain old-k8s-version-405646 in network mk-old-k8s-version-405646
I0407 14:05:19.169557 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | I0407 14:05:19.169488 298507 retry.go:31] will retry after 931.980959ms: waiting for domain to come up
I0407 14:05:20.102809 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | domain old-k8s-version-405646 has defined MAC address 52:54:00:54:a4:af in network mk-old-k8s-version-405646
I0407 14:05:20.103341 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | unable to find current IP address of domain old-k8s-version-405646 in network mk-old-k8s-version-405646
I0407 14:05:20.103367 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | I0407 14:05:20.103314 298507 retry.go:31] will retry after 1.44677769s: waiting for domain to come up
I0407 14:05:21.552189 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | domain old-k8s-version-405646 has defined MAC address 52:54:00:54:a4:af in network mk-old-k8s-version-405646
I0407 14:05:21.552811 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | unable to find current IP address of domain old-k8s-version-405646 in network mk-old-k8s-version-405646
I0407 14:05:21.552837 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | I0407 14:05:21.552784 298507 retry.go:31] will retry after 1.689221726s: waiting for domain to come up
I0407 14:05:23.243512 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | domain old-k8s-version-405646 has defined MAC address 52:54:00:54:a4:af in network mk-old-k8s-version-405646
I0407 14:05:23.244165 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | unable to find current IP address of domain old-k8s-version-405646 in network mk-old-k8s-version-405646
I0407 14:05:23.244205 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | I0407 14:05:23.244103 298507 retry.go:31] will retry after 2.473404072s: waiting for domain to come up
I0407 14:05:25.718843 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | domain old-k8s-version-405646 has defined MAC address 52:54:00:54:a4:af in network mk-old-k8s-version-405646
I0407 14:05:25.719568 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | unable to find current IP address of domain old-k8s-version-405646 in network mk-old-k8s-version-405646
I0407 14:05:25.719597 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | I0407 14:05:25.719460 298507 retry.go:31] will retry after 3.124817186s: waiting for domain to come up
I0407 14:05:28.846806 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | domain old-k8s-version-405646 has defined MAC address 52:54:00:54:a4:af in network mk-old-k8s-version-405646
I0407 14:05:28.847444 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | unable to find current IP address of domain old-k8s-version-405646 in network mk-old-k8s-version-405646
I0407 14:05:28.847481 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | I0407 14:05:28.847419 298507 retry.go:31] will retry after 4.256893324s: waiting for domain to come up
I0407 14:05:33.105684 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | domain old-k8s-version-405646 has defined MAC address 52:54:00:54:a4:af in network mk-old-k8s-version-405646
I0407 14:05:33.106244 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | unable to find current IP address of domain old-k8s-version-405646 in network mk-old-k8s-version-405646
I0407 14:05:33.106271 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | I0407 14:05:33.106186 298507 retry.go:31] will retry after 5.157393176s: waiting for domain to come up
I0407 14:05:38.265872 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | domain old-k8s-version-405646 has defined MAC address 52:54:00:54:a4:af in network mk-old-k8s-version-405646
I0407 14:05:38.266457 297880 main.go:141] libmachine: (old-k8s-version-405646) found domain IP: 192.168.72.163
I0407 14:05:38.266482 297880 main.go:141] libmachine: (old-k8s-version-405646) reserving static IP address...
I0407 14:05:38.266497 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | domain old-k8s-version-405646 has current primary IP address 192.168.72.163 and MAC address 52:54:00:54:a4:af in network mk-old-k8s-version-405646
I0407 14:05:38.266865 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-405646", mac: "52:54:00:54:a4:af", ip: "192.168.72.163"} in network mk-old-k8s-version-405646
I0407 14:05:38.349701 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | Getting to WaitForSSH function...
I0407 14:05:38.349729 297880 main.go:141] libmachine: (old-k8s-version-405646) reserved static IP address 192.168.72.163 for domain old-k8s-version-405646
I0407 14:05:38.349766 297880 main.go:141] libmachine: (old-k8s-version-405646) waiting for SSH...
I0407 14:05:38.352870 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | domain old-k8s-version-405646 has defined MAC address 52:54:00:54:a4:af in network mk-old-k8s-version-405646
I0407 14:05:38.353223 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | unable to find host DHCP lease matching {name: "", mac: "52:54:00:54:a4:af", ip: ""} in network mk-old-k8s-version-405646
I0407 14:05:38.353247 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | unable to find defined IP address of network mk-old-k8s-version-405646 interface with MAC address 52:54:00:54:a4:af
I0407 14:05:38.353423 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | Using SSH client type: external
I0407 14:05:38.353445 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | Using SSH private key: /home/jenkins/minikube-integration/20598-242355/.minikube/machines/old-k8s-version-405646/id_rsa (-rw-------)
I0407 14:05:38.353491 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@ -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/20598-242355/.minikube/machines/old-k8s-version-405646/id_rsa -p 22] /usr/bin/ssh <nil>}
I0407 14:05:38.353506 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | About to run SSH command:
I0407 14:05:38.353518 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | exit 0
I0407 14:05:38.357647 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | SSH cmd err, output: exit status 255:
I0407 14:05:38.357671 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | Error getting ssh command 'exit 0' : ssh command error:
I0407 14:05:38.357683 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | command : exit 0
I0407 14:05:38.357691 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | err : exit status 255
I0407 14:05:38.357705 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | output :
I0407 14:05:41.360211 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | Getting to WaitForSSH function...
I0407 14:05:41.363138 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | domain old-k8s-version-405646 has defined MAC address 52:54:00:54:a4:af in network mk-old-k8s-version-405646
I0407 14:05:41.363614 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:54:a4:af", ip: ""} in network mk-old-k8s-version-405646: {Iface:virbr4 ExpiryTime:2025-04-07 15:05:31 +0000 UTC Type:0 Mac:52:54:00:54:a4:af Iaid: IPaddr:192.168.72.163 Prefix:24 Hostname:old-k8s-version-405646 Clientid:01:52:54:00:54:a4:af}
I0407 14:05:41.363638 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | domain old-k8s-version-405646 has defined IP address 192.168.72.163 and MAC address 52:54:00:54:a4:af in network mk-old-k8s-version-405646
I0407 14:05:41.363788 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | Using SSH client type: external
I0407 14:05:41.363813 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | Using SSH private key: /home/jenkins/minikube-integration/20598-242355/.minikube/machines/old-k8s-version-405646/id_rsa (-rw-------)
I0407 14:05:41.363829 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.72.163 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/20598-242355/.minikube/machines/old-k8s-version-405646/id_rsa -p 22] /usr/bin/ssh <nil>}
I0407 14:05:41.363834 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | About to run SSH command:
I0407 14:05:41.363843 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | exit 0
I0407 14:05:41.496938 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | SSH cmd err, output: <nil>:
I0407 14:05:41.497233 297880 main.go:141] libmachine: (old-k8s-version-405646) KVM machine creation complete
I0407 14:05:41.497614 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetConfigRaw
I0407 14:05:41.498218 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .DriverName
I0407 14:05:41.498469 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .DriverName
I0407 14:05:41.498645 297880 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0407 14:05:41.498667 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetState
I0407 14:05:41.500243 297880 main.go:141] libmachine: Detecting operating system of created instance...
I0407 14:05:41.500261 297880 main.go:141] libmachine: Waiting for SSH to be available...
I0407 14:05:41.500269 297880 main.go:141] libmachine: Getting to WaitForSSH function...
I0407 14:05:41.500279 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetSSHHostname
I0407 14:05:41.503171 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | domain old-k8s-version-405646 has defined MAC address 52:54:00:54:a4:af in network mk-old-k8s-version-405646
I0407 14:05:41.503672 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:54:a4:af", ip: ""} in network mk-old-k8s-version-405646: {Iface:virbr4 ExpiryTime:2025-04-07 15:05:31 +0000 UTC Type:0 Mac:52:54:00:54:a4:af Iaid: IPaddr:192.168.72.163 Prefix:24 Hostname:old-k8s-version-405646 Clientid:01:52:54:00:54:a4:af}
I0407 14:05:41.503714 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | domain old-k8s-version-405646 has defined IP address 192.168.72.163 and MAC address 52:54:00:54:a4:af in network mk-old-k8s-version-405646
I0407 14:05:41.503996 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetSSHPort
I0407 14:05:41.504223 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetSSHKeyPath
I0407 14:05:41.504674 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetSSHKeyPath
I0407 14:05:41.504883 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetSSHUsername
I0407 14:05:41.505098 297880 main.go:141] libmachine: Using SSH client type: native
I0407 14:05:41.505390 297880 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.72.163 22 <nil> <nil>}
I0407 14:05:41.505405 297880 main.go:141] libmachine: About to run SSH command:
exit 0
I0407 14:05:41.616851 297880 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0407 14:05:41.616876 297880 main.go:141] libmachine: Detecting the provisioner...
I0407 14:05:41.616886 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetSSHHostname
I0407 14:05:41.620317 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | domain old-k8s-version-405646 has defined MAC address 52:54:00:54:a4:af in network mk-old-k8s-version-405646
I0407 14:05:41.620659 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:54:a4:af", ip: ""} in network mk-old-k8s-version-405646: {Iface:virbr4 ExpiryTime:2025-04-07 15:05:31 +0000 UTC Type:0 Mac:52:54:00:54:a4:af Iaid: IPaddr:192.168.72.163 Prefix:24 Hostname:old-k8s-version-405646 Clientid:01:52:54:00:54:a4:af}
I0407 14:05:41.620685 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | domain old-k8s-version-405646 has defined IP address 192.168.72.163 and MAC address 52:54:00:54:a4:af in network mk-old-k8s-version-405646
I0407 14:05:41.620869 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetSSHPort
I0407 14:05:41.621070 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetSSHKeyPath
I0407 14:05:41.621205 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetSSHKeyPath
I0407 14:05:41.621331 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetSSHUsername
I0407 14:05:41.621494 297880 main.go:141] libmachine: Using SSH client type: native
I0407 14:05:41.621781 297880 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.72.163 22 <nil> <nil>}
I0407 14:05:41.621793 297880 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0407 14:05:41.745755 297880 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0407 14:05:41.745871 297880 main.go:141] libmachine: found compatible host: buildroot
I0407 14:05:41.745887 297880 main.go:141] libmachine: Provisioning with buildroot...
I0407 14:05:41.745900 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetMachineName
I0407 14:05:41.746188 297880 buildroot.go:166] provisioning hostname "old-k8s-version-405646"
I0407 14:05:41.746222 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetMachineName
I0407 14:05:41.746449 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetSSHHostname
I0407 14:05:41.749663 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | domain old-k8s-version-405646 has defined MAC address 52:54:00:54:a4:af in network mk-old-k8s-version-405646
I0407 14:05:41.750093 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:54:a4:af", ip: ""} in network mk-old-k8s-version-405646: {Iface:virbr4 ExpiryTime:2025-04-07 15:05:31 +0000 UTC Type:0 Mac:52:54:00:54:a4:af Iaid: IPaddr:192.168.72.163 Prefix:24 Hostname:old-k8s-version-405646 Clientid:01:52:54:00:54:a4:af}
I0407 14:05:41.750139 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | domain old-k8s-version-405646 has defined IP address 192.168.72.163 and MAC address 52:54:00:54:a4:af in network mk-old-k8s-version-405646
I0407 14:05:41.750417 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetSSHPort
I0407 14:05:41.750587 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetSSHKeyPath
I0407 14:05:41.750866 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetSSHKeyPath
I0407 14:05:41.751065 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetSSHUsername
I0407 14:05:41.751283 297880 main.go:141] libmachine: Using SSH client type: native
I0407 14:05:41.751568 297880 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.72.163 22 <nil> <nil>}
I0407 14:05:41.751593 297880 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-405646 && echo "old-k8s-version-405646" | sudo tee /etc/hostname
I0407 14:05:41.880298 297880 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-405646
I0407 14:05:41.880333 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetSSHHostname
I0407 14:05:41.884279 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | domain old-k8s-version-405646 has defined MAC address 52:54:00:54:a4:af in network mk-old-k8s-version-405646
I0407 14:05:41.884765 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:54:a4:af", ip: ""} in network mk-old-k8s-version-405646: {Iface:virbr4 ExpiryTime:2025-04-07 15:05:31 +0000 UTC Type:0 Mac:52:54:00:54:a4:af Iaid: IPaddr:192.168.72.163 Prefix:24 Hostname:old-k8s-version-405646 Clientid:01:52:54:00:54:a4:af}
I0407 14:05:41.884795 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | domain old-k8s-version-405646 has defined IP address 192.168.72.163 and MAC address 52:54:00:54:a4:af in network mk-old-k8s-version-405646
I0407 14:05:41.885031 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetSSHPort
I0407 14:05:41.885243 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetSSHKeyPath
I0407 14:05:41.885440 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetSSHKeyPath
I0407 14:05:41.885584 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetSSHUsername
I0407 14:05:41.885766 297880 main.go:141] libmachine: Using SSH client type: native
I0407 14:05:41.886087 297880 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.72.163 22 <nil> <nil>}
I0407 14:05:41.886123 297880 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-405646' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-405646/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-405646' | sudo tee -a /etc/hosts;
fi
fi
I0407 14:05:42.023111 297880 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0407 14:05:42.023137 297880 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/20598-242355/.minikube CaCertPath:/home/jenkins/minikube-integration/20598-242355/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20598-242355/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20598-242355/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20598-242355/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20598-242355/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20598-242355/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20598-242355/.minikube}
I0407 14:05:42.023154 297880 buildroot.go:174] setting up certificates
I0407 14:05:42.023178 297880 provision.go:84] configureAuth start
I0407 14:05:42.023187 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetMachineName
I0407 14:05:42.023425 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetIP
I0407 14:05:42.026292 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | domain old-k8s-version-405646 has defined MAC address 52:54:00:54:a4:af in network mk-old-k8s-version-405646
I0407 14:05:42.026610 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:54:a4:af", ip: ""} in network mk-old-k8s-version-405646: {Iface:virbr4 ExpiryTime:2025-04-07 15:05:31 +0000 UTC Type:0 Mac:52:54:00:54:a4:af Iaid: IPaddr:192.168.72.163 Prefix:24 Hostname:old-k8s-version-405646 Clientid:01:52:54:00:54:a4:af}
I0407 14:05:42.026644 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | domain old-k8s-version-405646 has defined IP address 192.168.72.163 and MAC address 52:54:00:54:a4:af in network mk-old-k8s-version-405646
I0407 14:05:42.026850 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetSSHHostname
I0407 14:05:42.029085 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | domain old-k8s-version-405646 has defined MAC address 52:54:00:54:a4:af in network mk-old-k8s-version-405646
I0407 14:05:42.029543 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:54:a4:af", ip: ""} in network mk-old-k8s-version-405646: {Iface:virbr4 ExpiryTime:2025-04-07 15:05:31 +0000 UTC Type:0 Mac:52:54:00:54:a4:af Iaid: IPaddr:192.168.72.163 Prefix:24 Hostname:old-k8s-version-405646 Clientid:01:52:54:00:54:a4:af}
I0407 14:05:42.029562 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | domain old-k8s-version-405646 has defined IP address 192.168.72.163 and MAC address 52:54:00:54:a4:af in network mk-old-k8s-version-405646
I0407 14:05:42.029781 297880 provision.go:143] copyHostCerts
I0407 14:05:42.029856 297880 exec_runner.go:144] found /home/jenkins/minikube-integration/20598-242355/.minikube/ca.pem, removing ...
I0407 14:05:42.029880 297880 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20598-242355/.minikube/ca.pem
I0407 14:05:42.029932 297880 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20598-242355/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20598-242355/.minikube/ca.pem (1078 bytes)
I0407 14:05:42.030015 297880 exec_runner.go:144] found /home/jenkins/minikube-integration/20598-242355/.minikube/cert.pem, removing ...
I0407 14:05:42.030022 297880 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20598-242355/.minikube/cert.pem
I0407 14:05:42.030052 297880 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20598-242355/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20598-242355/.minikube/cert.pem (1123 bytes)
I0407 14:05:42.030104 297880 exec_runner.go:144] found /home/jenkins/minikube-integration/20598-242355/.minikube/key.pem, removing ...
I0407 14:05:42.030109 297880 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20598-242355/.minikube/key.pem
I0407 14:05:42.030126 297880 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20598-242355/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20598-242355/.minikube/key.pem (1679 bytes)
I0407 14:05:42.030169 297880 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20598-242355/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20598-242355/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20598-242355/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-405646 san=[127.0.0.1 192.168.72.163 localhost minikube old-k8s-version-405646]
I0407 14:05:43.074659 297880 provision.go:177] copyRemoteCerts
I0407 14:05:43.074748 297880 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0407 14:05:43.074785 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetSSHHostname
I0407 14:05:43.077979 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | domain old-k8s-version-405646 has defined MAC address 52:54:00:54:a4:af in network mk-old-k8s-version-405646
I0407 14:05:43.078467 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:54:a4:af", ip: ""} in network mk-old-k8s-version-405646: {Iface:virbr4 ExpiryTime:2025-04-07 15:05:31 +0000 UTC Type:0 Mac:52:54:00:54:a4:af Iaid: IPaddr:192.168.72.163 Prefix:24 Hostname:old-k8s-version-405646 Clientid:01:52:54:00:54:a4:af}
I0407 14:05:43.078506 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | domain old-k8s-version-405646 has defined IP address 192.168.72.163 and MAC address 52:54:00:54:a4:af in network mk-old-k8s-version-405646
I0407 14:05:43.078710 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetSSHPort
I0407 14:05:43.078964 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetSSHKeyPath
I0407 14:05:43.079181 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetSSHUsername
I0407 14:05:43.079353 297880 sshutil.go:53] new ssh client: &{IP:192.168.72.163 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20598-242355/.minikube/machines/old-k8s-version-405646/id_rsa Username:docker}
I0407 14:05:43.165227 297880 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20598-242355/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0407 14:05:43.194888 297880 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20598-242355/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0407 14:05:43.231876 297880 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20598-242355/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0407 14:05:43.266858 297880 provision.go:87] duration metric: took 1.243665863s to configureAuth
I0407 14:05:43.266903 297880 buildroot.go:189] setting minikube options for container-runtime
I0407 14:05:43.267122 297880 config.go:182] Loaded profile config "old-k8s-version-405646": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0407 14:05:43.267216 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetSSHHostname
I0407 14:05:43.270339 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | domain old-k8s-version-405646 has defined MAC address 52:54:00:54:a4:af in network mk-old-k8s-version-405646
I0407 14:05:43.270713 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:54:a4:af", ip: ""} in network mk-old-k8s-version-405646: {Iface:virbr4 ExpiryTime:2025-04-07 15:05:31 +0000 UTC Type:0 Mac:52:54:00:54:a4:af Iaid: IPaddr:192.168.72.163 Prefix:24 Hostname:old-k8s-version-405646 Clientid:01:52:54:00:54:a4:af}
I0407 14:05:43.270749 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | domain old-k8s-version-405646 has defined IP address 192.168.72.163 and MAC address 52:54:00:54:a4:af in network mk-old-k8s-version-405646
I0407 14:05:43.271083 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetSSHPort
I0407 14:05:43.271295 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetSSHKeyPath
I0407 14:05:43.271493 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetSSHKeyPath
I0407 14:05:43.271631 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetSSHUsername
I0407 14:05:43.271799 297880 main.go:141] libmachine: Using SSH client type: native
I0407 14:05:43.272113 297880 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.72.163 22 <nil> <nil>}
I0407 14:05:43.272137 297880 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0407 14:05:43.540502 297880 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0407 14:05:43.540542 297880 main.go:141] libmachine: Checking connection to Docker...
I0407 14:05:43.540552 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetURL
I0407 14:05:43.541839 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | using libvirt version 6000000
I0407 14:05:43.544793 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | domain old-k8s-version-405646 has defined MAC address 52:54:00:54:a4:af in network mk-old-k8s-version-405646
I0407 14:05:43.545157 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:54:a4:af", ip: ""} in network mk-old-k8s-version-405646: {Iface:virbr4 ExpiryTime:2025-04-07 15:05:31 +0000 UTC Type:0 Mac:52:54:00:54:a4:af Iaid: IPaddr:192.168.72.163 Prefix:24 Hostname:old-k8s-version-405646 Clientid:01:52:54:00:54:a4:af}
I0407 14:05:43.545184 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | domain old-k8s-version-405646 has defined IP address 192.168.72.163 and MAC address 52:54:00:54:a4:af in network mk-old-k8s-version-405646
I0407 14:05:43.545403 297880 main.go:141] libmachine: Docker is up and running!
I0407 14:05:43.545422 297880 main.go:141] libmachine: Reticulating splines...
I0407 14:05:43.545431 297880 client.go:171] duration metric: took 30.153370238s to LocalClient.Create
I0407 14:05:43.545449 297880 start.go:167] duration metric: took 30.15344088s to libmachine.API.Create "old-k8s-version-405646"
I0407 14:05:43.545460 297880 start.go:293] postStartSetup for "old-k8s-version-405646" (driver="kvm2")
I0407 14:05:43.545469 297880 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0407 14:05:43.545488 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .DriverName
I0407 14:05:43.545715 297880 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0407 14:05:43.545740 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetSSHHostname
I0407 14:05:43.548339 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | domain old-k8s-version-405646 has defined MAC address 52:54:00:54:a4:af in network mk-old-k8s-version-405646
I0407 14:05:43.548701 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:54:a4:af", ip: ""} in network mk-old-k8s-version-405646: {Iface:virbr4 ExpiryTime:2025-04-07 15:05:31 +0000 UTC Type:0 Mac:52:54:00:54:a4:af Iaid: IPaddr:192.168.72.163 Prefix:24 Hostname:old-k8s-version-405646 Clientid:01:52:54:00:54:a4:af}
I0407 14:05:43.548742 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | domain old-k8s-version-405646 has defined IP address 192.168.72.163 and MAC address 52:54:00:54:a4:af in network mk-old-k8s-version-405646
I0407 14:05:43.548939 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetSSHPort
I0407 14:05:43.549118 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetSSHKeyPath
I0407 14:05:43.549299 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetSSHUsername
I0407 14:05:43.549499 297880 sshutil.go:53] new ssh client: &{IP:192.168.72.163 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20598-242355/.minikube/machines/old-k8s-version-405646/id_rsa Username:docker}
I0407 14:05:43.641864 297880 ssh_runner.go:195] Run: cat /etc/os-release
I0407 14:05:43.647003 297880 info.go:137] Remote host: Buildroot 2023.02.9
I0407 14:05:43.647031 297880 filesync.go:126] Scanning /home/jenkins/minikube-integration/20598-242355/.minikube/addons for local assets ...
I0407 14:05:43.647121 297880 filesync.go:126] Scanning /home/jenkins/minikube-integration/20598-242355/.minikube/files for local assets ...
I0407 14:05:43.647218 297880 filesync.go:149] local asset: /home/jenkins/minikube-integration/20598-242355/.minikube/files/etc/ssl/certs/2495162.pem -> 2495162.pem in /etc/ssl/certs
I0407 14:05:43.647329 297880 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0407 14:05:43.659072 297880 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20598-242355/.minikube/files/etc/ssl/certs/2495162.pem --> /etc/ssl/certs/2495162.pem (1708 bytes)
I0407 14:05:43.686665 297880 start.go:296] duration metric: took 141.187412ms for postStartSetup
I0407 14:05:43.686737 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetConfigRaw
I0407 14:05:43.687555 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetIP
I0407 14:05:43.690274 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | domain old-k8s-version-405646 has defined MAC address 52:54:00:54:a4:af in network mk-old-k8s-version-405646
I0407 14:05:43.690573 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:54:a4:af", ip: ""} in network mk-old-k8s-version-405646: {Iface:virbr4 ExpiryTime:2025-04-07 15:05:31 +0000 UTC Type:0 Mac:52:54:00:54:a4:af Iaid: IPaddr:192.168.72.163 Prefix:24 Hostname:old-k8s-version-405646 Clientid:01:52:54:00:54:a4:af}
I0407 14:05:43.690592 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | domain old-k8s-version-405646 has defined IP address 192.168.72.163 and MAC address 52:54:00:54:a4:af in network mk-old-k8s-version-405646
I0407 14:05:43.690960 297880 profile.go:143] Saving config to /home/jenkins/minikube-integration/20598-242355/.minikube/profiles/old-k8s-version-405646/config.json ...
I0407 14:05:43.691195 297880 start.go:128] duration metric: took 30.321503403s to createHost
I0407 14:05:43.691248 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetSSHHostname
I0407 14:05:43.693364 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | domain old-k8s-version-405646 has defined MAC address 52:54:00:54:a4:af in network mk-old-k8s-version-405646
I0407 14:05:43.693676 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:54:a4:af", ip: ""} in network mk-old-k8s-version-405646: {Iface:virbr4 ExpiryTime:2025-04-07 15:05:31 +0000 UTC Type:0 Mac:52:54:00:54:a4:af Iaid: IPaddr:192.168.72.163 Prefix:24 Hostname:old-k8s-version-405646 Clientid:01:52:54:00:54:a4:af}
I0407 14:05:43.693703 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | domain old-k8s-version-405646 has defined IP address 192.168.72.163 and MAC address 52:54:00:54:a4:af in network mk-old-k8s-version-405646
I0407 14:05:43.693826 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetSSHPort
I0407 14:05:43.694028 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetSSHKeyPath
I0407 14:05:43.694210 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetSSHKeyPath
I0407 14:05:43.694372 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetSSHUsername
I0407 14:05:43.694565 297880 main.go:141] libmachine: Using SSH client type: native
I0407 14:05:43.694755 297880 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.72.163 22 <nil> <nil>}
I0407 14:05:43.694765 297880 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0407 14:05:43.801762 297880 main.go:141] libmachine: SSH cmd err, output: <nil>: 1744034743.779881462
I0407 14:05:43.801793 297880 fix.go:216] guest clock: 1744034743.779881462
I0407 14:05:43.801802 297880 fix.go:229] Guest: 2025-04-07 14:05:43.779881462 +0000 UTC Remote: 2025-04-07 14:05:43.691215699 +0000 UTC m=+85.261647241 (delta=88.665763ms)
I0407 14:05:43.801859 297880 fix.go:200] guest clock delta is within tolerance: 88.665763ms
I0407 14:05:43.801871 297880 start.go:83] releasing machines lock for "old-k8s-version-405646", held for 30.432309696s
I0407 14:05:43.801904 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .DriverName
I0407 14:05:43.802244 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetIP
I0407 14:05:43.805468 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | domain old-k8s-version-405646 has defined MAC address 52:54:00:54:a4:af in network mk-old-k8s-version-405646
I0407 14:05:43.805822 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:54:a4:af", ip: ""} in network mk-old-k8s-version-405646: {Iface:virbr4 ExpiryTime:2025-04-07 15:05:31 +0000 UTC Type:0 Mac:52:54:00:54:a4:af Iaid: IPaddr:192.168.72.163 Prefix:24 Hostname:old-k8s-version-405646 Clientid:01:52:54:00:54:a4:af}
I0407 14:05:43.805871 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | domain old-k8s-version-405646 has defined IP address 192.168.72.163 and MAC address 52:54:00:54:a4:af in network mk-old-k8s-version-405646
I0407 14:05:43.806113 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .DriverName
I0407 14:05:43.806620 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .DriverName
I0407 14:05:43.806794 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .DriverName
I0407 14:05:43.806874 297880 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0407 14:05:43.806918 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetSSHHostname
I0407 14:05:43.807025 297880 ssh_runner.go:195] Run: cat /version.json
I0407 14:05:43.807053 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetSSHHostname
I0407 14:05:43.810129 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | domain old-k8s-version-405646 has defined MAC address 52:54:00:54:a4:af in network mk-old-k8s-version-405646
I0407 14:05:43.810307 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | domain old-k8s-version-405646 has defined MAC address 52:54:00:54:a4:af in network mk-old-k8s-version-405646
I0407 14:05:43.810503 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:54:a4:af", ip: ""} in network mk-old-k8s-version-405646: {Iface:virbr4 ExpiryTime:2025-04-07 15:05:31 +0000 UTC Type:0 Mac:52:54:00:54:a4:af Iaid: IPaddr:192.168.72.163 Prefix:24 Hostname:old-k8s-version-405646 Clientid:01:52:54:00:54:a4:af}
I0407 14:05:43.810524 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | domain old-k8s-version-405646 has defined IP address 192.168.72.163 and MAC address 52:54:00:54:a4:af in network mk-old-k8s-version-405646
I0407 14:05:43.810719 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetSSHPort
I0407 14:05:43.810787 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:54:a4:af", ip: ""} in network mk-old-k8s-version-405646: {Iface:virbr4 ExpiryTime:2025-04-07 15:05:31 +0000 UTC Type:0 Mac:52:54:00:54:a4:af Iaid: IPaddr:192.168.72.163 Prefix:24 Hostname:old-k8s-version-405646 Clientid:01:52:54:00:54:a4:af}
I0407 14:05:43.810815 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | domain old-k8s-version-405646 has defined IP address 192.168.72.163 and MAC address 52:54:00:54:a4:af in network mk-old-k8s-version-405646
I0407 14:05:43.810931 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetSSHKeyPath
I0407 14:05:43.811029 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetSSHPort
I0407 14:05:43.811106 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetSSHUsername
I0407 14:05:43.811149 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetSSHKeyPath
I0407 14:05:43.811213 297880 sshutil.go:53] new ssh client: &{IP:192.168.72.163 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20598-242355/.minikube/machines/old-k8s-version-405646/id_rsa Username:docker}
I0407 14:05:43.811638 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetSSHUsername
I0407 14:05:43.811796 297880 sshutil.go:53] new ssh client: &{IP:192.168.72.163 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20598-242355/.minikube/machines/old-k8s-version-405646/id_rsa Username:docker}
I0407 14:05:43.891229 297880 ssh_runner.go:195] Run: systemctl --version
I0407 14:05:43.912168 297880 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0407 14:05:44.077226 297880 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0407 14:05:44.085833 297880 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0407 14:05:44.085894 297880 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0407 14:05:44.106221 297880 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0407 14:05:44.106256 297880 start.go:495] detecting cgroup driver to use...
I0407 14:05:44.106352 297880 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0407 14:05:44.126888 297880 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0407 14:05:44.147414 297880 docker.go:217] disabling cri-docker service (if available) ...
I0407 14:05:44.147493 297880 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0407 14:05:44.164645 297880 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0407 14:05:44.180472 297880 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0407 14:05:44.336287 297880 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0407 14:05:44.514962 297880 docker.go:233] disabling docker service ...
I0407 14:05:44.515026 297880 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0407 14:05:44.531145 297880 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0407 14:05:44.546568 297880 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0407 14:05:44.697809 297880 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0407 14:05:44.854077 297880 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0407 14:05:44.869925 297880 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0407 14:05:44.891031 297880 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0407 14:05:44.891099 297880 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0407 14:05:44.903604 297880 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0407 14:05:44.903672 297880 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0407 14:05:44.914837 297880 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0407 14:05:44.925215 297880 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0407 14:05:44.938894 297880 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0407 14:05:44.951274 297880 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0407 14:05:44.961382 297880 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0407 14:05:44.961466 297880 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0407 14:05:44.979064 297880 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0407 14:05:44.989350 297880 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0407 14:05:45.118707 297880 ssh_runner.go:195] Run: sudo systemctl restart crio
I0407 14:05:45.224862 297880 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0407 14:05:45.224957 297880 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0407 14:05:45.231337 297880 start.go:563] Will wait 60s for crictl version
I0407 14:05:45.231417 297880 ssh_runner.go:195] Run: which crictl
I0407 14:05:45.236625 297880 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0407 14:05:45.286793 297880 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0407 14:05:45.286885 297880 ssh_runner.go:195] Run: crio --version
I0407 14:05:45.326049 297880 ssh_runner.go:195] Run: crio --version
I0407 14:05:45.363890 297880 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0407 14:05:45.365047 297880 main.go:141] libmachine: (old-k8s-version-405646) Calling .GetIP
I0407 14:05:45.368018 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | domain old-k8s-version-405646 has defined MAC address 52:54:00:54:a4:af in network mk-old-k8s-version-405646
I0407 14:05:45.368357 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:54:a4:af", ip: ""} in network mk-old-k8s-version-405646: {Iface:virbr4 ExpiryTime:2025-04-07 15:05:31 +0000 UTC Type:0 Mac:52:54:00:54:a4:af Iaid: IPaddr:192.168.72.163 Prefix:24 Hostname:old-k8s-version-405646 Clientid:01:52:54:00:54:a4:af}
I0407 14:05:45.368385 297880 main.go:141] libmachine: (old-k8s-version-405646) DBG | domain old-k8s-version-405646 has defined IP address 192.168.72.163 and MAC address 52:54:00:54:a4:af in network mk-old-k8s-version-405646
I0407 14:05:45.368670 297880 ssh_runner.go:195] Run: grep 192.168.72.1 host.minikube.internal$ /etc/hosts
I0407 14:05:45.373631 297880 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.72.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0407 14:05:45.388171 297880 kubeadm.go:883] updating cluster {Name:old-k8s-version-405646 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1743675393-20591@sha256:8de8167e280414c9d16e4c3da59bc85bc7c9cc24228af995863fc7bcabfcf727 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-
version-405646 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.163 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountU
ID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0407 14:05:45.388372 297880 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0407 14:05:45.388469 297880 ssh_runner.go:195] Run: sudo crictl images --output json
I0407 14:05:45.431835 297880 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0407 14:05:45.431920 297880 ssh_runner.go:195] Run: which lz4
I0407 14:05:45.436991 297880 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0407 14:05:45.441671 297880 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0407 14:05:45.441704 297880 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20598-242355/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0407 14:05:47.125061 297880 crio.go:462] duration metric: took 1.688112643s to copy over tarball
I0407 14:05:47.125142 297880 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0407 14:05:50.280848 297880 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (3.155670323s)
I0407 14:05:50.280885 297880 crio.go:469] duration metric: took 3.155787946s to extract the tarball
I0407 14:05:50.280896 297880 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0407 14:05:50.326260 297880 ssh_runner.go:195] Run: sudo crictl images --output json
I0407 14:05:50.389584 297880 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0407 14:05:50.389619 297880 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0407 14:05:50.389678 297880 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0407 14:05:50.389700 297880 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0407 14:05:50.389734 297880 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0407 14:05:50.389713 297880 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0407 14:05:50.389939 297880 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0407 14:05:50.389997 297880 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I0407 14:05:50.390051 297880 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I0407 14:05:50.390150 297880 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0407 14:05:50.391738 297880 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0407 14:05:50.391819 297880 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0407 14:05:50.391902 297880 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0407 14:05:50.391820 297880 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0407 14:05:50.391991 297880 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0407 14:05:50.392059 297880 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0407 14:05:50.392161 297880 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0407 14:05:50.392171 297880 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0407 14:05:50.527801 297880 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0407 14:05:50.528148 297880 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0407 14:05:50.529140 297880 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0407 14:05:50.551644 297880 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0407 14:05:50.556268 297880 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0407 14:05:50.567370 297880 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0407 14:05:50.599316 297880 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0407 14:05:50.654114 297880 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0407 14:05:50.654175 297880 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0407 14:05:50.654316 297880 ssh_runner.go:195] Run: which crictl
I0407 14:05:50.709423 297880 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0407 14:05:50.709480 297880 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0407 14:05:50.709524 297880 ssh_runner.go:195] Run: which crictl
I0407 14:05:50.709729 297880 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0407 14:05:50.709775 297880 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0407 14:05:50.709833 297880 ssh_runner.go:195] Run: which crictl
I0407 14:05:50.752342 297880 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0407 14:05:50.752383 297880 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0407 14:05:50.752395 297880 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0407 14:05:50.752403 297880 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0407 14:05:50.752463 297880 ssh_runner.go:195] Run: which crictl
I0407 14:05:50.752463 297880 ssh_runner.go:195] Run: which crictl
I0407 14:05:50.752352 297880 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0407 14:05:50.752564 297880 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0407 14:05:50.752601 297880 ssh_runner.go:195] Run: which crictl
I0407 14:05:50.782038 297880 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0407 14:05:50.782092 297880 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0407 14:05:50.782140 297880 ssh_runner.go:195] Run: which crictl
I0407 14:05:50.782249 297880 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0407 14:05:50.782311 297880 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0407 14:05:50.782367 297880 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0407 14:05:50.782449 297880 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0407 14:05:50.782496 297880 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0407 14:05:50.782535 297880 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0407 14:05:50.949698 297880 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0407 14:05:50.949704 297880 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0407 14:05:50.949773 297880 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0407 14:05:50.963568 297880 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0407 14:05:50.963731 297880 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0407 14:05:50.963789 297880 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0407 14:05:50.963873 297880 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0407 14:05:51.164721 297880 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0407 14:05:51.164759 297880 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0407 14:05:51.164824 297880 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0407 14:05:51.181475 297880 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0407 14:05:51.181615 297880 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0407 14:05:51.181683 297880 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0407 14:05:51.181788 297880 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0407 14:05:51.379240 297880 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0407 14:05:51.379262 297880 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20598-242355/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0407 14:05:51.379290 297880 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20598-242355/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0407 14:05:51.397168 297880 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20598-242355/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0407 14:05:51.397259 297880 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20598-242355/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0407 14:05:51.397309 297880 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20598-242355/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0407 14:05:51.397351 297880 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20598-242355/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0407 14:05:51.430389 297880 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20598-242355/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0407 14:05:51.910141 297880 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0407 14:05:52.067474 297880 cache_images.go:92] duration metric: took 1.677833468s to LoadCachedImages
W0407 14:05:52.067569 297880 out.go:270] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20598-242355/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20598-242355/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2: no such file or directory
I0407 14:05:52.067588 297880 kubeadm.go:934] updating node { 192.168.72.163 8443 v1.20.0 crio true true} ...
I0407 14:05:52.067696 297880 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-405646 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.72.163
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-405646 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0407 14:05:52.067791 297880 ssh_runner.go:195] Run: crio config
I0407 14:05:52.135640 297880 cni.go:84] Creating CNI manager for ""
I0407 14:05:52.135673 297880 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0407 14:05:52.135688 297880 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0407 14:05:52.135715 297880 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.72.163 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-405646 NodeName:old-k8s-version-405646 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.72.163"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.72.163 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0407 14:05:52.135926 297880 kubeadm.go:195] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.72.163
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-405646"
kubeletExtraArgs:
node-ip: 192.168.72.163
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.72.163"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0407 14:05:52.136014 297880 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0407 14:05:52.151329 297880 binaries.go:44] Found k8s binaries, skipping transfer
I0407 14:05:52.151413 297880 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0407 14:05:52.164304 297880 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0407 14:05:52.185724 297880 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0407 14:05:52.210529 297880 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2123 bytes)
I0407 14:05:52.233908 297880 ssh_runner.go:195] Run: grep 192.168.72.163 control-plane.minikube.internal$ /etc/hosts
I0407 14:05:52.238209 297880 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.72.163 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0407 14:05:52.255609 297880 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0407 14:05:52.386184 297880 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0407 14:05:52.408618 297880 certs.go:68] Setting up /home/jenkins/minikube-integration/20598-242355/.minikube/profiles/old-k8s-version-405646 for IP: 192.168.72.163
I0407 14:05:52.408644 297880 certs.go:194] generating shared ca certs ...
I0407 14:05:52.408666 297880 certs.go:226] acquiring lock for ca certs: {Name:mk1da0e2436b5b22d130d00c7c348c272ee34f2e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0407 14:05:52.408843 297880 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20598-242355/.minikube/ca.key
I0407 14:05:52.408920 297880 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20598-242355/.minikube/proxy-client-ca.key
I0407 14:05:52.408936 297880 certs.go:256] generating profile certs ...
I0407 14:05:52.409010 297880 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/20598-242355/.minikube/profiles/old-k8s-version-405646/client.key
I0407 14:05:52.409028 297880 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20598-242355/.minikube/profiles/old-k8s-version-405646/client.crt with IP's: []
I0407 14:05:52.571921 297880 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20598-242355/.minikube/profiles/old-k8s-version-405646/client.crt ...
I0407 14:05:52.571954 297880 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20598-242355/.minikube/profiles/old-k8s-version-405646/client.crt: {Name:mkce07ebd1f4f437bf1027366e35a9f9f7bbbc6c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0407 14:05:52.572212 297880 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20598-242355/.minikube/profiles/old-k8s-version-405646/client.key ...
I0407 14:05:52.572239 297880 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20598-242355/.minikube/profiles/old-k8s-version-405646/client.key: {Name:mka9fd3bb039b40af1e6524fb2f22f689d130472 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0407 14:05:52.572405 297880 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/20598-242355/.minikube/profiles/old-k8s-version-405646/apiserver.key.f7e6b837
I0407 14:05:52.572444 297880 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20598-242355/.minikube/profiles/old-k8s-version-405646/apiserver.crt.f7e6b837 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.72.163]
I0407 14:05:53.065577 297880 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20598-242355/.minikube/profiles/old-k8s-version-405646/apiserver.crt.f7e6b837 ...
I0407 14:05:53.065621 297880 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20598-242355/.minikube/profiles/old-k8s-version-405646/apiserver.crt.f7e6b837: {Name:mk456889dfabcb01a7c53e53bb59df6bac0fc6cf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0407 14:05:53.065846 297880 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20598-242355/.minikube/profiles/old-k8s-version-405646/apiserver.key.f7e6b837 ...
I0407 14:05:53.065922 297880 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20598-242355/.minikube/profiles/old-k8s-version-405646/apiserver.key.f7e6b837: {Name:mk301ebac00082794d26c7cdc7764b0e13f36243 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0407 14:05:53.066077 297880 certs.go:381] copying /home/jenkins/minikube-integration/20598-242355/.minikube/profiles/old-k8s-version-405646/apiserver.crt.f7e6b837 -> /home/jenkins/minikube-integration/20598-242355/.minikube/profiles/old-k8s-version-405646/apiserver.crt
I0407 14:05:53.066191 297880 certs.go:385] copying /home/jenkins/minikube-integration/20598-242355/.minikube/profiles/old-k8s-version-405646/apiserver.key.f7e6b837 -> /home/jenkins/minikube-integration/20598-242355/.minikube/profiles/old-k8s-version-405646/apiserver.key
I0407 14:05:53.066276 297880 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/20598-242355/.minikube/profiles/old-k8s-version-405646/proxy-client.key
I0407 14:05:53.066300 297880 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20598-242355/.minikube/profiles/old-k8s-version-405646/proxy-client.crt with IP's: []
I0407 14:05:53.256757 297880 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20598-242355/.minikube/profiles/old-k8s-version-405646/proxy-client.crt ...
I0407 14:05:53.256791 297880 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20598-242355/.minikube/profiles/old-k8s-version-405646/proxy-client.crt: {Name:mk9ed7d6c4d0ab58eef3c788f19c757666450da9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0407 14:05:53.256938 297880 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20598-242355/.minikube/profiles/old-k8s-version-405646/proxy-client.key ...
I0407 14:05:53.256952 297880 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20598-242355/.minikube/profiles/old-k8s-version-405646/proxy-client.key: {Name:mkc7a6165cc94dc8ba294ef84f43d1df12fd5b1f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0407 14:05:53.257135 297880 certs.go:484] found cert: /home/jenkins/minikube-integration/20598-242355/.minikube/certs/249516.pem (1338 bytes)
W0407 14:05:53.257170 297880 certs.go:480] ignoring /home/jenkins/minikube-integration/20598-242355/.minikube/certs/249516_empty.pem, impossibly tiny 0 bytes
I0407 14:05:53.257180 297880 certs.go:484] found cert: /home/jenkins/minikube-integration/20598-242355/.minikube/certs/ca-key.pem (1675 bytes)
I0407 14:05:53.257200 297880 certs.go:484] found cert: /home/jenkins/minikube-integration/20598-242355/.minikube/certs/ca.pem (1078 bytes)
I0407 14:05:53.257226 297880 certs.go:484] found cert: /home/jenkins/minikube-integration/20598-242355/.minikube/certs/cert.pem (1123 bytes)
I0407 14:05:53.257246 297880 certs.go:484] found cert: /home/jenkins/minikube-integration/20598-242355/.minikube/certs/key.pem (1679 bytes)
I0407 14:05:53.257295 297880 certs.go:484] found cert: /home/jenkins/minikube-integration/20598-242355/.minikube/files/etc/ssl/certs/2495162.pem (1708 bytes)
I0407 14:05:53.257924 297880 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20598-242355/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0407 14:05:53.286633 297880 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20598-242355/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0407 14:05:53.310683 297880 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20598-242355/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0407 14:05:53.334445 297880 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20598-242355/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0407 14:05:53.363314 297880 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20598-242355/.minikube/profiles/old-k8s-version-405646/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0407 14:05:53.390361 297880 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20598-242355/.minikube/profiles/old-k8s-version-405646/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0407 14:05:53.417519 297880 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20598-242355/.minikube/profiles/old-k8s-version-405646/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0407 14:05:53.447692 297880 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20598-242355/.minikube/profiles/old-k8s-version-405646/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0407 14:05:53.481411 297880 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20598-242355/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0407 14:05:53.515235 297880 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20598-242355/.minikube/certs/249516.pem --> /usr/share/ca-certificates/249516.pem (1338 bytes)
I0407 14:05:53.553038 297880 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20598-242355/.minikube/files/etc/ssl/certs/2495162.pem --> /usr/share/ca-certificates/2495162.pem (1708 bytes)
I0407 14:05:53.584440 297880 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0407 14:05:53.605613 297880 ssh_runner.go:195] Run: openssl version
I0407 14:05:53.612357 297880 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0407 14:05:53.625475 297880 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0407 14:05:53.631470 297880 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Apr 7 12:56 /usr/share/ca-certificates/minikubeCA.pem
I0407 14:05:53.631542 297880 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0407 14:05:53.639313 297880 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0407 14:05:53.653656 297880 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/249516.pem && ln -fs /usr/share/ca-certificates/249516.pem /etc/ssl/certs/249516.pem"
I0407 14:05:53.669372 297880 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/249516.pem
I0407 14:05:53.674656 297880 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Apr 7 13:03 /usr/share/ca-certificates/249516.pem
I0407 14:05:53.674714 297880 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/249516.pem
I0407 14:05:53.680712 297880 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/249516.pem /etc/ssl/certs/51391683.0"
I0407 14:05:53.694247 297880 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/2495162.pem && ln -fs /usr/share/ca-certificates/2495162.pem /etc/ssl/certs/2495162.pem"
I0407 14:05:53.707447 297880 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/2495162.pem
I0407 14:05:53.712620 297880 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Apr 7 13:03 /usr/share/ca-certificates/2495162.pem
I0407 14:05:53.712674 297880 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/2495162.pem
I0407 14:05:53.719322 297880 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/2495162.pem /etc/ssl/certs/3ec20f2e.0"
I0407 14:05:53.732551 297880 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0407 14:05:53.737237 297880 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0407 14:05:53.737297 297880 kubeadm.go:392] StartCluster: {Name:old-k8s-version-405646 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1743675393-20591@sha256:8de8167e280414c9d16e4c3da59bc85bc7c9cc24228af995863fc7bcabfcf727 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-ver
sion-405646 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.163 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:
docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0407 14:05:53.737425 297880 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0407 14:05:53.737500 297880 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0407 14:05:53.782330 297880 cri.go:89] found id: ""
I0407 14:05:53.782412 297880 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0407 14:05:53.793938 297880 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0407 14:05:53.804826 297880 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0407 14:05:53.817440 297880 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0407 14:05:53.817461 297880 kubeadm.go:157] found existing configuration files:
I0407 14:05:53.817511 297880 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0407 14:05:53.828540 297880 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0407 14:05:53.828601 297880 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0407 14:05:53.843285 297880 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0407 14:05:53.857761 297880 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0407 14:05:53.857838 297880 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0407 14:05:53.870695 297880 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0407 14:05:53.883022 297880 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0407 14:05:53.883088 297880 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0407 14:05:53.896484 297880 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0407 14:05:53.910503 297880 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0407 14:05:53.910549 297880 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0407 14:05:53.926215 297880 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0407 14:05:54.109458 297880 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0407 14:05:54.109550 297880 kubeadm.go:310] [preflight] Running pre-flight checks
I0407 14:05:54.298839 297880 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0407 14:05:54.298982 297880 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0407 14:05:54.299112 297880 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0407 14:05:54.599163 297880 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0407 14:05:54.602557 297880 out.go:235] - Generating certificates and keys ...
I0407 14:05:54.602671 297880 kubeadm.go:310] [certs] Using existing ca certificate authority
I0407 14:05:54.602765 297880 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0407 14:05:54.700657 297880 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0407 14:05:54.986632 297880 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0407 14:05:55.171704 297880 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0407 14:05:55.657597 297880 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0407 14:05:56.317312 297880 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0407 14:05:56.317520 297880 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-405646] and IPs [192.168.72.163 127.0.0.1 ::1]
I0407 14:05:56.514169 297880 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0407 14:05:56.514356 297880 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-405646] and IPs [192.168.72.163 127.0.0.1 ::1]
I0407 14:05:56.883292 297880 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0407 14:05:57.044829 297880 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0407 14:05:57.089562 297880 kubeadm.go:310] [certs] Generating "sa" key and public key
I0407 14:05:57.089654 297880 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0407 14:05:57.382340 297880 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0407 14:05:57.815864 297880 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0407 14:05:57.918935 297880 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0407 14:05:58.240839 297880 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0407 14:05:58.271292 297880 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0407 14:05:58.272317 297880 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0407 14:05:58.272497 297880 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0407 14:05:58.447914 297880 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0407 14:05:58.449992 297880 out.go:235] - Booting up control plane ...
I0407 14:05:58.450157 297880 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0407 14:05:58.459766 297880 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0407 14:05:58.461003 297880 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0407 14:05:58.461952 297880 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0407 14:05:58.467179 297880 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0407 14:06:38.463065 297880 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0407 14:06:38.463770 297880 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0407 14:06:38.464003 297880 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0407 14:06:43.464399 297880 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0407 14:06:43.464668 297880 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0407 14:06:53.464816 297880 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0407 14:06:53.465106 297880 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0407 14:07:13.464913 297880 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0407 14:07:13.465190 297880 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0407 14:07:53.466833 297880 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0407 14:07:53.467083 297880 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0407 14:07:53.467107 297880 kubeadm.go:310]
I0407 14:07:53.467154 297880 kubeadm.go:310] Unfortunately, an error has occurred:
I0407 14:07:53.467254 297880 kubeadm.go:310] timed out waiting for the condition
I0407 14:07:53.467282 297880 kubeadm.go:310]
I0407 14:07:53.467336 297880 kubeadm.go:310] This error is likely caused by:
I0407 14:07:53.467383 297880 kubeadm.go:310] - The kubelet is not running
I0407 14:07:53.467529 297880 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0407 14:07:53.467550 297880 kubeadm.go:310]
I0407 14:07:53.467673 297880 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0407 14:07:53.467723 297880 kubeadm.go:310] - 'systemctl status kubelet'
I0407 14:07:53.467778 297880 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0407 14:07:53.467788 297880 kubeadm.go:310]
I0407 14:07:53.467981 297880 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0407 14:07:53.468138 297880 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0407 14:07:53.468152 297880 kubeadm.go:310]
I0407 14:07:53.468288 297880 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0407 14:07:53.468408 297880 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0407 14:07:53.468522 297880 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0407 14:07:53.468617 297880 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0407 14:07:53.468636 297880 kubeadm.go:310]
I0407 14:07:53.468814 297880 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0407 14:07:53.468928 297880 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0407 14:07:53.469025 297880 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
W0407 14:07:53.469203 297880 out.go:270] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-405646] and IPs [192.168.72.163 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-405646] and IPs [192.168.72.163 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-405646] and IPs [192.168.72.163 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-405646] and IPs [192.168.72.163 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0407 14:07:53.469259 297880 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0407 14:07:56.227113 297880 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (2.757821964s)
I0407 14:07:56.227191 297880 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0407 14:07:56.241626 297880 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0407 14:07:56.251980 297880 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0407 14:07:56.252000 297880 kubeadm.go:157] found existing configuration files:
I0407 14:07:56.252042 297880 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0407 14:07:56.261680 297880 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0407 14:07:56.261744 297880 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0407 14:07:56.271451 297880 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0407 14:07:56.280875 297880 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0407 14:07:56.280929 297880 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0407 14:07:56.290714 297880 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0407 14:07:56.300358 297880 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0407 14:07:56.300412 297880 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0407 14:07:56.310033 297880 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0407 14:07:56.319203 297880 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0407 14:07:56.319255 297880 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0407 14:07:56.328648 297880 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0407 14:07:56.533792 297880 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0407 14:09:52.821857 297880 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0407 14:09:52.822007 297880 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0407 14:09:52.824274 297880 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0407 14:09:52.824403 297880 kubeadm.go:310] [preflight] Running pre-flight checks
I0407 14:09:52.824537 297880 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0407 14:09:52.824698 297880 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0407 14:09:52.824858 297880 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0407 14:09:52.824944 297880 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0407 14:09:52.826571 297880 out.go:235] - Generating certificates and keys ...
I0407 14:09:52.826685 297880 kubeadm.go:310] [certs] Using existing ca certificate authority
I0407 14:09:52.826767 297880 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0407 14:09:52.826866 297880 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0407 14:09:52.826948 297880 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0407 14:09:52.827037 297880 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0407 14:09:52.827111 297880 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0407 14:09:52.827194 297880 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0407 14:09:52.827272 297880 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0407 14:09:52.827369 297880 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0407 14:09:52.827456 297880 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0407 14:09:52.827506 297880 kubeadm.go:310] [certs] Using the existing "sa" key
I0407 14:09:52.827567 297880 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0407 14:09:52.827625 297880 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0407 14:09:52.827686 297880 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0407 14:09:52.827760 297880 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0407 14:09:52.827824 297880 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0407 14:09:52.827942 297880 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0407 14:09:52.828053 297880 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0407 14:09:52.828107 297880 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0407 14:09:52.828191 297880 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0407 14:09:52.829514 297880 out.go:235] - Booting up control plane ...
I0407 14:09:52.829640 297880 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0407 14:09:52.829755 297880 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0407 14:09:52.829828 297880 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0407 14:09:52.829919 297880 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0407 14:09:52.830102 297880 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0407 14:09:52.830185 297880 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0407 14:09:52.830318 297880 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0407 14:09:52.830561 297880 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0407 14:09:52.830672 297880 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0407 14:09:52.830886 297880 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0407 14:09:52.830996 297880 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0407 14:09:52.831224 297880 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0407 14:09:52.831327 297880 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0407 14:09:52.831568 297880 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0407 14:09:52.831687 297880 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0407 14:09:52.831971 297880 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0407 14:09:52.831992 297880 kubeadm.go:310]
I0407 14:09:52.832040 297880 kubeadm.go:310] Unfortunately, an error has occurred:
I0407 14:09:52.832095 297880 kubeadm.go:310] timed out waiting for the condition
I0407 14:09:52.832116 297880 kubeadm.go:310]
I0407 14:09:52.832166 297880 kubeadm.go:310] This error is likely caused by:
I0407 14:09:52.832225 297880 kubeadm.go:310] - The kubelet is not running
I0407 14:09:52.832365 297880 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0407 14:09:52.832379 297880 kubeadm.go:310]
I0407 14:09:52.832547 297880 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0407 14:09:52.832613 297880 kubeadm.go:310] - 'systemctl status kubelet'
I0407 14:09:52.832653 297880 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0407 14:09:52.832662 297880 kubeadm.go:310]
I0407 14:09:52.832799 297880 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0407 14:09:52.832913 297880 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0407 14:09:52.832931 297880 kubeadm.go:310]
I0407 14:09:52.833096 297880 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0407 14:09:52.833221 297880 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0407 14:09:52.833342 297880 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0407 14:09:52.833452 297880 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0407 14:09:52.833535 297880 kubeadm.go:310]
I0407 14:09:52.833539 297880 kubeadm.go:394] duration metric: took 3m59.096250562s to StartCluster
I0407 14:09:52.833615 297880 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0407 14:09:52.833686 297880 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0407 14:09:52.889275 297880 cri.go:89] found id: ""
I0407 14:09:52.889312 297880 logs.go:282] 0 containers: []
W0407 14:09:52.889324 297880 logs.go:284] No container was found matching "kube-apiserver"
I0407 14:09:52.889333 297880 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0407 14:09:52.889403 297880 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0407 14:09:52.932483 297880 cri.go:89] found id: ""
I0407 14:09:52.932507 297880 logs.go:282] 0 containers: []
W0407 14:09:52.932516 297880 logs.go:284] No container was found matching "etcd"
I0407 14:09:52.932521 297880 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0407 14:09:52.932586 297880 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0407 14:09:52.969035 297880 cri.go:89] found id: ""
I0407 14:09:52.969064 297880 logs.go:282] 0 containers: []
W0407 14:09:52.969072 297880 logs.go:284] No container was found matching "coredns"
I0407 14:09:52.969079 297880 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0407 14:09:52.969149 297880 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0407 14:09:53.007411 297880 cri.go:89] found id: ""
I0407 14:09:53.007444 297880 logs.go:282] 0 containers: []
W0407 14:09:53.007456 297880 logs.go:284] No container was found matching "kube-scheduler"
I0407 14:09:53.007464 297880 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0407 14:09:53.007530 297880 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0407 14:09:53.041456 297880 cri.go:89] found id: ""
I0407 14:09:53.041482 297880 logs.go:282] 0 containers: []
W0407 14:09:53.041489 297880 logs.go:284] No container was found matching "kube-proxy"
I0407 14:09:53.041495 297880 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0407 14:09:53.041561 297880 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0407 14:09:53.083495 297880 cri.go:89] found id: ""
I0407 14:09:53.083525 297880 logs.go:282] 0 containers: []
W0407 14:09:53.083533 297880 logs.go:284] No container was found matching "kube-controller-manager"
I0407 14:09:53.083540 297880 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0407 14:09:53.083592 297880 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0407 14:09:53.119029 297880 cri.go:89] found id: ""
I0407 14:09:53.119072 297880 logs.go:282] 0 containers: []
W0407 14:09:53.119086 297880 logs.go:284] No container was found matching "kindnet"
I0407 14:09:53.119100 297880 logs.go:123] Gathering logs for dmesg ...
I0407 14:09:53.119119 297880 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0407 14:09:53.133275 297880 logs.go:123] Gathering logs for describe nodes ...
I0407 14:09:53.133311 297880 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0407 14:09:53.283102 297880 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0407 14:09:53.283136 297880 logs.go:123] Gathering logs for CRI-O ...
I0407 14:09:53.283155 297880 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0407 14:09:53.389469 297880 logs.go:123] Gathering logs for container status ...
I0407 14:09:53.389528 297880 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0407 14:09:53.429915 297880 logs.go:123] Gathering logs for kubelet ...
I0407 14:09:53.429951 297880 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0407 14:09:53.485426 297880 out.go:418] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0407 14:09:53.485485 297880 out.go:270] *
*
W0407 14:09:53.485596 297880 out.go:270] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0407 14:09:53.485619 297880 out.go:270] *
*
W0407 14:09:53.486448 297880 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0407 14:09:53.489367 297880 out.go:201]
W0407 14:09:53.490550 297880 out.go:270] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0407 14:09:53.490592 297880 out.go:270] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0407 14:09:53.490623 297880 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0407 14:09:53.493217 297880 out.go:201]
** /stderr **
start_stop_delete_test.go:186: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-405646 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-405646 -n old-k8s-version-405646
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-405646 -n old-k8s-version-405646: exit status 6 (239.149124ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0407 14:09:53.778109 305401 status.go:458] kubeconfig endpoint: get endpoint: "old-k8s-version-405646" does not appear in /home/jenkins/minikube-integration/20598-242355/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-405646" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (335.37s)