=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:184: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-435730 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:184: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-435730 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m33.844296318s)
-- stdout --
* [old-k8s-version-435730] minikube v1.35.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=20602
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/20602-1162386/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/20602-1162386/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-435730" primary control-plane node in "old-k8s-version-435730" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0407 13:29:03.000240 1206720 out.go:345] Setting OutFile to fd 1 ...
I0407 13:29:03.000693 1206720 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0407 13:29:03.000709 1206720 out.go:358] Setting ErrFile to fd 2...
I0407 13:29:03.000717 1206720 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0407 13:29:03.001079 1206720 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20602-1162386/.minikube/bin
I0407 13:29:03.001995 1206720 out.go:352] Setting JSON to false
I0407 13:29:03.004004 1206720 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-2","uptime":18687,"bootTime":1744013856,"procs":179,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1078-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0407 13:29:03.004180 1206720 start.go:139] virtualization: kvm guest
I0407 13:29:03.006852 1206720 out.go:177] * [old-k8s-version-435730] minikube v1.35.0 on Ubuntu 20.04 (kvm/amd64)
I0407 13:29:03.008561 1206720 notify.go:220] Checking for updates...
I0407 13:29:03.008576 1206720 out.go:177] - MINIKUBE_LOCATION=20602
I0407 13:29:03.011785 1206720 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0407 13:29:03.013459 1206720 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/20602-1162386/kubeconfig
I0407 13:29:03.017109 1206720 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/20602-1162386/.minikube
I0407 13:29:03.020936 1206720 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0407 13:29:03.023226 1206720 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0407 13:29:03.026590 1206720 driver.go:394] Setting default libvirt URI to qemu:///system
I0407 13:29:03.081788 1206720 out.go:177] * Using the kvm2 driver based on user configuration
I0407 13:29:03.083403 1206720 start.go:297] selected driver: kvm2
I0407 13:29:03.083433 1206720 start.go:901] validating driver "kvm2" against <nil>
I0407 13:29:03.083446 1206720 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0407 13:29:03.084844 1206720 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0407 13:29:03.085009 1206720 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/20602-1162386/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0407 13:29:03.106707 1206720 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.35.0
I0407 13:29:03.106829 1206720 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0407 13:29:03.107162 1206720 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0407 13:29:03.107206 1206720 cni.go:84] Creating CNI manager for ""
I0407 13:29:03.107246 1206720 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0407 13:29:03.107264 1206720 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0407 13:29:03.107329 1206720 start.go:340] cluster config:
{Name:old-k8s-version-435730 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1743675393-20591@sha256:8de8167e280414c9d16e4c3da59bc85bc7c9cc24228af995863fc7bcabfcf727 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-435730 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0407 13:29:03.107474 1206720 iso.go:125] acquiring lock: {Name:mk51e1827709f7a3810dbd898083f8185ece65eb Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0407 13:29:03.110022 1206720 out.go:177] * Starting "old-k8s-version-435730" primary control-plane node in "old-k8s-version-435730" cluster
I0407 13:29:03.112339 1206720 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0407 13:29:03.112419 1206720 preload.go:146] Found local preload: /home/jenkins/minikube-integration/20602-1162386/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0407 13:29:03.112459 1206720 cache.go:56] Caching tarball of preloaded images
I0407 13:29:03.112614 1206720 preload.go:172] Found /home/jenkins/minikube-integration/20602-1162386/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0407 13:29:03.112631 1206720 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0407 13:29:03.112960 1206720 profile.go:143] Saving config to /home/jenkins/minikube-integration/20602-1162386/.minikube/profiles/old-k8s-version-435730/config.json ...
I0407 13:29:03.112997 1206720 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20602-1162386/.minikube/profiles/old-k8s-version-435730/config.json: {Name:mk8f1b272eb2efc3b9c7974cff46ed8da7a4eaaa Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0407 13:29:03.113187 1206720 start.go:360] acquireMachinesLock for old-k8s-version-435730: {Name:mk51d4c744fa92d56cf6ac11b1e792c85ef6709a Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0407 13:29:03.113260 1206720 start.go:364] duration metric: took 49.415µs to acquireMachinesLock for "old-k8s-version-435730"
I0407 13:29:03.113289 1206720 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-435730 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1743675393-20591@sha256:8de8167e280414c9d16e4c3da59bc85bc7c9cc24228af995863fc7bcabfcf727 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 C
lusterName:old-k8s-version-435730 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p M
ountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0407 13:29:03.113374 1206720 start.go:125] createHost starting for "" (driver="kvm2")
I0407 13:29:03.115405 1206720 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0407 13:29:03.115701 1206720 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0407 13:29:03.115772 1206720 main.go:141] libmachine: Launching plugin server for driver kvm2
I0407 13:29:03.133400 1206720 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34605
I0407 13:29:03.134025 1206720 main.go:141] libmachine: () Calling .GetVersion
I0407 13:29:03.134601 1206720 main.go:141] libmachine: Using API Version 1
I0407 13:29:03.134626 1206720 main.go:141] libmachine: () Calling .SetConfigRaw
I0407 13:29:03.135028 1206720 main.go:141] libmachine: () Calling .GetMachineName
I0407 13:29:03.135225 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetMachineName
I0407 13:29:03.135412 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .DriverName
I0407 13:29:03.135562 1206720 start.go:159] libmachine.API.Create for "old-k8s-version-435730" (driver="kvm2")
I0407 13:29:03.135592 1206720 client.go:168] LocalClient.Create starting
I0407 13:29:03.135621 1206720 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20602-1162386/.minikube/certs/ca.pem
I0407 13:29:03.135657 1206720 main.go:141] libmachine: Decoding PEM data...
I0407 13:29:03.135671 1206720 main.go:141] libmachine: Parsing certificate...
I0407 13:29:03.135734 1206720 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20602-1162386/.minikube/certs/cert.pem
I0407 13:29:03.135755 1206720 main.go:141] libmachine: Decoding PEM data...
I0407 13:29:03.135765 1206720 main.go:141] libmachine: Parsing certificate...
I0407 13:29:03.135782 1206720 main.go:141] libmachine: Running pre-create checks...
I0407 13:29:03.135792 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .PreCreateCheck
I0407 13:29:03.136104 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetConfigRaw
I0407 13:29:03.136563 1206720 main.go:141] libmachine: Creating machine...
I0407 13:29:03.136579 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .Create
I0407 13:29:03.136736 1206720 main.go:141] libmachine: (old-k8s-version-435730) creating KVM machine...
I0407 13:29:03.136751 1206720 main.go:141] libmachine: (old-k8s-version-435730) creating network...
I0407 13:29:03.138997 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | found existing default KVM network
I0407 13:29:03.140237 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | I0407 13:29:03.139941 1206777 network.go:206] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc00020eef0}
I0407 13:29:03.140444 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | created network xml:
I0407 13:29:03.140477 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | <network>
I0407 13:29:03.140492 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | <name>mk-old-k8s-version-435730</name>
I0407 13:29:03.140501 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | <dns enable='no'/>
I0407 13:29:03.140518 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG |
I0407 13:29:03.140530 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | <ip address='192.168.39.1' netmask='255.255.255.0'>
I0407 13:29:03.140542 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | <dhcp>
I0407 13:29:03.140550 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | <range start='192.168.39.2' end='192.168.39.253'/>
I0407 13:29:03.140602 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | </dhcp>
I0407 13:29:03.140638 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | </ip>
I0407 13:29:03.140648 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG |
I0407 13:29:03.140655 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | </network>
I0407 13:29:03.140686 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG |
I0407 13:29:03.147126 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | trying to create private KVM network mk-old-k8s-version-435730 192.168.39.0/24...
I0407 13:29:03.269865 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | private KVM network mk-old-k8s-version-435730 192.168.39.0/24 created
I0407 13:29:03.269897 1206720 main.go:141] libmachine: (old-k8s-version-435730) setting up store path in /home/jenkins/minikube-integration/20602-1162386/.minikube/machines/old-k8s-version-435730 ...
I0407 13:29:03.269912 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | I0407 13:29:03.263475 1206777 common.go:144] Making disk image using store path: /home/jenkins/minikube-integration/20602-1162386/.minikube
I0407 13:29:03.269933 1206720 main.go:141] libmachine: (old-k8s-version-435730) building disk image from file:///home/jenkins/minikube-integration/20602-1162386/.minikube/cache/iso/amd64/minikube-v1.35.0-amd64.iso
I0407 13:29:03.269954 1206720 main.go:141] libmachine: (old-k8s-version-435730) Downloading /home/jenkins/minikube-integration/20602-1162386/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/20602-1162386/.minikube/cache/iso/amd64/minikube-v1.35.0-amd64.iso...
I0407 13:29:03.638730 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | I0407 13:29:03.638518 1206777 common.go:151] Creating ssh key: /home/jenkins/minikube-integration/20602-1162386/.minikube/machines/old-k8s-version-435730/id_rsa...
I0407 13:29:03.724878 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | I0407 13:29:03.724608 1206777 common.go:157] Creating raw disk image: /home/jenkins/minikube-integration/20602-1162386/.minikube/machines/old-k8s-version-435730/old-k8s-version-435730.rawdisk...
I0407 13:29:03.724944 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | Writing magic tar header
I0407 13:29:03.724959 1206720 main.go:141] libmachine: (old-k8s-version-435730) setting executable bit set on /home/jenkins/minikube-integration/20602-1162386/.minikube/machines/old-k8s-version-435730 (perms=drwx------)
I0407 13:29:03.724977 1206720 main.go:141] libmachine: (old-k8s-version-435730) setting executable bit set on /home/jenkins/minikube-integration/20602-1162386/.minikube/machines (perms=drwxr-xr-x)
I0407 13:29:03.724984 1206720 main.go:141] libmachine: (old-k8s-version-435730) setting executable bit set on /home/jenkins/minikube-integration/20602-1162386/.minikube (perms=drwxr-xr-x)
I0407 13:29:03.724992 1206720 main.go:141] libmachine: (old-k8s-version-435730) setting executable bit set on /home/jenkins/minikube-integration/20602-1162386 (perms=drwxrwxr-x)
I0407 13:29:03.724999 1206720 main.go:141] libmachine: (old-k8s-version-435730) setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0407 13:29:03.725006 1206720 main.go:141] libmachine: (old-k8s-version-435730) setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0407 13:29:03.725015 1206720 main.go:141] libmachine: (old-k8s-version-435730) creating domain...
I0407 13:29:03.725788 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | Writing SSH key tar header
I0407 13:29:03.725876 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | I0407 13:29:03.724749 1206777 common.go:171] Fixing permissions on /home/jenkins/minikube-integration/20602-1162386/.minikube/machines/old-k8s-version-435730 ...
I0407 13:29:03.725908 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20602-1162386/.minikube/machines/old-k8s-version-435730
I0407 13:29:03.725930 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20602-1162386/.minikube/machines
I0407 13:29:03.725941 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20602-1162386/.minikube
I0407 13:29:03.725951 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20602-1162386
I0407 13:29:03.725968 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | checking permissions on dir: /home/jenkins/minikube-integration
I0407 13:29:03.725977 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | checking permissions on dir: /home/jenkins
I0407 13:29:03.725991 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | checking permissions on dir: /home
I0407 13:29:03.726000 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | skipping /home - not owner
I0407 13:29:03.727191 1206720 main.go:141] libmachine: (old-k8s-version-435730) define libvirt domain using xml:
I0407 13:29:03.727257 1206720 main.go:141] libmachine: (old-k8s-version-435730) <domain type='kvm'>
I0407 13:29:03.727458 1206720 main.go:141] libmachine: (old-k8s-version-435730) <name>old-k8s-version-435730</name>
I0407 13:29:03.727513 1206720 main.go:141] libmachine: (old-k8s-version-435730) <memory unit='MiB'>2200</memory>
I0407 13:29:03.727536 1206720 main.go:141] libmachine: (old-k8s-version-435730) <vcpu>2</vcpu>
I0407 13:29:03.727545 1206720 main.go:141] libmachine: (old-k8s-version-435730) <features>
I0407 13:29:03.727557 1206720 main.go:141] libmachine: (old-k8s-version-435730) <acpi/>
I0407 13:29:03.727648 1206720 main.go:141] libmachine: (old-k8s-version-435730) <apic/>
I0407 13:29:03.727665 1206720 main.go:141] libmachine: (old-k8s-version-435730) <pae/>
I0407 13:29:03.727936 1206720 main.go:141] libmachine: (old-k8s-version-435730)
I0407 13:29:03.728054 1206720 main.go:141] libmachine: (old-k8s-version-435730) </features>
I0407 13:29:03.728091 1206720 main.go:141] libmachine: (old-k8s-version-435730) <cpu mode='host-passthrough'>
I0407 13:29:03.728146 1206720 main.go:141] libmachine: (old-k8s-version-435730)
I0407 13:29:03.728168 1206720 main.go:141] libmachine: (old-k8s-version-435730) </cpu>
I0407 13:29:03.728177 1206720 main.go:141] libmachine: (old-k8s-version-435730) <os>
I0407 13:29:03.728189 1206720 main.go:141] libmachine: (old-k8s-version-435730) <type>hvm</type>
I0407 13:29:03.728213 1206720 main.go:141] libmachine: (old-k8s-version-435730) <boot dev='cdrom'/>
I0407 13:29:03.728217 1206720 main.go:141] libmachine: (old-k8s-version-435730) <boot dev='hd'/>
I0407 13:29:03.728227 1206720 main.go:141] libmachine: (old-k8s-version-435730) <bootmenu enable='no'/>
I0407 13:29:03.728231 1206720 main.go:141] libmachine: (old-k8s-version-435730) </os>
I0407 13:29:03.728236 1206720 main.go:141] libmachine: (old-k8s-version-435730) <devices>
I0407 13:29:03.728241 1206720 main.go:141] libmachine: (old-k8s-version-435730) <disk type='file' device='cdrom'>
I0407 13:29:03.728254 1206720 main.go:141] libmachine: (old-k8s-version-435730) <source file='/home/jenkins/minikube-integration/20602-1162386/.minikube/machines/old-k8s-version-435730/boot2docker.iso'/>
I0407 13:29:03.728270 1206720 main.go:141] libmachine: (old-k8s-version-435730) <target dev='hdc' bus='scsi'/>
I0407 13:29:03.728387 1206720 main.go:141] libmachine: (old-k8s-version-435730) <readonly/>
I0407 13:29:03.728436 1206720 main.go:141] libmachine: (old-k8s-version-435730) </disk>
I0407 13:29:03.728453 1206720 main.go:141] libmachine: (old-k8s-version-435730) <disk type='file' device='disk'>
I0407 13:29:03.728477 1206720 main.go:141] libmachine: (old-k8s-version-435730) <driver name='qemu' type='raw' cache='default' io='threads' />
I0407 13:29:03.728503 1206720 main.go:141] libmachine: (old-k8s-version-435730) <source file='/home/jenkins/minikube-integration/20602-1162386/.minikube/machines/old-k8s-version-435730/old-k8s-version-435730.rawdisk'/>
I0407 13:29:03.728519 1206720 main.go:141] libmachine: (old-k8s-version-435730) <target dev='hda' bus='virtio'/>
I0407 13:29:03.728536 1206720 main.go:141] libmachine: (old-k8s-version-435730) </disk>
I0407 13:29:03.728555 1206720 main.go:141] libmachine: (old-k8s-version-435730) <interface type='network'>
I0407 13:29:03.728574 1206720 main.go:141] libmachine: (old-k8s-version-435730) <source network='mk-old-k8s-version-435730'/>
I0407 13:29:03.728586 1206720 main.go:141] libmachine: (old-k8s-version-435730) <model type='virtio'/>
I0407 13:29:03.728596 1206720 main.go:141] libmachine: (old-k8s-version-435730) </interface>
I0407 13:29:03.728610 1206720 main.go:141] libmachine: (old-k8s-version-435730) <interface type='network'>
I0407 13:29:03.728621 1206720 main.go:141] libmachine: (old-k8s-version-435730) <source network='default'/>
I0407 13:29:03.728641 1206720 main.go:141] libmachine: (old-k8s-version-435730) <model type='virtio'/>
I0407 13:29:03.728655 1206720 main.go:141] libmachine: (old-k8s-version-435730) </interface>
I0407 13:29:03.728666 1206720 main.go:141] libmachine: (old-k8s-version-435730) <serial type='pty'>
I0407 13:29:03.728676 1206720 main.go:141] libmachine: (old-k8s-version-435730) <target port='0'/>
I0407 13:29:03.728687 1206720 main.go:141] libmachine: (old-k8s-version-435730) </serial>
I0407 13:29:03.728697 1206720 main.go:141] libmachine: (old-k8s-version-435730) <console type='pty'>
I0407 13:29:03.728716 1206720 main.go:141] libmachine: (old-k8s-version-435730) <target type='serial' port='0'/>
I0407 13:29:03.728728 1206720 main.go:141] libmachine: (old-k8s-version-435730) </console>
I0407 13:29:03.728740 1206720 main.go:141] libmachine: (old-k8s-version-435730) <rng model='virtio'>
I0407 13:29:03.728751 1206720 main.go:141] libmachine: (old-k8s-version-435730) <backend model='random'>/dev/random</backend>
I0407 13:29:03.728763 1206720 main.go:141] libmachine: (old-k8s-version-435730) </rng>
I0407 13:29:03.728773 1206720 main.go:141] libmachine: (old-k8s-version-435730)
I0407 13:29:03.728783 1206720 main.go:141] libmachine: (old-k8s-version-435730)
I0407 13:29:03.728833 1206720 main.go:141] libmachine: (old-k8s-version-435730) </devices>
I0407 13:29:03.728871 1206720 main.go:141] libmachine: (old-k8s-version-435730) </domain>
I0407 13:29:03.728887 1206720 main.go:141] libmachine: (old-k8s-version-435730)
I0407 13:29:03.734142 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | domain old-k8s-version-435730 has defined MAC address 52:54:00:f3:bd:52 in network default
I0407 13:29:03.735231 1206720 main.go:141] libmachine: (old-k8s-version-435730) starting domain...
I0407 13:29:03.735262 1206720 main.go:141] libmachine: (old-k8s-version-435730) ensuring networks are active...
I0407 13:29:03.735281 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | domain old-k8s-version-435730 has defined MAC address 52:54:00:e3:da:b2 in network mk-old-k8s-version-435730
I0407 13:29:03.736456 1206720 main.go:141] libmachine: (old-k8s-version-435730) Ensuring network default is active
I0407 13:29:03.736888 1206720 main.go:141] libmachine: (old-k8s-version-435730) Ensuring network mk-old-k8s-version-435730 is active
I0407 13:29:03.737764 1206720 main.go:141] libmachine: (old-k8s-version-435730) getting domain XML...
I0407 13:29:03.738779 1206720 main.go:141] libmachine: (old-k8s-version-435730) creating domain...
I0407 13:29:05.425029 1206720 main.go:141] libmachine: (old-k8s-version-435730) waiting for IP...
I0407 13:29:05.426008 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | domain old-k8s-version-435730 has defined MAC address 52:54:00:e3:da:b2 in network mk-old-k8s-version-435730
I0407 13:29:05.426473 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | unable to find current IP address of domain old-k8s-version-435730 in network mk-old-k8s-version-435730
I0407 13:29:05.426543 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | I0407 13:29:05.426485 1206777 retry.go:31] will retry after 240.732984ms: waiting for domain to come up
I0407 13:29:05.669344 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | domain old-k8s-version-435730 has defined MAC address 52:54:00:e3:da:b2 in network mk-old-k8s-version-435730
I0407 13:29:05.669974 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | unable to find current IP address of domain old-k8s-version-435730 in network mk-old-k8s-version-435730
I0407 13:29:05.670002 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | I0407 13:29:05.669902 1206777 retry.go:31] will retry after 300.446039ms: waiting for domain to come up
I0407 13:29:05.972845 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | domain old-k8s-version-435730 has defined MAC address 52:54:00:e3:da:b2 in network mk-old-k8s-version-435730
I0407 13:29:05.973612 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | unable to find current IP address of domain old-k8s-version-435730 in network mk-old-k8s-version-435730
I0407 13:29:05.973701 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | I0407 13:29:05.973582 1206777 retry.go:31] will retry after 307.704268ms: waiting for domain to come up
I0407 13:29:06.283301 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | domain old-k8s-version-435730 has defined MAC address 52:54:00:e3:da:b2 in network mk-old-k8s-version-435730
I0407 13:29:06.283883 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | unable to find current IP address of domain old-k8s-version-435730 in network mk-old-k8s-version-435730
I0407 13:29:06.283949 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | I0407 13:29:06.283869 1206777 retry.go:31] will retry after 579.147006ms: waiting for domain to come up
I0407 13:29:06.865451 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | domain old-k8s-version-435730 has defined MAC address 52:54:00:e3:da:b2 in network mk-old-k8s-version-435730
I0407 13:29:06.866533 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | unable to find current IP address of domain old-k8s-version-435730 in network mk-old-k8s-version-435730
I0407 13:29:06.866572 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | I0407 13:29:06.866437 1206777 retry.go:31] will retry after 540.673117ms: waiting for domain to come up
I0407 13:29:07.409806 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | domain old-k8s-version-435730 has defined MAC address 52:54:00:e3:da:b2 in network mk-old-k8s-version-435730
I0407 13:29:07.410334 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | unable to find current IP address of domain old-k8s-version-435730 in network mk-old-k8s-version-435730
I0407 13:29:07.410369 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | I0407 13:29:07.410269 1206777 retry.go:31] will retry after 919.802789ms: waiting for domain to come up
I0407 13:29:08.332761 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | domain old-k8s-version-435730 has defined MAC address 52:54:00:e3:da:b2 in network mk-old-k8s-version-435730
I0407 13:29:08.333241 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | unable to find current IP address of domain old-k8s-version-435730 in network mk-old-k8s-version-435730
I0407 13:29:08.333262 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | I0407 13:29:08.333215 1206777 retry.go:31] will retry after 1.00646546s: waiting for domain to come up
I0407 13:29:09.341019 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | domain old-k8s-version-435730 has defined MAC address 52:54:00:e3:da:b2 in network mk-old-k8s-version-435730
I0407 13:29:09.341566 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | unable to find current IP address of domain old-k8s-version-435730 in network mk-old-k8s-version-435730
I0407 13:29:09.341603 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | I0407 13:29:09.341523 1206777 retry.go:31] will retry after 1.396900093s: waiting for domain to come up
I0407 13:29:10.740150 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | domain old-k8s-version-435730 has defined MAC address 52:54:00:e3:da:b2 in network mk-old-k8s-version-435730
I0407 13:29:10.740907 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | unable to find current IP address of domain old-k8s-version-435730 in network mk-old-k8s-version-435730
I0407 13:29:10.740970 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | I0407 13:29:10.740779 1206777 retry.go:31] will retry after 1.636977425s: waiting for domain to come up
I0407 13:29:12.379465 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | domain old-k8s-version-435730 has defined MAC address 52:54:00:e3:da:b2 in network mk-old-k8s-version-435730
I0407 13:29:12.380402 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | unable to find current IP address of domain old-k8s-version-435730 in network mk-old-k8s-version-435730
I0407 13:29:12.380434 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | I0407 13:29:12.380334 1206777 retry.go:31] will retry after 2.247187975s: waiting for domain to come up
I0407 13:29:14.630031 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | domain old-k8s-version-435730 has defined MAC address 52:54:00:e3:da:b2 in network mk-old-k8s-version-435730
I0407 13:29:14.630740 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | unable to find current IP address of domain old-k8s-version-435730 in network mk-old-k8s-version-435730
I0407 13:29:14.630767 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | I0407 13:29:14.630698 1206777 retry.go:31] will retry after 1.76677182s: waiting for domain to come up
I0407 13:29:16.398950 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | domain old-k8s-version-435730 has defined MAC address 52:54:00:e3:da:b2 in network mk-old-k8s-version-435730
I0407 13:29:16.399526 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | unable to find current IP address of domain old-k8s-version-435730 in network mk-old-k8s-version-435730
I0407 13:29:16.399557 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | I0407 13:29:16.399466 1206777 retry.go:31] will retry after 2.279920734s: waiting for domain to come up
I0407 13:29:18.680932 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | domain old-k8s-version-435730 has defined MAC address 52:54:00:e3:da:b2 in network mk-old-k8s-version-435730
I0407 13:29:18.681573 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | unable to find current IP address of domain old-k8s-version-435730 in network mk-old-k8s-version-435730
I0407 13:29:18.681607 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | I0407 13:29:18.681486 1206777 retry.go:31] will retry after 3.99702619s: waiting for domain to come up
I0407 13:29:22.680586 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | domain old-k8s-version-435730 has defined MAC address 52:54:00:e3:da:b2 in network mk-old-k8s-version-435730
I0407 13:29:22.681295 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | unable to find current IP address of domain old-k8s-version-435730 in network mk-old-k8s-version-435730
I0407 13:29:22.681367 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | I0407 13:29:22.681254 1206777 retry.go:31] will retry after 3.724879233s: waiting for domain to come up
I0407 13:29:26.410195 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | domain old-k8s-version-435730 has defined MAC address 52:54:00:e3:da:b2 in network mk-old-k8s-version-435730
I0407 13:29:26.410696 1206720 main.go:141] libmachine: (old-k8s-version-435730) found domain IP: 192.168.39.211
I0407 13:29:26.410723 1206720 main.go:141] libmachine: (old-k8s-version-435730) reserving static IP address...
I0407 13:29:26.410738 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | domain old-k8s-version-435730 has current primary IP address 192.168.39.211 and MAC address 52:54:00:e3:da:b2 in network mk-old-k8s-version-435730
I0407 13:29:26.411376 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-435730", mac: "52:54:00:e3:da:b2", ip: "192.168.39.211"} in network mk-old-k8s-version-435730
I0407 13:29:26.518938 1206720 main.go:141] libmachine: (old-k8s-version-435730) reserved static IP address 192.168.39.211 for domain old-k8s-version-435730
I0407 13:29:26.518970 1206720 main.go:141] libmachine: (old-k8s-version-435730) waiting for SSH...
I0407 13:29:26.518980 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | Getting to WaitForSSH function...
I0407 13:29:26.522517 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | domain old-k8s-version-435730 has defined MAC address 52:54:00:e3:da:b2 in network mk-old-k8s-version-435730
I0407 13:29:26.523039 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e3:da:b2", ip: ""} in network mk-old-k8s-version-435730: {Iface:virbr1 ExpiryTime:2025-04-07 14:29:20 +0000 UTC Type:0 Mac:52:54:00:e3:da:b2 Iaid: IPaddr:192.168.39.211 Prefix:24 Hostname:minikube Clientid:01:52:54:00:e3:da:b2}
I0407 13:29:26.523081 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | domain old-k8s-version-435730 has defined IP address 192.168.39.211 and MAC address 52:54:00:e3:da:b2 in network mk-old-k8s-version-435730
I0407 13:29:26.523288 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | Using SSH client type: external
I0407 13:29:26.523319 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | Using SSH private key: /home/jenkins/minikube-integration/20602-1162386/.minikube/machines/old-k8s-version-435730/id_rsa (-rw-------)
I0407 13:29:26.523359 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.211 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/20602-1162386/.minikube/machines/old-k8s-version-435730/id_rsa -p 22] /usr/bin/ssh <nil>}
I0407 13:29:26.523370 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | About to run SSH command:
I0407 13:29:26.523403 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | exit 0
I0407 13:29:26.650715 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | SSH cmd err, output: <nil>:
I0407 13:29:26.650936 1206720 main.go:141] libmachine: (old-k8s-version-435730) KVM machine creation complete
I0407 13:29:26.651488 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetConfigRaw
I0407 13:29:26.652237 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .DriverName
I0407 13:29:26.652538 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .DriverName
I0407 13:29:26.652794 1206720 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0407 13:29:26.652812 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetState
I0407 13:29:26.655076 1206720 main.go:141] libmachine: Detecting operating system of created instance...
I0407 13:29:26.655101 1206720 main.go:141] libmachine: Waiting for SSH to be available...
I0407 13:29:26.655121 1206720 main.go:141] libmachine: Getting to WaitForSSH function...
I0407 13:29:26.655131 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetSSHHostname
I0407 13:29:26.658257 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | domain old-k8s-version-435730 has defined MAC address 52:54:00:e3:da:b2 in network mk-old-k8s-version-435730
I0407 13:29:26.658753 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e3:da:b2", ip: ""} in network mk-old-k8s-version-435730: {Iface:virbr1 ExpiryTime:2025-04-07 14:29:20 +0000 UTC Type:0 Mac:52:54:00:e3:da:b2 Iaid: IPaddr:192.168.39.211 Prefix:24 Hostname:old-k8s-version-435730 Clientid:01:52:54:00:e3:da:b2}
I0407 13:29:26.658784 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | domain old-k8s-version-435730 has defined IP address 192.168.39.211 and MAC address 52:54:00:e3:da:b2 in network mk-old-k8s-version-435730
I0407 13:29:26.658956 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetSSHPort
I0407 13:29:26.659204 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetSSHKeyPath
I0407 13:29:26.659389 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetSSHKeyPath
I0407 13:29:26.659518 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetSSHUsername
I0407 13:29:26.659683 1206720 main.go:141] libmachine: Using SSH client type: native
I0407 13:29:26.659978 1206720 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.39.211 22 <nil> <nil>}
I0407 13:29:26.659992 1206720 main.go:141] libmachine: About to run SSH command:
exit 0
I0407 13:29:26.765680 1206720 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0407 13:29:26.765737 1206720 main.go:141] libmachine: Detecting the provisioner...
I0407 13:29:26.765749 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetSSHHostname
I0407 13:29:26.769225 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | domain old-k8s-version-435730 has defined MAC address 52:54:00:e3:da:b2 in network mk-old-k8s-version-435730
I0407 13:29:26.769653 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e3:da:b2", ip: ""} in network mk-old-k8s-version-435730: {Iface:virbr1 ExpiryTime:2025-04-07 14:29:20 +0000 UTC Type:0 Mac:52:54:00:e3:da:b2 Iaid: IPaddr:192.168.39.211 Prefix:24 Hostname:old-k8s-version-435730 Clientid:01:52:54:00:e3:da:b2}
I0407 13:29:26.769690 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | domain old-k8s-version-435730 has defined IP address 192.168.39.211 and MAC address 52:54:00:e3:da:b2 in network mk-old-k8s-version-435730
I0407 13:29:26.769965 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetSSHPort
I0407 13:29:26.770273 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetSSHKeyPath
I0407 13:29:26.770479 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetSSHKeyPath
I0407 13:29:26.770709 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetSSHUsername
I0407 13:29:26.770910 1206720 main.go:141] libmachine: Using SSH client type: native
I0407 13:29:26.771175 1206720 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.39.211 22 <nil> <nil>}
I0407 13:29:26.771188 1206720 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0407 13:29:26.878891 1206720 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0407 13:29:26.878980 1206720 main.go:141] libmachine: found compatible host: buildroot
I0407 13:29:26.878990 1206720 main.go:141] libmachine: Provisioning with buildroot...
I0407 13:29:26.878999 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetMachineName
I0407 13:29:26.879358 1206720 buildroot.go:166] provisioning hostname "old-k8s-version-435730"
I0407 13:29:26.879393 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetMachineName
I0407 13:29:26.879621 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetSSHHostname
I0407 13:29:26.882571 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | domain old-k8s-version-435730 has defined MAC address 52:54:00:e3:da:b2 in network mk-old-k8s-version-435730
I0407 13:29:26.883103 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e3:da:b2", ip: ""} in network mk-old-k8s-version-435730: {Iface:virbr1 ExpiryTime:2025-04-07 14:29:20 +0000 UTC Type:0 Mac:52:54:00:e3:da:b2 Iaid: IPaddr:192.168.39.211 Prefix:24 Hostname:old-k8s-version-435730 Clientid:01:52:54:00:e3:da:b2}
I0407 13:29:26.883128 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | domain old-k8s-version-435730 has defined IP address 192.168.39.211 and MAC address 52:54:00:e3:da:b2 in network mk-old-k8s-version-435730
I0407 13:29:26.883387 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetSSHPort
I0407 13:29:26.883601 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetSSHKeyPath
I0407 13:29:26.883749 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetSSHKeyPath
I0407 13:29:26.883877 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetSSHUsername
I0407 13:29:26.884109 1206720 main.go:141] libmachine: Using SSH client type: native
I0407 13:29:26.884317 1206720 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.39.211 22 <nil> <nil>}
I0407 13:29:26.884331 1206720 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-435730 && echo "old-k8s-version-435730" | sudo tee /etc/hostname
I0407 13:29:27.006816 1206720 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-435730
I0407 13:29:27.006854 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetSSHHostname
I0407 13:29:27.010015 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | domain old-k8s-version-435730 has defined MAC address 52:54:00:e3:da:b2 in network mk-old-k8s-version-435730
I0407 13:29:27.010432 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e3:da:b2", ip: ""} in network mk-old-k8s-version-435730: {Iface:virbr1 ExpiryTime:2025-04-07 14:29:20 +0000 UTC Type:0 Mac:52:54:00:e3:da:b2 Iaid: IPaddr:192.168.39.211 Prefix:24 Hostname:old-k8s-version-435730 Clientid:01:52:54:00:e3:da:b2}
I0407 13:29:27.010465 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | domain old-k8s-version-435730 has defined IP address 192.168.39.211 and MAC address 52:54:00:e3:da:b2 in network mk-old-k8s-version-435730
I0407 13:29:27.010673 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetSSHPort
I0407 13:29:27.010902 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetSSHKeyPath
I0407 13:29:27.011088 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetSSHKeyPath
I0407 13:29:27.011251 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetSSHUsername
I0407 13:29:27.011440 1206720 main.go:141] libmachine: Using SSH client type: native
I0407 13:29:27.011649 1206720 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.39.211 22 <nil> <nil>}
I0407 13:29:27.011665 1206720 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-435730' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-435730/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-435730' | sudo tee -a /etc/hosts;
fi
fi
I0407 13:29:27.128015 1206720 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0407 13:29:27.128055 1206720 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/20602-1162386/.minikube CaCertPath:/home/jenkins/minikube-integration/20602-1162386/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20602-1162386/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20602-1162386/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20602-1162386/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20602-1162386/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20602-1162386/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20602-1162386/.minikube}
I0407 13:29:27.128123 1206720 buildroot.go:174] setting up certificates
I0407 13:29:27.128141 1206720 provision.go:84] configureAuth start
I0407 13:29:27.128158 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetMachineName
I0407 13:29:27.128471 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetIP
I0407 13:29:27.131909 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | domain old-k8s-version-435730 has defined MAC address 52:54:00:e3:da:b2 in network mk-old-k8s-version-435730
I0407 13:29:27.132346 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e3:da:b2", ip: ""} in network mk-old-k8s-version-435730: {Iface:virbr1 ExpiryTime:2025-04-07 14:29:20 +0000 UTC Type:0 Mac:52:54:00:e3:da:b2 Iaid: IPaddr:192.168.39.211 Prefix:24 Hostname:old-k8s-version-435730 Clientid:01:52:54:00:e3:da:b2}
I0407 13:29:27.132371 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | domain old-k8s-version-435730 has defined IP address 192.168.39.211 and MAC address 52:54:00:e3:da:b2 in network mk-old-k8s-version-435730
I0407 13:29:27.132630 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetSSHHostname
I0407 13:29:27.135545 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | domain old-k8s-version-435730 has defined MAC address 52:54:00:e3:da:b2 in network mk-old-k8s-version-435730
I0407 13:29:27.135976 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e3:da:b2", ip: ""} in network mk-old-k8s-version-435730: {Iface:virbr1 ExpiryTime:2025-04-07 14:29:20 +0000 UTC Type:0 Mac:52:54:00:e3:da:b2 Iaid: IPaddr:192.168.39.211 Prefix:24 Hostname:old-k8s-version-435730 Clientid:01:52:54:00:e3:da:b2}
I0407 13:29:27.136032 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | domain old-k8s-version-435730 has defined IP address 192.168.39.211 and MAC address 52:54:00:e3:da:b2 in network mk-old-k8s-version-435730
I0407 13:29:27.136350 1206720 provision.go:143] copyHostCerts
I0407 13:29:27.136434 1206720 exec_runner.go:144] found /home/jenkins/minikube-integration/20602-1162386/.minikube/ca.pem, removing ...
I0407 13:29:27.136455 1206720 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20602-1162386/.minikube/ca.pem
I0407 13:29:27.136522 1206720 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20602-1162386/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20602-1162386/.minikube/ca.pem (1078 bytes)
I0407 13:29:27.136609 1206720 exec_runner.go:144] found /home/jenkins/minikube-integration/20602-1162386/.minikube/cert.pem, removing ...
I0407 13:29:27.136619 1206720 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20602-1162386/.minikube/cert.pem
I0407 13:29:27.136641 1206720 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20602-1162386/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20602-1162386/.minikube/cert.pem (1123 bytes)
I0407 13:29:27.136690 1206720 exec_runner.go:144] found /home/jenkins/minikube-integration/20602-1162386/.minikube/key.pem, removing ...
I0407 13:29:27.136697 1206720 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20602-1162386/.minikube/key.pem
I0407 13:29:27.136718 1206720 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20602-1162386/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20602-1162386/.minikube/key.pem (1675 bytes)
I0407 13:29:27.136790 1206720 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20602-1162386/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20602-1162386/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20602-1162386/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-435730 san=[127.0.0.1 192.168.39.211 localhost minikube old-k8s-version-435730]
I0407 13:29:27.669690 1206720 provision.go:177] copyRemoteCerts
I0407 13:29:27.669779 1206720 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0407 13:29:27.669817 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetSSHHostname
I0407 13:29:27.673258 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | domain old-k8s-version-435730 has defined MAC address 52:54:00:e3:da:b2 in network mk-old-k8s-version-435730
I0407 13:29:27.673664 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e3:da:b2", ip: ""} in network mk-old-k8s-version-435730: {Iface:virbr1 ExpiryTime:2025-04-07 14:29:20 +0000 UTC Type:0 Mac:52:54:00:e3:da:b2 Iaid: IPaddr:192.168.39.211 Prefix:24 Hostname:old-k8s-version-435730 Clientid:01:52:54:00:e3:da:b2}
I0407 13:29:27.673698 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | domain old-k8s-version-435730 has defined IP address 192.168.39.211 and MAC address 52:54:00:e3:da:b2 in network mk-old-k8s-version-435730
I0407 13:29:27.673845 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetSSHPort
I0407 13:29:27.674108 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetSSHKeyPath
I0407 13:29:27.674292 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetSSHUsername
I0407 13:29:27.674465 1206720 sshutil.go:53] new ssh client: &{IP:192.168.39.211 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20602-1162386/.minikube/machines/old-k8s-version-435730/id_rsa Username:docker}
I0407 13:29:27.761341 1206720 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20602-1162386/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0407 13:29:27.792470 1206720 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20602-1162386/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0407 13:29:27.821594 1206720 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20602-1162386/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0407 13:29:27.851663 1206720 provision.go:87] duration metric: took 723.502166ms to configureAuth
I0407 13:29:27.851706 1206720 buildroot.go:189] setting minikube options for container-runtime
I0407 13:29:27.851913 1206720 config.go:182] Loaded profile config "old-k8s-version-435730": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0407 13:29:27.852035 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetSSHHostname
I0407 13:29:27.855733 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | domain old-k8s-version-435730 has defined MAC address 52:54:00:e3:da:b2 in network mk-old-k8s-version-435730
I0407 13:29:27.856349 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e3:da:b2", ip: ""} in network mk-old-k8s-version-435730: {Iface:virbr1 ExpiryTime:2025-04-07 14:29:20 +0000 UTC Type:0 Mac:52:54:00:e3:da:b2 Iaid: IPaddr:192.168.39.211 Prefix:24 Hostname:old-k8s-version-435730 Clientid:01:52:54:00:e3:da:b2}
I0407 13:29:27.856377 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | domain old-k8s-version-435730 has defined IP address 192.168.39.211 and MAC address 52:54:00:e3:da:b2 in network mk-old-k8s-version-435730
I0407 13:29:27.856604 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetSSHPort
I0407 13:29:27.856861 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetSSHKeyPath
I0407 13:29:27.857014 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetSSHKeyPath
I0407 13:29:27.857156 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetSSHUsername
I0407 13:29:27.857345 1206720 main.go:141] libmachine: Using SSH client type: native
I0407 13:29:27.857581 1206720 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.39.211 22 <nil> <nil>}
I0407 13:29:27.857600 1206720 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0407 13:29:28.103926 1206720 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0407 13:29:28.103957 1206720 main.go:141] libmachine: Checking connection to Docker...
I0407 13:29:28.103970 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetURL
I0407 13:29:28.105591 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | using libvirt version 6000000
I0407 13:29:28.109746 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | domain old-k8s-version-435730 has defined MAC address 52:54:00:e3:da:b2 in network mk-old-k8s-version-435730
I0407 13:29:28.110525 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e3:da:b2", ip: ""} in network mk-old-k8s-version-435730: {Iface:virbr1 ExpiryTime:2025-04-07 14:29:20 +0000 UTC Type:0 Mac:52:54:00:e3:da:b2 Iaid: IPaddr:192.168.39.211 Prefix:24 Hostname:old-k8s-version-435730 Clientid:01:52:54:00:e3:da:b2}
I0407 13:29:28.110573 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | domain old-k8s-version-435730 has defined IP address 192.168.39.211 and MAC address 52:54:00:e3:da:b2 in network mk-old-k8s-version-435730
I0407 13:29:28.110897 1206720 main.go:141] libmachine: Docker is up and running!
I0407 13:29:28.110921 1206720 main.go:141] libmachine: Reticulating splines...
I0407 13:29:28.110931 1206720 client.go:171] duration metric: took 24.97532972s to LocalClient.Create
I0407 13:29:28.110964 1206720 start.go:167] duration metric: took 24.97540235s to libmachine.API.Create "old-k8s-version-435730"
I0407 13:29:28.110974 1206720 start.go:293] postStartSetup for "old-k8s-version-435730" (driver="kvm2")
I0407 13:29:28.110986 1206720 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0407 13:29:28.111046 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .DriverName
I0407 13:29:28.111444 1206720 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0407 13:29:28.111485 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetSSHHostname
I0407 13:29:28.114671 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | domain old-k8s-version-435730 has defined MAC address 52:54:00:e3:da:b2 in network mk-old-k8s-version-435730
I0407 13:29:28.115092 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e3:da:b2", ip: ""} in network mk-old-k8s-version-435730: {Iface:virbr1 ExpiryTime:2025-04-07 14:29:20 +0000 UTC Type:0 Mac:52:54:00:e3:da:b2 Iaid: IPaddr:192.168.39.211 Prefix:24 Hostname:old-k8s-version-435730 Clientid:01:52:54:00:e3:da:b2}
I0407 13:29:28.115127 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | domain old-k8s-version-435730 has defined IP address 192.168.39.211 and MAC address 52:54:00:e3:da:b2 in network mk-old-k8s-version-435730
I0407 13:29:28.115299 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetSSHPort
I0407 13:29:28.115590 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetSSHKeyPath
I0407 13:29:28.115819 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetSSHUsername
I0407 13:29:28.116009 1206720 sshutil.go:53] new ssh client: &{IP:192.168.39.211 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20602-1162386/.minikube/machines/old-k8s-version-435730/id_rsa Username:docker}
I0407 13:29:28.200794 1206720 ssh_runner.go:195] Run: cat /etc/os-release
I0407 13:29:28.205856 1206720 info.go:137] Remote host: Buildroot 2023.02.9
I0407 13:29:28.205899 1206720 filesync.go:126] Scanning /home/jenkins/minikube-integration/20602-1162386/.minikube/addons for local assets ...
I0407 13:29:28.205988 1206720 filesync.go:126] Scanning /home/jenkins/minikube-integration/20602-1162386/.minikube/files for local assets ...
I0407 13:29:28.206122 1206720 filesync.go:149] local asset: /home/jenkins/minikube-integration/20602-1162386/.minikube/files/etc/ssl/certs/11697162.pem -> 11697162.pem in /etc/ssl/certs
I0407 13:29:28.206286 1206720 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0407 13:29:28.217630 1206720 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20602-1162386/.minikube/files/etc/ssl/certs/11697162.pem --> /etc/ssl/certs/11697162.pem (1708 bytes)
I0407 13:29:28.245540 1206720 start.go:296] duration metric: took 134.546886ms for postStartSetup
I0407 13:29:28.245617 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetConfigRaw
I0407 13:29:28.246576 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetIP
I0407 13:29:28.250438 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | domain old-k8s-version-435730 has defined MAC address 52:54:00:e3:da:b2 in network mk-old-k8s-version-435730
I0407 13:29:28.250990 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e3:da:b2", ip: ""} in network mk-old-k8s-version-435730: {Iface:virbr1 ExpiryTime:2025-04-07 14:29:20 +0000 UTC Type:0 Mac:52:54:00:e3:da:b2 Iaid: IPaddr:192.168.39.211 Prefix:24 Hostname:old-k8s-version-435730 Clientid:01:52:54:00:e3:da:b2}
I0407 13:29:28.251005 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | domain old-k8s-version-435730 has defined IP address 192.168.39.211 and MAC address 52:54:00:e3:da:b2 in network mk-old-k8s-version-435730
I0407 13:29:28.251414 1206720 profile.go:143] Saving config to /home/jenkins/minikube-integration/20602-1162386/.minikube/profiles/old-k8s-version-435730/config.json ...
I0407 13:29:28.251655 1206720 start.go:128] duration metric: took 25.138267404s to createHost
I0407 13:29:28.251688 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetSSHHostname
I0407 13:29:28.255096 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | domain old-k8s-version-435730 has defined MAC address 52:54:00:e3:da:b2 in network mk-old-k8s-version-435730
I0407 13:29:28.255468 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e3:da:b2", ip: ""} in network mk-old-k8s-version-435730: {Iface:virbr1 ExpiryTime:2025-04-07 14:29:20 +0000 UTC Type:0 Mac:52:54:00:e3:da:b2 Iaid: IPaddr:192.168.39.211 Prefix:24 Hostname:old-k8s-version-435730 Clientid:01:52:54:00:e3:da:b2}
I0407 13:29:28.255506 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | domain old-k8s-version-435730 has defined IP address 192.168.39.211 and MAC address 52:54:00:e3:da:b2 in network mk-old-k8s-version-435730
I0407 13:29:28.255704 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetSSHPort
I0407 13:29:28.255996 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetSSHKeyPath
I0407 13:29:28.256275 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetSSHKeyPath
I0407 13:29:28.256566 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetSSHUsername
I0407 13:29:28.256814 1206720 main.go:141] libmachine: Using SSH client type: native
I0407 13:29:28.257053 1206720 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.39.211 22 <nil> <nil>}
I0407 13:29:28.257068 1206720 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0407 13:29:28.367370 1206720 main.go:141] libmachine: SSH cmd err, output: <nil>: 1744032568.335280597
I0407 13:29:28.367398 1206720 fix.go:216] guest clock: 1744032568.335280597
I0407 13:29:28.367406 1206720 fix.go:229] Guest: 2025-04-07 13:29:28.335280597 +0000 UTC Remote: 2025-04-07 13:29:28.251668506 +0000 UTC m=+25.308284461 (delta=83.612091ms)
I0407 13:29:28.367452 1206720 fix.go:200] guest clock delta is within tolerance: 83.612091ms
I0407 13:29:28.367458 1206720 start.go:83] releasing machines lock for "old-k8s-version-435730", held for 25.254184932s
I0407 13:29:28.367488 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .DriverName
I0407 13:29:28.367848 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetIP
I0407 13:29:28.371613 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | domain old-k8s-version-435730 has defined MAC address 52:54:00:e3:da:b2 in network mk-old-k8s-version-435730
I0407 13:29:28.372180 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e3:da:b2", ip: ""} in network mk-old-k8s-version-435730: {Iface:virbr1 ExpiryTime:2025-04-07 14:29:20 +0000 UTC Type:0 Mac:52:54:00:e3:da:b2 Iaid: IPaddr:192.168.39.211 Prefix:24 Hostname:old-k8s-version-435730 Clientid:01:52:54:00:e3:da:b2}
I0407 13:29:28.372218 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | domain old-k8s-version-435730 has defined IP address 192.168.39.211 and MAC address 52:54:00:e3:da:b2 in network mk-old-k8s-version-435730
I0407 13:29:28.372471 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .DriverName
I0407 13:29:28.373324 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .DriverName
I0407 13:29:28.373604 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .DriverName
I0407 13:29:28.373735 1206720 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0407 13:29:28.373794 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetSSHHostname
I0407 13:29:28.373927 1206720 ssh_runner.go:195] Run: cat /version.json
I0407 13:29:28.373952 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetSSHHostname
I0407 13:29:28.378582 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | domain old-k8s-version-435730 has defined MAC address 52:54:00:e3:da:b2 in network mk-old-k8s-version-435730
I0407 13:29:28.379956 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e3:da:b2", ip: ""} in network mk-old-k8s-version-435730: {Iface:virbr1 ExpiryTime:2025-04-07 14:29:20 +0000 UTC Type:0 Mac:52:54:00:e3:da:b2 Iaid: IPaddr:192.168.39.211 Prefix:24 Hostname:old-k8s-version-435730 Clientid:01:52:54:00:e3:da:b2}
I0407 13:29:28.380038 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | domain old-k8s-version-435730 has defined IP address 192.168.39.211 and MAC address 52:54:00:e3:da:b2 in network mk-old-k8s-version-435730
I0407 13:29:28.380071 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | domain old-k8s-version-435730 has defined MAC address 52:54:00:e3:da:b2 in network mk-old-k8s-version-435730
I0407 13:29:28.380199 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetSSHPort
I0407 13:29:28.380523 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetSSHKeyPath
I0407 13:29:28.380848 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetSSHUsername
I0407 13:29:28.380864 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e3:da:b2", ip: ""} in network mk-old-k8s-version-435730: {Iface:virbr1 ExpiryTime:2025-04-07 14:29:20 +0000 UTC Type:0 Mac:52:54:00:e3:da:b2 Iaid: IPaddr:192.168.39.211 Prefix:24 Hostname:old-k8s-version-435730 Clientid:01:52:54:00:e3:da:b2}
I0407 13:29:28.380888 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | domain old-k8s-version-435730 has defined IP address 192.168.39.211 and MAC address 52:54:00:e3:da:b2 in network mk-old-k8s-version-435730
I0407 13:29:28.381126 1206720 sshutil.go:53] new ssh client: &{IP:192.168.39.211 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20602-1162386/.minikube/machines/old-k8s-version-435730/id_rsa Username:docker}
I0407 13:29:28.381312 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetSSHPort
I0407 13:29:28.381803 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetSSHKeyPath
I0407 13:29:28.382130 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetSSHUsername
I0407 13:29:28.382455 1206720 sshutil.go:53] new ssh client: &{IP:192.168.39.211 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20602-1162386/.minikube/machines/old-k8s-version-435730/id_rsa Username:docker}
I0407 13:29:28.490819 1206720 ssh_runner.go:195] Run: systemctl --version
I0407 13:29:28.497732 1206720 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0407 13:29:28.678766 1206720 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0407 13:29:28.687049 1206720 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0407 13:29:28.687134 1206720 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0407 13:29:28.706772 1206720 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0407 13:29:28.706802 1206720 start.go:495] detecting cgroup driver to use...
I0407 13:29:28.706869 1206720 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0407 13:29:28.724653 1206720 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0407 13:29:28.741640 1206720 docker.go:217] disabling cri-docker service (if available) ...
I0407 13:29:28.741734 1206720 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0407 13:29:28.758064 1206720 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0407 13:29:28.774056 1206720 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0407 13:29:28.910469 1206720 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0407 13:29:29.080892 1206720 docker.go:233] disabling docker service ...
I0407 13:29:29.080988 1206720 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0407 13:29:29.097231 1206720 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0407 13:29:29.111574 1206720 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0407 13:29:29.247464 1206720 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0407 13:29:29.365355 1206720 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0407 13:29:29.381585 1206720 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0407 13:29:29.402855 1206720 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0407 13:29:29.402938 1206720 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0407 13:29:29.415141 1206720 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0407 13:29:29.415242 1206720 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0407 13:29:29.427470 1206720 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0407 13:29:29.438411 1206720 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0407 13:29:29.451530 1206720 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0407 13:29:29.463469 1206720 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0407 13:29:29.473950 1206720 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0407 13:29:29.474035 1206720 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0407 13:29:29.491064 1206720 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0407 13:29:29.503193 1206720 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0407 13:29:29.621593 1206720 ssh_runner.go:195] Run: sudo systemctl restart crio
I0407 13:29:29.728587 1206720 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0407 13:29:29.728757 1206720 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0407 13:29:29.734070 1206720 start.go:563] Will wait 60s for crictl version
I0407 13:29:29.734142 1206720 ssh_runner.go:195] Run: which crictl
I0407 13:29:29.738694 1206720 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0407 13:29:29.779804 1206720 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0407 13:29:29.779892 1206720 ssh_runner.go:195] Run: crio --version
I0407 13:29:29.810551 1206720 ssh_runner.go:195] Run: crio --version
I0407 13:29:29.847945 1206720 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0407 13:29:29.850474 1206720 main.go:141] libmachine: (old-k8s-version-435730) Calling .GetIP
I0407 13:29:29.854967 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | domain old-k8s-version-435730 has defined MAC address 52:54:00:e3:da:b2 in network mk-old-k8s-version-435730
I0407 13:29:29.855481 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e3:da:b2", ip: ""} in network mk-old-k8s-version-435730: {Iface:virbr1 ExpiryTime:2025-04-07 14:29:20 +0000 UTC Type:0 Mac:52:54:00:e3:da:b2 Iaid: IPaddr:192.168.39.211 Prefix:24 Hostname:old-k8s-version-435730 Clientid:01:52:54:00:e3:da:b2}
I0407 13:29:29.855512 1206720 main.go:141] libmachine: (old-k8s-version-435730) DBG | domain old-k8s-version-435730 has defined IP address 192.168.39.211 and MAC address 52:54:00:e3:da:b2 in network mk-old-k8s-version-435730
I0407 13:29:29.855839 1206720 ssh_runner.go:195] Run: grep 192.168.39.1 host.minikube.internal$ /etc/hosts
I0407 13:29:29.861457 1206720 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0407 13:29:29.877866 1206720 kubeadm.go:883] updating cluster {Name:old-k8s-version-435730 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1743675393-20591@sha256:8de8167e280414c9d16e4c3da59bc85bc7c9cc24228af995863fc7bcabfcf727 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-
version-435730 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.211 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountU
ID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0407 13:29:29.878036 1206720 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0407 13:29:29.878200 1206720 ssh_runner.go:195] Run: sudo crictl images --output json
I0407 13:29:29.926522 1206720 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0407 13:29:29.926611 1206720 ssh_runner.go:195] Run: which lz4
I0407 13:29:29.931012 1206720 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0407 13:29:29.936235 1206720 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0407 13:29:29.936302 1206720 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20602-1162386/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0407 13:29:31.840518 1206720 crio.go:462] duration metric: took 1.909545488s to copy over tarball
I0407 13:29:31.840612 1206720 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0407 13:29:34.726791 1206720 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.886144371s)
I0407 13:29:34.726829 1206720 crio.go:469] duration metric: took 2.886276173s to extract the tarball
I0407 13:29:34.726841 1206720 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0407 13:29:34.771380 1206720 ssh_runner.go:195] Run: sudo crictl images --output json
I0407 13:29:34.827791 1206720 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0407 13:29:34.827832 1206720 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0407 13:29:34.827889 1206720 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0407 13:29:34.827921 1206720 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0407 13:29:34.827953 1206720 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I0407 13:29:34.827971 1206720 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0407 13:29:34.828024 1206720 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I0407 13:29:34.828063 1206720 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0407 13:29:34.828076 1206720 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0407 13:29:34.828198 1206720 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0407 13:29:34.829615 1206720 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0407 13:29:34.829647 1206720 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0407 13:29:34.829684 1206720 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0407 13:29:34.829762 1206720 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0407 13:29:34.829778 1206720 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0407 13:29:34.829616 1206720 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0407 13:29:34.829808 1206720 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0407 13:29:34.829930 1206720 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0407 13:29:34.978992 1206720 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0407 13:29:34.996027 1206720 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0407 13:29:34.996628 1206720 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0407 13:29:35.004669 1206720 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0407 13:29:35.004693 1206720 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0407 13:29:35.006599 1206720 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0407 13:29:35.014363 1206720 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0407 13:29:35.085912 1206720 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0407 13:29:35.085972 1206720 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0407 13:29:35.086054 1206720 ssh_runner.go:195] Run: which crictl
I0407 13:29:35.141406 1206720 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0407 13:29:35.141478 1206720 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0407 13:29:35.141526 1206720 ssh_runner.go:195] Run: which crictl
I0407 13:29:35.153779 1206720 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0407 13:29:35.153842 1206720 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0407 13:29:35.153897 1206720 ssh_runner.go:195] Run: which crictl
I0407 13:29:35.185600 1206720 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0407 13:29:35.185667 1206720 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0407 13:29:35.185683 1206720 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0407 13:29:35.185746 1206720 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0407 13:29:35.185797 1206720 ssh_runner.go:195] Run: which crictl
I0407 13:29:35.185809 1206720 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0407 13:29:35.185849 1206720 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0407 13:29:35.185919 1206720 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0407 13:29:35.185926 1206720 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0407 13:29:35.185940 1206720 ssh_runner.go:195] Run: which crictl
I0407 13:29:35.185748 1206720 ssh_runner.go:195] Run: which crictl
I0407 13:29:35.185745 1206720 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0407 13:29:35.186022 1206720 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0407 13:29:35.186028 1206720 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0407 13:29:35.186056 1206720 ssh_runner.go:195] Run: which crictl
I0407 13:29:35.258255 1206720 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0407 13:29:35.258327 1206720 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0407 13:29:35.258362 1206720 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0407 13:29:35.258331 1206720 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0407 13:29:35.277507 1206720 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0407 13:29:35.277529 1206720 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0407 13:29:35.277644 1206720 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0407 13:29:35.400929 1206720 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0407 13:29:35.400977 1206720 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0407 13:29:35.419669 1206720 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0407 13:29:35.419746 1206720 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0407 13:29:35.448603 1206720 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0407 13:29:35.455911 1206720 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0407 13:29:35.455969 1206720 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0407 13:29:35.559100 1206720 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0407 13:29:35.559247 1206720 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0407 13:29:35.568988 1206720 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20602-1162386/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0407 13:29:35.569108 1206720 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0407 13:29:35.614493 1206720 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20602-1162386/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0407 13:29:35.622906 1206720 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20602-1162386/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0407 13:29:35.623018 1206720 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0407 13:29:35.680918 1206720 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20602-1162386/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0407 13:29:35.680942 1206720 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20602-1162386/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0407 13:29:35.681005 1206720 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20602-1162386/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0407 13:29:35.703560 1206720 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20602-1162386/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0407 13:29:36.504350 1206720 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0407 13:29:36.647645 1206720 cache_images.go:92] duration metric: took 1.81979062s to LoadCachedImages
W0407 13:29:36.647769 1206720 out.go:270] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20602-1162386/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20602-1162386/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0: no such file or directory
I0407 13:29:36.647787 1206720 kubeadm.go:934] updating node { 192.168.39.211 8443 v1.20.0 crio true true} ...
I0407 13:29:36.648067 1206720 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-435730 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.39.211
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-435730 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0407 13:29:36.648185 1206720 ssh_runner.go:195] Run: crio config
I0407 13:29:36.700774 1206720 cni.go:84] Creating CNI manager for ""
I0407 13:29:36.700801 1206720 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0407 13:29:36.700814 1206720 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0407 13:29:36.700838 1206720 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.211 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-435730 NodeName:old-k8s-version-435730 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.211"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.211 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0407 13:29:36.700990 1206720 kubeadm.go:195] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.39.211
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-435730"
kubeletExtraArgs:
node-ip: 192.168.39.211
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.39.211"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0407 13:29:36.701102 1206720 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0407 13:29:36.712553 1206720 binaries.go:44] Found k8s binaries, skipping transfer
I0407 13:29:36.712647 1206720 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0407 13:29:36.725514 1206720 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0407 13:29:36.745734 1206720 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0407 13:29:36.764465 1206720 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2123 bytes)
I0407 13:29:36.784025 1206720 ssh_runner.go:195] Run: grep 192.168.39.211 control-plane.minikube.internal$ /etc/hosts
I0407 13:29:36.789365 1206720 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.211 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0407 13:29:36.805248 1206720 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0407 13:29:36.965627 1206720 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0407 13:29:36.985431 1206720 certs.go:68] Setting up /home/jenkins/minikube-integration/20602-1162386/.minikube/profiles/old-k8s-version-435730 for IP: 192.168.39.211
I0407 13:29:36.985472 1206720 certs.go:194] generating shared ca certs ...
I0407 13:29:36.985516 1206720 certs.go:226] acquiring lock for ca certs: {Name:mk8e89191fca7f2111bdd08c345368f593b0d5d0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0407 13:29:36.985760 1206720 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20602-1162386/.minikube/ca.key
I0407 13:29:36.985823 1206720 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20602-1162386/.minikube/proxy-client-ca.key
I0407 13:29:36.985839 1206720 certs.go:256] generating profile certs ...
I0407 13:29:36.985926 1206720 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/20602-1162386/.minikube/profiles/old-k8s-version-435730/client.key
I0407 13:29:36.985963 1206720 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20602-1162386/.minikube/profiles/old-k8s-version-435730/client.crt with IP's: []
I0407 13:29:37.248216 1206720 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20602-1162386/.minikube/profiles/old-k8s-version-435730/client.crt ...
I0407 13:29:37.248255 1206720 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20602-1162386/.minikube/profiles/old-k8s-version-435730/client.crt: {Name:mk3cdd3eb059e643128e83ffb648bc8e5f5e06eb Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0407 13:29:37.248463 1206720 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20602-1162386/.minikube/profiles/old-k8s-version-435730/client.key ...
I0407 13:29:37.248483 1206720 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20602-1162386/.minikube/profiles/old-k8s-version-435730/client.key: {Name:mk20f511327f90d4ac4d61b37474f7384f6e2ee7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0407 13:29:37.248619 1206720 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/20602-1162386/.minikube/profiles/old-k8s-version-435730/apiserver.key.7d731b07
I0407 13:29:37.248649 1206720 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20602-1162386/.minikube/profiles/old-k8s-version-435730/apiserver.crt.7d731b07 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.211]
I0407 13:29:37.499314 1206720 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20602-1162386/.minikube/profiles/old-k8s-version-435730/apiserver.crt.7d731b07 ...
I0407 13:29:37.499357 1206720 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20602-1162386/.minikube/profiles/old-k8s-version-435730/apiserver.crt.7d731b07: {Name:mkc782a9c7b44e5fc3216a2ec9f08c083ff0a48c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0407 13:29:37.499578 1206720 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20602-1162386/.minikube/profiles/old-k8s-version-435730/apiserver.key.7d731b07 ...
I0407 13:29:37.499596 1206720 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20602-1162386/.minikube/profiles/old-k8s-version-435730/apiserver.key.7d731b07: {Name:mk8336111df6062c85f0a548e4bb2dcc742b302b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0407 13:29:37.499705 1206720 certs.go:381] copying /home/jenkins/minikube-integration/20602-1162386/.minikube/profiles/old-k8s-version-435730/apiserver.crt.7d731b07 -> /home/jenkins/minikube-integration/20602-1162386/.minikube/profiles/old-k8s-version-435730/apiserver.crt
I0407 13:29:37.499804 1206720 certs.go:385] copying /home/jenkins/minikube-integration/20602-1162386/.minikube/profiles/old-k8s-version-435730/apiserver.key.7d731b07 -> /home/jenkins/minikube-integration/20602-1162386/.minikube/profiles/old-k8s-version-435730/apiserver.key
I0407 13:29:37.499886 1206720 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/20602-1162386/.minikube/profiles/old-k8s-version-435730/proxy-client.key
I0407 13:29:37.499909 1206720 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20602-1162386/.minikube/profiles/old-k8s-version-435730/proxy-client.crt with IP's: []
I0407 13:29:37.779389 1206720 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20602-1162386/.minikube/profiles/old-k8s-version-435730/proxy-client.crt ...
I0407 13:29:37.779436 1206720 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20602-1162386/.minikube/profiles/old-k8s-version-435730/proxy-client.crt: {Name:mk212e670bf841c8860d6efaca1fea6d1cacbc3d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0407 13:29:37.779626 1206720 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20602-1162386/.minikube/profiles/old-k8s-version-435730/proxy-client.key ...
I0407 13:29:37.779642 1206720 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20602-1162386/.minikube/profiles/old-k8s-version-435730/proxy-client.key: {Name:mkec86cff69d764c5dbad525d3ce7ccae5565641 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0407 13:29:37.779816 1206720 certs.go:484] found cert: /home/jenkins/minikube-integration/20602-1162386/.minikube/certs/1169716.pem (1338 bytes)
W0407 13:29:37.779857 1206720 certs.go:480] ignoring /home/jenkins/minikube-integration/20602-1162386/.minikube/certs/1169716_empty.pem, impossibly tiny 0 bytes
I0407 13:29:37.779865 1206720 certs.go:484] found cert: /home/jenkins/minikube-integration/20602-1162386/.minikube/certs/ca-key.pem (1675 bytes)
I0407 13:29:37.779886 1206720 certs.go:484] found cert: /home/jenkins/minikube-integration/20602-1162386/.minikube/certs/ca.pem (1078 bytes)
I0407 13:29:37.779906 1206720 certs.go:484] found cert: /home/jenkins/minikube-integration/20602-1162386/.minikube/certs/cert.pem (1123 bytes)
I0407 13:29:37.779926 1206720 certs.go:484] found cert: /home/jenkins/minikube-integration/20602-1162386/.minikube/certs/key.pem (1675 bytes)
I0407 13:29:37.779964 1206720 certs.go:484] found cert: /home/jenkins/minikube-integration/20602-1162386/.minikube/files/etc/ssl/certs/11697162.pem (1708 bytes)
I0407 13:29:37.780529 1206720 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20602-1162386/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0407 13:29:37.818034 1206720 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20602-1162386/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0407 13:29:37.847761 1206720 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20602-1162386/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0407 13:29:37.881896 1206720 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20602-1162386/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0407 13:29:37.919939 1206720 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20602-1162386/.minikube/profiles/old-k8s-version-435730/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0407 13:29:37.947720 1206720 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20602-1162386/.minikube/profiles/old-k8s-version-435730/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0407 13:29:37.974521 1206720 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20602-1162386/.minikube/profiles/old-k8s-version-435730/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0407 13:29:38.002608 1206720 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20602-1162386/.minikube/profiles/old-k8s-version-435730/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0407 13:29:38.030916 1206720 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20602-1162386/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0407 13:29:38.060591 1206720 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20602-1162386/.minikube/certs/1169716.pem --> /usr/share/ca-certificates/1169716.pem (1338 bytes)
I0407 13:29:38.087276 1206720 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20602-1162386/.minikube/files/etc/ssl/certs/11697162.pem --> /usr/share/ca-certificates/11697162.pem (1708 bytes)
I0407 13:29:38.115268 1206720 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0407 13:29:38.134524 1206720 ssh_runner.go:195] Run: openssl version
I0407 13:29:38.140700 1206720 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/11697162.pem && ln -fs /usr/share/ca-certificates/11697162.pem /etc/ssl/certs/11697162.pem"
I0407 13:29:38.152939 1206720 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/11697162.pem
I0407 13:29:38.158568 1206720 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Apr 7 12:22 /usr/share/ca-certificates/11697162.pem
I0407 13:29:38.158658 1206720 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/11697162.pem
I0407 13:29:38.165454 1206720 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/11697162.pem /etc/ssl/certs/3ec20f2e.0"
I0407 13:29:38.178649 1206720 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0407 13:29:38.191377 1206720 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0407 13:29:38.196993 1206720 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Apr 7 12:14 /usr/share/ca-certificates/minikubeCA.pem
I0407 13:29:38.197089 1206720 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0407 13:29:38.203627 1206720 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0407 13:29:38.215552 1206720 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1169716.pem && ln -fs /usr/share/ca-certificates/1169716.pem /etc/ssl/certs/1169716.pem"
I0407 13:29:38.226935 1206720 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1169716.pem
I0407 13:29:38.231926 1206720 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Apr 7 12:22 /usr/share/ca-certificates/1169716.pem
I0407 13:29:38.232012 1206720 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1169716.pem
I0407 13:29:38.238163 1206720 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1169716.pem /etc/ssl/certs/51391683.0"
I0407 13:29:38.250257 1206720 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0407 13:29:38.255173 1206720 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0407 13:29:38.255273 1206720 kubeadm.go:392] StartCluster: {Name:old-k8s-version-435730 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1743675393-20591@sha256:8de8167e280414c9d16e4c3da59bc85bc7c9cc24228af995863fc7bcabfcf727 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-ver
sion-435730 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.211 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:
docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0407 13:29:38.255382 1206720 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0407 13:29:38.255463 1206720 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0407 13:29:38.297804 1206720 cri.go:89] found id: ""
I0407 13:29:38.297898 1206720 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0407 13:29:38.309895 1206720 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0407 13:29:38.322361 1206720 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0407 13:29:38.334411 1206720 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0407 13:29:38.334443 1206720 kubeadm.go:157] found existing configuration files:
I0407 13:29:38.334506 1206720 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0407 13:29:38.345811 1206720 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0407 13:29:38.345888 1206720 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0407 13:29:38.356796 1206720 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0407 13:29:38.366507 1206720 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0407 13:29:38.366582 1206720 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0407 13:29:38.377100 1206720 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0407 13:29:38.387477 1206720 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0407 13:29:38.387548 1206720 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0407 13:29:38.398271 1206720 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0407 13:29:38.410130 1206720 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0407 13:29:38.410218 1206720 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0407 13:29:38.422390 1206720 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0407 13:29:38.560776 1206720 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0407 13:29:38.560868 1206720 kubeadm.go:310] [preflight] Running pre-flight checks
I0407 13:29:38.715852 1206720 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0407 13:29:38.716058 1206720 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0407 13:29:38.716206 1206720 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0407 13:29:38.909274 1206720 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0407 13:29:38.911667 1206720 out.go:235] - Generating certificates and keys ...
I0407 13:29:38.911808 1206720 kubeadm.go:310] [certs] Using existing ca certificate authority
I0407 13:29:38.911923 1206720 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0407 13:29:39.091094 1206720 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0407 13:29:39.283525 1206720 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0407 13:29:39.413364 1206720 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0407 13:29:39.694986 1206720 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0407 13:29:39.846396 1206720 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0407 13:29:39.848193 1206720 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-435730] and IPs [192.168.39.211 127.0.0.1 ::1]
I0407 13:29:39.928837 1206720 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0407 13:29:39.929085 1206720 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-435730] and IPs [192.168.39.211 127.0.0.1 ::1]
I0407 13:29:40.096707 1206720 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0407 13:29:40.226194 1206720 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0407 13:29:40.386369 1206720 kubeadm.go:310] [certs] Generating "sa" key and public key
I0407 13:29:40.386752 1206720 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0407 13:29:40.476370 1206720 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0407 13:29:40.868146 1206720 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0407 13:29:41.223858 1206720 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0407 13:29:41.325409 1206720 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0407 13:29:41.354600 1206720 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0407 13:29:41.356003 1206720 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0407 13:29:41.356259 1206720 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0407 13:29:41.546020 1206720 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0407 13:29:41.550048 1206720 out.go:235] - Booting up control plane ...
I0407 13:29:41.550294 1206720 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0407 13:29:41.550439 1206720 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0407 13:29:41.550554 1206720 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0407 13:29:41.551567 1206720 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0407 13:29:41.557175 1206720 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0407 13:30:21.547856 1206720 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0407 13:30:21.548096 1206720 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0407 13:30:21.548390 1206720 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0407 13:30:26.549001 1206720 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0407 13:30:26.549330 1206720 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0407 13:30:36.549118 1206720 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0407 13:30:36.549392 1206720 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0407 13:30:56.548639 1206720 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0407 13:30:56.548905 1206720 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0407 13:31:36.549773 1206720 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0407 13:31:36.550080 1206720 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0407 13:31:36.550109 1206720 kubeadm.go:310]
I0407 13:31:36.550289 1206720 kubeadm.go:310] Unfortunately, an error has occurred:
I0407 13:31:36.550360 1206720 kubeadm.go:310] timed out waiting for the condition
I0407 13:31:36.550378 1206720 kubeadm.go:310]
I0407 13:31:36.550414 1206720 kubeadm.go:310] This error is likely caused by:
I0407 13:31:36.550456 1206720 kubeadm.go:310] - The kubelet is not running
I0407 13:31:36.550555 1206720 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0407 13:31:36.550563 1206720 kubeadm.go:310]
I0407 13:31:36.550643 1206720 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0407 13:31:36.550673 1206720 kubeadm.go:310] - 'systemctl status kubelet'
I0407 13:31:36.550701 1206720 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0407 13:31:36.550707 1206720 kubeadm.go:310]
I0407 13:31:36.550853 1206720 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0407 13:31:36.551010 1206720 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0407 13:31:36.551025 1206720 kubeadm.go:310]
I0407 13:31:36.551231 1206720 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0407 13:31:36.551374 1206720 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0407 13:31:36.551483 1206720 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0407 13:31:36.551585 1206720 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0407 13:31:36.551619 1206720 kubeadm.go:310]
I0407 13:31:36.551783 1206720 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0407 13:31:36.551924 1206720 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0407 13:31:36.552091 1206720 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
W0407 13:31:36.552224 1206720 out.go:270] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-435730] and IPs [192.168.39.211 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-435730] and IPs [192.168.39.211 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-435730] and IPs [192.168.39.211 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-435730] and IPs [192.168.39.211 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0407 13:31:36.552276 1206720 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0407 13:31:39.647067 1206720 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (3.094752316s)
I0407 13:31:39.647176 1206720 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0407 13:31:39.661376 1206720 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0407 13:31:39.671867 1206720 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0407 13:31:39.671891 1206720 kubeadm.go:157] found existing configuration files:
I0407 13:31:39.671978 1206720 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0407 13:31:39.682357 1206720 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0407 13:31:39.682439 1206720 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0407 13:31:39.692933 1206720 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0407 13:31:39.703192 1206720 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0407 13:31:39.703282 1206720 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0407 13:31:39.716110 1206720 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0407 13:31:39.727995 1206720 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0407 13:31:39.728081 1206720 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0407 13:31:39.738829 1206720 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0407 13:31:39.749268 1206720 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0407 13:31:39.749366 1206720 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0407 13:31:39.760373 1206720 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0407 13:31:40.016833 1206720 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0407 13:33:35.983488 1206720 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0407 13:33:35.983622 1206720 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0407 13:33:35.985329 1206720 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0407 13:33:35.985403 1206720 kubeadm.go:310] [preflight] Running pre-flight checks
I0407 13:33:35.985523 1206720 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0407 13:33:35.985698 1206720 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0407 13:33:35.985849 1206720 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0407 13:33:35.985943 1206720 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0407 13:33:35.988815 1206720 out.go:235] - Generating certificates and keys ...
I0407 13:33:35.988955 1206720 kubeadm.go:310] [certs] Using existing ca certificate authority
I0407 13:33:35.989172 1206720 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0407 13:33:35.989272 1206720 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0407 13:33:35.989326 1206720 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0407 13:33:35.989381 1206720 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0407 13:33:35.989426 1206720 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0407 13:33:35.989482 1206720 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0407 13:33:35.989531 1206720 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0407 13:33:35.989592 1206720 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0407 13:33:35.989680 1206720 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0407 13:33:35.989755 1206720 kubeadm.go:310] [certs] Using the existing "sa" key
I0407 13:33:35.989828 1206720 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0407 13:33:35.989894 1206720 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0407 13:33:35.989950 1206720 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0407 13:33:35.990034 1206720 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0407 13:33:35.990106 1206720 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0407 13:33:35.990240 1206720 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0407 13:33:35.990347 1206720 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0407 13:33:35.990387 1206720 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0407 13:33:35.990447 1206720 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0407 13:33:35.992917 1206720 out.go:235] - Booting up control plane ...
I0407 13:33:35.993087 1206720 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0407 13:33:35.993218 1206720 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0407 13:33:35.993309 1206720 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0407 13:33:35.993619 1206720 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0407 13:33:35.994137 1206720 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0407 13:33:35.994228 1206720 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0407 13:33:35.994390 1206720 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0407 13:33:35.994623 1206720 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0407 13:33:35.994721 1206720 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0407 13:33:35.995119 1206720 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0407 13:33:35.995280 1206720 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0407 13:33:35.995555 1206720 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0407 13:33:35.995642 1206720 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0407 13:33:35.996034 1206720 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0407 13:33:35.996146 1206720 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0407 13:33:35.996474 1206720 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0407 13:33:35.996493 1206720 kubeadm.go:310]
I0407 13:33:35.996546 1206720 kubeadm.go:310] Unfortunately, an error has occurred:
I0407 13:33:35.996596 1206720 kubeadm.go:310] timed out waiting for the condition
I0407 13:33:35.996606 1206720 kubeadm.go:310]
I0407 13:33:35.996652 1206720 kubeadm.go:310] This error is likely caused by:
I0407 13:33:35.996725 1206720 kubeadm.go:310] - The kubelet is not running
I0407 13:33:35.996854 1206720 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0407 13:33:35.996868 1206720 kubeadm.go:310]
I0407 13:33:35.997004 1206720 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0407 13:33:35.997050 1206720 kubeadm.go:310] - 'systemctl status kubelet'
I0407 13:33:35.997092 1206720 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0407 13:33:35.997101 1206720 kubeadm.go:310]
I0407 13:33:35.997231 1206720 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0407 13:33:35.997363 1206720 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0407 13:33:35.997390 1206720 kubeadm.go:310]
I0407 13:33:35.997572 1206720 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0407 13:33:35.997696 1206720 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0407 13:33:35.997842 1206720 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0407 13:33:35.997967 1206720 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0407 13:33:35.998064 1206720 kubeadm.go:310]
I0407 13:33:35.998078 1206720 kubeadm.go:394] duration metric: took 3m57.742805034s to StartCluster
I0407 13:33:35.998139 1206720 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0407 13:33:35.998243 1206720 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0407 13:33:36.050376 1206720 cri.go:89] found id: ""
I0407 13:33:36.050447 1206720 logs.go:282] 0 containers: []
W0407 13:33:36.050463 1206720 logs.go:284] No container was found matching "kube-apiserver"
I0407 13:33:36.050472 1206720 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0407 13:33:36.050551 1206720 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0407 13:33:36.101420 1206720 cri.go:89] found id: ""
I0407 13:33:36.101455 1206720 logs.go:282] 0 containers: []
W0407 13:33:36.101469 1206720 logs.go:284] No container was found matching "etcd"
I0407 13:33:36.101477 1206720 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0407 13:33:36.101549 1206720 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0407 13:33:36.157805 1206720 cri.go:89] found id: ""
I0407 13:33:36.157852 1206720 logs.go:282] 0 containers: []
W0407 13:33:36.157866 1206720 logs.go:284] No container was found matching "coredns"
I0407 13:33:36.157876 1206720 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0407 13:33:36.158005 1206720 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0407 13:33:36.205052 1206720 cri.go:89] found id: ""
I0407 13:33:36.205094 1206720 logs.go:282] 0 containers: []
W0407 13:33:36.205115 1206720 logs.go:284] No container was found matching "kube-scheduler"
I0407 13:33:36.205124 1206720 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0407 13:33:36.205200 1206720 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0407 13:33:36.247127 1206720 cri.go:89] found id: ""
I0407 13:33:36.247161 1206720 logs.go:282] 0 containers: []
W0407 13:33:36.247170 1206720 logs.go:284] No container was found matching "kube-proxy"
I0407 13:33:36.247177 1206720 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0407 13:33:36.247241 1206720 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0407 13:33:36.287879 1206720 cri.go:89] found id: ""
I0407 13:33:36.287923 1206720 logs.go:282] 0 containers: []
W0407 13:33:36.287935 1206720 logs.go:284] No container was found matching "kube-controller-manager"
I0407 13:33:36.287943 1206720 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0407 13:33:36.288037 1206720 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0407 13:33:36.330634 1206720 cri.go:89] found id: ""
I0407 13:33:36.330673 1206720 logs.go:282] 0 containers: []
W0407 13:33:36.330686 1206720 logs.go:284] No container was found matching "kindnet"
I0407 13:33:36.330700 1206720 logs.go:123] Gathering logs for CRI-O ...
I0407 13:33:36.330717 1206720 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0407 13:33:36.459639 1206720 logs.go:123] Gathering logs for container status ...
I0407 13:33:36.459689 1206720 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0407 13:33:36.520494 1206720 logs.go:123] Gathering logs for kubelet ...
I0407 13:33:36.520542 1206720 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0407 13:33:36.581038 1206720 logs.go:123] Gathering logs for dmesg ...
I0407 13:33:36.581103 1206720 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0407 13:33:36.603634 1206720 logs.go:123] Gathering logs for describe nodes ...
I0407 13:33:36.603680 1206720 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0407 13:33:36.765987 1206720 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
W0407 13:33:36.766018 1206720 out.go:418] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0407 13:33:36.766097 1206720 out.go:270] *
*
W0407 13:33:36.766173 1206720 out.go:270] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0407 13:33:36.766215 1206720 out.go:270] *
*
W0407 13:33:36.767134 1206720 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0407 13:33:36.770832 1206720 out.go:201]
W0407 13:33:36.772620 1206720 out.go:270] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0407 13:33:36.772703 1206720 out.go:270] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0407 13:33:36.772730 1206720 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0407 13:33:36.774760 1206720 out.go:201]
** /stderr **
start_stop_delete_test.go:186: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-435730 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-435730 -n old-k8s-version-435730
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-435730 -n old-k8s-version-435730: exit status 6 (260.012309ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0407 13:33:37.094397 1212774 status.go:458] kubeconfig endpoint: get endpoint: "old-k8s-version-435730" does not appear in /home/jenkins/minikube-integration/20602-1162386/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-435730" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (274.18s)