=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:184: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-089147 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:184: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-089147 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m44.444162262s)
-- stdout --
* [old-k8s-version-089147] minikube v1.35.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=20720
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/20720-388787/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/20720-388787/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-089147" primary control-plane node in "old-k8s-version-089147" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0510 19:20:48.878285 449945 out.go:345] Setting OutFile to fd 1 ...
I0510 19:20:48.878627 449945 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0510 19:20:48.878640 449945 out.go:358] Setting ErrFile to fd 2...
I0510 19:20:48.878645 449945 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0510 19:20:48.878877 449945 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20720-388787/.minikube/bin
I0510 19:20:48.879565 449945 out.go:352] Setting JSON to false
I0510 19:20:48.880879 449945 start.go:130] hostinfo: {"hostname":"ubuntu-20-agent-13","uptime":32597,"bootTime":1746872252,"procs":305,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1081-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0510 19:20:48.881001 449945 start.go:140] virtualization: kvm guest
I0510 19:20:48.883631 449945 out.go:177] * [old-k8s-version-089147] minikube v1.35.0 on Ubuntu 20.04 (kvm/amd64)
I0510 19:20:48.885246 449945 notify.go:220] Checking for updates...
I0510 19:20:48.885259 449945 out.go:177] - MINIKUBE_LOCATION=20720
I0510 19:20:48.887423 449945 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0510 19:20:48.888809 449945 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/20720-388787/kubeconfig
I0510 19:20:48.890290 449945 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/20720-388787/.minikube
I0510 19:20:48.891948 449945 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0510 19:20:48.893788 449945 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0510 19:20:48.896196 449945 config.go:182] Loaded profile config "bridge-380533": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.33.0
I0510 19:20:48.896362 449945 config.go:182] Loaded profile config "enable-default-cni-380533": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.33.0
I0510 19:20:48.896538 449945 config.go:182] Loaded profile config "flannel-380533": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.33.0
I0510 19:20:48.896731 449945 driver.go:404] Setting default libvirt URI to qemu:///system
I0510 19:20:48.940038 449945 out.go:177] * Using the kvm2 driver based on user configuration
I0510 19:20:48.941565 449945 start.go:304] selected driver: kvm2
I0510 19:20:48.941591 449945 start.go:908] validating driver "kvm2" against <nil>
I0510 19:20:48.941609 449945 start.go:919] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0510 19:20:48.942761 449945 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0510 19:20:48.942882 449945 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/20720-388787/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0510 19:20:48.961368 449945 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.35.0
I0510 19:20:48.961438 449945 start_flags.go:311] no existing cluster config was found, will generate one from the flags
I0510 19:20:48.961701 449945 start_flags.go:975] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0510 19:20:48.961744 449945 cni.go:84] Creating CNI manager for ""
I0510 19:20:48.961808 449945 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0510 19:20:48.961822 449945 start_flags.go:320] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0510 19:20:48.961887 449945 start.go:347] cluster config:
{Name:old-k8s-version-089147 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1746731792-20718@sha256:074d9afa1e8827ea0e101248fc55098d304814b5d8bf485882a81afc90084155 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-089147 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0510 19:20:48.962007 449945 iso.go:125] acquiring lock: {Name:mk19640015999219180c6685480547adf0c02201 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0510 19:20:48.964188 449945 out.go:177] * Starting "old-k8s-version-089147" primary control-plane node in "old-k8s-version-089147" cluster
I0510 19:20:48.965646 449945 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0510 19:20:48.965715 449945 preload.go:146] Found local preload: /home/jenkins/minikube-integration/20720-388787/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0510 19:20:48.965732 449945 cache.go:56] Caching tarball of preloaded images
I0510 19:20:48.965858 449945 preload.go:172] Found /home/jenkins/minikube-integration/20720-388787/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0510 19:20:48.965874 449945 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0510 19:20:48.966020 449945 profile.go:143] Saving config to /home/jenkins/minikube-integration/20720-388787/.minikube/profiles/old-k8s-version-089147/config.json ...
I0510 19:20:48.966054 449945 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20720-388787/.minikube/profiles/old-k8s-version-089147/config.json: {Name:mk2bd57292fc9d988920da17952f9982e28bbca1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0510 19:20:48.966270 449945 start.go:360] acquireMachinesLock for old-k8s-version-089147: {Name:mk11499d7756d503a7a24339ad1a7f9ab9dc0fab Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0510 19:20:51.490051 449945 start.go:364] duration metric: took 2.523725902s to acquireMachinesLock for "old-k8s-version-089147"
I0510 19:20:51.490134 449945 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-089147 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/20720/minikube-v1.35.0-1746739450-20720-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1746731792-20718@sha256:074d9afa1e8827ea0e101248fc55098d304814b5d8bf485882a81afc90084155 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-089147 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0510 19:20:51.490351 449945 start.go:125] createHost starting for "" (driver="kvm2")
I0510 19:20:51.492411 449945 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0510 19:20:51.492751 449945 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0510 19:20:51.492818 449945 main.go:141] libmachine: Launching plugin server for driver kvm2
I0510 19:20:51.514873 449945 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34507
I0510 19:20:51.515494 449945 main.go:141] libmachine: () Calling .GetVersion
I0510 19:20:51.516136 449945 main.go:141] libmachine: Using API Version 1
I0510 19:20:51.516164 449945 main.go:141] libmachine: () Calling .SetConfigRaw
I0510 19:20:51.516571 449945 main.go:141] libmachine: () Calling .GetMachineName
I0510 19:20:51.516831 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetMachineName
I0510 19:20:51.517055 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .DriverName
I0510 19:20:51.517390 449945 start.go:159] libmachine.API.Create for "old-k8s-version-089147" (driver="kvm2")
I0510 19:20:51.517432 449945 client.go:168] LocalClient.Create starting
I0510 19:20:51.517488 449945 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20720-388787/.minikube/certs/ca.pem
I0510 19:20:51.517541 449945 main.go:141] libmachine: Decoding PEM data...
I0510 19:20:51.517566 449945 main.go:141] libmachine: Parsing certificate...
I0510 19:20:51.517642 449945 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20720-388787/.minikube/certs/cert.pem
I0510 19:20:51.517669 449945 main.go:141] libmachine: Decoding PEM data...
I0510 19:20:51.517692 449945 main.go:141] libmachine: Parsing certificate...
I0510 19:20:51.517715 449945 main.go:141] libmachine: Running pre-create checks...
I0510 19:20:51.517727 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .PreCreateCheck
I0510 19:20:51.518317 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetConfigRaw
I0510 19:20:51.518967 449945 main.go:141] libmachine: Creating machine...
I0510 19:20:51.518999 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .Create
I0510 19:20:51.519194 449945 main.go:141] libmachine: (old-k8s-version-089147) creating KVM machine...
I0510 19:20:51.519216 449945 main.go:141] libmachine: (old-k8s-version-089147) creating network...
I0510 19:20:51.520679 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | found existing default KVM network
I0510 19:20:51.521687 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | I0510 19:20:51.521511 449969 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:9a:36:23} reservation:<nil>}
I0510 19:20:51.522851 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | I0510 19:20:51.522766 449969 network.go:206] using free private subnet 192.168.50.0/24: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000205230}
I0510 19:20:51.522981 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | created network xml:
I0510 19:20:51.523004 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | <network>
I0510 19:20:51.523016 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | <name>mk-old-k8s-version-089147</name>
I0510 19:20:51.523031 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | <dns enable='no'/>
I0510 19:20:51.523040 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG |
I0510 19:20:51.523049 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | <ip address='192.168.50.1' netmask='255.255.255.0'>
I0510 19:20:51.523066 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | <dhcp>
I0510 19:20:51.523076 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | <range start='192.168.50.2' end='192.168.50.253'/>
I0510 19:20:51.523083 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | </dhcp>
I0510 19:20:51.523088 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | </ip>
I0510 19:20:51.523095 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG |
I0510 19:20:51.523101 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | </network>
I0510 19:20:51.523117 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG |
I0510 19:20:51.529050 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | trying to create private KVM network mk-old-k8s-version-089147 192.168.50.0/24...
I0510 19:20:51.632784 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | private KVM network mk-old-k8s-version-089147 192.168.50.0/24 created
I0510 19:20:51.632819 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | I0510 19:20:51.632765 449969 common.go:144] Making disk image using store path: /home/jenkins/minikube-integration/20720-388787/.minikube
I0510 19:20:51.632832 449945 main.go:141] libmachine: (old-k8s-version-089147) setting up store path in /home/jenkins/minikube-integration/20720-388787/.minikube/machines/old-k8s-version-089147 ...
I0510 19:20:51.632864 449945 main.go:141] libmachine: (old-k8s-version-089147) building disk image from file:///home/jenkins/minikube-integration/20720-388787/.minikube/cache/iso/amd64/minikube-v1.35.0-1746739450-20720-amd64.iso
I0510 19:20:51.632969 449945 main.go:141] libmachine: (old-k8s-version-089147) Downloading /home/jenkins/minikube-integration/20720-388787/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/20720-388787/.minikube/cache/iso/amd64/minikube-v1.35.0-1746739450-20720-amd64.iso...
I0510 19:20:51.972183 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | I0510 19:20:51.972004 449969 common.go:151] Creating ssh key: /home/jenkins/minikube-integration/20720-388787/.minikube/machines/old-k8s-version-089147/id_rsa...
I0510 19:20:52.158307 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | I0510 19:20:52.158154 449969 common.go:157] Creating raw disk image: /home/jenkins/minikube-integration/20720-388787/.minikube/machines/old-k8s-version-089147/old-k8s-version-089147.rawdisk...
I0510 19:20:52.158341 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | Writing magic tar header
I0510 19:20:52.158375 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | Writing SSH key tar header
I0510 19:20:52.158392 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | I0510 19:20:52.158311 449969 common.go:171] Fixing permissions on /home/jenkins/minikube-integration/20720-388787/.minikube/machines/old-k8s-version-089147 ...
I0510 19:20:52.158500 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20720-388787/.minikube/machines/old-k8s-version-089147
I0510 19:20:52.158536 449945 main.go:141] libmachine: (old-k8s-version-089147) setting executable bit set on /home/jenkins/minikube-integration/20720-388787/.minikube/machines/old-k8s-version-089147 (perms=drwx------)
I0510 19:20:52.158554 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20720-388787/.minikube/machines
I0510 19:20:52.158574 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20720-388787/.minikube
I0510 19:20:52.158587 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20720-388787
I0510 19:20:52.158599 449945 main.go:141] libmachine: (old-k8s-version-089147) setting executable bit set on /home/jenkins/minikube-integration/20720-388787/.minikube/machines (perms=drwxr-xr-x)
I0510 19:20:52.158649 449945 main.go:141] libmachine: (old-k8s-version-089147) setting executable bit set on /home/jenkins/minikube-integration/20720-388787/.minikube (perms=drwxr-xr-x)
I0510 19:20:52.158672 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | checking permissions on dir: /home/jenkins/minikube-integration
I0510 19:20:52.158682 449945 main.go:141] libmachine: (old-k8s-version-089147) setting executable bit set on /home/jenkins/minikube-integration/20720-388787 (perms=drwxrwxr-x)
I0510 19:20:52.158693 449945 main.go:141] libmachine: (old-k8s-version-089147) setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0510 19:20:52.158701 449945 main.go:141] libmachine: (old-k8s-version-089147) setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0510 19:20:52.158709 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | checking permissions on dir: /home/jenkins
I0510 19:20:52.158715 449945 main.go:141] libmachine: (old-k8s-version-089147) creating domain...
I0510 19:20:52.158727 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | checking permissions on dir: /home
I0510 19:20:52.158733 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | skipping /home - not owner
I0510 19:20:52.160035 449945 main.go:141] libmachine: (old-k8s-version-089147) define libvirt domain using xml:
I0510 19:20:52.160065 449945 main.go:141] libmachine: (old-k8s-version-089147) <domain type='kvm'>
I0510 19:20:52.160076 449945 main.go:141] libmachine: (old-k8s-version-089147) <name>old-k8s-version-089147</name>
I0510 19:20:52.160089 449945 main.go:141] libmachine: (old-k8s-version-089147) <memory unit='MiB'>2200</memory>
I0510 19:20:52.160098 449945 main.go:141] libmachine: (old-k8s-version-089147) <vcpu>2</vcpu>
I0510 19:20:52.160105 449945 main.go:141] libmachine: (old-k8s-version-089147) <features>
I0510 19:20:52.160113 449945 main.go:141] libmachine: (old-k8s-version-089147) <acpi/>
I0510 19:20:52.160136 449945 main.go:141] libmachine: (old-k8s-version-089147) <apic/>
I0510 19:20:52.160149 449945 main.go:141] libmachine: (old-k8s-version-089147) <pae/>
I0510 19:20:52.160154 449945 main.go:141] libmachine: (old-k8s-version-089147)
I0510 19:20:52.160164 449945 main.go:141] libmachine: (old-k8s-version-089147) </features>
I0510 19:20:52.160176 449945 main.go:141] libmachine: (old-k8s-version-089147) <cpu mode='host-passthrough'>
I0510 19:20:52.160185 449945 main.go:141] libmachine: (old-k8s-version-089147)
I0510 19:20:52.160195 449945 main.go:141] libmachine: (old-k8s-version-089147) </cpu>
I0510 19:20:52.160203 449945 main.go:141] libmachine: (old-k8s-version-089147) <os>
I0510 19:20:52.160213 449945 main.go:141] libmachine: (old-k8s-version-089147) <type>hvm</type>
I0510 19:20:52.160222 449945 main.go:141] libmachine: (old-k8s-version-089147) <boot dev='cdrom'/>
I0510 19:20:52.160231 449945 main.go:141] libmachine: (old-k8s-version-089147) <boot dev='hd'/>
I0510 19:20:52.160240 449945 main.go:141] libmachine: (old-k8s-version-089147) <bootmenu enable='no'/>
I0510 19:20:52.160248 449945 main.go:141] libmachine: (old-k8s-version-089147) </os>
I0510 19:20:52.160258 449945 main.go:141] libmachine: (old-k8s-version-089147) <devices>
I0510 19:20:52.160270 449945 main.go:141] libmachine: (old-k8s-version-089147) <disk type='file' device='cdrom'>
I0510 19:20:52.160284 449945 main.go:141] libmachine: (old-k8s-version-089147) <source file='/home/jenkins/minikube-integration/20720-388787/.minikube/machines/old-k8s-version-089147/boot2docker.iso'/>
I0510 19:20:52.160297 449945 main.go:141] libmachine: (old-k8s-version-089147) <target dev='hdc' bus='scsi'/>
I0510 19:20:52.160310 449945 main.go:141] libmachine: (old-k8s-version-089147) <readonly/>
I0510 19:20:52.160320 449945 main.go:141] libmachine: (old-k8s-version-089147) </disk>
I0510 19:20:52.160339 449945 main.go:141] libmachine: (old-k8s-version-089147) <disk type='file' device='disk'>
I0510 19:20:52.160352 449945 main.go:141] libmachine: (old-k8s-version-089147) <driver name='qemu' type='raw' cache='default' io='threads' />
I0510 19:20:52.160371 449945 main.go:141] libmachine: (old-k8s-version-089147) <source file='/home/jenkins/minikube-integration/20720-388787/.minikube/machines/old-k8s-version-089147/old-k8s-version-089147.rawdisk'/>
I0510 19:20:52.160380 449945 main.go:141] libmachine: (old-k8s-version-089147) <target dev='hda' bus='virtio'/>
I0510 19:20:52.160391 449945 main.go:141] libmachine: (old-k8s-version-089147) </disk>
I0510 19:20:52.160402 449945 main.go:141] libmachine: (old-k8s-version-089147) <interface type='network'>
I0510 19:20:52.160413 449945 main.go:141] libmachine: (old-k8s-version-089147) <source network='mk-old-k8s-version-089147'/>
I0510 19:20:52.160443 449945 main.go:141] libmachine: (old-k8s-version-089147) <model type='virtio'/>
I0510 19:20:52.160454 449945 main.go:141] libmachine: (old-k8s-version-089147) </interface>
I0510 19:20:52.160462 449945 main.go:141] libmachine: (old-k8s-version-089147) <interface type='network'>
I0510 19:20:52.160473 449945 main.go:141] libmachine: (old-k8s-version-089147) <source network='default'/>
I0510 19:20:52.160485 449945 main.go:141] libmachine: (old-k8s-version-089147) <model type='virtio'/>
I0510 19:20:52.160497 449945 main.go:141] libmachine: (old-k8s-version-089147) </interface>
I0510 19:20:52.160507 449945 main.go:141] libmachine: (old-k8s-version-089147) <serial type='pty'>
I0510 19:20:52.160517 449945 main.go:141] libmachine: (old-k8s-version-089147) <target port='0'/>
I0510 19:20:52.160527 449945 main.go:141] libmachine: (old-k8s-version-089147) </serial>
I0510 19:20:52.160539 449945 main.go:141] libmachine: (old-k8s-version-089147) <console type='pty'>
I0510 19:20:52.160550 449945 main.go:141] libmachine: (old-k8s-version-089147) <target type='serial' port='0'/>
I0510 19:20:52.160562 449945 main.go:141] libmachine: (old-k8s-version-089147) </console>
I0510 19:20:52.160572 449945 main.go:141] libmachine: (old-k8s-version-089147) <rng model='virtio'>
I0510 19:20:52.160583 449945 main.go:141] libmachine: (old-k8s-version-089147) <backend model='random'>/dev/random</backend>
I0510 19:20:52.160593 449945 main.go:141] libmachine: (old-k8s-version-089147) </rng>
I0510 19:20:52.160602 449945 main.go:141] libmachine: (old-k8s-version-089147)
I0510 19:20:52.160629 449945 main.go:141] libmachine: (old-k8s-version-089147)
I0510 19:20:52.160642 449945 main.go:141] libmachine: (old-k8s-version-089147) </devices>
I0510 19:20:52.160650 449945 main.go:141] libmachine: (old-k8s-version-089147) </domain>
I0510 19:20:52.160664 449945 main.go:141] libmachine: (old-k8s-version-089147)
I0510 19:20:52.165294 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | domain old-k8s-version-089147 has defined MAC address 52:54:00:ed:4c:2f in network default
I0510 19:20:52.166019 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | domain old-k8s-version-089147 has defined MAC address 52:54:00:c5:c6:86 in network mk-old-k8s-version-089147
I0510 19:20:52.166041 449945 main.go:141] libmachine: (old-k8s-version-089147) starting domain...
I0510 19:20:52.166059 449945 main.go:141] libmachine: (old-k8s-version-089147) ensuring networks are active...
I0510 19:20:52.166972 449945 main.go:141] libmachine: (old-k8s-version-089147) Ensuring network default is active
I0510 19:20:52.167502 449945 main.go:141] libmachine: (old-k8s-version-089147) Ensuring network mk-old-k8s-version-089147 is active
I0510 19:20:52.168294 449945 main.go:141] libmachine: (old-k8s-version-089147) getting domain XML...
I0510 19:20:52.169129 449945 main.go:141] libmachine: (old-k8s-version-089147) creating domain...
I0510 19:20:53.653091 449945 main.go:141] libmachine: (old-k8s-version-089147) waiting for IP...
I0510 19:20:53.653824 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | domain old-k8s-version-089147 has defined MAC address 52:54:00:c5:c6:86 in network mk-old-k8s-version-089147
I0510 19:20:53.654389 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | unable to find current IP address of domain old-k8s-version-089147 in network mk-old-k8s-version-089147
I0510 19:20:53.654517 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | I0510 19:20:53.654412 449969 retry.go:31] will retry after 231.968436ms: waiting for domain to come up
I0510 19:20:53.888316 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | domain old-k8s-version-089147 has defined MAC address 52:54:00:c5:c6:86 in network mk-old-k8s-version-089147
I0510 19:20:53.889107 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | unable to find current IP address of domain old-k8s-version-089147 in network mk-old-k8s-version-089147
I0510 19:20:53.889153 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | I0510 19:20:53.889071 449969 retry.go:31] will retry after 253.257147ms: waiting for domain to come up
I0510 19:20:54.143740 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | domain old-k8s-version-089147 has defined MAC address 52:54:00:c5:c6:86 in network mk-old-k8s-version-089147
I0510 19:20:54.144295 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | unable to find current IP address of domain old-k8s-version-089147 in network mk-old-k8s-version-089147
I0510 19:20:54.144326 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | I0510 19:20:54.144271 449969 retry.go:31] will retry after 402.096936ms: waiting for domain to come up
I0510 19:20:54.547963 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | domain old-k8s-version-089147 has defined MAC address 52:54:00:c5:c6:86 in network mk-old-k8s-version-089147
I0510 19:20:54.548556 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | unable to find current IP address of domain old-k8s-version-089147 in network mk-old-k8s-version-089147
I0510 19:20:54.548583 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | I0510 19:20:54.548535 449969 retry.go:31] will retry after 492.954609ms: waiting for domain to come up
I0510 19:20:55.043631 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | domain old-k8s-version-089147 has defined MAC address 52:54:00:c5:c6:86 in network mk-old-k8s-version-089147
I0510 19:20:55.044664 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | unable to find current IP address of domain old-k8s-version-089147 in network mk-old-k8s-version-089147
I0510 19:20:55.044696 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | I0510 19:20:55.044612 449969 retry.go:31] will retry after 525.824276ms: waiting for domain to come up
I0510 19:20:55.572483 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | domain old-k8s-version-089147 has defined MAC address 52:54:00:c5:c6:86 in network mk-old-k8s-version-089147
I0510 19:20:55.573300 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | unable to find current IP address of domain old-k8s-version-089147 in network mk-old-k8s-version-089147
I0510 19:20:55.573373 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | I0510 19:20:55.573252 449969 retry.go:31] will retry after 612.35236ms: waiting for domain to come up
I0510 19:20:56.188067 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | domain old-k8s-version-089147 has defined MAC address 52:54:00:c5:c6:86 in network mk-old-k8s-version-089147
I0510 19:20:56.188783 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | unable to find current IP address of domain old-k8s-version-089147 in network mk-old-k8s-version-089147
I0510 19:20:56.188819 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | I0510 19:20:56.188673 449969 retry.go:31] will retry after 1.146096376s: waiting for domain to come up
I0510 19:20:57.336690 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | domain old-k8s-version-089147 has defined MAC address 52:54:00:c5:c6:86 in network mk-old-k8s-version-089147
I0510 19:20:57.337295 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | unable to find current IP address of domain old-k8s-version-089147 in network mk-old-k8s-version-089147
I0510 19:20:57.337325 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | I0510 19:20:57.337274 449969 retry.go:31] will retry after 894.20735ms: waiting for domain to come up
I0510 19:20:58.233383 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | domain old-k8s-version-089147 has defined MAC address 52:54:00:c5:c6:86 in network mk-old-k8s-version-089147
I0510 19:20:58.234052 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | unable to find current IP address of domain old-k8s-version-089147 in network mk-old-k8s-version-089147
I0510 19:20:58.234080 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | I0510 19:20:58.234013 449969 retry.go:31] will retry after 1.733145712s: waiting for domain to come up
I0510 19:20:59.968387 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | domain old-k8s-version-089147 has defined MAC address 52:54:00:c5:c6:86 in network mk-old-k8s-version-089147
I0510 19:20:59.968991 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | unable to find current IP address of domain old-k8s-version-089147 in network mk-old-k8s-version-089147
I0510 19:20:59.969039 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | I0510 19:20:59.968973 449969 retry.go:31] will retry after 1.493771314s: waiting for domain to come up
I0510 19:21:01.464484 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | domain old-k8s-version-089147 has defined MAC address 52:54:00:c5:c6:86 in network mk-old-k8s-version-089147
I0510 19:21:01.464968 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | unable to find current IP address of domain old-k8s-version-089147 in network mk-old-k8s-version-089147
I0510 19:21:01.465010 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | I0510 19:21:01.464954 449969 retry.go:31] will retry after 2.679980544s: waiting for domain to come up
I0510 19:21:04.146797 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | domain old-k8s-version-089147 has defined MAC address 52:54:00:c5:c6:86 in network mk-old-k8s-version-089147
I0510 19:21:04.147608 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | unable to find current IP address of domain old-k8s-version-089147 in network mk-old-k8s-version-089147
I0510 19:21:04.147633 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | I0510 19:21:04.147500 449969 retry.go:31] will retry after 2.50424137s: waiting for domain to come up
I0510 19:21:06.652996 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | domain old-k8s-version-089147 has defined MAC address 52:54:00:c5:c6:86 in network mk-old-k8s-version-089147
I0510 19:21:06.653668 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | unable to find current IP address of domain old-k8s-version-089147 in network mk-old-k8s-version-089147
I0510 19:21:06.653745 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | I0510 19:21:06.653638 449969 retry.go:31] will retry after 4.281861018s: waiting for domain to come up
I0510 19:21:10.940117 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | domain old-k8s-version-089147 has defined MAC address 52:54:00:c5:c6:86 in network mk-old-k8s-version-089147
I0510 19:21:10.940735 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | unable to find current IP address of domain old-k8s-version-089147 in network mk-old-k8s-version-089147
I0510 19:21:10.940757 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | I0510 19:21:10.940688 449969 retry.go:31] will retry after 3.85851524s: waiting for domain to come up
I0510 19:21:14.800702 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | domain old-k8s-version-089147 has defined MAC address 52:54:00:c5:c6:86 in network mk-old-k8s-version-089147
I0510 19:21:14.801289 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | unable to find current IP address of domain old-k8s-version-089147 in network mk-old-k8s-version-089147
I0510 19:21:14.801339 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | I0510 19:21:14.801286 449969 retry.go:31] will retry after 5.486250873s: waiting for domain to come up
I0510 19:21:20.290661 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | domain old-k8s-version-089147 has defined MAC address 52:54:00:c5:c6:86 in network mk-old-k8s-version-089147
I0510 19:21:20.291375 449945 main.go:141] libmachine: (old-k8s-version-089147) found domain IP: 192.168.50.225
I0510 19:21:20.291393 449945 main.go:141] libmachine: (old-k8s-version-089147) reserving static IP address...
I0510 19:21:20.291414 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | domain old-k8s-version-089147 has current primary IP address 192.168.50.225 and MAC address 52:54:00:c5:c6:86 in network mk-old-k8s-version-089147
I0510 19:21:20.291774 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-089147", mac: "52:54:00:c5:c6:86", ip: "192.168.50.225"} in network mk-old-k8s-version-089147
I0510 19:21:20.401205 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | Getting to WaitForSSH function...
I0510 19:21:20.401240 449945 main.go:141] libmachine: (old-k8s-version-089147) reserved static IP address 192.168.50.225 for domain old-k8s-version-089147
I0510 19:21:20.401248 449945 main.go:141] libmachine: (old-k8s-version-089147) waiting for SSH...
I0510 19:21:20.404521 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | domain old-k8s-version-089147 has defined MAC address 52:54:00:c5:c6:86 in network mk-old-k8s-version-089147
I0510 19:21:20.405262 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:c6:86", ip: ""} in network mk-old-k8s-version-089147: {Iface:virbr2 ExpiryTime:2025-05-10 20:21:09 +0000 UTC Type:0 Mac:52:54:00:c5:c6:86 Iaid: IPaddr:192.168.50.225 Prefix:24 Hostname:minikube Clientid:01:52:54:00:c5:c6:86}
I0510 19:21:20.405288 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | domain old-k8s-version-089147 has defined IP address 192.168.50.225 and MAC address 52:54:00:c5:c6:86 in network mk-old-k8s-version-089147
I0510 19:21:20.405980 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | Using SSH client type: external
I0510 19:21:20.406002 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | Using SSH private key: /home/jenkins/minikube-integration/20720-388787/.minikube/machines/old-k8s-version-089147/id_rsa (-rw-------)
I0510 19:21:20.406033 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.50.225 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/20720-388787/.minikube/machines/old-k8s-version-089147/id_rsa -p 22] /usr/bin/ssh <nil>}
I0510 19:21:20.406041 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | About to run SSH command:
I0510 19:21:20.406055 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | exit 0
I0510 19:21:20.560566 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | SSH cmd err, output: <nil>:
I0510 19:21:20.560822 449945 main.go:141] libmachine: (old-k8s-version-089147) KVM machine creation complete
I0510 19:21:20.561170 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetConfigRaw
I0510 19:21:20.562394 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .DriverName
I0510 19:21:20.562595 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .DriverName
I0510 19:21:20.563034 449945 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0510 19:21:20.563049 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetState
I0510 19:21:20.564648 449945 main.go:141] libmachine: Detecting operating system of created instance...
I0510 19:21:20.564679 449945 main.go:141] libmachine: Waiting for SSH to be available...
I0510 19:21:20.564688 449945 main.go:141] libmachine: Getting to WaitForSSH function...
I0510 19:21:20.564716 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetSSHHostname
I0510 19:21:20.568429 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | domain old-k8s-version-089147 has defined MAC address 52:54:00:c5:c6:86 in network mk-old-k8s-version-089147
I0510 19:21:20.568955 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:c6:86", ip: ""} in network mk-old-k8s-version-089147: {Iface:virbr2 ExpiryTime:2025-05-10 20:21:09 +0000 UTC Type:0 Mac:52:54:00:c5:c6:86 Iaid: IPaddr:192.168.50.225 Prefix:24 Hostname:old-k8s-version-089147 Clientid:01:52:54:00:c5:c6:86}
I0510 19:21:20.568992 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | domain old-k8s-version-089147 has defined IP address 192.168.50.225 and MAC address 52:54:00:c5:c6:86 in network mk-old-k8s-version-089147
I0510 19:21:20.569238 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetSSHPort
I0510 19:21:20.569459 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetSSHKeyPath
I0510 19:21:20.569666 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetSSHKeyPath
I0510 19:21:20.569827 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetSSHUsername
I0510 19:21:20.569993 449945 main.go:141] libmachine: Using SSH client type: native
I0510 19:21:20.570336 449945 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836380] 0x839080 <nil> [] 0s} 192.168.50.225 22 <nil> <nil>}
I0510 19:21:20.570351 449945 main.go:141] libmachine: About to run SSH command:
exit 0
I0510 19:21:20.715385 449945 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0510 19:21:20.715409 449945 main.go:141] libmachine: Detecting the provisioner...
I0510 19:21:20.715418 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetSSHHostname
I0510 19:21:20.719032 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | domain old-k8s-version-089147 has defined MAC address 52:54:00:c5:c6:86 in network mk-old-k8s-version-089147
I0510 19:21:20.719400 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:c6:86", ip: ""} in network mk-old-k8s-version-089147: {Iface:virbr2 ExpiryTime:2025-05-10 20:21:09 +0000 UTC Type:0 Mac:52:54:00:c5:c6:86 Iaid: IPaddr:192.168.50.225 Prefix:24 Hostname:old-k8s-version-089147 Clientid:01:52:54:00:c5:c6:86}
I0510 19:21:20.719431 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | domain old-k8s-version-089147 has defined IP address 192.168.50.225 and MAC address 52:54:00:c5:c6:86 in network mk-old-k8s-version-089147
I0510 19:21:20.719703 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetSSHPort
I0510 19:21:20.719902 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetSSHKeyPath
I0510 19:21:20.720043 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetSSHKeyPath
I0510 19:21:20.720180 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetSSHUsername
I0510 19:21:20.720292 449945 main.go:141] libmachine: Using SSH client type: native
I0510 19:21:20.720492 449945 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836380] 0x839080 <nil> [] 0s} 192.168.50.225 22 <nil> <nil>}
I0510 19:21:20.720498 449945 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0510 19:21:20.854194 449945 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2024.11.2-dirty
ID=buildroot
VERSION_ID=2024.11.2
PRETTY_NAME="Buildroot 2024.11.2"
I0510 19:21:20.854290 449945 main.go:141] libmachine: found compatible host: buildroot
I0510 19:21:20.854303 449945 main.go:141] libmachine: Provisioning with buildroot...
I0510 19:21:20.854313 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetMachineName
I0510 19:21:20.854610 449945 buildroot.go:166] provisioning hostname "old-k8s-version-089147"
I0510 19:21:20.854642 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetMachineName
I0510 19:21:20.854958 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetSSHHostname
I0510 19:21:20.858793 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | domain old-k8s-version-089147 has defined MAC address 52:54:00:c5:c6:86 in network mk-old-k8s-version-089147
I0510 19:21:20.859292 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:c6:86", ip: ""} in network mk-old-k8s-version-089147: {Iface:virbr2 ExpiryTime:2025-05-10 20:21:09 +0000 UTC Type:0 Mac:52:54:00:c5:c6:86 Iaid: IPaddr:192.168.50.225 Prefix:24 Hostname:old-k8s-version-089147 Clientid:01:52:54:00:c5:c6:86}
I0510 19:21:20.859317 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | domain old-k8s-version-089147 has defined IP address 192.168.50.225 and MAC address 52:54:00:c5:c6:86 in network mk-old-k8s-version-089147
I0510 19:21:20.859590 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetSSHPort
I0510 19:21:20.859821 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetSSHKeyPath
I0510 19:21:20.860017 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetSSHKeyPath
I0510 19:21:20.860173 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetSSHUsername
I0510 19:21:20.860345 449945 main.go:141] libmachine: Using SSH client type: native
I0510 19:21:20.860741 449945 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836380] 0x839080 <nil> [] 0s} 192.168.50.225 22 <nil> <nil>}
I0510 19:21:20.860793 449945 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-089147 && echo "old-k8s-version-089147" | sudo tee /etc/hostname
I0510 19:21:21.021255 449945 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-089147
I0510 19:21:21.021317 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetSSHHostname
I0510 19:21:21.025238 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | domain old-k8s-version-089147 has defined MAC address 52:54:00:c5:c6:86 in network mk-old-k8s-version-089147
I0510 19:21:21.025828 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:c6:86", ip: ""} in network mk-old-k8s-version-089147: {Iface:virbr2 ExpiryTime:2025-05-10 20:21:09 +0000 UTC Type:0 Mac:52:54:00:c5:c6:86 Iaid: IPaddr:192.168.50.225 Prefix:24 Hostname:old-k8s-version-089147 Clientid:01:52:54:00:c5:c6:86}
I0510 19:21:21.025867 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | domain old-k8s-version-089147 has defined IP address 192.168.50.225 and MAC address 52:54:00:c5:c6:86 in network mk-old-k8s-version-089147
I0510 19:21:21.026180 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetSSHPort
I0510 19:21:21.026415 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetSSHKeyPath
I0510 19:21:21.026609 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetSSHKeyPath
I0510 19:21:21.026803 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetSSHUsername
I0510 19:21:21.027065 449945 main.go:141] libmachine: Using SSH client type: native
I0510 19:21:21.027423 449945 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836380] 0x839080 <nil> [] 0s} 192.168.50.225 22 <nil> <nil>}
I0510 19:21:21.027454 449945 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-089147' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-089147/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-089147' | sudo tee -a /etc/hosts;
fi
fi
I0510 19:21:21.192009 449945 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0510 19:21:21.192053 449945 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/20720-388787/.minikube CaCertPath:/home/jenkins/minikube-integration/20720-388787/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20720-388787/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20720-388787/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20720-388787/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20720-388787/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20720-388787/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20720-388787/.minikube}
I0510 19:21:21.192119 449945 buildroot.go:174] setting up certificates
I0510 19:21:21.192148 449945 provision.go:84] configureAuth start
I0510 19:21:21.192171 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetMachineName
I0510 19:21:21.193129 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetIP
I0510 19:21:21.196589 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | domain old-k8s-version-089147 has defined MAC address 52:54:00:c5:c6:86 in network mk-old-k8s-version-089147
I0510 19:21:21.197032 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:c6:86", ip: ""} in network mk-old-k8s-version-089147: {Iface:virbr2 ExpiryTime:2025-05-10 20:21:09 +0000 UTC Type:0 Mac:52:54:00:c5:c6:86 Iaid: IPaddr:192.168.50.225 Prefix:24 Hostname:old-k8s-version-089147 Clientid:01:52:54:00:c5:c6:86}
I0510 19:21:21.197061 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | domain old-k8s-version-089147 has defined IP address 192.168.50.225 and MAC address 52:54:00:c5:c6:86 in network mk-old-k8s-version-089147
I0510 19:21:21.197333 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetSSHHostname
I0510 19:21:21.209484 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | domain old-k8s-version-089147 has defined MAC address 52:54:00:c5:c6:86 in network mk-old-k8s-version-089147
I0510 19:21:21.210072 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:c6:86", ip: ""} in network mk-old-k8s-version-089147: {Iface:virbr2 ExpiryTime:2025-05-10 20:21:09 +0000 UTC Type:0 Mac:52:54:00:c5:c6:86 Iaid: IPaddr:192.168.50.225 Prefix:24 Hostname:old-k8s-version-089147 Clientid:01:52:54:00:c5:c6:86}
I0510 19:21:21.210099 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | domain old-k8s-version-089147 has defined IP address 192.168.50.225 and MAC address 52:54:00:c5:c6:86 in network mk-old-k8s-version-089147
I0510 19:21:21.210309 449945 provision.go:143] copyHostCerts
I0510 19:21:21.210389 449945 exec_runner.go:144] found /home/jenkins/minikube-integration/20720-388787/.minikube/ca.pem, removing ...
I0510 19:21:21.210414 449945 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20720-388787/.minikube/ca.pem
I0510 19:21:21.210484 449945 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20720-388787/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20720-388787/.minikube/ca.pem (1078 bytes)
I0510 19:21:21.210621 449945 exec_runner.go:144] found /home/jenkins/minikube-integration/20720-388787/.minikube/cert.pem, removing ...
I0510 19:21:21.210633 449945 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20720-388787/.minikube/cert.pem
I0510 19:21:21.210666 449945 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20720-388787/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20720-388787/.minikube/cert.pem (1123 bytes)
I0510 19:21:21.210754 449945 exec_runner.go:144] found /home/jenkins/minikube-integration/20720-388787/.minikube/key.pem, removing ...
I0510 19:21:21.210766 449945 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20720-388787/.minikube/key.pem
I0510 19:21:21.210803 449945 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20720-388787/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20720-388787/.minikube/key.pem (1675 bytes)
I0510 19:21:21.210872 449945 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20720-388787/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20720-388787/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20720-388787/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-089147 san=[127.0.0.1 192.168.50.225 localhost minikube old-k8s-version-089147]
I0510 19:21:21.671962 449945 provision.go:177] copyRemoteCerts
I0510 19:21:21.672047 449945 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0510 19:21:21.672081 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetSSHHostname
I0510 19:21:21.682374 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | domain old-k8s-version-089147 has defined MAC address 52:54:00:c5:c6:86 in network mk-old-k8s-version-089147
I0510 19:21:21.682855 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:c6:86", ip: ""} in network mk-old-k8s-version-089147: {Iface:virbr2 ExpiryTime:2025-05-10 20:21:09 +0000 UTC Type:0 Mac:52:54:00:c5:c6:86 Iaid: IPaddr:192.168.50.225 Prefix:24 Hostname:old-k8s-version-089147 Clientid:01:52:54:00:c5:c6:86}
I0510 19:21:21.682898 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | domain old-k8s-version-089147 has defined IP address 192.168.50.225 and MAC address 52:54:00:c5:c6:86 in network mk-old-k8s-version-089147
I0510 19:21:21.683530 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetSSHPort
I0510 19:21:21.683848 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetSSHKeyPath
I0510 19:21:21.684055 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetSSHUsername
I0510 19:21:21.684243 449945 sshutil.go:53] new ssh client: &{IP:192.168.50.225 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20720-388787/.minikube/machines/old-k8s-version-089147/id_rsa Username:docker}
I0510 19:21:21.791515 449945 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20720-388787/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0510 19:21:21.837059 449945 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20720-388787/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0510 19:21:21.874330 449945 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20720-388787/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0510 19:21:21.917803 449945 provision.go:87] duration metric: took 725.633631ms to configureAuth
I0510 19:21:21.917840 449945 buildroot.go:189] setting minikube options for container-runtime
I0510 19:21:21.918094 449945 config.go:182] Loaded profile config "old-k8s-version-089147": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0510 19:21:21.918217 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetSSHHostname
I0510 19:21:21.921692 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | domain old-k8s-version-089147 has defined MAC address 52:54:00:c5:c6:86 in network mk-old-k8s-version-089147
I0510 19:21:21.922245 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:c6:86", ip: ""} in network mk-old-k8s-version-089147: {Iface:virbr2 ExpiryTime:2025-05-10 20:21:09 +0000 UTC Type:0 Mac:52:54:00:c5:c6:86 Iaid: IPaddr:192.168.50.225 Prefix:24 Hostname:old-k8s-version-089147 Clientid:01:52:54:00:c5:c6:86}
I0510 19:21:21.922288 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | domain old-k8s-version-089147 has defined IP address 192.168.50.225 and MAC address 52:54:00:c5:c6:86 in network mk-old-k8s-version-089147
I0510 19:21:21.922537 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetSSHPort
I0510 19:21:21.922766 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetSSHKeyPath
I0510 19:21:21.922961 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetSSHKeyPath
I0510 19:21:21.923152 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetSSHUsername
I0510 19:21:21.923421 449945 main.go:141] libmachine: Using SSH client type: native
I0510 19:21:21.923733 449945 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836380] 0x839080 <nil> [] 0s} 192.168.50.225 22 <nil> <nil>}
I0510 19:21:21.923760 449945 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0510 19:21:22.227497 449945 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0510 19:21:22.227525 449945 main.go:141] libmachine: Checking connection to Docker...
I0510 19:21:22.227543 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetURL
I0510 19:21:22.229469 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | using libvirt version 6000000
I0510 19:21:22.232016 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | domain old-k8s-version-089147 has defined MAC address 52:54:00:c5:c6:86 in network mk-old-k8s-version-089147
I0510 19:21:22.234322 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:c6:86", ip: ""} in network mk-old-k8s-version-089147: {Iface:virbr2 ExpiryTime:2025-05-10 20:21:09 +0000 UTC Type:0 Mac:52:54:00:c5:c6:86 Iaid: IPaddr:192.168.50.225 Prefix:24 Hostname:old-k8s-version-089147 Clientid:01:52:54:00:c5:c6:86}
I0510 19:21:22.234342 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | domain old-k8s-version-089147 has defined IP address 192.168.50.225 and MAC address 52:54:00:c5:c6:86 in network mk-old-k8s-version-089147
I0510 19:21:22.234726 449945 main.go:141] libmachine: Docker is up and running!
I0510 19:21:22.234739 449945 main.go:141] libmachine: Reticulating splines...
I0510 19:21:22.234748 449945 client.go:171] duration metric: took 30.717306672s to LocalClient.Create
I0510 19:21:22.234769 449945 start.go:167] duration metric: took 30.717380432s to libmachine.API.Create "old-k8s-version-089147"
I0510 19:21:22.234781 449945 start.go:293] postStartSetup for "old-k8s-version-089147" (driver="kvm2")
I0510 19:21:22.234799 449945 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0510 19:21:22.234822 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .DriverName
I0510 19:21:22.235016 449945 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0510 19:21:22.235036 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetSSHHostname
I0510 19:21:22.238014 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | domain old-k8s-version-089147 has defined MAC address 52:54:00:c5:c6:86 in network mk-old-k8s-version-089147
I0510 19:21:22.238386 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:c6:86", ip: ""} in network mk-old-k8s-version-089147: {Iface:virbr2 ExpiryTime:2025-05-10 20:21:09 +0000 UTC Type:0 Mac:52:54:00:c5:c6:86 Iaid: IPaddr:192.168.50.225 Prefix:24 Hostname:old-k8s-version-089147 Clientid:01:52:54:00:c5:c6:86}
I0510 19:21:22.238419 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | domain old-k8s-version-089147 has defined IP address 192.168.50.225 and MAC address 52:54:00:c5:c6:86 in network mk-old-k8s-version-089147
I0510 19:21:22.238561 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetSSHPort
I0510 19:21:22.238804 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetSSHKeyPath
I0510 19:21:22.239005 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetSSHUsername
I0510 19:21:22.239176 449945 sshutil.go:53] new ssh client: &{IP:192.168.50.225 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20720-388787/.minikube/machines/old-k8s-version-089147/id_rsa Username:docker}
I0510 19:21:22.341394 449945 ssh_runner.go:195] Run: cat /etc/os-release
I0510 19:21:22.349448 449945 info.go:137] Remote host: Buildroot 2024.11.2
I0510 19:21:22.349486 449945 filesync.go:126] Scanning /home/jenkins/minikube-integration/20720-388787/.minikube/addons for local assets ...
I0510 19:21:22.349575 449945 filesync.go:126] Scanning /home/jenkins/minikube-integration/20720-388787/.minikube/files for local assets ...
I0510 19:21:22.349704 449945 filesync.go:149] local asset: /home/jenkins/minikube-integration/20720-388787/.minikube/files/etc/ssl/certs/3959802.pem -> 3959802.pem in /etc/ssl/certs
I0510 19:21:22.349845 449945 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0510 19:21:22.366993 449945 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20720-388787/.minikube/files/etc/ssl/certs/3959802.pem --> /etc/ssl/certs/3959802.pem (1708 bytes)
I0510 19:21:22.405786 449945 start.go:296] duration metric: took 170.979343ms for postStartSetup
I0510 19:21:22.405858 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetConfigRaw
I0510 19:21:22.406705 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetIP
I0510 19:21:22.410530 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | domain old-k8s-version-089147 has defined MAC address 52:54:00:c5:c6:86 in network mk-old-k8s-version-089147
I0510 19:21:22.411122 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:c6:86", ip: ""} in network mk-old-k8s-version-089147: {Iface:virbr2 ExpiryTime:2025-05-10 20:21:09 +0000 UTC Type:0 Mac:52:54:00:c5:c6:86 Iaid: IPaddr:192.168.50.225 Prefix:24 Hostname:old-k8s-version-089147 Clientid:01:52:54:00:c5:c6:86}
I0510 19:21:22.411144 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | domain old-k8s-version-089147 has defined IP address 192.168.50.225 and MAC address 52:54:00:c5:c6:86 in network mk-old-k8s-version-089147
I0510 19:21:22.411759 449945 profile.go:143] Saving config to /home/jenkins/minikube-integration/20720-388787/.minikube/profiles/old-k8s-version-089147/config.json ...
I0510 19:21:22.412087 449945 start.go:128] duration metric: took 30.92170916s to createHost
I0510 19:21:22.412131 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetSSHHostname
I0510 19:21:22.415152 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | domain old-k8s-version-089147 has defined MAC address 52:54:00:c5:c6:86 in network mk-old-k8s-version-089147
I0510 19:21:22.415763 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:c6:86", ip: ""} in network mk-old-k8s-version-089147: {Iface:virbr2 ExpiryTime:2025-05-10 20:21:09 +0000 UTC Type:0 Mac:52:54:00:c5:c6:86 Iaid: IPaddr:192.168.50.225 Prefix:24 Hostname:old-k8s-version-089147 Clientid:01:52:54:00:c5:c6:86}
I0510 19:21:22.415797 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | domain old-k8s-version-089147 has defined IP address 192.168.50.225 and MAC address 52:54:00:c5:c6:86 in network mk-old-k8s-version-089147
I0510 19:21:22.416129 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetSSHPort
I0510 19:21:22.416344 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetSSHKeyPath
I0510 19:21:22.416550 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetSSHKeyPath
I0510 19:21:22.416723 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetSSHUsername
I0510 19:21:22.417046 449945 main.go:141] libmachine: Using SSH client type: native
I0510 19:21:22.417348 449945 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836380] 0x839080 <nil> [] 0s} 192.168.50.225 22 <nil> <nil>}
I0510 19:21:22.417371 449945 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0510 19:21:22.537739 449945 main.go:141] libmachine: SSH cmd err, output: <nil>: 1746904882.525586093
I0510 19:21:22.537777 449945 fix.go:216] guest clock: 1746904882.525586093
I0510 19:21:22.537801 449945 fix.go:229] Guest: 2025-05-10 19:21:22.525586093 +0000 UTC Remote: 2025-05-10 19:21:22.412109791 +0000 UTC m=+33.580148420 (delta=113.476302ms)
I0510 19:21:22.537841 449945 fix.go:200] guest clock delta is within tolerance: 113.476302ms
I0510 19:21:22.537855 449945 start.go:83] releasing machines lock for "old-k8s-version-089147", held for 31.047765142s
I0510 19:21:22.537892 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .DriverName
I0510 19:21:22.538173 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetIP
I0510 19:21:22.541869 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | domain old-k8s-version-089147 has defined MAC address 52:54:00:c5:c6:86 in network mk-old-k8s-version-089147
I0510 19:21:22.542416 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:c6:86", ip: ""} in network mk-old-k8s-version-089147: {Iface:virbr2 ExpiryTime:2025-05-10 20:21:09 +0000 UTC Type:0 Mac:52:54:00:c5:c6:86 Iaid: IPaddr:192.168.50.225 Prefix:24 Hostname:old-k8s-version-089147 Clientid:01:52:54:00:c5:c6:86}
I0510 19:21:22.542446 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | domain old-k8s-version-089147 has defined IP address 192.168.50.225 and MAC address 52:54:00:c5:c6:86 in network mk-old-k8s-version-089147
I0510 19:21:22.542850 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .DriverName
I0510 19:21:22.543509 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .DriverName
I0510 19:21:22.543748 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .DriverName
I0510 19:21:22.543882 449945 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0510 19:21:22.543931 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetSSHHostname
I0510 19:21:22.544002 449945 ssh_runner.go:195] Run: cat /version.json
I0510 19:21:22.544034 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetSSHHostname
I0510 19:21:22.550348 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | domain old-k8s-version-089147 has defined MAC address 52:54:00:c5:c6:86 in network mk-old-k8s-version-089147
I0510 19:21:22.550390 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | domain old-k8s-version-089147 has defined MAC address 52:54:00:c5:c6:86 in network mk-old-k8s-version-089147
I0510 19:21:22.550421 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:c6:86", ip: ""} in network mk-old-k8s-version-089147: {Iface:virbr2 ExpiryTime:2025-05-10 20:21:09 +0000 UTC Type:0 Mac:52:54:00:c5:c6:86 Iaid: IPaddr:192.168.50.225 Prefix:24 Hostname:old-k8s-version-089147 Clientid:01:52:54:00:c5:c6:86}
I0510 19:21:22.550449 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | domain old-k8s-version-089147 has defined IP address 192.168.50.225 and MAC address 52:54:00:c5:c6:86 in network mk-old-k8s-version-089147
I0510 19:21:22.550620 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:c6:86", ip: ""} in network mk-old-k8s-version-089147: {Iface:virbr2 ExpiryTime:2025-05-10 20:21:09 +0000 UTC Type:0 Mac:52:54:00:c5:c6:86 Iaid: IPaddr:192.168.50.225 Prefix:24 Hostname:old-k8s-version-089147 Clientid:01:52:54:00:c5:c6:86}
I0510 19:21:22.550648 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | domain old-k8s-version-089147 has defined IP address 192.168.50.225 and MAC address 52:54:00:c5:c6:86 in network mk-old-k8s-version-089147
I0510 19:21:22.550674 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetSSHPort
I0510 19:21:22.550824 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetSSHPort
I0510 19:21:22.551036 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetSSHKeyPath
I0510 19:21:22.551037 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetSSHKeyPath
I0510 19:21:22.551315 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetSSHUsername
I0510 19:21:22.551321 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetSSHUsername
I0510 19:21:22.551698 449945 sshutil.go:53] new ssh client: &{IP:192.168.50.225 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20720-388787/.minikube/machines/old-k8s-version-089147/id_rsa Username:docker}
I0510 19:21:22.551720 449945 sshutil.go:53] new ssh client: &{IP:192.168.50.225 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20720-388787/.minikube/machines/old-k8s-version-089147/id_rsa Username:docker}
I0510 19:21:22.653934 449945 ssh_runner.go:195] Run: systemctl --version
I0510 19:21:22.661143 449945 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0510 19:21:22.838744 449945 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0510 19:21:22.846641 449945 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0510 19:21:22.846715 449945 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0510 19:21:22.870438 449945 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0510 19:21:22.870478 449945 start.go:495] detecting cgroup driver to use...
I0510 19:21:22.870566 449945 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0510 19:21:22.891892 449945 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0510 19:21:22.912835 449945 docker.go:225] disabling cri-docker service (if available) ...
I0510 19:21:22.912914 449945 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0510 19:21:22.934541 449945 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0510 19:21:22.955586 449945 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0510 19:21:23.151737 449945 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0510 19:21:23.335401 449945 docker.go:241] disabling docker service ...
I0510 19:21:23.335466 449945 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0510 19:21:23.352797 449945 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0510 19:21:23.368070 449945 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0510 19:21:23.577409 449945 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0510 19:21:23.744843 449945 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0510 19:21:23.763093 449945 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0510 19:21:23.791682 449945 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0510 19:21:23.791744 449945 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0510 19:21:23.805396 449945 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0510 19:21:23.805486 449945 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0510 19:21:23.819170 449945 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0510 19:21:23.831857 449945 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0510 19:21:23.845315 449945 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0510 19:21:23.860220 449945 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0510 19:21:23.874517 449945 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 1
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0510 19:21:23.874593 449945 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0510 19:21:23.895067 449945 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0510 19:21:23.909239 449945 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0510 19:21:24.096028 449945 ssh_runner.go:195] Run: sudo systemctl restart crio
I0510 19:21:24.240197 449945 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0510 19:21:24.240276 449945 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0510 19:21:24.246397 449945 start.go:563] Will wait 60s for crictl version
I0510 19:21:24.246465 449945 ssh_runner.go:195] Run: which crictl
I0510 19:21:24.251291 449945 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0510 19:21:24.302952 449945 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0510 19:21:24.303058 449945 ssh_runner.go:195] Run: crio --version
I0510 19:21:24.344222 449945 ssh_runner.go:195] Run: crio --version
I0510 19:21:24.382142 449945 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0510 19:21:24.383482 449945 main.go:141] libmachine: (old-k8s-version-089147) Calling .GetIP
I0510 19:21:24.386339 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | domain old-k8s-version-089147 has defined MAC address 52:54:00:c5:c6:86 in network mk-old-k8s-version-089147
I0510 19:21:24.386651 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:c6:86", ip: ""} in network mk-old-k8s-version-089147: {Iface:virbr2 ExpiryTime:2025-05-10 20:21:09 +0000 UTC Type:0 Mac:52:54:00:c5:c6:86 Iaid: IPaddr:192.168.50.225 Prefix:24 Hostname:old-k8s-version-089147 Clientid:01:52:54:00:c5:c6:86}
I0510 19:21:24.386700 449945 main.go:141] libmachine: (old-k8s-version-089147) DBG | domain old-k8s-version-089147 has defined IP address 192.168.50.225 and MAC address 52:54:00:c5:c6:86 in network mk-old-k8s-version-089147
I0510 19:21:24.386998 449945 ssh_runner.go:195] Run: grep 192.168.50.1 host.minikube.internal$ /etc/hosts
I0510 19:21:24.391659 449945 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.50.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0510 19:21:24.410346 449945 kubeadm.go:875] updating cluster {Name:old-k8s-version-089147 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/20720/minikube-v1.35.0-1746739450-20720-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1746731792-20718@sha256:074d9afa1e8827ea0e101248fc55098d304814b5d8bf485882a81afc90084155 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-089147 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.50.225 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] M
ountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0510 19:21:24.410605 449945 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0510 19:21:24.410697 449945 ssh_runner.go:195] Run: sudo crictl images --output json
I0510 19:21:24.455967 449945 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0510 19:21:24.456054 449945 ssh_runner.go:195] Run: which lz4
I0510 19:21:24.461984 449945 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0510 19:21:24.467758 449945 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0510 19:21:24.467806 449945 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20720-388787/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0510 19:21:26.355840 449945 crio.go:462] duration metric: took 1.893909907s to copy over tarball
I0510 19:21:26.355928 449945 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0510 19:21:29.170739 449945 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.814779516s)
I0510 19:21:29.170772 449945 crio.go:469] duration metric: took 2.814895923s to extract the tarball
I0510 19:21:29.170781 449945 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0510 19:21:29.226017 449945 ssh_runner.go:195] Run: sudo crictl images --output json
I0510 19:21:29.304587 449945 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0510 19:21:29.304626 449945 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0510 19:21:29.304742 449945 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0510 19:21:29.304778 449945 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0510 19:21:29.304825 449945 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0510 19:21:29.304822 449945 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0510 19:21:29.305065 449945 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0510 19:21:29.305101 449945 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I0510 19:21:29.305103 449945 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I0510 19:21:29.304748 449945 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0510 19:21:29.307115 449945 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0510 19:21:29.307149 449945 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0510 19:21:29.307152 449945 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0510 19:21:29.307115 449945 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0510 19:21:29.307119 449945 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0510 19:21:29.307193 449945 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0510 19:21:29.307195 449945 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0510 19:21:29.307117 449945 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0510 19:21:29.453533 449945 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0510 19:21:29.457142 449945 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0510 19:21:29.460352 449945 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0510 19:21:29.474804 449945 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0510 19:21:29.498395 449945 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0510 19:21:29.499964 449945 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0510 19:21:29.522887 449945 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0510 19:21:29.594937 449945 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0510 19:21:29.594994 449945 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0510 19:21:29.595045 449945 ssh_runner.go:195] Run: which crictl
I0510 19:21:29.601399 449945 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0510 19:21:29.601449 449945 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0510 19:21:29.601505 449945 ssh_runner.go:195] Run: which crictl
I0510 19:21:29.657430 449945 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0510 19:21:29.657475 449945 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0510 19:21:29.657527 449945 ssh_runner.go:195] Run: which crictl
I0510 19:21:29.657590 449945 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0510 19:21:29.657602 449945 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0510 19:21:29.657642 449945 ssh_runner.go:195] Run: which crictl
I0510 19:21:29.721459 449945 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0510 19:21:29.721507 449945 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0510 19:21:29.721513 449945 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0510 19:21:29.721545 449945 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0510 19:21:29.721554 449945 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0510 19:21:29.721587 449945 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0510 19:21:29.721594 449945 ssh_runner.go:195] Run: which crictl
I0510 19:21:29.721611 449945 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0510 19:21:29.721621 449945 ssh_runner.go:195] Run: which crictl
I0510 19:21:29.721565 449945 ssh_runner.go:195] Run: which crictl
I0510 19:21:29.721660 449945 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0510 19:21:29.721709 449945 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0510 19:21:29.721717 449945 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0510 19:21:29.747111 449945 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0510 19:21:29.874737 449945 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0510 19:21:29.874806 449945 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0510 19:21:29.890193 449945 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0510 19:21:29.890386 449945 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0510 19:21:29.890476 449945 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0510 19:21:29.890606 449945 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0510 19:21:30.041497 449945 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0510 19:21:30.054683 449945 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0510 19:21:30.054840 449945 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0510 19:21:30.054932 449945 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0510 19:21:30.101091 449945 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0510 19:21:30.101244 449945 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0510 19:21:30.101246 449945 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0510 19:21:30.194579 449945 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0510 19:21:30.273791 449945 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20720-388787/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0510 19:21:30.273918 449945 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20720-388787/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0510 19:21:30.274200 449945 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0510 19:21:30.299228 449945 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0510 19:21:30.305783 449945 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0510 19:21:30.305809 449945 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20720-388787/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0510 19:21:30.305813 449945 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20720-388787/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0510 19:21:30.392830 449945 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20720-388787/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0510 19:21:30.412826 449945 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20720-388787/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0510 19:21:30.527050 449945 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20720-388787/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0510 19:21:30.527114 449945 cache_images.go:92] duration metric: took 1.222467308s to LoadCachedImages
W0510 19:21:30.527206 449945 out.go:270] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20720-388787/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20720-388787/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0: no such file or directory
I0510 19:21:30.527223 449945 kubeadm.go:926] updating node { 192.168.50.225 8443 v1.20.0 crio true true} ...
I0510 19:21:30.527377 449945 kubeadm.go:938] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-089147 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.50.225
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-089147 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0510 19:21:30.527499 449945 ssh_runner.go:195] Run: crio config
I0510 19:21:30.587847 449945 cni.go:84] Creating CNI manager for ""
I0510 19:21:30.587873 449945 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0510 19:21:30.587883 449945 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0510 19:21:30.587903 449945 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.50.225 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-089147 NodeName:old-k8s-version-089147 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.50.225"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.50.225 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0510 19:21:30.588062 449945 kubeadm.go:195] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.50.225
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-089147"
kubeletExtraArgs:
node-ip: 192.168.50.225
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.50.225"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0510 19:21:30.588141 449945 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0510 19:21:30.603817 449945 binaries.go:44] Found k8s binaries, skipping transfer
I0510 19:21:30.603882 449945 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0510 19:21:30.619865 449945 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0510 19:21:30.644415 449945 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0510 19:21:30.669208 449945 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2123 bytes)
I0510 19:21:30.693368 449945 ssh_runner.go:195] Run: grep 192.168.50.225 control-plane.minikube.internal$ /etc/hosts
I0510 19:21:30.698409 449945 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.50.225 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0510 19:21:30.717734 449945 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0510 19:21:30.860444 449945 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0510 19:21:30.906143 449945 certs.go:68] Setting up /home/jenkins/minikube-integration/20720-388787/.minikube/profiles/old-k8s-version-089147 for IP: 192.168.50.225
I0510 19:21:30.906169 449945 certs.go:194] generating shared ca certs ...
I0510 19:21:30.906205 449945 certs.go:226] acquiring lock for ca certs: {Name:mk8db74782205da4ac57ef815dd495cda255251a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0510 19:21:30.906395 449945 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20720-388787/.minikube/ca.key
I0510 19:21:30.906455 449945 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20720-388787/.minikube/proxy-client-ca.key
I0510 19:21:30.906471 449945 certs.go:256] generating profile certs ...
I0510 19:21:30.906547 449945 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/20720-388787/.minikube/profiles/old-k8s-version-089147/client.key
I0510 19:21:30.906572 449945 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20720-388787/.minikube/profiles/old-k8s-version-089147/client.crt with IP's: []
I0510 19:21:31.144171 449945 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20720-388787/.minikube/profiles/old-k8s-version-089147/client.crt ...
I0510 19:21:31.144215 449945 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20720-388787/.minikube/profiles/old-k8s-version-089147/client.crt: {Name:mkd3e44a31effbc9de9caa7169df2c977a6fcf87 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0510 19:21:31.144455 449945 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20720-388787/.minikube/profiles/old-k8s-version-089147/client.key ...
I0510 19:21:31.144484 449945 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20720-388787/.minikube/profiles/old-k8s-version-089147/client.key: {Name:mk41b411364bd6e1d56b6f1220ad140a9dc65173 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0510 19:21:31.144650 449945 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/20720-388787/.minikube/profiles/old-k8s-version-089147/apiserver.key.3362ca92
I0510 19:21:31.144678 449945 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20720-388787/.minikube/profiles/old-k8s-version-089147/apiserver.crt.3362ca92 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.50.225]
I0510 19:21:31.492681 449945 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20720-388787/.minikube/profiles/old-k8s-version-089147/apiserver.crt.3362ca92 ...
I0510 19:21:31.492735 449945 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20720-388787/.minikube/profiles/old-k8s-version-089147/apiserver.crt.3362ca92: {Name:mk20d72bbb716bbda62045df3beaef639ca6f90e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0510 19:21:31.492988 449945 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20720-388787/.minikube/profiles/old-k8s-version-089147/apiserver.key.3362ca92 ...
I0510 19:21:31.493020 449945 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20720-388787/.minikube/profiles/old-k8s-version-089147/apiserver.key.3362ca92: {Name:mkc13f178a94fa7a2b105ca5208ae459ae06ddf6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0510 19:21:31.493160 449945 certs.go:381] copying /home/jenkins/minikube-integration/20720-388787/.minikube/profiles/old-k8s-version-089147/apiserver.crt.3362ca92 -> /home/jenkins/minikube-integration/20720-388787/.minikube/profiles/old-k8s-version-089147/apiserver.crt
I0510 19:21:31.493295 449945 certs.go:385] copying /home/jenkins/minikube-integration/20720-388787/.minikube/profiles/old-k8s-version-089147/apiserver.key.3362ca92 -> /home/jenkins/minikube-integration/20720-388787/.minikube/profiles/old-k8s-version-089147/apiserver.key
I0510 19:21:31.493407 449945 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/20720-388787/.minikube/profiles/old-k8s-version-089147/proxy-client.key
I0510 19:21:31.493432 449945 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20720-388787/.minikube/profiles/old-k8s-version-089147/proxy-client.crt with IP's: []
I0510 19:21:31.895522 449945 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20720-388787/.minikube/profiles/old-k8s-version-089147/proxy-client.crt ...
I0510 19:21:31.895554 449945 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20720-388787/.minikube/profiles/old-k8s-version-089147/proxy-client.crt: {Name:mk951aaec3f68066e7d9e622df9f1a7e4bed97f8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0510 19:21:31.895770 449945 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20720-388787/.minikube/profiles/old-k8s-version-089147/proxy-client.key ...
I0510 19:21:31.895795 449945 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20720-388787/.minikube/profiles/old-k8s-version-089147/proxy-client.key: {Name:mk68e23e19629d4227adc67645c210885ec95725 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0510 19:21:31.896027 449945 certs.go:484] found cert: /home/jenkins/minikube-integration/20720-388787/.minikube/certs/395980.pem (1338 bytes)
W0510 19:21:31.896081 449945 certs.go:480] ignoring /home/jenkins/minikube-integration/20720-388787/.minikube/certs/395980_empty.pem, impossibly tiny 0 bytes
I0510 19:21:31.896096 449945 certs.go:484] found cert: /home/jenkins/minikube-integration/20720-388787/.minikube/certs/ca-key.pem (1679 bytes)
I0510 19:21:31.896126 449945 certs.go:484] found cert: /home/jenkins/minikube-integration/20720-388787/.minikube/certs/ca.pem (1078 bytes)
I0510 19:21:31.896157 449945 certs.go:484] found cert: /home/jenkins/minikube-integration/20720-388787/.minikube/certs/cert.pem (1123 bytes)
I0510 19:21:31.896195 449945 certs.go:484] found cert: /home/jenkins/minikube-integration/20720-388787/.minikube/certs/key.pem (1675 bytes)
I0510 19:21:31.896249 449945 certs.go:484] found cert: /home/jenkins/minikube-integration/20720-388787/.minikube/files/etc/ssl/certs/3959802.pem (1708 bytes)
I0510 19:21:31.896908 449945 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20720-388787/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0510 19:21:31.960562 449945 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20720-388787/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0510 19:21:32.005812 449945 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20720-388787/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0510 19:21:32.041443 449945 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20720-388787/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0510 19:21:32.078545 449945 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20720-388787/.minikube/profiles/old-k8s-version-089147/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0510 19:21:32.112579 449945 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20720-388787/.minikube/profiles/old-k8s-version-089147/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0510 19:21:32.145337 449945 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20720-388787/.minikube/profiles/old-k8s-version-089147/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0510 19:21:32.177795 449945 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20720-388787/.minikube/profiles/old-k8s-version-089147/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0510 19:21:32.214358 449945 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20720-388787/.minikube/files/etc/ssl/certs/3959802.pem --> /usr/share/ca-certificates/3959802.pem (1708 bytes)
I0510 19:21:32.253230 449945 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20720-388787/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0510 19:21:32.289334 449945 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20720-388787/.minikube/certs/395980.pem --> /usr/share/ca-certificates/395980.pem (1338 bytes)
I0510 19:21:32.326391 449945 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0510 19:21:32.350523 449945 ssh_runner.go:195] Run: openssl version
I0510 19:21:32.357910 449945 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0510 19:21:32.372460 449945 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0510 19:21:32.378253 449945 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 May 10 17:52 /usr/share/ca-certificates/minikubeCA.pem
I0510 19:21:32.378322 449945 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0510 19:21:32.386076 449945 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0510 19:21:32.399982 449945 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/395980.pem && ln -fs /usr/share/ca-certificates/395980.pem /etc/ssl/certs/395980.pem"
I0510 19:21:32.415384 449945 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/395980.pem
I0510 19:21:32.421094 449945 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 May 10 18:00 /usr/share/ca-certificates/395980.pem
I0510 19:21:32.421162 449945 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/395980.pem
I0510 19:21:32.429738 449945 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/395980.pem /etc/ssl/certs/51391683.0"
I0510 19:21:32.444783 449945 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/3959802.pem && ln -fs /usr/share/ca-certificates/3959802.pem /etc/ssl/certs/3959802.pem"
I0510 19:21:32.459789 449945 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/3959802.pem
I0510 19:21:32.465379 449945 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 May 10 18:00 /usr/share/ca-certificates/3959802.pem
I0510 19:21:32.465467 449945 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/3959802.pem
I0510 19:21:32.473184 449945 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/3959802.pem /etc/ssl/certs/3ec20f2e.0"
I0510 19:21:32.486777 449945 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0510 19:21:32.493175 449945 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0510 19:21:32.493235 449945 kubeadm.go:392] StartCluster: {Name:old-k8s-version-089147 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/20720/minikube-v1.35.0-1746739450-20720-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1746731792-20718@sha256:074d9afa1e8827ea0e101248fc55098d304814b5d8bf485882a81afc90084155 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-089147 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.50.225 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Moun
tPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0510 19:21:32.493338 449945 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0510 19:21:32.493404 449945 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0510 19:21:32.539454 449945 cri.go:89] found id: ""
I0510 19:21:32.539542 449945 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0510 19:21:32.553528 449945 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0510 19:21:32.566073 449945 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0510 19:21:32.581581 449945 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0510 19:21:32.581605 449945 kubeadm.go:157] found existing configuration files:
I0510 19:21:32.581712 449945 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0510 19:21:32.601258 449945 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0510 19:21:32.601333 449945 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0510 19:21:32.618027 449945 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0510 19:21:32.638107 449945 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0510 19:21:32.638195 449945 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0510 19:21:32.663338 449945 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0510 19:21:32.680737 449945 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0510 19:21:32.680795 449945 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0510 19:21:32.697673 449945 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0510 19:21:32.716656 449945 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0510 19:21:32.716756 449945 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0510 19:21:32.734393 449945 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0510 19:21:33.037107 449945 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0510 19:21:33.037410 449945 kubeadm.go:310] [preflight] Running pre-flight checks
I0510 19:21:33.226453 449945 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0510 19:21:33.226602 449945 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0510 19:21:33.226737 449945 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0510 19:21:33.467696 449945 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0510 19:21:33.471653 449945 out.go:235] - Generating certificates and keys ...
I0510 19:21:33.471790 449945 kubeadm.go:310] [certs] Using existing ca certificate authority
I0510 19:21:33.471886 449945 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0510 19:21:33.680409 449945 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0510 19:21:34.106643 449945 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0510 19:21:34.201256 449945 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0510 19:21:34.540153 449945 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0510 19:21:34.863830 449945 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0510 19:21:34.864024 449945 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-089147] and IPs [192.168.50.225 127.0.0.1 ::1]
I0510 19:21:35.312169 449945 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0510 19:21:35.312486 449945 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-089147] and IPs [192.168.50.225 127.0.0.1 ::1]
I0510 19:21:35.509676 449945 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0510 19:21:35.700092 449945 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0510 19:21:36.076176 449945 kubeadm.go:310] [certs] Generating "sa" key and public key
I0510 19:21:36.076444 449945 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0510 19:21:36.446354 449945 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0510 19:21:36.687450 449945 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0510 19:21:36.861085 449945 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0510 19:21:36.999215 449945 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0510 19:21:37.020519 449945 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0510 19:21:37.021033 449945 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0510 19:21:37.021096 449945 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0510 19:21:37.245762 449945 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0510 19:21:37.248397 449945 out.go:235] - Booting up control plane ...
I0510 19:21:37.248549 449945 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0510 19:21:37.292883 449945 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0510 19:21:37.296768 449945 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0510 19:21:37.296985 449945 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0510 19:21:37.304216 449945 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0510 19:22:17.304037 449945 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0510 19:22:17.304860 449945 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0510 19:22:17.305123 449945 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0510 19:22:22.306255 449945 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0510 19:22:22.306510 449945 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0510 19:22:32.308387 449945 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0510 19:22:32.308676 449945 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0510 19:22:52.309621 449945 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0510 19:22:52.309838 449945 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0510 19:23:32.310291 449945 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0510 19:23:32.310610 449945 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0510 19:23:32.310652 449945 kubeadm.go:310]
I0510 19:23:32.310711 449945 kubeadm.go:310] Unfortunately, an error has occurred:
I0510 19:23:32.310762 449945 kubeadm.go:310] timed out waiting for the condition
I0510 19:23:32.310772 449945 kubeadm.go:310]
I0510 19:23:32.310823 449945 kubeadm.go:310] This error is likely caused by:
I0510 19:23:32.310868 449945 kubeadm.go:310] - The kubelet is not running
I0510 19:23:32.311011 449945 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0510 19:23:32.311019 449945 kubeadm.go:310]
I0510 19:23:32.311156 449945 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0510 19:23:32.311206 449945 kubeadm.go:310] - 'systemctl status kubelet'
I0510 19:23:32.311297 449945 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0510 19:23:32.311308 449945 kubeadm.go:310]
I0510 19:23:32.311524 449945 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0510 19:23:32.311658 449945 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0510 19:23:32.311667 449945 kubeadm.go:310]
I0510 19:23:32.311815 449945 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0510 19:23:32.311977 449945 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0510 19:23:32.312104 449945 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0510 19:23:32.312242 449945 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0510 19:23:32.312258 449945 kubeadm.go:310]
I0510 19:23:32.314070 449945 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0510 19:23:32.314238 449945 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0510 19:23:32.314355 449945 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
W0510 19:23:32.314522 449945 out.go:270] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-089147] and IPs [192.168.50.225 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-089147] and IPs [192.168.50.225 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-089147] and IPs [192.168.50.225 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-089147] and IPs [192.168.50.225 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0510 19:23:32.314566 449945 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0510 19:23:35.682672 449945 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (3.368080923s)
I0510 19:23:35.682754 449945 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0510 19:23:35.699453 449945 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0510 19:23:35.711689 449945 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0510 19:23:35.711714 449945 kubeadm.go:157] found existing configuration files:
I0510 19:23:35.711775 449945 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0510 19:23:35.722998 449945 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0510 19:23:35.723076 449945 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0510 19:23:35.735160 449945 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0510 19:23:35.746207 449945 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0510 19:23:35.746282 449945 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0510 19:23:35.758236 449945 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0510 19:23:35.768951 449945 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0510 19:23:35.769025 449945 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0510 19:23:35.780887 449945 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0510 19:23:35.791499 449945 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0510 19:23:35.791569 449945 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0510 19:23:35.803997 449945 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0510 19:23:36.041550 449945 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0510 19:25:32.426177 449945 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0510 19:25:32.426313 449945 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0510 19:25:32.429352 449945 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0510 19:25:32.429461 449945 kubeadm.go:310] [preflight] Running pre-flight checks
I0510 19:25:32.429647 449945 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0510 19:25:32.429777 449945 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0510 19:25:32.429911 449945 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0510 19:25:32.429996 449945 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0510 19:25:32.432164 449945 out.go:235] - Generating certificates and keys ...
I0510 19:25:32.432271 449945 kubeadm.go:310] [certs] Using existing ca certificate authority
I0510 19:25:32.432347 449945 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0510 19:25:32.432460 449945 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0510 19:25:32.432533 449945 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0510 19:25:32.432670 449945 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0510 19:25:32.432742 449945 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0510 19:25:32.432869 449945 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0510 19:25:32.432988 449945 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0510 19:25:32.433096 449945 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0510 19:25:32.433191 449945 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0510 19:25:32.433249 449945 kubeadm.go:310] [certs] Using the existing "sa" key
I0510 19:25:32.433356 449945 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0510 19:25:32.433461 449945 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0510 19:25:32.433556 449945 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0510 19:25:32.433631 449945 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0510 19:25:32.433700 449945 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0510 19:25:32.433824 449945 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0510 19:25:32.433961 449945 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0510 19:25:32.434037 449945 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0510 19:25:32.434127 449945 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0510 19:25:32.436436 449945 out.go:235] - Booting up control plane ...
I0510 19:25:32.436563 449945 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0510 19:25:32.436715 449945 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0510 19:25:32.436816 449945 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0510 19:25:32.436934 449945 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0510 19:25:32.437147 449945 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0510 19:25:32.437242 449945 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0510 19:25:32.437359 449945 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0510 19:25:32.437631 449945 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0510 19:25:32.437738 449945 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0510 19:25:32.438015 449945 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0510 19:25:32.438101 449945 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0510 19:25:32.438358 449945 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0510 19:25:32.438464 449945 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0510 19:25:32.438666 449945 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0510 19:25:32.438752 449945 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0510 19:25:32.438936 449945 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0510 19:25:32.438943 449945 kubeadm.go:310]
I0510 19:25:32.438991 449945 kubeadm.go:310] Unfortunately, an error has occurred:
I0510 19:25:32.439046 449945 kubeadm.go:310] timed out waiting for the condition
I0510 19:25:32.439056 449945 kubeadm.go:310]
I0510 19:25:32.439106 449945 kubeadm.go:310] This error is likely caused by:
I0510 19:25:32.439163 449945 kubeadm.go:310] - The kubelet is not running
I0510 19:25:32.439358 449945 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0510 19:25:32.439379 449945 kubeadm.go:310]
I0510 19:25:32.439535 449945 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0510 19:25:32.439583 449945 kubeadm.go:310] - 'systemctl status kubelet'
I0510 19:25:32.439638 449945 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0510 19:25:32.439646 449945 kubeadm.go:310]
I0510 19:25:32.439785 449945 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0510 19:25:32.439911 449945 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0510 19:25:32.439923 449945 kubeadm.go:310]
I0510 19:25:32.440074 449945 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0510 19:25:32.440216 449945 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0510 19:25:32.440331 449945 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0510 19:25:32.440439 449945 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0510 19:25:32.440512 449945 kubeadm.go:310]
I0510 19:25:32.440523 449945 kubeadm.go:394] duration metric: took 3m59.947291468s to StartCluster
I0510 19:25:32.440568 449945 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0510 19:25:32.440650 449945 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0510 19:25:32.513353 449945 cri.go:89] found id: ""
I0510 19:25:32.513392 449945 logs.go:282] 0 containers: []
W0510 19:25:32.513405 449945 logs.go:284] No container was found matching "kube-apiserver"
I0510 19:25:32.513414 449945 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0510 19:25:32.513546 449945 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0510 19:25:32.562601 449945 cri.go:89] found id: ""
I0510 19:25:32.562633 449945 logs.go:282] 0 containers: []
W0510 19:25:32.562644 449945 logs.go:284] No container was found matching "etcd"
I0510 19:25:32.562651 449945 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0510 19:25:32.562747 449945 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0510 19:25:32.612454 449945 cri.go:89] found id: ""
I0510 19:25:32.612490 449945 logs.go:282] 0 containers: []
W0510 19:25:32.612501 449945 logs.go:284] No container was found matching "coredns"
I0510 19:25:32.612512 449945 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0510 19:25:32.612596 449945 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0510 19:25:32.668741 449945 cri.go:89] found id: ""
I0510 19:25:32.668785 449945 logs.go:282] 0 containers: []
W0510 19:25:32.668801 449945 logs.go:284] No container was found matching "kube-scheduler"
I0510 19:25:32.668809 449945 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0510 19:25:32.668876 449945 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0510 19:25:32.722750 449945 cri.go:89] found id: ""
I0510 19:25:32.722793 449945 logs.go:282] 0 containers: []
W0510 19:25:32.722805 449945 logs.go:284] No container was found matching "kube-proxy"
I0510 19:25:32.722813 449945 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0510 19:25:32.722887 449945 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0510 19:25:32.771819 449945 cri.go:89] found id: ""
I0510 19:25:32.771858 449945 logs.go:282] 0 containers: []
W0510 19:25:32.771870 449945 logs.go:284] No container was found matching "kube-controller-manager"
I0510 19:25:32.771885 449945 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0510 19:25:32.771955 449945 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0510 19:25:32.815591 449945 cri.go:89] found id: ""
I0510 19:25:32.815626 449945 logs.go:282] 0 containers: []
W0510 19:25:32.815638 449945 logs.go:284] No container was found matching "kindnet"
I0510 19:25:32.815654 449945 logs.go:123] Gathering logs for container status ...
I0510 19:25:32.815671 449945 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0510 19:25:32.873245 449945 logs.go:123] Gathering logs for kubelet ...
I0510 19:25:32.873284 449945 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0510 19:25:32.941510 449945 logs.go:123] Gathering logs for dmesg ...
I0510 19:25:32.941558 449945 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0510 19:25:32.961761 449945 logs.go:123] Gathering logs for describe nodes ...
I0510 19:25:32.961800 449945 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0510 19:25:33.143092 449945 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0510 19:25:33.143125 449945 logs.go:123] Gathering logs for CRI-O ...
I0510 19:25:33.143142 449945 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
W0510 19:25:33.257247 449945 out.go:418] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0510 19:25:33.257335 449945 out.go:270] *
*
W0510 19:25:33.257412 449945 out.go:270] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0510 19:25:33.257431 449945 out.go:270] *
*
W0510 19:25:33.258239 449945 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0510 19:25:33.261499 449945 out.go:201]
W0510 19:25:33.263106 449945 out.go:270] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0510 19:25:33.263180 449945 out.go:270] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0510 19:25:33.263213 449945 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0510 19:25:33.265218 449945 out.go:201]
** /stderr **
start_stop_delete_test.go:186: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-089147 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-089147 -n old-k8s-version-089147
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-089147 -n old-k8s-version-089147: exit status 6 (262.382576ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0510 19:25:33.571300 457414 status.go:458] kubeconfig endpoint: get endpoint: "old-k8s-version-089147" does not appear in /home/jenkins/minikube-integration/20720-388787/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-089147" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (284.77s)