=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-210420 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-210420 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m29.164095126s)
-- stdout --
* [old-k8s-version-210420] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=18925
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/18925-3819/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/18925-3819/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-210420" primary control-plane node in "old-k8s-version-210420" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0520 11:36:34.924585 54732 out.go:291] Setting OutFile to fd 1 ...
I0520 11:36:34.924695 54732 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0520 11:36:34.924703 54732 out.go:304] Setting ErrFile to fd 2...
I0520 11:36:34.924708 54732 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0520 11:36:34.924867 54732 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18925-3819/.minikube/bin
I0520 11:36:34.925474 54732 out.go:298] Setting JSON to false
I0520 11:36:34.926335 54732 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-10","uptime":4738,"bootTime":1716200257,"procs":220,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1060-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0520 11:36:34.926390 54732 start.go:139] virtualization: kvm guest
I0520 11:36:34.928768 54732 out.go:177] * [old-k8s-version-210420] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
I0520 11:36:34.930252 54732 out.go:177] - MINIKUBE_LOCATION=18925
I0520 11:36:34.930263 54732 notify.go:220] Checking for updates...
I0520 11:36:34.931679 54732 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0520 11:36:34.933173 54732 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/18925-3819/kubeconfig
I0520 11:36:34.934463 54732 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/18925-3819/.minikube
I0520 11:36:34.935908 54732 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0520 11:36:34.937216 54732 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0520 11:36:34.939062 54732 config.go:182] Loaded profile config "cert-expiration-355991": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.1
I0520 11:36:34.939195 54732 config.go:182] Loaded profile config "kubernetes-upgrade-854547": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.1
I0520 11:36:34.939359 54732 config.go:182] Loaded profile config "pause-120159": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.1
I0520 11:36:34.939456 54732 driver.go:392] Setting default libvirt URI to qemu:///system
I0520 11:36:34.977941 54732 out.go:177] * Using the kvm2 driver based on user configuration
I0520 11:36:34.979409 54732 start.go:297] selected driver: kvm2
I0520 11:36:34.979437 54732 start.go:901] validating driver "kvm2" against <nil>
I0520 11:36:34.979450 54732 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0520 11:36:34.980387 54732 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0520 11:36:34.980479 54732 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/18925-3819/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0520 11:36:34.995908 54732 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.1
I0520 11:36:34.995989 54732 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0520 11:36:34.996261 54732 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0520 11:36:34.996298 54732 cni.go:84] Creating CNI manager for ""
I0520 11:36:34.996308 54732 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0520 11:36:34.996321 54732 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0520 11:36:34.996392 54732 start.go:340] cluster config:
{Name:old-k8s-version-210420 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1715707529-18887@sha256:734a2adad159415bd51b0392bc8976bd7e3e543e9165c2374d6e59bac37aed3a Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-210420 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0520 11:36:34.996529 54732 iso.go:125] acquiring lock: {Name:mk9a0add0607cefcce3bacafa064900f37df9c39 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0520 11:36:34.998465 54732 out.go:177] * Starting "old-k8s-version-210420" primary control-plane node in "old-k8s-version-210420" cluster
I0520 11:36:34.999693 54732 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0520 11:36:34.999727 54732 preload.go:147] Found local preload: /home/jenkins/minikube-integration/18925-3819/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0520 11:36:34.999733 54732 cache.go:56] Caching tarball of preloaded images
I0520 11:36:34.999804 54732 preload.go:173] Found /home/jenkins/minikube-integration/18925-3819/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0520 11:36:34.999820 54732 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0520 11:36:34.999919 54732 profile.go:143] Saving config to /home/jenkins/minikube-integration/18925-3819/.minikube/profiles/old-k8s-version-210420/config.json ...
I0520 11:36:34.999937 54732 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18925-3819/.minikube/profiles/old-k8s-version-210420/config.json: {Name:mkba1d4dc9330c5a6116d6f4725e66ffa908c3c3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0520 11:36:35.000083 54732 start.go:360] acquireMachinesLock for old-k8s-version-210420: {Name:mk8938b3cbc1430dfda9af859ea7269768f74090 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0520 11:36:35.000121 54732 start.go:364] duration metric: took 18.485µs to acquireMachinesLock for "old-k8s-version-210420"
I0520 11:36:35.000143 54732 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-210420 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18869/minikube-v1.33.1-1715594774-18869-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1715707529-18887@sha256:734a2adad159415bd51b0392bc8976bd7e3e543e9165c2374d6e59bac37aed3a Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-210420 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0520 11:36:35.000199 54732 start.go:125] createHost starting for "" (driver="kvm2")
I0520 11:36:35.002725 54732 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0520 11:36:35.002882 54732 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0520 11:36:35.002925 54732 main.go:141] libmachine: Launching plugin server for driver kvm2
I0520 11:36:35.017943 54732 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35777
I0520 11:36:35.018361 54732 main.go:141] libmachine: () Calling .GetVersion
I0520 11:36:35.018933 54732 main.go:141] libmachine: Using API Version 1
I0520 11:36:35.018957 54732 main.go:141] libmachine: () Calling .SetConfigRaw
I0520 11:36:35.019326 54732 main.go:141] libmachine: () Calling .GetMachineName
I0520 11:36:35.019531 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetMachineName
I0520 11:36:35.019673 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .DriverName
I0520 11:36:35.019868 54732 start.go:159] libmachine.API.Create for "old-k8s-version-210420" (driver="kvm2")
I0520 11:36:35.019898 54732 client.go:168] LocalClient.Create starting
I0520 11:36:35.019933 54732 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18925-3819/.minikube/certs/ca.pem
I0520 11:36:35.019975 54732 main.go:141] libmachine: Decoding PEM data...
I0520 11:36:35.019998 54732 main.go:141] libmachine: Parsing certificate...
I0520 11:36:35.020074 54732 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18925-3819/.minikube/certs/cert.pem
I0520 11:36:35.020101 54732 main.go:141] libmachine: Decoding PEM data...
I0520 11:36:35.020120 54732 main.go:141] libmachine: Parsing certificate...
I0520 11:36:35.020144 54732 main.go:141] libmachine: Running pre-create checks...
I0520 11:36:35.020156 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .PreCreateCheck
I0520 11:36:35.020505 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetConfigRaw
I0520 11:36:35.020895 54732 main.go:141] libmachine: Creating machine...
I0520 11:36:35.020908 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .Create
I0520 11:36:35.021045 54732 main.go:141] libmachine: (old-k8s-version-210420) Creating KVM machine...
I0520 11:36:35.022377 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | found existing default KVM network
I0520 11:36:35.023751 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | I0520 11:36:35.023592 54755 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:f9:d0:04} reservation:<nil>}
I0520 11:36:35.024764 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | I0520 11:36:35.024687 54755 network.go:211] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr2 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:87:e9:79} reservation:<nil>}
I0520 11:36:35.026003 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | I0520 11:36:35.025924 54755 network.go:211] skipping subnet 192.168.61.0/24 that is taken: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName:virbr3 IfaceIPv4:192.168.61.1 IfaceMTU:1500 IfaceMAC:52:54:00:cd:e6:f9} reservation:<nil>}
I0520 11:36:35.028479 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | I0520 11:36:35.028403 54755 network.go:209] skipping subnet 192.168.72.0/24 that is reserved: &{IP:192.168.72.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.72.0/24 Gateway:192.168.72.1 ClientMin:192.168.72.2 ClientMax:192.168.72.254 Broadcast:192.168.72.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}
I0520 11:36:35.029634 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | I0520 11:36:35.029565 54755 network.go:206] using free private subnet 192.168.83.0/24: &{IP:192.168.83.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.83.0/24 Gateway:192.168.83.1 ClientMin:192.168.83.2 ClientMax:192.168.83.254 Broadcast:192.168.83.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000014d70}
I0520 11:36:35.029659 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | created network xml:
I0520 11:36:35.029667 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | <network>
I0520 11:36:35.029675 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | <name>mk-old-k8s-version-210420</name>
I0520 11:36:35.029680 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | <dns enable='no'/>
I0520 11:36:35.029685 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG |
I0520 11:36:35.029700 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | <ip address='192.168.83.1' netmask='255.255.255.0'>
I0520 11:36:35.029714 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | <dhcp>
I0520 11:36:35.029726 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | <range start='192.168.83.2' end='192.168.83.253'/>
I0520 11:36:35.029740 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | </dhcp>
I0520 11:36:35.029748 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | </ip>
I0520 11:36:35.029753 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG |
I0520 11:36:35.029761 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | </network>
I0520 11:36:35.029771 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG |
I0520 11:36:35.035567 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | trying to create private KVM network mk-old-k8s-version-210420 192.168.83.0/24...
I0520 11:36:35.110126 54732 main.go:141] libmachine: (old-k8s-version-210420) Setting up store path in /home/jenkins/minikube-integration/18925-3819/.minikube/machines/old-k8s-version-210420 ...
I0520 11:36:35.110161 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | private KVM network mk-old-k8s-version-210420 192.168.83.0/24 created
I0520 11:36:35.110185 54732 main.go:141] libmachine: (old-k8s-version-210420) Building disk image from file:///home/jenkins/minikube-integration/18925-3819/.minikube/cache/iso/amd64/minikube-v1.33.1-1715594774-18869-amd64.iso
I0520 11:36:35.110205 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | I0520 11:36:35.110056 54755 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/18925-3819/.minikube
I0520 11:36:35.110259 54732 main.go:141] libmachine: (old-k8s-version-210420) Downloading /home/jenkins/minikube-integration/18925-3819/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/18925-3819/.minikube/cache/iso/amd64/minikube-v1.33.1-1715594774-18869-amd64.iso...
I0520 11:36:35.361587 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | I0520 11:36:35.361434 54755 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/18925-3819/.minikube/machines/old-k8s-version-210420/id_rsa...
I0520 11:36:35.721187 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | I0520 11:36:35.721073 54755 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/18925-3819/.minikube/machines/old-k8s-version-210420/old-k8s-version-210420.rawdisk...
I0520 11:36:35.721215 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | Writing magic tar header
I0520 11:36:35.721232 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | Writing SSH key tar header
I0520 11:36:35.721245 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | I0520 11:36:35.721174 54755 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/18925-3819/.minikube/machines/old-k8s-version-210420 ...
I0520 11:36:35.721274 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18925-3819/.minikube/machines/old-k8s-version-210420
I0520 11:36:35.721313 54732 main.go:141] libmachine: (old-k8s-version-210420) Setting executable bit set on /home/jenkins/minikube-integration/18925-3819/.minikube/machines/old-k8s-version-210420 (perms=drwx------)
I0520 11:36:35.721328 54732 main.go:141] libmachine: (old-k8s-version-210420) Setting executable bit set on /home/jenkins/minikube-integration/18925-3819/.minikube/machines (perms=drwxr-xr-x)
I0520 11:36:35.721339 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18925-3819/.minikube/machines
I0520 11:36:35.721394 54732 main.go:141] libmachine: (old-k8s-version-210420) Setting executable bit set on /home/jenkins/minikube-integration/18925-3819/.minikube (perms=drwxr-xr-x)
I0520 11:36:35.721426 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18925-3819/.minikube
I0520 11:36:35.721441 54732 main.go:141] libmachine: (old-k8s-version-210420) Setting executable bit set on /home/jenkins/minikube-integration/18925-3819 (perms=drwxrwxr-x)
I0520 11:36:35.721457 54732 main.go:141] libmachine: (old-k8s-version-210420) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0520 11:36:35.721471 54732 main.go:141] libmachine: (old-k8s-version-210420) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0520 11:36:35.721482 54732 main.go:141] libmachine: (old-k8s-version-210420) Creating domain...
I0520 11:36:35.721500 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18925-3819
I0520 11:36:35.721512 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0520 11:36:35.721526 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | Checking permissions on dir: /home/jenkins
I0520 11:36:35.721542 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | Checking permissions on dir: /home
I0520 11:36:35.721571 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | Skipping /home - not owner
I0520 11:36:35.722625 54732 main.go:141] libmachine: (old-k8s-version-210420) define libvirt domain using xml:
I0520 11:36:35.722650 54732 main.go:141] libmachine: (old-k8s-version-210420) <domain type='kvm'>
I0520 11:36:35.722662 54732 main.go:141] libmachine: (old-k8s-version-210420) <name>old-k8s-version-210420</name>
I0520 11:36:35.722671 54732 main.go:141] libmachine: (old-k8s-version-210420) <memory unit='MiB'>2200</memory>
I0520 11:36:35.722680 54732 main.go:141] libmachine: (old-k8s-version-210420) <vcpu>2</vcpu>
I0520 11:36:35.722688 54732 main.go:141] libmachine: (old-k8s-version-210420) <features>
I0520 11:36:35.722696 54732 main.go:141] libmachine: (old-k8s-version-210420) <acpi/>
I0520 11:36:35.722703 54732 main.go:141] libmachine: (old-k8s-version-210420) <apic/>
I0520 11:36:35.722713 54732 main.go:141] libmachine: (old-k8s-version-210420) <pae/>
I0520 11:36:35.722718 54732 main.go:141] libmachine: (old-k8s-version-210420)
I0520 11:36:35.722727 54732 main.go:141] libmachine: (old-k8s-version-210420) </features>
I0520 11:36:35.722732 54732 main.go:141] libmachine: (old-k8s-version-210420) <cpu mode='host-passthrough'>
I0520 11:36:35.722759 54732 main.go:141] libmachine: (old-k8s-version-210420)
I0520 11:36:35.722794 54732 main.go:141] libmachine: (old-k8s-version-210420) </cpu>
I0520 11:36:35.722804 54732 main.go:141] libmachine: (old-k8s-version-210420) <os>
I0520 11:36:35.722815 54732 main.go:141] libmachine: (old-k8s-version-210420) <type>hvm</type>
I0520 11:36:35.722833 54732 main.go:141] libmachine: (old-k8s-version-210420) <boot dev='cdrom'/>
I0520 11:36:35.722844 54732 main.go:141] libmachine: (old-k8s-version-210420) <boot dev='hd'/>
I0520 11:36:35.722854 54732 main.go:141] libmachine: (old-k8s-version-210420) <bootmenu enable='no'/>
I0520 11:36:35.722868 54732 main.go:141] libmachine: (old-k8s-version-210420) </os>
I0520 11:36:35.722881 54732 main.go:141] libmachine: (old-k8s-version-210420) <devices>
I0520 11:36:35.722888 54732 main.go:141] libmachine: (old-k8s-version-210420) <disk type='file' device='cdrom'>
I0520 11:36:35.722905 54732 main.go:141] libmachine: (old-k8s-version-210420) <source file='/home/jenkins/minikube-integration/18925-3819/.minikube/machines/old-k8s-version-210420/boot2docker.iso'/>
I0520 11:36:35.722916 54732 main.go:141] libmachine: (old-k8s-version-210420) <target dev='hdc' bus='scsi'/>
I0520 11:36:35.722925 54732 main.go:141] libmachine: (old-k8s-version-210420) <readonly/>
I0520 11:36:35.722935 54732 main.go:141] libmachine: (old-k8s-version-210420) </disk>
I0520 11:36:35.722945 54732 main.go:141] libmachine: (old-k8s-version-210420) <disk type='file' device='disk'>
I0520 11:36:35.722963 54732 main.go:141] libmachine: (old-k8s-version-210420) <driver name='qemu' type='raw' cache='default' io='threads' />
I0520 11:36:35.722981 54732 main.go:141] libmachine: (old-k8s-version-210420) <source file='/home/jenkins/minikube-integration/18925-3819/.minikube/machines/old-k8s-version-210420/old-k8s-version-210420.rawdisk'/>
I0520 11:36:35.722993 54732 main.go:141] libmachine: (old-k8s-version-210420) <target dev='hda' bus='virtio'/>
I0520 11:36:35.723005 54732 main.go:141] libmachine: (old-k8s-version-210420) </disk>
I0520 11:36:35.723016 54732 main.go:141] libmachine: (old-k8s-version-210420) <interface type='network'>
I0520 11:36:35.723033 54732 main.go:141] libmachine: (old-k8s-version-210420) <source network='mk-old-k8s-version-210420'/>
I0520 11:36:35.723048 54732 main.go:141] libmachine: (old-k8s-version-210420) <model type='virtio'/>
I0520 11:36:35.723059 54732 main.go:141] libmachine: (old-k8s-version-210420) </interface>
I0520 11:36:35.723073 54732 main.go:141] libmachine: (old-k8s-version-210420) <interface type='network'>
I0520 11:36:35.723090 54732 main.go:141] libmachine: (old-k8s-version-210420) <source network='default'/>
I0520 11:36:35.723098 54732 main.go:141] libmachine: (old-k8s-version-210420) <model type='virtio'/>
I0520 11:36:35.723103 54732 main.go:141] libmachine: (old-k8s-version-210420) </interface>
I0520 11:36:35.723110 54732 main.go:141] libmachine: (old-k8s-version-210420) <serial type='pty'>
I0520 11:36:35.723135 54732 main.go:141] libmachine: (old-k8s-version-210420) <target port='0'/>
I0520 11:36:35.723156 54732 main.go:141] libmachine: (old-k8s-version-210420) </serial>
I0520 11:36:35.723170 54732 main.go:141] libmachine: (old-k8s-version-210420) <console type='pty'>
I0520 11:36:35.723180 54732 main.go:141] libmachine: (old-k8s-version-210420) <target type='serial' port='0'/>
I0520 11:36:35.723193 54732 main.go:141] libmachine: (old-k8s-version-210420) </console>
I0520 11:36:35.723227 54732 main.go:141] libmachine: (old-k8s-version-210420) <rng model='virtio'>
I0520 11:36:35.723241 54732 main.go:141] libmachine: (old-k8s-version-210420) <backend model='random'>/dev/random</backend>
I0520 11:36:35.723251 54732 main.go:141] libmachine: (old-k8s-version-210420) </rng>
I0520 11:36:35.723261 54732 main.go:141] libmachine: (old-k8s-version-210420)
I0520 11:36:35.723269 54732 main.go:141] libmachine: (old-k8s-version-210420)
I0520 11:36:35.723279 54732 main.go:141] libmachine: (old-k8s-version-210420) </devices>
I0520 11:36:35.723290 54732 main.go:141] libmachine: (old-k8s-version-210420) </domain>
I0520 11:36:35.723299 54732 main.go:141] libmachine: (old-k8s-version-210420)
I0520 11:36:35.727234 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | domain old-k8s-version-210420 has defined MAC address 52:54:00:7a:d0:98 in network default
I0520 11:36:35.727750 54732 main.go:141] libmachine: (old-k8s-version-210420) Ensuring networks are active...
I0520 11:36:35.727768 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | domain old-k8s-version-210420 has defined MAC address 52:54:00:69:43:1a in network mk-old-k8s-version-210420
I0520 11:36:35.728436 54732 main.go:141] libmachine: (old-k8s-version-210420) Ensuring network default is active
I0520 11:36:35.728679 54732 main.go:141] libmachine: (old-k8s-version-210420) Ensuring network mk-old-k8s-version-210420 is active
I0520 11:36:35.729118 54732 main.go:141] libmachine: (old-k8s-version-210420) Getting domain xml...
I0520 11:36:35.729706 54732 main.go:141] libmachine: (old-k8s-version-210420) Creating domain...
I0520 11:36:37.054514 54732 main.go:141] libmachine: (old-k8s-version-210420) Waiting to get IP...
I0520 11:36:37.055222 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | domain old-k8s-version-210420 has defined MAC address 52:54:00:69:43:1a in network mk-old-k8s-version-210420
I0520 11:36:37.055663 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | unable to find current IP address of domain old-k8s-version-210420 in network mk-old-k8s-version-210420
I0520 11:36:37.055693 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | I0520 11:36:37.055611 54755 retry.go:31] will retry after 250.742445ms: waiting for machine to come up
I0520 11:36:37.308328 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | domain old-k8s-version-210420 has defined MAC address 52:54:00:69:43:1a in network mk-old-k8s-version-210420
I0520 11:36:37.308967 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | unable to find current IP address of domain old-k8s-version-210420 in network mk-old-k8s-version-210420
I0520 11:36:37.308995 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | I0520 11:36:37.308910 54755 retry.go:31] will retry after 389.201353ms: waiting for machine to come up
I0520 11:36:37.699518 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | domain old-k8s-version-210420 has defined MAC address 52:54:00:69:43:1a in network mk-old-k8s-version-210420
I0520 11:36:37.699981 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | unable to find current IP address of domain old-k8s-version-210420 in network mk-old-k8s-version-210420
I0520 11:36:37.700011 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | I0520 11:36:37.699941 54755 retry.go:31] will retry after 435.785471ms: waiting for machine to come up
I0520 11:36:38.137687 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | domain old-k8s-version-210420 has defined MAC address 52:54:00:69:43:1a in network mk-old-k8s-version-210420
I0520 11:36:38.138161 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | unable to find current IP address of domain old-k8s-version-210420 in network mk-old-k8s-version-210420
I0520 11:36:38.138190 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | I0520 11:36:38.138123 54755 retry.go:31] will retry after 521.950828ms: waiting for machine to come up
I0520 11:36:38.661976 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | domain old-k8s-version-210420 has defined MAC address 52:54:00:69:43:1a in network mk-old-k8s-version-210420
I0520 11:36:38.662533 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | unable to find current IP address of domain old-k8s-version-210420 in network mk-old-k8s-version-210420
I0520 11:36:38.662556 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | I0520 11:36:38.662488 54755 retry.go:31] will retry after 628.547713ms: waiting for machine to come up
I0520 11:36:39.292067 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | domain old-k8s-version-210420 has defined MAC address 52:54:00:69:43:1a in network mk-old-k8s-version-210420
I0520 11:36:39.292558 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | unable to find current IP address of domain old-k8s-version-210420 in network mk-old-k8s-version-210420
I0520 11:36:39.292582 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | I0520 11:36:39.292508 54755 retry.go:31] will retry after 602.715223ms: waiting for machine to come up
I0520 11:36:39.897344 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | domain old-k8s-version-210420 has defined MAC address 52:54:00:69:43:1a in network mk-old-k8s-version-210420
I0520 11:36:39.897833 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | unable to find current IP address of domain old-k8s-version-210420 in network mk-old-k8s-version-210420
I0520 11:36:39.897862 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | I0520 11:36:39.897782 54755 retry.go:31] will retry after 880.165132ms: waiting for machine to come up
I0520 11:36:40.779736 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | domain old-k8s-version-210420 has defined MAC address 52:54:00:69:43:1a in network mk-old-k8s-version-210420
I0520 11:36:40.780219 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | unable to find current IP address of domain old-k8s-version-210420 in network mk-old-k8s-version-210420
I0520 11:36:40.780248 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | I0520 11:36:40.780178 54755 retry.go:31] will retry after 1.272197275s: waiting for machine to come up
I0520 11:36:42.054726 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | domain old-k8s-version-210420 has defined MAC address 52:54:00:69:43:1a in network mk-old-k8s-version-210420
I0520 11:36:42.055207 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | unable to find current IP address of domain old-k8s-version-210420 in network mk-old-k8s-version-210420
I0520 11:36:42.055229 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | I0520 11:36:42.055143 54755 retry.go:31] will retry after 1.67461889s: waiting for machine to come up
I0520 11:36:43.731060 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | domain old-k8s-version-210420 has defined MAC address 52:54:00:69:43:1a in network mk-old-k8s-version-210420
I0520 11:36:43.731544 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | unable to find current IP address of domain old-k8s-version-210420 in network mk-old-k8s-version-210420
I0520 11:36:43.731573 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | I0520 11:36:43.731493 54755 retry.go:31] will retry after 2.249865047s: waiting for machine to come up
I0520 11:36:45.983452 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | domain old-k8s-version-210420 has defined MAC address 52:54:00:69:43:1a in network mk-old-k8s-version-210420
I0520 11:36:45.984016 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | unable to find current IP address of domain old-k8s-version-210420 in network mk-old-k8s-version-210420
I0520 11:36:45.984068 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | I0520 11:36:45.983968 54755 retry.go:31] will retry after 2.737409087s: waiting for machine to come up
I0520 11:36:48.722775 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | domain old-k8s-version-210420 has defined MAC address 52:54:00:69:43:1a in network mk-old-k8s-version-210420
I0520 11:36:48.723225 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | unable to find current IP address of domain old-k8s-version-210420 in network mk-old-k8s-version-210420
I0520 11:36:48.723255 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | I0520 11:36:48.723183 54755 retry.go:31] will retry after 2.212815155s: waiting for machine to come up
I0520 11:36:50.938087 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | domain old-k8s-version-210420 has defined MAC address 52:54:00:69:43:1a in network mk-old-k8s-version-210420
I0520 11:36:50.938585 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | unable to find current IP address of domain old-k8s-version-210420 in network mk-old-k8s-version-210420
I0520 11:36:50.938615 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | I0520 11:36:50.938538 54755 retry.go:31] will retry after 3.187157159s: waiting for machine to come up
I0520 11:36:54.127263 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | domain old-k8s-version-210420 has defined MAC address 52:54:00:69:43:1a in network mk-old-k8s-version-210420
I0520 11:36:54.127657 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | unable to find current IP address of domain old-k8s-version-210420 in network mk-old-k8s-version-210420
I0520 11:36:54.127683 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | I0520 11:36:54.127614 54755 retry.go:31] will retry after 4.331061914s: waiting for machine to come up
I0520 11:36:58.463061 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | domain old-k8s-version-210420 has defined MAC address 52:54:00:69:43:1a in network mk-old-k8s-version-210420
I0520 11:36:58.463494 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | domain old-k8s-version-210420 has current primary IP address 192.168.83.100 and MAC address 52:54:00:69:43:1a in network mk-old-k8s-version-210420
I0520 11:36:58.463530 54732 main.go:141] libmachine: (old-k8s-version-210420) Found IP for machine: 192.168.83.100
I0520 11:36:58.463539 54732 main.go:141] libmachine: (old-k8s-version-210420) Reserving static IP address...
I0520 11:36:58.463857 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-210420", mac: "52:54:00:69:43:1a", ip: "192.168.83.100"} in network mk-old-k8s-version-210420
I0520 11:36:58.538368 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | Getting to WaitForSSH function...
I0520 11:36:58.538404 54732 main.go:141] libmachine: (old-k8s-version-210420) Reserved static IP address: 192.168.83.100
I0520 11:36:58.538417 54732 main.go:141] libmachine: (old-k8s-version-210420) Waiting for SSH to be available...
I0520 11:36:58.540887 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | domain old-k8s-version-210420 has defined MAC address 52:54:00:69:43:1a in network mk-old-k8s-version-210420
I0520 11:36:58.541361 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:69:43:1a", ip: ""} in network mk-old-k8s-version-210420: {Iface:virbr4 ExpiryTime:2024-05-20 12:36:50 +0000 UTC Type:0 Mac:52:54:00:69:43:1a Iaid: IPaddr:192.168.83.100 Prefix:24 Hostname:minikube Clientid:01:52:54:00:69:43:1a}
I0520 11:36:58.541394 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | domain old-k8s-version-210420 has defined IP address 192.168.83.100 and MAC address 52:54:00:69:43:1a in network mk-old-k8s-version-210420
I0520 11:36:58.541531 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | Using SSH client type: external
I0520 11:36:58.541561 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | Using SSH private key: /home/jenkins/minikube-integration/18925-3819/.minikube/machines/old-k8s-version-210420/id_rsa (-rw-------)
I0520 11:36:58.541590 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.83.100 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/18925-3819/.minikube/machines/old-k8s-version-210420/id_rsa -p 22] /usr/bin/ssh <nil>}
I0520 11:36:58.541614 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | About to run SSH command:
I0520 11:36:58.541632 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | exit 0
I0520 11:36:58.669046 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | SSH cmd err, output: <nil>:
I0520 11:36:58.669304 54732 main.go:141] libmachine: (old-k8s-version-210420) KVM machine creation complete!
I0520 11:36:58.669649 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetConfigRaw
I0520 11:36:58.670148 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .DriverName
I0520 11:36:58.670359 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .DriverName
I0520 11:36:58.670540 54732 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0520 11:36:58.670559 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetState
I0520 11:36:58.671802 54732 main.go:141] libmachine: Detecting operating system of created instance...
I0520 11:36:58.671815 54732 main.go:141] libmachine: Waiting for SSH to be available...
I0520 11:36:58.671820 54732 main.go:141] libmachine: Getting to WaitForSSH function...
I0520 11:36:58.671826 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetSSHHostname
I0520 11:36:58.673985 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | domain old-k8s-version-210420 has defined MAC address 52:54:00:69:43:1a in network mk-old-k8s-version-210420
I0520 11:36:58.674327 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:69:43:1a", ip: ""} in network mk-old-k8s-version-210420: {Iface:virbr4 ExpiryTime:2024-05-20 12:36:50 +0000 UTC Type:0 Mac:52:54:00:69:43:1a Iaid: IPaddr:192.168.83.100 Prefix:24 Hostname:old-k8s-version-210420 Clientid:01:52:54:00:69:43:1a}
I0520 11:36:58.674357 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | domain old-k8s-version-210420 has defined IP address 192.168.83.100 and MAC address 52:54:00:69:43:1a in network mk-old-k8s-version-210420
I0520 11:36:58.674419 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetSSHPort
I0520 11:36:58.674570 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetSSHKeyPath
I0520 11:36:58.674717 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetSSHKeyPath
I0520 11:36:58.674863 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetSSHUsername
I0520 11:36:58.675080 54732 main.go:141] libmachine: Using SSH client type: native
I0520 11:36:58.675315 54732 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d800] 0x830560 <nil> [] 0s} 192.168.83.100 22 <nil> <nil>}
I0520 11:36:58.675331 54732 main.go:141] libmachine: About to run SSH command:
exit 0
I0520 11:36:58.788510 54732 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0520 11:36:58.788531 54732 main.go:141] libmachine: Detecting the provisioner...
I0520 11:36:58.788538 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetSSHHostname
I0520 11:36:58.791777 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | domain old-k8s-version-210420 has defined MAC address 52:54:00:69:43:1a in network mk-old-k8s-version-210420
I0520 11:36:58.792093 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:69:43:1a", ip: ""} in network mk-old-k8s-version-210420: {Iface:virbr4 ExpiryTime:2024-05-20 12:36:50 +0000 UTC Type:0 Mac:52:54:00:69:43:1a Iaid: IPaddr:192.168.83.100 Prefix:24 Hostname:old-k8s-version-210420 Clientid:01:52:54:00:69:43:1a}
I0520 11:36:58.792120 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | domain old-k8s-version-210420 has defined IP address 192.168.83.100 and MAC address 52:54:00:69:43:1a in network mk-old-k8s-version-210420
I0520 11:36:58.792298 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetSSHPort
I0520 11:36:58.792515 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetSSHKeyPath
I0520 11:36:58.792694 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetSSHKeyPath
I0520 11:36:58.792833 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetSSHUsername
I0520 11:36:58.792980 54732 main.go:141] libmachine: Using SSH client type: native
I0520 11:36:58.793159 54732 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d800] 0x830560 <nil> [] 0s} 192.168.83.100 22 <nil> <nil>}
I0520 11:36:58.793169 54732 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0520 11:36:58.905732 54732 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0520 11:36:58.905795 54732 main.go:141] libmachine: found compatible host: buildroot
I0520 11:36:58.905808 54732 main.go:141] libmachine: Provisioning with buildroot...
I0520 11:36:58.905817 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetMachineName
I0520 11:36:58.906037 54732 buildroot.go:166] provisioning hostname "old-k8s-version-210420"
I0520 11:36:58.906069 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetMachineName
I0520 11:36:58.906235 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetSSHHostname
I0520 11:36:58.908812 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | domain old-k8s-version-210420 has defined MAC address 52:54:00:69:43:1a in network mk-old-k8s-version-210420
I0520 11:36:58.909252 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:69:43:1a", ip: ""} in network mk-old-k8s-version-210420: {Iface:virbr4 ExpiryTime:2024-05-20 12:36:50 +0000 UTC Type:0 Mac:52:54:00:69:43:1a Iaid: IPaddr:192.168.83.100 Prefix:24 Hostname:old-k8s-version-210420 Clientid:01:52:54:00:69:43:1a}
I0520 11:36:58.909279 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | domain old-k8s-version-210420 has defined IP address 192.168.83.100 and MAC address 52:54:00:69:43:1a in network mk-old-k8s-version-210420
I0520 11:36:58.909457 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetSSHPort
I0520 11:36:58.909640 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetSSHKeyPath
I0520 11:36:58.909803 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetSSHKeyPath
I0520 11:36:58.909963 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetSSHUsername
I0520 11:36:58.910137 54732 main.go:141] libmachine: Using SSH client type: native
I0520 11:36:58.910360 54732 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d800] 0x830560 <nil> [] 0s} 192.168.83.100 22 <nil> <nil>}
I0520 11:36:58.910382 54732 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-210420 && echo "old-k8s-version-210420" | sudo tee /etc/hostname
I0520 11:36:59.043365 54732 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-210420
I0520 11:36:59.043395 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetSSHHostname
I0520 11:36:59.046494 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | domain old-k8s-version-210420 has defined MAC address 52:54:00:69:43:1a in network mk-old-k8s-version-210420
I0520 11:36:59.047005 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:69:43:1a", ip: ""} in network mk-old-k8s-version-210420: {Iface:virbr4 ExpiryTime:2024-05-20 12:36:50 +0000 UTC Type:0 Mac:52:54:00:69:43:1a Iaid: IPaddr:192.168.83.100 Prefix:24 Hostname:old-k8s-version-210420 Clientid:01:52:54:00:69:43:1a}
I0520 11:36:59.047029 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | domain old-k8s-version-210420 has defined IP address 192.168.83.100 and MAC address 52:54:00:69:43:1a in network mk-old-k8s-version-210420
I0520 11:36:59.047181 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetSSHPort
I0520 11:36:59.047365 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetSSHKeyPath
I0520 11:36:59.047541 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetSSHKeyPath
I0520 11:36:59.047678 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetSSHUsername
I0520 11:36:59.047866 54732 main.go:141] libmachine: Using SSH client type: native
I0520 11:36:59.048197 54732 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d800] 0x830560 <nil> [] 0s} 192.168.83.100 22 <nil> <nil>}
I0520 11:36:59.048223 54732 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-210420' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-210420/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-210420' | sudo tee -a /etc/hosts;
fi
fi
I0520 11:36:59.175659 54732 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0520 11:36:59.175698 54732 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/18925-3819/.minikube CaCertPath:/home/jenkins/minikube-integration/18925-3819/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18925-3819/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18925-3819/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18925-3819/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18925-3819/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18925-3819/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18925-3819/.minikube}
I0520 11:36:59.175720 54732 buildroot.go:174] setting up certificates
I0520 11:36:59.175734 54732 provision.go:84] configureAuth start
I0520 11:36:59.175750 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetMachineName
I0520 11:36:59.176024 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetIP
I0520 11:36:59.179114 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | domain old-k8s-version-210420 has defined MAC address 52:54:00:69:43:1a in network mk-old-k8s-version-210420
I0520 11:36:59.179481 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:69:43:1a", ip: ""} in network mk-old-k8s-version-210420: {Iface:virbr4 ExpiryTime:2024-05-20 12:36:50 +0000 UTC Type:0 Mac:52:54:00:69:43:1a Iaid: IPaddr:192.168.83.100 Prefix:24 Hostname:old-k8s-version-210420 Clientid:01:52:54:00:69:43:1a}
I0520 11:36:59.179513 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | domain old-k8s-version-210420 has defined IP address 192.168.83.100 and MAC address 52:54:00:69:43:1a in network mk-old-k8s-version-210420
I0520 11:36:59.179636 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetSSHHostname
I0520 11:36:59.182365 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | domain old-k8s-version-210420 has defined MAC address 52:54:00:69:43:1a in network mk-old-k8s-version-210420
I0520 11:36:59.182693 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:69:43:1a", ip: ""} in network mk-old-k8s-version-210420: {Iface:virbr4 ExpiryTime:2024-05-20 12:36:50 +0000 UTC Type:0 Mac:52:54:00:69:43:1a Iaid: IPaddr:192.168.83.100 Prefix:24 Hostname:old-k8s-version-210420 Clientid:01:52:54:00:69:43:1a}
I0520 11:36:59.182728 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | domain old-k8s-version-210420 has defined IP address 192.168.83.100 and MAC address 52:54:00:69:43:1a in network mk-old-k8s-version-210420
I0520 11:36:59.182892 54732 provision.go:143] copyHostCerts
I0520 11:36:59.182948 54732 exec_runner.go:144] found /home/jenkins/minikube-integration/18925-3819/.minikube/key.pem, removing ...
I0520 11:36:59.182963 54732 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18925-3819/.minikube/key.pem
I0520 11:36:59.183017 54732 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18925-3819/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18925-3819/.minikube/key.pem (1679 bytes)
I0520 11:36:59.183120 54732 exec_runner.go:144] found /home/jenkins/minikube-integration/18925-3819/.minikube/ca.pem, removing ...
I0520 11:36:59.183130 54732 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18925-3819/.minikube/ca.pem
I0520 11:36:59.183162 54732 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18925-3819/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18925-3819/.minikube/ca.pem (1078 bytes)
I0520 11:36:59.183225 54732 exec_runner.go:144] found /home/jenkins/minikube-integration/18925-3819/.minikube/cert.pem, removing ...
I0520 11:36:59.183232 54732 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18925-3819/.minikube/cert.pem
I0520 11:36:59.183252 54732 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18925-3819/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18925-3819/.minikube/cert.pem (1123 bytes)
I0520 11:36:59.183325 54732 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18925-3819/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18925-3819/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18925-3819/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-210420 san=[127.0.0.1 192.168.83.100 localhost minikube old-k8s-version-210420]
I0520 11:36:59.516574 54732 provision.go:177] copyRemoteCerts
I0520 11:36:59.516648 54732 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0520 11:36:59.516694 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetSSHHostname
I0520 11:36:59.520890 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | domain old-k8s-version-210420 has defined MAC address 52:54:00:69:43:1a in network mk-old-k8s-version-210420
I0520 11:36:59.521316 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:69:43:1a", ip: ""} in network mk-old-k8s-version-210420: {Iface:virbr4 ExpiryTime:2024-05-20 12:36:50 +0000 UTC Type:0 Mac:52:54:00:69:43:1a Iaid: IPaddr:192.168.83.100 Prefix:24 Hostname:old-k8s-version-210420 Clientid:01:52:54:00:69:43:1a}
I0520 11:36:59.521452 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | domain old-k8s-version-210420 has defined IP address 192.168.83.100 and MAC address 52:54:00:69:43:1a in network mk-old-k8s-version-210420
I0520 11:36:59.521534 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetSSHPort
I0520 11:36:59.521799 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetSSHKeyPath
I0520 11:36:59.521994 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetSSHUsername
I0520 11:36:59.522137 54732 sshutil.go:53] new ssh client: &{IP:192.168.83.100 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18925-3819/.minikube/machines/old-k8s-version-210420/id_rsa Username:docker}
I0520 11:36:59.615162 54732 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-3819/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0520 11:36:59.639370 54732 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-3819/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0520 11:36:59.669948 54732 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-3819/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0520 11:36:59.697465 54732 provision.go:87] duration metric: took 521.714661ms to configureAuth
I0520 11:36:59.697495 54732 buildroot.go:189] setting minikube options for container-runtime
I0520 11:36:59.697690 54732 config.go:182] Loaded profile config "old-k8s-version-210420": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0520 11:36:59.697772 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetSSHHostname
I0520 11:36:59.700598 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | domain old-k8s-version-210420 has defined MAC address 52:54:00:69:43:1a in network mk-old-k8s-version-210420
I0520 11:36:59.700997 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:69:43:1a", ip: ""} in network mk-old-k8s-version-210420: {Iface:virbr4 ExpiryTime:2024-05-20 12:36:50 +0000 UTC Type:0 Mac:52:54:00:69:43:1a Iaid: IPaddr:192.168.83.100 Prefix:24 Hostname:old-k8s-version-210420 Clientid:01:52:54:00:69:43:1a}
I0520 11:36:59.701028 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | domain old-k8s-version-210420 has defined IP address 192.168.83.100 and MAC address 52:54:00:69:43:1a in network mk-old-k8s-version-210420
I0520 11:36:59.701242 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetSSHPort
I0520 11:36:59.701414 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetSSHKeyPath
I0520 11:36:59.701561 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetSSHKeyPath
I0520 11:36:59.701663 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetSSHUsername
I0520 11:36:59.701879 54732 main.go:141] libmachine: Using SSH client type: native
I0520 11:36:59.702086 54732 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d800] 0x830560 <nil> [] 0s} 192.168.83.100 22 <nil> <nil>}
I0520 11:36:59.702102 54732 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0520 11:37:00.030830 54732 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0520 11:37:00.030863 54732 main.go:141] libmachine: Checking connection to Docker...
I0520 11:37:00.030875 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetURL
I0520 11:37:00.032252 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | Using libvirt version 6000000
I0520 11:37:00.034407 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | domain old-k8s-version-210420 has defined MAC address 52:54:00:69:43:1a in network mk-old-k8s-version-210420
I0520 11:37:00.034740 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:69:43:1a", ip: ""} in network mk-old-k8s-version-210420: {Iface:virbr4 ExpiryTime:2024-05-20 12:36:50 +0000 UTC Type:0 Mac:52:54:00:69:43:1a Iaid: IPaddr:192.168.83.100 Prefix:24 Hostname:old-k8s-version-210420 Clientid:01:52:54:00:69:43:1a}
I0520 11:37:00.034776 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | domain old-k8s-version-210420 has defined IP address 192.168.83.100 and MAC address 52:54:00:69:43:1a in network mk-old-k8s-version-210420
I0520 11:37:00.034998 54732 main.go:141] libmachine: Docker is up and running!
I0520 11:37:00.035022 54732 main.go:141] libmachine: Reticulating splines...
I0520 11:37:00.035028 54732 client.go:171] duration metric: took 25.015121735s to LocalClient.Create
I0520 11:37:00.035057 54732 start.go:167] duration metric: took 25.015189379s to libmachine.API.Create "old-k8s-version-210420"
I0520 11:37:00.035076 54732 start.go:293] postStartSetup for "old-k8s-version-210420" (driver="kvm2")
I0520 11:37:00.035090 54732 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0520 11:37:00.035116 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .DriverName
I0520 11:37:00.035406 54732 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0520 11:37:00.035442 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetSSHHostname
I0520 11:37:00.037625 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | domain old-k8s-version-210420 has defined MAC address 52:54:00:69:43:1a in network mk-old-k8s-version-210420
I0520 11:37:00.037965 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:69:43:1a", ip: ""} in network mk-old-k8s-version-210420: {Iface:virbr4 ExpiryTime:2024-05-20 12:36:50 +0000 UTC Type:0 Mac:52:54:00:69:43:1a Iaid: IPaddr:192.168.83.100 Prefix:24 Hostname:old-k8s-version-210420 Clientid:01:52:54:00:69:43:1a}
I0520 11:37:00.037999 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | domain old-k8s-version-210420 has defined IP address 192.168.83.100 and MAC address 52:54:00:69:43:1a in network mk-old-k8s-version-210420
I0520 11:37:00.038068 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetSSHPort
I0520 11:37:00.038248 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetSSHKeyPath
I0520 11:37:00.038449 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetSSHUsername
I0520 11:37:00.038628 54732 sshutil.go:53] new ssh client: &{IP:192.168.83.100 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18925-3819/.minikube/machines/old-k8s-version-210420/id_rsa Username:docker}
I0520 11:37:00.128149 54732 ssh_runner.go:195] Run: cat /etc/os-release
I0520 11:37:00.132646 54732 info.go:137] Remote host: Buildroot 2023.02.9
I0520 11:37:00.132670 54732 filesync.go:126] Scanning /home/jenkins/minikube-integration/18925-3819/.minikube/addons for local assets ...
I0520 11:37:00.132739 54732 filesync.go:126] Scanning /home/jenkins/minikube-integration/18925-3819/.minikube/files for local assets ...
I0520 11:37:00.132838 54732 filesync.go:149] local asset: /home/jenkins/minikube-integration/18925-3819/.minikube/files/etc/ssl/certs/111622.pem -> 111622.pem in /etc/ssl/certs
I0520 11:37:00.132998 54732 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0520 11:37:00.142874 54732 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-3819/.minikube/files/etc/ssl/certs/111622.pem --> /etc/ssl/certs/111622.pem (1708 bytes)
I0520 11:37:00.169803 54732 start.go:296] duration metric: took 134.712167ms for postStartSetup
I0520 11:37:00.169866 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetConfigRaw
I0520 11:37:00.170434 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetIP
I0520 11:37:00.173263 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | domain old-k8s-version-210420 has defined MAC address 52:54:00:69:43:1a in network mk-old-k8s-version-210420
I0520 11:37:00.173608 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:69:43:1a", ip: ""} in network mk-old-k8s-version-210420: {Iface:virbr4 ExpiryTime:2024-05-20 12:36:50 +0000 UTC Type:0 Mac:52:54:00:69:43:1a Iaid: IPaddr:192.168.83.100 Prefix:24 Hostname:old-k8s-version-210420 Clientid:01:52:54:00:69:43:1a}
I0520 11:37:00.173633 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | domain old-k8s-version-210420 has defined IP address 192.168.83.100 and MAC address 52:54:00:69:43:1a in network mk-old-k8s-version-210420
I0520 11:37:00.173934 54732 profile.go:143] Saving config to /home/jenkins/minikube-integration/18925-3819/.minikube/profiles/old-k8s-version-210420/config.json ...
I0520 11:37:00.174155 54732 start.go:128] duration metric: took 25.173945173s to createHost
I0520 11:37:00.174185 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetSSHHostname
I0520 11:37:00.176961 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | domain old-k8s-version-210420 has defined MAC address 52:54:00:69:43:1a in network mk-old-k8s-version-210420
I0520 11:37:00.177375 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:69:43:1a", ip: ""} in network mk-old-k8s-version-210420: {Iface:virbr4 ExpiryTime:2024-05-20 12:36:50 +0000 UTC Type:0 Mac:52:54:00:69:43:1a Iaid: IPaddr:192.168.83.100 Prefix:24 Hostname:old-k8s-version-210420 Clientid:01:52:54:00:69:43:1a}
I0520 11:37:00.177397 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | domain old-k8s-version-210420 has defined IP address 192.168.83.100 and MAC address 52:54:00:69:43:1a in network mk-old-k8s-version-210420
I0520 11:37:00.177708 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetSSHPort
I0520 11:37:00.177888 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetSSHKeyPath
I0520 11:37:00.178074 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetSSHKeyPath
I0520 11:37:00.178247 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetSSHUsername
I0520 11:37:00.178432 54732 main.go:141] libmachine: Using SSH client type: native
I0520 11:37:00.178642 54732 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d800] 0x830560 <nil> [] 0s} 192.168.83.100 22 <nil> <nil>}
I0520 11:37:00.178659 54732 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0520 11:37:00.293928 54732 main.go:141] libmachine: SSH cmd err, output: <nil>: 1716205020.272115335
I0520 11:37:00.293949 54732 fix.go:216] guest clock: 1716205020.272115335
I0520 11:37:00.293959 54732 fix.go:229] Guest: 2024-05-20 11:37:00.272115335 +0000 UTC Remote: 2024-05-20 11:37:00.174170865 +0000 UTC m=+25.282981176 (delta=97.94447ms)
I0520 11:37:00.294015 54732 fix.go:200] guest clock delta is within tolerance: 97.94447ms
I0520 11:37:00.294023 54732 start.go:83] releasing machines lock for "old-k8s-version-210420", held for 25.293893571s
I0520 11:37:00.294050 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .DriverName
I0520 11:37:00.294323 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetIP
I0520 11:37:00.297134 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | domain old-k8s-version-210420 has defined MAC address 52:54:00:69:43:1a in network mk-old-k8s-version-210420
I0520 11:37:00.297565 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:69:43:1a", ip: ""} in network mk-old-k8s-version-210420: {Iface:virbr4 ExpiryTime:2024-05-20 12:36:50 +0000 UTC Type:0 Mac:52:54:00:69:43:1a Iaid: IPaddr:192.168.83.100 Prefix:24 Hostname:old-k8s-version-210420 Clientid:01:52:54:00:69:43:1a}
I0520 11:37:00.297596 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | domain old-k8s-version-210420 has defined IP address 192.168.83.100 and MAC address 52:54:00:69:43:1a in network mk-old-k8s-version-210420
I0520 11:37:00.297885 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .DriverName
I0520 11:37:00.298445 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .DriverName
I0520 11:37:00.298625 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .DriverName
I0520 11:37:00.298696 54732 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0520 11:37:00.298744 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetSSHHostname
I0520 11:37:00.298828 54732 ssh_runner.go:195] Run: cat /version.json
I0520 11:37:00.298860 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetSSHHostname
I0520 11:37:00.301978 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | domain old-k8s-version-210420 has defined MAC address 52:54:00:69:43:1a in network mk-old-k8s-version-210420
I0520 11:37:00.302405 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | domain old-k8s-version-210420 has defined MAC address 52:54:00:69:43:1a in network mk-old-k8s-version-210420
I0520 11:37:00.302462 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:69:43:1a", ip: ""} in network mk-old-k8s-version-210420: {Iface:virbr4 ExpiryTime:2024-05-20 12:36:50 +0000 UTC Type:0 Mac:52:54:00:69:43:1a Iaid: IPaddr:192.168.83.100 Prefix:24 Hostname:old-k8s-version-210420 Clientid:01:52:54:00:69:43:1a}
I0520 11:37:00.302490 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | domain old-k8s-version-210420 has defined IP address 192.168.83.100 and MAC address 52:54:00:69:43:1a in network mk-old-k8s-version-210420
I0520 11:37:00.302601 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetSSHPort
I0520 11:37:00.302743 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetSSHKeyPath
I0520 11:37:00.302885 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetSSHUsername
I0520 11:37:00.302980 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:69:43:1a", ip: ""} in network mk-old-k8s-version-210420: {Iface:virbr4 ExpiryTime:2024-05-20 12:36:50 +0000 UTC Type:0 Mac:52:54:00:69:43:1a Iaid: IPaddr:192.168.83.100 Prefix:24 Hostname:old-k8s-version-210420 Clientid:01:52:54:00:69:43:1a}
I0520 11:37:00.303000 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | domain old-k8s-version-210420 has defined IP address 192.168.83.100 and MAC address 52:54:00:69:43:1a in network mk-old-k8s-version-210420
I0520 11:37:00.303029 54732 sshutil.go:53] new ssh client: &{IP:192.168.83.100 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18925-3819/.minikube/machines/old-k8s-version-210420/id_rsa Username:docker}
I0520 11:37:00.303310 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetSSHPort
I0520 11:37:00.303464 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetSSHKeyPath
I0520 11:37:00.303598 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetSSHUsername
I0520 11:37:00.303715 54732 sshutil.go:53] new ssh client: &{IP:192.168.83.100 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18925-3819/.minikube/machines/old-k8s-version-210420/id_rsa Username:docker}
W0520 11:37:00.415297 54732 out.go:239] ! Image was not built for the current minikube version. To resolve this you can delete and recreate your minikube cluster using the latest images. Expected minikube version: v1.33.0 -> Actual minikube version: v1.33.1
! Image was not built for the current minikube version. To resolve this you can delete and recreate your minikube cluster using the latest images. Expected minikube version: v1.33.0 -> Actual minikube version: v1.33.1
I0520 11:37:00.415384 54732 ssh_runner.go:195] Run: systemctl --version
I0520 11:37:00.422441 54732 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0520 11:37:00.586815 54732 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0520 11:37:00.594067 54732 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0520 11:37:00.594148 54732 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0520 11:37:00.610884 54732 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0520 11:37:00.610907 54732 start.go:494] detecting cgroup driver to use...
I0520 11:37:00.610976 54732 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0520 11:37:00.628469 54732 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0520 11:37:00.644580 54732 docker.go:217] disabling cri-docker service (if available) ...
I0520 11:37:00.644642 54732 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0520 11:37:00.659819 54732 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0520 11:37:00.673915 54732 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0520 11:37:00.804460 54732 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0520 11:37:00.986774 54732 docker.go:233] disabling docker service ...
I0520 11:37:00.986844 54732 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0520 11:37:01.004845 54732 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0520 11:37:01.019356 54732 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0520 11:37:01.148680 54732 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0520 11:37:01.269540 54732 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0520 11:37:01.285312 54732 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0520 11:37:01.304010 54732 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0520 11:37:01.304084 54732 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0520 11:37:01.316378 54732 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0520 11:37:01.316451 54732 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0520 11:37:01.327728 54732 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0520 11:37:01.338698 54732 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0520 11:37:01.349526 54732 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0520 11:37:01.360959 54732 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0520 11:37:01.373008 54732 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0520 11:37:01.373060 54732 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0520 11:37:01.386782 54732 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0520 11:37:01.397163 54732 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0520 11:37:01.518110 54732 ssh_runner.go:195] Run: sudo systemctl restart crio
I0520 11:37:01.665579 54732 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0520 11:37:01.665652 54732 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0520 11:37:01.670666 54732 start.go:562] Will wait 60s for crictl version
I0520 11:37:01.670709 54732 ssh_runner.go:195] Run: which crictl
I0520 11:37:01.674485 54732 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0520 11:37:01.728836 54732 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0520 11:37:01.728982 54732 ssh_runner.go:195] Run: crio --version
I0520 11:37:01.760458 54732 ssh_runner.go:195] Run: crio --version
I0520 11:37:01.792553 54732 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0520 11:37:01.793799 54732 main.go:141] libmachine: (old-k8s-version-210420) Calling .GetIP
I0520 11:37:01.796811 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | domain old-k8s-version-210420 has defined MAC address 52:54:00:69:43:1a in network mk-old-k8s-version-210420
I0520 11:37:01.797255 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:69:43:1a", ip: ""} in network mk-old-k8s-version-210420: {Iface:virbr4 ExpiryTime:2024-05-20 12:36:50 +0000 UTC Type:0 Mac:52:54:00:69:43:1a Iaid: IPaddr:192.168.83.100 Prefix:24 Hostname:old-k8s-version-210420 Clientid:01:52:54:00:69:43:1a}
I0520 11:37:01.797279 54732 main.go:141] libmachine: (old-k8s-version-210420) DBG | domain old-k8s-version-210420 has defined IP address 192.168.83.100 and MAC address 52:54:00:69:43:1a in network mk-old-k8s-version-210420
I0520 11:37:01.797553 54732 ssh_runner.go:195] Run: grep 192.168.83.1 host.minikube.internal$ /etc/hosts
I0520 11:37:01.801923 54732 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.83.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0520 11:37:01.814795 54732 kubeadm.go:877] updating cluster {Name:old-k8s-version-210420 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18869/minikube-v1.33.1-1715594774-18869-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1715707529-18887@sha256:734a2adad159415bd51b0392bc8976bd7e3e543e9165c2374d6e59bac37aed3a Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-210420 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.83.100 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] M
ountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0520 11:37:01.814936 54732 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0520 11:37:01.815002 54732 ssh_runner.go:195] Run: sudo crictl images --output json
I0520 11:37:01.846574 54732 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0520 11:37:01.846646 54732 ssh_runner.go:195] Run: which lz4
I0520 11:37:01.850943 54732 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0520 11:37:01.855547 54732 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0520 11:37:01.855574 54732 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-3819/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0520 11:37:03.680746 54732 crio.go:462] duration metric: took 1.829828922s to copy over tarball
I0520 11:37:03.680826 54732 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0520 11:37:06.452881 54732 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.77202524s)
I0520 11:37:06.452914 54732 crio.go:469] duration metric: took 2.77213672s to extract the tarball
I0520 11:37:06.452948 54732 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0520 11:37:06.496108 54732 ssh_runner.go:195] Run: sudo crictl images --output json
I0520 11:37:06.542385 54732 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0520 11:37:06.542414 54732 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0520 11:37:06.542466 54732 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0520 11:37:06.542500 54732 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0520 11:37:06.542517 54732 image.go:134] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0520 11:37:06.542528 54732 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0520 11:37:06.542579 54732 image.go:134] retrieving image: registry.k8s.io/coredns:1.7.0
I0520 11:37:06.542620 54732 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0520 11:37:06.542508 54732 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0520 11:37:06.542588 54732 image.go:134] retrieving image: registry.k8s.io/pause:3.2
I0520 11:37:06.543881 54732 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0520 11:37:06.543932 54732 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0520 11:37:06.544060 54732 image.go:177] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0520 11:37:06.544066 54732 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0520 11:37:06.544057 54732 image.go:177] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0520 11:37:06.544093 54732 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0520 11:37:06.544088 54732 image.go:177] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0520 11:37:06.544234 54732 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0520 11:37:06.689722 54732 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0520 11:37:06.692704 54732 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0520 11:37:06.700348 54732 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0520 11:37:06.715480 54732 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0520 11:37:06.736341 54732 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0520 11:37:06.740710 54732 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0520 11:37:06.745468 54732 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0520 11:37:06.745506 54732 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0520 11:37:06.745544 54732 ssh_runner.go:195] Run: which crictl
I0520 11:37:06.755418 54732 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0520 11:37:06.845909 54732 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0520 11:37:06.845942 54732 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0520 11:37:06.845961 54732 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0520 11:37:06.845977 54732 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0520 11:37:06.846011 54732 ssh_runner.go:195] Run: which crictl
I0520 11:37:06.846035 54732 ssh_runner.go:195] Run: which crictl
I0520 11:37:06.893251 54732 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0520 11:37:06.893310 54732 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0520 11:37:06.893290 54732 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0520 11:37:06.893347 54732 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0520 11:37:06.893361 54732 ssh_runner.go:195] Run: which crictl
I0520 11:37:06.893406 54732 ssh_runner.go:195] Run: which crictl
I0520 11:37:06.904838 54732 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0520 11:37:06.904904 54732 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0520 11:37:06.904920 54732 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0520 11:37:06.904968 54732 ssh_runner.go:195] Run: which crictl
I0520 11:37:06.910151 54732 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0520 11:37:06.910188 54732 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0520 11:37:06.910215 54732 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0520 11:37:06.910228 54732 ssh_runner.go:195] Run: which crictl
I0520 11:37:06.910230 54732 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0520 11:37:06.910288 54732 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0520 11:37:06.910363 54732 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0520 11:37:06.912545 54732 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0520 11:37:07.003917 54732 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18925-3819/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0520 11:37:07.021998 54732 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18925-3819/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0520 11:37:07.038760 54732 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18925-3819/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0520 11:37:07.038853 54732 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0520 11:37:07.038887 54732 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18925-3819/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0520 11:37:07.039429 54732 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18925-3819/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0520 11:37:07.042472 54732 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18925-3819/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0520 11:37:07.075138 54732 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18925-3819/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0520 11:37:07.461848 54732 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0520 11:37:07.605217 54732 cache_images.go:92] duration metric: took 1.062783538s to LoadCachedImages
W0520 11:37:07.605318 54732 out.go:239] X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/18925-3819/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0: no such file or directory
X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/18925-3819/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0: no such file or directory
I0520 11:37:07.605336 54732 kubeadm.go:928] updating node { 192.168.83.100 8443 v1.20.0 crio true true} ...
I0520 11:37:07.605472 54732 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-210420 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.83.100
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-210420 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0520 11:37:07.605583 54732 ssh_runner.go:195] Run: crio config
I0520 11:37:07.668258 54732 cni.go:84] Creating CNI manager for ""
I0520 11:37:07.668286 54732 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0520 11:37:07.668310 54732 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0520 11:37:07.668337 54732 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.83.100 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-210420 NodeName:old-k8s-version-210420 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.83.100"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.83.100 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0520 11:37:07.668520 54732 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.83.100
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-210420"
kubeletExtraArgs:
node-ip: 192.168.83.100
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.83.100"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0520 11:37:07.668591 54732 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0520 11:37:07.679647 54732 binaries.go:44] Found k8s binaries, skipping transfer
I0520 11:37:07.679713 54732 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0520 11:37:07.689918 54732 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0520 11:37:07.711056 54732 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0520 11:37:07.730271 54732 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2123 bytes)
I0520 11:37:07.751969 54732 ssh_runner.go:195] Run: grep 192.168.83.100 control-plane.minikube.internal$ /etc/hosts
I0520 11:37:07.756727 54732 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.83.100 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0520 11:37:07.771312 54732 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0520 11:37:07.893449 54732 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0520 11:37:07.911536 54732 certs.go:68] Setting up /home/jenkins/minikube-integration/18925-3819/.minikube/profiles/old-k8s-version-210420 for IP: 192.168.83.100
I0520 11:37:07.911562 54732 certs.go:194] generating shared ca certs ...
I0520 11:37:07.911582 54732 certs.go:226] acquiring lock for ca certs: {Name:mk10f8c4e53cbda78dab56f1515712938835df03 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0520 11:37:07.911754 54732 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/18925-3819/.minikube/ca.key
I0520 11:37:07.911807 54732 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/18925-3819/.minikube/proxy-client-ca.key
I0520 11:37:07.911819 54732 certs.go:256] generating profile certs ...
I0520 11:37:07.911894 54732 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/18925-3819/.minikube/profiles/old-k8s-version-210420/client.key
I0520 11:37:07.911913 54732 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18925-3819/.minikube/profiles/old-k8s-version-210420/client.crt with IP's: []
I0520 11:37:08.010690 54732 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18925-3819/.minikube/profiles/old-k8s-version-210420/client.crt ...
I0520 11:37:08.010774 54732 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18925-3819/.minikube/profiles/old-k8s-version-210420/client.crt: {Name:mk37e4d8e6b70b9df4bd1f33a3bb1ce774741c46 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0520 11:37:08.010992 54732 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18925-3819/.minikube/profiles/old-k8s-version-210420/client.key ...
I0520 11:37:08.011048 54732 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18925-3819/.minikube/profiles/old-k8s-version-210420/client.key: {Name:mkef658583b929f627b0a4742ad863dab8569cac Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0520 11:37:08.011194 54732 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/18925-3819/.minikube/profiles/old-k8s-version-210420/apiserver.key.a7d5d0f9
I0520 11:37:08.011251 54732 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18925-3819/.minikube/profiles/old-k8s-version-210420/apiserver.crt.a7d5d0f9 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.83.100]
I0520 11:37:08.123361 54732 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18925-3819/.minikube/profiles/old-k8s-version-210420/apiserver.crt.a7d5d0f9 ...
I0520 11:37:08.123391 54732 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18925-3819/.minikube/profiles/old-k8s-version-210420/apiserver.crt.a7d5d0f9: {Name:mk126bf7eda8dbc6aeee644e3e54901634a644ad Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0520 11:37:08.123558 54732 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18925-3819/.minikube/profiles/old-k8s-version-210420/apiserver.key.a7d5d0f9 ...
I0520 11:37:08.123577 54732 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18925-3819/.minikube/profiles/old-k8s-version-210420/apiserver.key.a7d5d0f9: {Name:mkf6c45a2b2e90a3cb664c8a2d9327ba46d6c43e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0520 11:37:08.123773 54732 certs.go:381] copying /home/jenkins/minikube-integration/18925-3819/.minikube/profiles/old-k8s-version-210420/apiserver.crt.a7d5d0f9 -> /home/jenkins/minikube-integration/18925-3819/.minikube/profiles/old-k8s-version-210420/apiserver.crt
I0520 11:37:08.123864 54732 certs.go:385] copying /home/jenkins/minikube-integration/18925-3819/.minikube/profiles/old-k8s-version-210420/apiserver.key.a7d5d0f9 -> /home/jenkins/minikube-integration/18925-3819/.minikube/profiles/old-k8s-version-210420/apiserver.key
I0520 11:37:08.123915 54732 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/18925-3819/.minikube/profiles/old-k8s-version-210420/proxy-client.key
I0520 11:37:08.123933 54732 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18925-3819/.minikube/profiles/old-k8s-version-210420/proxy-client.crt with IP's: []
I0520 11:37:08.287603 54732 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18925-3819/.minikube/profiles/old-k8s-version-210420/proxy-client.crt ...
I0520 11:37:08.287636 54732 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18925-3819/.minikube/profiles/old-k8s-version-210420/proxy-client.crt: {Name:mk5a61fe0b766f2d87c141b576ed804ead7b2cef Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0520 11:37:08.287789 54732 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18925-3819/.minikube/profiles/old-k8s-version-210420/proxy-client.key ...
I0520 11:37:08.287803 54732 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18925-3819/.minikube/profiles/old-k8s-version-210420/proxy-client.key: {Name:mk6ecec165027e23fe429021af4b2049861c5527 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0520 11:37:08.287990 54732 certs.go:484] found cert: /home/jenkins/minikube-integration/18925-3819/.minikube/certs/11162.pem (1338 bytes)
W0520 11:37:08.288041 54732 certs.go:480] ignoring /home/jenkins/minikube-integration/18925-3819/.minikube/certs/11162_empty.pem, impossibly tiny 0 bytes
I0520 11:37:08.288052 54732 certs.go:484] found cert: /home/jenkins/minikube-integration/18925-3819/.minikube/certs/ca-key.pem (1675 bytes)
I0520 11:37:08.288094 54732 certs.go:484] found cert: /home/jenkins/minikube-integration/18925-3819/.minikube/certs/ca.pem (1078 bytes)
I0520 11:37:08.288129 54732 certs.go:484] found cert: /home/jenkins/minikube-integration/18925-3819/.minikube/certs/cert.pem (1123 bytes)
I0520 11:37:08.288162 54732 certs.go:484] found cert: /home/jenkins/minikube-integration/18925-3819/.minikube/certs/key.pem (1679 bytes)
I0520 11:37:08.288214 54732 certs.go:484] found cert: /home/jenkins/minikube-integration/18925-3819/.minikube/files/etc/ssl/certs/111622.pem (1708 bytes)
I0520 11:37:08.288774 54732 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-3819/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0520 11:37:08.323616 54732 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-3819/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0520 11:37:08.353034 54732 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-3819/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0520 11:37:08.383245 54732 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-3819/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0520 11:37:08.412983 54732 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-3819/.minikube/profiles/old-k8s-version-210420/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0520 11:37:08.443285 54732 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-3819/.minikube/profiles/old-k8s-version-210420/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0520 11:37:08.474262 54732 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-3819/.minikube/profiles/old-k8s-version-210420/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0520 11:37:08.507794 54732 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-3819/.minikube/profiles/old-k8s-version-210420/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0520 11:37:08.542166 54732 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-3819/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0520 11:37:08.572287 54732 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-3819/.minikube/certs/11162.pem --> /usr/share/ca-certificates/11162.pem (1338 bytes)
I0520 11:37:08.603134 54732 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-3819/.minikube/files/etc/ssl/certs/111622.pem --> /usr/share/ca-certificates/111622.pem (1708 bytes)
I0520 11:37:08.633088 54732 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0520 11:37:08.650484 54732 ssh_runner.go:195] Run: openssl version
I0520 11:37:08.657729 54732 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0520 11:37:08.669476 54732 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0520 11:37:08.674540 54732 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 May 20 10:22 /usr/share/ca-certificates/minikubeCA.pem
I0520 11:37:08.674594 54732 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0520 11:37:08.682466 54732 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0520 11:37:08.694751 54732 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/11162.pem && ln -fs /usr/share/ca-certificates/11162.pem /etc/ssl/certs/11162.pem"
I0520 11:37:08.709664 54732 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/11162.pem
I0520 11:37:08.715955 54732 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 May 20 10:34 /usr/share/ca-certificates/11162.pem
I0520 11:37:08.716013 54732 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/11162.pem
I0520 11:37:08.724137 54732 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/11162.pem /etc/ssl/certs/51391683.0"
I0520 11:37:08.736195 54732 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/111622.pem && ln -fs /usr/share/ca-certificates/111622.pem /etc/ssl/certs/111622.pem"
I0520 11:37:08.747804 54732 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/111622.pem
I0520 11:37:08.754314 54732 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 May 20 10:34 /usr/share/ca-certificates/111622.pem
I0520 11:37:08.754379 54732 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/111622.pem
I0520 11:37:08.762305 54732 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/111622.pem /etc/ssl/certs/3ec20f2e.0"
I0520 11:37:08.777044 54732 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0520 11:37:08.782996 54732 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0520 11:37:08.783051 54732 kubeadm.go:391] StartCluster: {Name:old-k8s-version-210420 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18869/minikube-v1.33.1-1715594774-18869-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1715707529-18887@sha256:734a2adad159415bd51b0392bc8976bd7e3e543e9165c2374d6e59bac37aed3a Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-210420 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.83.100 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Moun
tPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0520 11:37:08.783153 54732 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0520 11:37:08.783206 54732 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0520 11:37:08.832683 54732 cri.go:89] found id: ""
I0520 11:37:08.832748 54732 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0520 11:37:08.843324 54732 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0520 11:37:08.853560 54732 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0520 11:37:08.863070 54732 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0520 11:37:08.863089 54732 kubeadm.go:156] found existing configuration files:
I0520 11:37:08.863140 54732 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0520 11:37:08.876732 54732 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0520 11:37:08.876795 54732 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0520 11:37:08.888527 54732 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0520 11:37:08.904546 54732 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0520 11:37:08.904618 54732 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0520 11:37:08.920506 54732 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0520 11:37:08.932922 54732 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0520 11:37:08.932998 54732 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0520 11:37:08.954646 54732 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0520 11:37:08.966058 54732 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0520 11:37:08.966132 54732 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0520 11:37:08.978052 54732 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0520 11:37:09.252760 54732 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0520 11:39:06.870452 54732 kubeadm.go:309] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0520 11:39:06.870569 54732 kubeadm.go:309] To see the stack trace of this error execute with --v=5 or higher
I0520 11:39:06.872019 54732 kubeadm.go:309] [init] Using Kubernetes version: v1.20.0
I0520 11:39:06.872105 54732 kubeadm.go:309] [preflight] Running pre-flight checks
I0520 11:39:06.872214 54732 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0520 11:39:06.872397 54732 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0520 11:39:06.872485 54732 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0520 11:39:06.872538 54732 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0520 11:39:06.874474 54732 out.go:204] - Generating certificates and keys ...
I0520 11:39:06.874567 54732 kubeadm.go:309] [certs] Using existing ca certificate authority
I0520 11:39:06.874665 54732 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0520 11:39:06.874778 54732 kubeadm.go:309] [certs] Generating "apiserver-kubelet-client" certificate and key
I0520 11:39:06.874866 54732 kubeadm.go:309] [certs] Generating "front-proxy-ca" certificate and key
I0520 11:39:06.874951 54732 kubeadm.go:309] [certs] Generating "front-proxy-client" certificate and key
I0520 11:39:06.875031 54732 kubeadm.go:309] [certs] Generating "etcd/ca" certificate and key
I0520 11:39:06.875109 54732 kubeadm.go:309] [certs] Generating "etcd/server" certificate and key
I0520 11:39:06.875267 54732 kubeadm.go:309] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-210420] and IPs [192.168.83.100 127.0.0.1 ::1]
I0520 11:39:06.875316 54732 kubeadm.go:309] [certs] Generating "etcd/peer" certificate and key
I0520 11:39:06.875430 54732 kubeadm.go:309] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-210420] and IPs [192.168.83.100 127.0.0.1 ::1]
I0520 11:39:06.875494 54732 kubeadm.go:309] [certs] Generating "etcd/healthcheck-client" certificate and key
I0520 11:39:06.875546 54732 kubeadm.go:309] [certs] Generating "apiserver-etcd-client" certificate and key
I0520 11:39:06.875587 54732 kubeadm.go:309] [certs] Generating "sa" key and public key
I0520 11:39:06.875650 54732 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0520 11:39:06.875701 54732 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0520 11:39:06.875755 54732 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0520 11:39:06.875830 54732 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0520 11:39:06.875897 54732 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0520 11:39:06.876045 54732 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0520 11:39:06.876121 54732 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0520 11:39:06.876173 54732 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0520 11:39:06.876241 54732 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0520 11:39:06.877814 54732 out.go:204] - Booting up control plane ...
I0520 11:39:06.877901 54732 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0520 11:39:06.877977 54732 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0520 11:39:06.878035 54732 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0520 11:39:06.878112 54732 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0520 11:39:06.878339 54732 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0520 11:39:06.878421 54732 kubeadm.go:309] [kubelet-check] Initial timeout of 40s passed.
I0520 11:39:06.878525 54732 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0520 11:39:06.878750 54732 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0520 11:39:06.878810 54732 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0520 11:39:06.879031 54732 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0520 11:39:06.879097 54732 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0520 11:39:06.879264 54732 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0520 11:39:06.879331 54732 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0520 11:39:06.879523 54732 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0520 11:39:06.879596 54732 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0520 11:39:06.879768 54732 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0520 11:39:06.879776 54732 kubeadm.go:309]
I0520 11:39:06.879809 54732 kubeadm.go:309] Unfortunately, an error has occurred:
I0520 11:39:06.879843 54732 kubeadm.go:309] timed out waiting for the condition
I0520 11:39:06.879853 54732 kubeadm.go:309]
I0520 11:39:06.879883 54732 kubeadm.go:309] This error is likely caused by:
I0520 11:39:06.879916 54732 kubeadm.go:309] - The kubelet is not running
I0520 11:39:06.880008 54732 kubeadm.go:309] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0520 11:39:06.880019 54732 kubeadm.go:309]
I0520 11:39:06.880109 54732 kubeadm.go:309] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0520 11:39:06.880145 54732 kubeadm.go:309] - 'systemctl status kubelet'
I0520 11:39:06.880174 54732 kubeadm.go:309] - 'journalctl -xeu kubelet'
I0520 11:39:06.880180 54732 kubeadm.go:309]
I0520 11:39:06.880282 54732 kubeadm.go:309] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0520 11:39:06.880357 54732 kubeadm.go:309] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0520 11:39:06.880363 54732 kubeadm.go:309]
I0520 11:39:06.880449 54732 kubeadm.go:309] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0520 11:39:06.880521 54732 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0520 11:39:06.880601 54732 kubeadm.go:309] Once you have found the failing container, you can inspect its logs with:
I0520 11:39:06.880684 54732 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0520 11:39:06.880746 54732 kubeadm.go:309]
W0520 11:39:06.880820 54732 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-210420] and IPs [192.168.83.100 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-210420] and IPs [192.168.83.100 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-210420] and IPs [192.168.83.100 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-210420] and IPs [192.168.83.100 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0520 11:39:06.880872 54732 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0520 11:39:07.352365 54732 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0520 11:39:07.370353 54732 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0520 11:39:07.383396 54732 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0520 11:39:07.383423 54732 kubeadm.go:156] found existing configuration files:
I0520 11:39:07.383484 54732 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0520 11:39:07.394548 54732 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0520 11:39:07.394612 54732 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0520 11:39:07.404757 54732 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0520 11:39:07.414241 54732 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0520 11:39:07.414291 54732 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0520 11:39:07.423674 54732 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0520 11:39:07.434052 54732 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0520 11:39:07.434118 54732 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0520 11:39:07.443817 54732 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0520 11:39:07.453000 54732 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0520 11:39:07.453055 54732 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0520 11:39:07.462906 54732 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0520 11:39:07.695143 54732 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0520 11:41:03.444918 54732 kubeadm.go:309] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0520 11:41:03.445084 54732 kubeadm.go:309] To see the stack trace of this error execute with --v=5 or higher
I0520 11:41:03.446449 54732 kubeadm.go:309] [init] Using Kubernetes version: v1.20.0
I0520 11:41:03.446551 54732 kubeadm.go:309] [preflight] Running pre-flight checks
I0520 11:41:03.446647 54732 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0520 11:41:03.446768 54732 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0520 11:41:03.446915 54732 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0520 11:41:03.447031 54732 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0520 11:41:03.448689 54732 out.go:204] - Generating certificates and keys ...
I0520 11:41:03.448753 54732 kubeadm.go:309] [certs] Using existing ca certificate authority
I0520 11:41:03.448808 54732 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0520 11:41:03.448875 54732 kubeadm.go:309] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0520 11:41:03.448970 54732 kubeadm.go:309] [certs] Using existing front-proxy-ca certificate authority
I0520 11:41:03.449051 54732 kubeadm.go:309] [certs] Using existing front-proxy-client certificate and key on disk
I0520 11:41:03.449129 54732 kubeadm.go:309] [certs] Using existing etcd/ca certificate authority
I0520 11:41:03.449209 54732 kubeadm.go:309] [certs] Using existing etcd/server certificate and key on disk
I0520 11:41:03.449318 54732 kubeadm.go:309] [certs] Using existing etcd/peer certificate and key on disk
I0520 11:41:03.449434 54732 kubeadm.go:309] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0520 11:41:03.449536 54732 kubeadm.go:309] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0520 11:41:03.449598 54732 kubeadm.go:309] [certs] Using the existing "sa" key
I0520 11:41:03.449676 54732 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0520 11:41:03.449742 54732 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0520 11:41:03.449820 54732 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0520 11:41:03.449907 54732 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0520 11:41:03.449976 54732 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0520 11:41:03.450121 54732 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0520 11:41:03.450253 54732 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0520 11:41:03.450321 54732 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0520 11:41:03.450427 54732 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0520 11:41:03.451864 54732 out.go:204] - Booting up control plane ...
I0520 11:41:03.451947 54732 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0520 11:41:03.452022 54732 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0520 11:41:03.452097 54732 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0520 11:41:03.452195 54732 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0520 11:41:03.452372 54732 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0520 11:41:03.452437 54732 kubeadm.go:309] [kubelet-check] Initial timeout of 40s passed.
I0520 11:41:03.452506 54732 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0520 11:41:03.452737 54732 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0520 11:41:03.452847 54732 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0520 11:41:03.453058 54732 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0520 11:41:03.453148 54732 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0520 11:41:03.453347 54732 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0520 11:41:03.453451 54732 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0520 11:41:03.453665 54732 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0520 11:41:03.453729 54732 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0520 11:41:03.453943 54732 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0520 11:41:03.453951 54732 kubeadm.go:309]
I0520 11:41:03.454012 54732 kubeadm.go:309] Unfortunately, an error has occurred:
I0520 11:41:03.454059 54732 kubeadm.go:309] timed out waiting for the condition
I0520 11:41:03.454074 54732 kubeadm.go:309]
I0520 11:41:03.454114 54732 kubeadm.go:309] This error is likely caused by:
I0520 11:41:03.454150 54732 kubeadm.go:309] - The kubelet is not running
I0520 11:41:03.454285 54732 kubeadm.go:309] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0520 11:41:03.454293 54732 kubeadm.go:309]
I0520 11:41:03.454384 54732 kubeadm.go:309] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0520 11:41:03.454437 54732 kubeadm.go:309] - 'systemctl status kubelet'
I0520 11:41:03.454477 54732 kubeadm.go:309] - 'journalctl -xeu kubelet'
I0520 11:41:03.454485 54732 kubeadm.go:309]
I0520 11:41:03.454596 54732 kubeadm.go:309] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0520 11:41:03.454696 54732 kubeadm.go:309] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0520 11:41:03.454706 54732 kubeadm.go:309]
I0520 11:41:03.454840 54732 kubeadm.go:309] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0520 11:41:03.454933 54732 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0520 11:41:03.455017 54732 kubeadm.go:309] Once you have found the failing container, you can inspect its logs with:
I0520 11:41:03.455083 54732 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0520 11:41:03.455125 54732 kubeadm.go:309]
I0520 11:41:03.455149 54732 kubeadm.go:393] duration metric: took 3m54.67210194s to StartCluster
I0520 11:41:03.455189 54732 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0520 11:41:03.455240 54732 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0520 11:41:03.505729 54732 cri.go:89] found id: ""
I0520 11:41:03.505754 54732 logs.go:276] 0 containers: []
W0520 11:41:03.505762 54732 logs.go:278] No container was found matching "kube-apiserver"
I0520 11:41:03.505768 54732 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0520 11:41:03.505813 54732 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0520 11:41:03.542383 54732 cri.go:89] found id: ""
I0520 11:41:03.542413 54732 logs.go:276] 0 containers: []
W0520 11:41:03.542424 54732 logs.go:278] No container was found matching "etcd"
I0520 11:41:03.542432 54732 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0520 11:41:03.542497 54732 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0520 11:41:03.575843 54732 cri.go:89] found id: ""
I0520 11:41:03.575867 54732 logs.go:276] 0 containers: []
W0520 11:41:03.575876 54732 logs.go:278] No container was found matching "coredns"
I0520 11:41:03.575881 54732 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0520 11:41:03.575927 54732 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0520 11:41:03.614187 54732 cri.go:89] found id: ""
I0520 11:41:03.614213 54732 logs.go:276] 0 containers: []
W0520 11:41:03.614220 54732 logs.go:278] No container was found matching "kube-scheduler"
I0520 11:41:03.614226 54732 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0520 11:41:03.614276 54732 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0520 11:41:03.650186 54732 cri.go:89] found id: ""
I0520 11:41:03.650210 54732 logs.go:276] 0 containers: []
W0520 11:41:03.650222 54732 logs.go:278] No container was found matching "kube-proxy"
I0520 11:41:03.650227 54732 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0520 11:41:03.650279 54732 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0520 11:41:03.684191 54732 cri.go:89] found id: ""
I0520 11:41:03.684222 54732 logs.go:276] 0 containers: []
W0520 11:41:03.684231 54732 logs.go:278] No container was found matching "kube-controller-manager"
I0520 11:41:03.684239 54732 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0520 11:41:03.684311 54732 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0520 11:41:03.716280 54732 cri.go:89] found id: ""
I0520 11:41:03.716311 54732 logs.go:276] 0 containers: []
W0520 11:41:03.716322 54732 logs.go:278] No container was found matching "kindnet"
I0520 11:41:03.716332 54732 logs.go:123] Gathering logs for container status ...
I0520 11:41:03.716346 54732 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0520 11:41:03.757209 54732 logs.go:123] Gathering logs for kubelet ...
I0520 11:41:03.757237 54732 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0520 11:41:03.808564 54732 logs.go:123] Gathering logs for dmesg ...
I0520 11:41:03.808596 54732 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0520 11:41:03.821715 54732 logs.go:123] Gathering logs for describe nodes ...
I0520 11:41:03.821738 54732 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0520 11:41:03.938212 54732 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0520 11:41:03.938232 54732 logs.go:123] Gathering logs for CRI-O ...
I0520 11:41:03.938245 54732 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
W0520 11:41:04.040204 54732 out.go:364] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0520 11:41:04.040259 54732 out.go:239] *
*
W0520 11:41:04.040326 54732 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0520 11:41:04.040357 54732 out.go:239] *
*
W0520 11:41:04.041244 54732 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0520 11:41:04.044166 54732 out.go:177]
W0520 11:41:04.045419 54732 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0520 11:41:04.045482 54732 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0520 11:41:04.045519 54732 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0520 11:41:04.047686 54732 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-210420 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-210420 -n old-k8s-version-210420
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-210420 -n old-k8s-version-210420: exit status 6 (224.661073ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0520 11:41:04.314737 57578 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-210420" does not appear in /home/jenkins/minikube-integration/18925-3819/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-210420" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (269.44s)