=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-968094 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-968094 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m54.460714591s)
-- stdout --
* [old-k8s-version-968094] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=18384
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/18384-942544/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/18384-942544/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-968094" primary control-plane node in "old-k8s-version-968094" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0314 19:13:54.203012 988436 out.go:291] Setting OutFile to fd 1 ...
I0314 19:13:54.203275 988436 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0314 19:13:54.203286 988436 out.go:304] Setting ErrFile to fd 2...
I0314 19:13:54.203290 988436 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0314 19:13:54.203485 988436 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18384-942544/.minikube/bin
I0314 19:13:54.204081 988436 out.go:298] Setting JSON to false
I0314 19:13:54.205130 988436 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-13","uptime":96986,"bootTime":1710346648,"procs":215,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1053-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0314 19:13:54.205196 988436 start.go:139] virtualization: kvm guest
I0314 19:13:54.207533 988436 out.go:177] * [old-k8s-version-968094] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
I0314 19:13:54.208949 988436 out.go:177] - MINIKUBE_LOCATION=18384
I0314 19:13:54.210269 988436 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0314 19:13:54.208984 988436 notify.go:220] Checking for updates...
I0314 19:13:54.212612 988436 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/18384-942544/kubeconfig
I0314 19:13:54.213838 988436 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/18384-942544/.minikube
I0314 19:13:54.215125 988436 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0314 19:13:54.216269 988436 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0314 19:13:54.217858 988436 config.go:182] Loaded profile config "NoKubernetes-578974": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v0.0.0
I0314 19:13:54.217977 988436 config.go:182] Loaded profile config "cert-expiration-525214": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0314 19:13:54.218083 988436 config.go:182] Loaded profile config "kubernetes-upgrade-097195": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.29.0-rc.2
I0314 19:13:54.218183 988436 driver.go:392] Setting default libvirt URI to qemu:///system
I0314 19:13:55.200119 988436 out.go:177] * Using the kvm2 driver based on user configuration
I0314 19:13:55.201713 988436 start.go:297] selected driver: kvm2
I0314 19:13:55.201733 988436 start.go:901] validating driver "kvm2" against <nil>
I0314 19:13:55.201749 988436 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0314 19:13:55.202770 988436 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0314 19:13:55.202862 988436 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/18384-942544/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0314 19:13:55.219661 988436 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.32.0
I0314 19:13:55.219716 988436 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0314 19:13:55.219981 988436 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0314 19:13:55.220026 988436 cni.go:84] Creating CNI manager for ""
I0314 19:13:55.220037 988436 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0314 19:13:55.220050 988436 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0314 19:13:55.220108 988436 start.go:340] cluster config:
{Name:old-k8s-version-968094 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-968094 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0314 19:13:55.220237 988436 iso.go:125] acquiring lock: {Name:mk586a3a5cfb4f22aec6aed37f8969c973afde28 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0314 19:13:55.221929 988436 out.go:177] * Starting "old-k8s-version-968094" primary control-plane node in "old-k8s-version-968094" cluster
I0314 19:13:55.223255 988436 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0314 19:13:55.223299 988436 preload.go:147] Found local preload: /home/jenkins/minikube-integration/18384-942544/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0314 19:13:55.223313 988436 cache.go:56] Caching tarball of preloaded images
I0314 19:13:55.223411 988436 preload.go:173] Found /home/jenkins/minikube-integration/18384-942544/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0314 19:13:55.223426 988436 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0314 19:13:55.223547 988436 profile.go:142] Saving config to /home/jenkins/minikube-integration/18384-942544/.minikube/profiles/old-k8s-version-968094/config.json ...
I0314 19:13:55.223570 988436 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18384-942544/.minikube/profiles/old-k8s-version-968094/config.json: {Name:mk775b9e5ec231840f7f8b92c4b92c61a3c60317 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0314 19:13:55.223721 988436 start.go:360] acquireMachinesLock for old-k8s-version-968094: {Name:mk9a566594d7aef48d36f06eee60109ab60ed27a Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0314 19:14:14.977397 988436 start.go:364] duration metric: took 19.753633418s to acquireMachinesLock for "old-k8s-version-968094"
I0314 19:14:14.977471 988436 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-968094 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18375/minikube-v1.32.1-1710348681-18375-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-968094 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0314 19:14:14.977616 988436 start.go:125] createHost starting for "" (driver="kvm2")
I0314 19:14:14.979586 988436 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0314 19:14:14.979774 988436 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0314 19:14:14.979842 988436 main.go:141] libmachine: Launching plugin server for driver kvm2
I0314 19:14:14.996969 988436 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37201
I0314 19:14:14.997375 988436 main.go:141] libmachine: () Calling .GetVersion
I0314 19:14:14.997882 988436 main.go:141] libmachine: Using API Version 1
I0314 19:14:14.997906 988436 main.go:141] libmachine: () Calling .SetConfigRaw
I0314 19:14:14.998341 988436 main.go:141] libmachine: () Calling .GetMachineName
I0314 19:14:14.998669 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetMachineName
I0314 19:14:14.998872 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .DriverName
I0314 19:14:14.999049 988436 start.go:159] libmachine.API.Create for "old-k8s-version-968094" (driver="kvm2")
I0314 19:14:14.999078 988436 client.go:168] LocalClient.Create starting
I0314 19:14:14.999125 988436 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18384-942544/.minikube/certs/ca.pem
I0314 19:14:14.999170 988436 main.go:141] libmachine: Decoding PEM data...
I0314 19:14:14.999194 988436 main.go:141] libmachine: Parsing certificate...
I0314 19:14:14.999299 988436 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18384-942544/.minikube/certs/cert.pem
I0314 19:14:14.999324 988436 main.go:141] libmachine: Decoding PEM data...
I0314 19:14:14.999335 988436 main.go:141] libmachine: Parsing certificate...
I0314 19:14:14.999353 988436 main.go:141] libmachine: Running pre-create checks...
I0314 19:14:14.999578 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .PreCreateCheck
I0314 19:14:15.001322 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetConfigRaw
I0314 19:14:15.001814 988436 main.go:141] libmachine: Creating machine...
I0314 19:14:15.001831 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .Create
I0314 19:14:15.002002 988436 main.go:141] libmachine: (old-k8s-version-968094) Creating KVM machine...
I0314 19:14:15.003167 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | found existing default KVM network
I0314 19:14:15.004844 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | I0314 19:14:15.004693 988720 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:01:d2:f4} reservation:<nil>}
I0314 19:14:15.005768 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | I0314 19:14:15.005684 988720 network.go:211] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr2 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:2b:d3:3a} reservation:<nil>}
I0314 19:14:15.006646 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | I0314 19:14:15.006567 988720 network.go:211] skipping subnet 192.168.61.0/24 that is taken: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName:virbr3 IfaceIPv4:192.168.61.1 IfaceMTU:1500 IfaceMAC:52:54:00:24:75:87} reservation:<nil>}
I0314 19:14:15.007824 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | I0314 19:14:15.007730 988720 network.go:206] using free private subnet 192.168.72.0/24: &{IP:192.168.72.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.72.0/24 Gateway:192.168.72.1 ClientMin:192.168.72.2 ClientMax:192.168.72.254 Broadcast:192.168.72.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000352480}
I0314 19:14:15.007850 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | created network xml:
I0314 19:14:15.007864 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | <network>
I0314 19:14:15.007873 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | <name>mk-old-k8s-version-968094</name>
I0314 19:14:15.007887 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | <dns enable='no'/>
I0314 19:14:15.007897 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG |
I0314 19:14:15.007913 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | <ip address='192.168.72.1' netmask='255.255.255.0'>
I0314 19:14:15.007926 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | <dhcp>
I0314 19:14:15.007936 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | <range start='192.168.72.2' end='192.168.72.253'/>
I0314 19:14:15.007946 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | </dhcp>
I0314 19:14:15.007954 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | </ip>
I0314 19:14:15.007965 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG |
I0314 19:14:15.007974 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | </network>
I0314 19:14:15.007980 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG |
I0314 19:14:15.013775 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | trying to create private KVM network mk-old-k8s-version-968094 192.168.72.0/24...
I0314 19:14:15.087225 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | private KVM network mk-old-k8s-version-968094 192.168.72.0/24 created
I0314 19:14:15.087259 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | I0314 19:14:15.087173 988720 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/18384-942544/.minikube
I0314 19:14:15.087278 988436 main.go:141] libmachine: (old-k8s-version-968094) Setting up store path in /home/jenkins/minikube-integration/18384-942544/.minikube/machines/old-k8s-version-968094 ...
I0314 19:14:15.087297 988436 main.go:141] libmachine: (old-k8s-version-968094) Building disk image from file:///home/jenkins/minikube-integration/18384-942544/.minikube/cache/iso/amd64/minikube-v1.32.1-1710348681-18375-amd64.iso
I0314 19:14:15.087352 988436 main.go:141] libmachine: (old-k8s-version-968094) Downloading /home/jenkins/minikube-integration/18384-942544/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/18384-942544/.minikube/cache/iso/amd64/minikube-v1.32.1-1710348681-18375-amd64.iso...
I0314 19:14:15.334181 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | I0314 19:14:15.334042 988720 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/18384-942544/.minikube/machines/old-k8s-version-968094/id_rsa...
I0314 19:14:15.502173 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | I0314 19:14:15.502014 988720 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/18384-942544/.minikube/machines/old-k8s-version-968094/old-k8s-version-968094.rawdisk...
I0314 19:14:15.502210 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | Writing magic tar header
I0314 19:14:15.502233 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | Writing SSH key tar header
I0314 19:14:15.502248 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | I0314 19:14:15.502195 988720 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/18384-942544/.minikube/machines/old-k8s-version-968094 ...
I0314 19:14:15.502340 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18384-942544/.minikube/machines/old-k8s-version-968094
I0314 19:14:15.502378 988436 main.go:141] libmachine: (old-k8s-version-968094) Setting executable bit set on /home/jenkins/minikube-integration/18384-942544/.minikube/machines/old-k8s-version-968094 (perms=drwx------)
I0314 19:14:15.502394 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18384-942544/.minikube/machines
I0314 19:14:15.502415 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18384-942544/.minikube
I0314 19:14:15.502428 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18384-942544
I0314 19:14:15.502444 988436 main.go:141] libmachine: (old-k8s-version-968094) Setting executable bit set on /home/jenkins/minikube-integration/18384-942544/.minikube/machines (perms=drwxr-xr-x)
I0314 19:14:15.502456 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0314 19:14:15.502473 988436 main.go:141] libmachine: (old-k8s-version-968094) Setting executable bit set on /home/jenkins/minikube-integration/18384-942544/.minikube (perms=drwxr-xr-x)
I0314 19:14:15.502487 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | Checking permissions on dir: /home/jenkins
I0314 19:14:15.502501 988436 main.go:141] libmachine: (old-k8s-version-968094) Setting executable bit set on /home/jenkins/minikube-integration/18384-942544 (perms=drwxrwxr-x)
I0314 19:14:15.502516 988436 main.go:141] libmachine: (old-k8s-version-968094) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0314 19:14:15.502527 988436 main.go:141] libmachine: (old-k8s-version-968094) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0314 19:14:15.502542 988436 main.go:141] libmachine: (old-k8s-version-968094) Creating domain...
I0314 19:14:15.502553 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | Checking permissions on dir: /home
I0314 19:14:15.502573 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | Skipping /home - not owner
I0314 19:14:15.503897 988436 main.go:141] libmachine: (old-k8s-version-968094) define libvirt domain using xml:
I0314 19:14:15.503919 988436 main.go:141] libmachine: (old-k8s-version-968094) <domain type='kvm'>
I0314 19:14:15.503926 988436 main.go:141] libmachine: (old-k8s-version-968094) <name>old-k8s-version-968094</name>
I0314 19:14:15.503932 988436 main.go:141] libmachine: (old-k8s-version-968094) <memory unit='MiB'>2200</memory>
I0314 19:14:15.503938 988436 main.go:141] libmachine: (old-k8s-version-968094) <vcpu>2</vcpu>
I0314 19:14:15.503942 988436 main.go:141] libmachine: (old-k8s-version-968094) <features>
I0314 19:14:15.503950 988436 main.go:141] libmachine: (old-k8s-version-968094) <acpi/>
I0314 19:14:15.503955 988436 main.go:141] libmachine: (old-k8s-version-968094) <apic/>
I0314 19:14:15.503960 988436 main.go:141] libmachine: (old-k8s-version-968094) <pae/>
I0314 19:14:15.503965 988436 main.go:141] libmachine: (old-k8s-version-968094)
I0314 19:14:15.503970 988436 main.go:141] libmachine: (old-k8s-version-968094) </features>
I0314 19:14:15.503977 988436 main.go:141] libmachine: (old-k8s-version-968094) <cpu mode='host-passthrough'>
I0314 19:14:15.503983 988436 main.go:141] libmachine: (old-k8s-version-968094)
I0314 19:14:15.503988 988436 main.go:141] libmachine: (old-k8s-version-968094) </cpu>
I0314 19:14:15.503994 988436 main.go:141] libmachine: (old-k8s-version-968094) <os>
I0314 19:14:15.504002 988436 main.go:141] libmachine: (old-k8s-version-968094) <type>hvm</type>
I0314 19:14:15.504008 988436 main.go:141] libmachine: (old-k8s-version-968094) <boot dev='cdrom'/>
I0314 19:14:15.504019 988436 main.go:141] libmachine: (old-k8s-version-968094) <boot dev='hd'/>
I0314 19:14:15.504027 988436 main.go:141] libmachine: (old-k8s-version-968094) <bootmenu enable='no'/>
I0314 19:14:15.504032 988436 main.go:141] libmachine: (old-k8s-version-968094) </os>
I0314 19:14:15.504038 988436 main.go:141] libmachine: (old-k8s-version-968094) <devices>
I0314 19:14:15.504043 988436 main.go:141] libmachine: (old-k8s-version-968094) <disk type='file' device='cdrom'>
I0314 19:14:15.504053 988436 main.go:141] libmachine: (old-k8s-version-968094) <source file='/home/jenkins/minikube-integration/18384-942544/.minikube/machines/old-k8s-version-968094/boot2docker.iso'/>
I0314 19:14:15.504064 988436 main.go:141] libmachine: (old-k8s-version-968094) <target dev='hdc' bus='scsi'/>
I0314 19:14:15.504076 988436 main.go:141] libmachine: (old-k8s-version-968094) <readonly/>
I0314 19:14:15.504087 988436 main.go:141] libmachine: (old-k8s-version-968094) </disk>
I0314 19:14:15.504150 988436 main.go:141] libmachine: (old-k8s-version-968094) <disk type='file' device='disk'>
I0314 19:14:15.504178 988436 main.go:141] libmachine: (old-k8s-version-968094) <driver name='qemu' type='raw' cache='default' io='threads' />
I0314 19:14:15.504193 988436 main.go:141] libmachine: (old-k8s-version-968094) <source file='/home/jenkins/minikube-integration/18384-942544/.minikube/machines/old-k8s-version-968094/old-k8s-version-968094.rawdisk'/>
I0314 19:14:15.504202 988436 main.go:141] libmachine: (old-k8s-version-968094) <target dev='hda' bus='virtio'/>
I0314 19:14:15.504234 988436 main.go:141] libmachine: (old-k8s-version-968094) </disk>
I0314 19:14:15.504250 988436 main.go:141] libmachine: (old-k8s-version-968094) <interface type='network'>
I0314 19:14:15.504265 988436 main.go:141] libmachine: (old-k8s-version-968094) <source network='mk-old-k8s-version-968094'/>
I0314 19:14:15.504275 988436 main.go:141] libmachine: (old-k8s-version-968094) <model type='virtio'/>
I0314 19:14:15.504281 988436 main.go:141] libmachine: (old-k8s-version-968094) </interface>
I0314 19:14:15.504289 988436 main.go:141] libmachine: (old-k8s-version-968094) <interface type='network'>
I0314 19:14:15.504296 988436 main.go:141] libmachine: (old-k8s-version-968094) <source network='default'/>
I0314 19:14:15.504304 988436 main.go:141] libmachine: (old-k8s-version-968094) <model type='virtio'/>
I0314 19:14:15.504314 988436 main.go:141] libmachine: (old-k8s-version-968094) </interface>
I0314 19:14:15.504326 988436 main.go:141] libmachine: (old-k8s-version-968094) <serial type='pty'>
I0314 19:14:15.504337 988436 main.go:141] libmachine: (old-k8s-version-968094) <target port='0'/>
I0314 19:14:15.504350 988436 main.go:141] libmachine: (old-k8s-version-968094) </serial>
I0314 19:14:15.504360 988436 main.go:141] libmachine: (old-k8s-version-968094) <console type='pty'>
I0314 19:14:15.504366 988436 main.go:141] libmachine: (old-k8s-version-968094) <target type='serial' port='0'/>
I0314 19:14:15.504373 988436 main.go:141] libmachine: (old-k8s-version-968094) </console>
I0314 19:14:15.504379 988436 main.go:141] libmachine: (old-k8s-version-968094) <rng model='virtio'>
I0314 19:14:15.504387 988436 main.go:141] libmachine: (old-k8s-version-968094) <backend model='random'>/dev/random</backend>
I0314 19:14:15.504394 988436 main.go:141] libmachine: (old-k8s-version-968094) </rng>
I0314 19:14:15.504405 988436 main.go:141] libmachine: (old-k8s-version-968094)
I0314 19:14:15.504419 988436 main.go:141] libmachine: (old-k8s-version-968094)
I0314 19:14:15.504434 988436 main.go:141] libmachine: (old-k8s-version-968094) </devices>
I0314 19:14:15.504472 988436 main.go:141] libmachine: (old-k8s-version-968094) </domain>
I0314 19:14:15.504497 988436 main.go:141] libmachine: (old-k8s-version-968094)
I0314 19:14:15.509914 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | domain old-k8s-version-968094 has defined MAC address 52:54:00:11:fb:7b in network default
I0314 19:14:15.510536 988436 main.go:141] libmachine: (old-k8s-version-968094) Ensuring networks are active...
I0314 19:14:15.510563 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | domain old-k8s-version-968094 has defined MAC address 52:54:00:45:00:8a in network mk-old-k8s-version-968094
I0314 19:14:15.511299 988436 main.go:141] libmachine: (old-k8s-version-968094) Ensuring network default is active
I0314 19:14:15.511673 988436 main.go:141] libmachine: (old-k8s-version-968094) Ensuring network mk-old-k8s-version-968094 is active
I0314 19:14:15.512297 988436 main.go:141] libmachine: (old-k8s-version-968094) Getting domain xml...
I0314 19:14:15.513015 988436 main.go:141] libmachine: (old-k8s-version-968094) Creating domain...
I0314 19:14:16.838508 988436 main.go:141] libmachine: (old-k8s-version-968094) Waiting to get IP...
I0314 19:14:16.839093 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | domain old-k8s-version-968094 has defined MAC address 52:54:00:45:00:8a in network mk-old-k8s-version-968094
I0314 19:14:16.839434 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | unable to find current IP address of domain old-k8s-version-968094 in network mk-old-k8s-version-968094
I0314 19:14:16.839465 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | I0314 19:14:16.839422 988720 retry.go:31] will retry after 280.866203ms: waiting for machine to come up
I0314 19:14:17.122181 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | domain old-k8s-version-968094 has defined MAC address 52:54:00:45:00:8a in network mk-old-k8s-version-968094
I0314 19:14:17.123635 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | unable to find current IP address of domain old-k8s-version-968094 in network mk-old-k8s-version-968094
I0314 19:14:17.123664 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | I0314 19:14:17.123570 988720 retry.go:31] will retry after 276.458753ms: waiting for machine to come up
I0314 19:14:17.785603 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | domain old-k8s-version-968094 has defined MAC address 52:54:00:45:00:8a in network mk-old-k8s-version-968094
I0314 19:14:17.786111 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | unable to find current IP address of domain old-k8s-version-968094 in network mk-old-k8s-version-968094
I0314 19:14:17.786168 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | I0314 19:14:17.786093 988720 retry.go:31] will retry after 389.166315ms: waiting for machine to come up
I0314 19:14:18.176561 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | domain old-k8s-version-968094 has defined MAC address 52:54:00:45:00:8a in network mk-old-k8s-version-968094
I0314 19:14:18.177070 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | unable to find current IP address of domain old-k8s-version-968094 in network mk-old-k8s-version-968094
I0314 19:14:18.177106 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | I0314 19:14:18.177023 988720 retry.go:31] will retry after 380.752529ms: waiting for machine to come up
I0314 19:14:18.559815 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | domain old-k8s-version-968094 has defined MAC address 52:54:00:45:00:8a in network mk-old-k8s-version-968094
I0314 19:14:18.560949 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | unable to find current IP address of domain old-k8s-version-968094 in network mk-old-k8s-version-968094
I0314 19:14:18.560983 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | I0314 19:14:18.560890 988720 retry.go:31] will retry after 727.786586ms: waiting for machine to come up
I0314 19:14:19.290657 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | domain old-k8s-version-968094 has defined MAC address 52:54:00:45:00:8a in network mk-old-k8s-version-968094
I0314 19:14:19.291148 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | unable to find current IP address of domain old-k8s-version-968094 in network mk-old-k8s-version-968094
I0314 19:14:19.291182 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | I0314 19:14:19.291092 988720 retry.go:31] will retry after 821.899642ms: waiting for machine to come up
I0314 19:14:20.114550 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | domain old-k8s-version-968094 has defined MAC address 52:54:00:45:00:8a in network mk-old-k8s-version-968094
I0314 19:14:20.115072 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | unable to find current IP address of domain old-k8s-version-968094 in network mk-old-k8s-version-968094
I0314 19:14:20.115105 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | I0314 19:14:20.115013 988720 retry.go:31] will retry after 966.170572ms: waiting for machine to come up
I0314 19:14:21.083182 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | domain old-k8s-version-968094 has defined MAC address 52:54:00:45:00:8a in network mk-old-k8s-version-968094
I0314 19:14:21.083774 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | unable to find current IP address of domain old-k8s-version-968094 in network mk-old-k8s-version-968094
I0314 19:14:21.083801 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | I0314 19:14:21.083727 988720 retry.go:31] will retry after 1.076047079s: waiting for machine to come up
I0314 19:14:22.161652 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | domain old-k8s-version-968094 has defined MAC address 52:54:00:45:00:8a in network mk-old-k8s-version-968094
I0314 19:14:22.162151 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | unable to find current IP address of domain old-k8s-version-968094 in network mk-old-k8s-version-968094
I0314 19:14:22.162182 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | I0314 19:14:22.162089 988720 retry.go:31] will retry after 1.501351238s: waiting for machine to come up
I0314 19:14:23.665996 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | domain old-k8s-version-968094 has defined MAC address 52:54:00:45:00:8a in network mk-old-k8s-version-968094
I0314 19:14:23.666527 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | unable to find current IP address of domain old-k8s-version-968094 in network mk-old-k8s-version-968094
I0314 19:14:23.666563 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | I0314 19:14:23.666483 988720 retry.go:31] will retry after 1.978163759s: waiting for machine to come up
I0314 19:14:25.646944 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | domain old-k8s-version-968094 has defined MAC address 52:54:00:45:00:8a in network mk-old-k8s-version-968094
I0314 19:14:25.647516 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | unable to find current IP address of domain old-k8s-version-968094 in network mk-old-k8s-version-968094
I0314 19:14:25.647545 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | I0314 19:14:25.647467 988720 retry.go:31] will retry after 2.901646032s: waiting for machine to come up
I0314 19:14:28.552868 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | domain old-k8s-version-968094 has defined MAC address 52:54:00:45:00:8a in network mk-old-k8s-version-968094
I0314 19:14:28.553474 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | unable to find current IP address of domain old-k8s-version-968094 in network mk-old-k8s-version-968094
I0314 19:14:28.553508 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | I0314 19:14:28.553406 988720 retry.go:31] will retry after 3.528157438s: waiting for machine to come up
I0314 19:14:32.084474 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | domain old-k8s-version-968094 has defined MAC address 52:54:00:45:00:8a in network mk-old-k8s-version-968094
I0314 19:14:32.084898 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | unable to find current IP address of domain old-k8s-version-968094 in network mk-old-k8s-version-968094
I0314 19:14:32.084931 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | I0314 19:14:32.084846 988720 retry.go:31] will retry after 4.015658963s: waiting for machine to come up
I0314 19:14:36.102233 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | domain old-k8s-version-968094 has defined MAC address 52:54:00:45:00:8a in network mk-old-k8s-version-968094
I0314 19:14:36.102603 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | unable to find current IP address of domain old-k8s-version-968094 in network mk-old-k8s-version-968094
I0314 19:14:36.102632 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | I0314 19:14:36.102545 988720 retry.go:31] will retry after 5.130164013s: waiting for machine to come up
I0314 19:14:41.233833 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | domain old-k8s-version-968094 has defined MAC address 52:54:00:45:00:8a in network mk-old-k8s-version-968094
I0314 19:14:41.234521 988436 main.go:141] libmachine: (old-k8s-version-968094) Found IP for machine: 192.168.72.211
I0314 19:14:41.234548 988436 main.go:141] libmachine: (old-k8s-version-968094) Reserving static IP address...
I0314 19:14:41.234559 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | domain old-k8s-version-968094 has current primary IP address 192.168.72.211 and MAC address 52:54:00:45:00:8a in network mk-old-k8s-version-968094
I0314 19:14:41.234918 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-968094", mac: "52:54:00:45:00:8a", ip: "192.168.72.211"} in network mk-old-k8s-version-968094
I0314 19:14:41.311619 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | Getting to WaitForSSH function...
I0314 19:14:41.311651 988436 main.go:141] libmachine: (old-k8s-version-968094) Reserved static IP address: 192.168.72.211
I0314 19:14:41.311664 988436 main.go:141] libmachine: (old-k8s-version-968094) Waiting for SSH to be available...
I0314 19:14:41.314272 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | domain old-k8s-version-968094 has defined MAC address 52:54:00:45:00:8a in network mk-old-k8s-version-968094
I0314 19:14:41.314865 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:45:00:8a", ip: ""} in network mk-old-k8s-version-968094: {Iface:virbr4 ExpiryTime:2024-03-14 20:14:31 +0000 UTC Type:0 Mac:52:54:00:45:00:8a Iaid: IPaddr:192.168.72.211 Prefix:24 Hostname:minikube Clientid:01:52:54:00:45:00:8a}
I0314 19:14:41.314905 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | domain old-k8s-version-968094 has defined IP address 192.168.72.211 and MAC address 52:54:00:45:00:8a in network mk-old-k8s-version-968094
I0314 19:14:41.315027 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | Using SSH client type: external
I0314 19:14:41.315064 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | Using SSH private key: /home/jenkins/minikube-integration/18384-942544/.minikube/machines/old-k8s-version-968094/id_rsa (-rw-------)
I0314 19:14:41.315099 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.72.211 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/18384-942544/.minikube/machines/old-k8s-version-968094/id_rsa -p 22] /usr/bin/ssh <nil>}
I0314 19:14:41.315121 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | About to run SSH command:
I0314 19:14:41.315135 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | exit 0
I0314 19:14:41.440131 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | SSH cmd err, output: <nil>:
I0314 19:14:41.440410 988436 main.go:141] libmachine: (old-k8s-version-968094) KVM machine creation complete!
I0314 19:14:41.440739 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetConfigRaw
I0314 19:14:41.441338 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .DriverName
I0314 19:14:41.441540 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .DriverName
I0314 19:14:41.441683 988436 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0314 19:14:41.441703 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetState
I0314 19:14:41.443149 988436 main.go:141] libmachine: Detecting operating system of created instance...
I0314 19:14:41.443165 988436 main.go:141] libmachine: Waiting for SSH to be available...
I0314 19:14:41.443173 988436 main.go:141] libmachine: Getting to WaitForSSH function...
I0314 19:14:41.443179 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetSSHHostname
I0314 19:14:41.445819 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | domain old-k8s-version-968094 has defined MAC address 52:54:00:45:00:8a in network mk-old-k8s-version-968094
I0314 19:14:41.446175 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:45:00:8a", ip: ""} in network mk-old-k8s-version-968094: {Iface:virbr4 ExpiryTime:2024-03-14 20:14:31 +0000 UTC Type:0 Mac:52:54:00:45:00:8a Iaid: IPaddr:192.168.72.211 Prefix:24 Hostname:old-k8s-version-968094 Clientid:01:52:54:00:45:00:8a}
I0314 19:14:41.446211 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | domain old-k8s-version-968094 has defined IP address 192.168.72.211 and MAC address 52:54:00:45:00:8a in network mk-old-k8s-version-968094
I0314 19:14:41.446343 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetSSHPort
I0314 19:14:41.446536 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetSSHKeyPath
I0314 19:14:41.446702 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetSSHKeyPath
I0314 19:14:41.446836 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetSSHUsername
I0314 19:14:41.447031 988436 main.go:141] libmachine: Using SSH client type: native
I0314 19:14:41.447292 988436 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4a0] 0x830200 <nil> [] 0s} 192.168.72.211 22 <nil> <nil>}
I0314 19:14:41.447309 988436 main.go:141] libmachine: About to run SSH command:
exit 0
I0314 19:14:41.555625 988436 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0314 19:14:41.555651 988436 main.go:141] libmachine: Detecting the provisioner...
I0314 19:14:41.555661 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetSSHHostname
I0314 19:14:41.558680 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | domain old-k8s-version-968094 has defined MAC address 52:54:00:45:00:8a in network mk-old-k8s-version-968094
I0314 19:14:41.559201 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:45:00:8a", ip: ""} in network mk-old-k8s-version-968094: {Iface:virbr4 ExpiryTime:2024-03-14 20:14:31 +0000 UTC Type:0 Mac:52:54:00:45:00:8a Iaid: IPaddr:192.168.72.211 Prefix:24 Hostname:old-k8s-version-968094 Clientid:01:52:54:00:45:00:8a}
I0314 19:14:41.559234 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | domain old-k8s-version-968094 has defined IP address 192.168.72.211 and MAC address 52:54:00:45:00:8a in network mk-old-k8s-version-968094
I0314 19:14:41.559380 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetSSHPort
I0314 19:14:41.559603 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetSSHKeyPath
I0314 19:14:41.559772 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetSSHKeyPath
I0314 19:14:41.559895 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetSSHUsername
I0314 19:14:41.560034 988436 main.go:141] libmachine: Using SSH client type: native
I0314 19:14:41.560224 988436 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4a0] 0x830200 <nil> [] 0s} 192.168.72.211 22 <nil> <nil>}
I0314 19:14:41.560241 988436 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0314 19:14:41.669043 988436 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0314 19:14:41.669119 988436 main.go:141] libmachine: found compatible host: buildroot
I0314 19:14:41.669132 988436 main.go:141] libmachine: Provisioning with buildroot...
I0314 19:14:41.669141 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetMachineName
I0314 19:14:41.669386 988436 buildroot.go:166] provisioning hostname "old-k8s-version-968094"
I0314 19:14:41.669423 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetMachineName
I0314 19:14:41.669617 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetSSHHostname
I0314 19:14:41.672459 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | domain old-k8s-version-968094 has defined MAC address 52:54:00:45:00:8a in network mk-old-k8s-version-968094
I0314 19:14:41.672874 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:45:00:8a", ip: ""} in network mk-old-k8s-version-968094: {Iface:virbr4 ExpiryTime:2024-03-14 20:14:31 +0000 UTC Type:0 Mac:52:54:00:45:00:8a Iaid: IPaddr:192.168.72.211 Prefix:24 Hostname:old-k8s-version-968094 Clientid:01:52:54:00:45:00:8a}
I0314 19:14:41.672902 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | domain old-k8s-version-968094 has defined IP address 192.168.72.211 and MAC address 52:54:00:45:00:8a in network mk-old-k8s-version-968094
I0314 19:14:41.673013 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetSSHPort
I0314 19:14:41.673213 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetSSHKeyPath
I0314 19:14:41.673399 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetSSHKeyPath
I0314 19:14:41.673528 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetSSHUsername
I0314 19:14:41.673671 988436 main.go:141] libmachine: Using SSH client type: native
I0314 19:14:41.673846 988436 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4a0] 0x830200 <nil> [] 0s} 192.168.72.211 22 <nil> <nil>}
I0314 19:14:41.673859 988436 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-968094 && echo "old-k8s-version-968094" | sudo tee /etc/hostname
I0314 19:14:41.802301 988436 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-968094
I0314 19:14:41.802339 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetSSHHostname
I0314 19:14:41.806468 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | domain old-k8s-version-968094 has defined MAC address 52:54:00:45:00:8a in network mk-old-k8s-version-968094
I0314 19:14:41.806904 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:45:00:8a", ip: ""} in network mk-old-k8s-version-968094: {Iface:virbr4 ExpiryTime:2024-03-14 20:14:31 +0000 UTC Type:0 Mac:52:54:00:45:00:8a Iaid: IPaddr:192.168.72.211 Prefix:24 Hostname:old-k8s-version-968094 Clientid:01:52:54:00:45:00:8a}
I0314 19:14:41.806938 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | domain old-k8s-version-968094 has defined IP address 192.168.72.211 and MAC address 52:54:00:45:00:8a in network mk-old-k8s-version-968094
I0314 19:14:41.807147 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetSSHPort
I0314 19:14:41.807366 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetSSHKeyPath
I0314 19:14:41.807517 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetSSHKeyPath
I0314 19:14:41.807661 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetSSHUsername
I0314 19:14:41.807812 988436 main.go:141] libmachine: Using SSH client type: native
I0314 19:14:41.808045 988436 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4a0] 0x830200 <nil> [] 0s} 192.168.72.211 22 <nil> <nil>}
I0314 19:14:41.808067 988436 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-968094' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-968094/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-968094' | sudo tee -a /etc/hosts;
fi
fi
I0314 19:14:41.926611 988436 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0314 19:14:41.926646 988436 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/18384-942544/.minikube CaCertPath:/home/jenkins/minikube-integration/18384-942544/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18384-942544/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18384-942544/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18384-942544/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18384-942544/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18384-942544/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18384-942544/.minikube}
I0314 19:14:41.926706 988436 buildroot.go:174] setting up certificates
I0314 19:14:41.926720 988436 provision.go:84] configureAuth start
I0314 19:14:41.926737 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetMachineName
I0314 19:14:41.927071 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetIP
I0314 19:14:41.929859 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | domain old-k8s-version-968094 has defined MAC address 52:54:00:45:00:8a in network mk-old-k8s-version-968094
I0314 19:14:41.930239 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:45:00:8a", ip: ""} in network mk-old-k8s-version-968094: {Iface:virbr4 ExpiryTime:2024-03-14 20:14:31 +0000 UTC Type:0 Mac:52:54:00:45:00:8a Iaid: IPaddr:192.168.72.211 Prefix:24 Hostname:old-k8s-version-968094 Clientid:01:52:54:00:45:00:8a}
I0314 19:14:41.930276 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | domain old-k8s-version-968094 has defined IP address 192.168.72.211 and MAC address 52:54:00:45:00:8a in network mk-old-k8s-version-968094
I0314 19:14:41.930391 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetSSHHostname
I0314 19:14:41.932830 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | domain old-k8s-version-968094 has defined MAC address 52:54:00:45:00:8a in network mk-old-k8s-version-968094
I0314 19:14:41.933165 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:45:00:8a", ip: ""} in network mk-old-k8s-version-968094: {Iface:virbr4 ExpiryTime:2024-03-14 20:14:31 +0000 UTC Type:0 Mac:52:54:00:45:00:8a Iaid: IPaddr:192.168.72.211 Prefix:24 Hostname:old-k8s-version-968094 Clientid:01:52:54:00:45:00:8a}
I0314 19:14:41.933194 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | domain old-k8s-version-968094 has defined IP address 192.168.72.211 and MAC address 52:54:00:45:00:8a in network mk-old-k8s-version-968094
I0314 19:14:41.933295 988436 provision.go:143] copyHostCerts
I0314 19:14:41.933367 988436 exec_runner.go:144] found /home/jenkins/minikube-integration/18384-942544/.minikube/key.pem, removing ...
I0314 19:14:41.933378 988436 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18384-942544/.minikube/key.pem
I0314 19:14:41.933440 988436 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18384-942544/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18384-942544/.minikube/key.pem (1675 bytes)
I0314 19:14:41.933566 988436 exec_runner.go:144] found /home/jenkins/minikube-integration/18384-942544/.minikube/ca.pem, removing ...
I0314 19:14:41.933579 988436 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18384-942544/.minikube/ca.pem
I0314 19:14:41.933612 988436 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18384-942544/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18384-942544/.minikube/ca.pem (1082 bytes)
I0314 19:14:41.933689 988436 exec_runner.go:144] found /home/jenkins/minikube-integration/18384-942544/.minikube/cert.pem, removing ...
I0314 19:14:41.933699 988436 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18384-942544/.minikube/cert.pem
I0314 19:14:41.933726 988436 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18384-942544/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18384-942544/.minikube/cert.pem (1123 bytes)
I0314 19:14:41.933797 988436 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18384-942544/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18384-942544/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18384-942544/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-968094 san=[127.0.0.1 192.168.72.211 localhost minikube old-k8s-version-968094]
I0314 19:14:42.182763 988436 provision.go:177] copyRemoteCerts
I0314 19:14:42.182826 988436 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0314 19:14:42.182857 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetSSHHostname
I0314 19:14:42.185712 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | domain old-k8s-version-968094 has defined MAC address 52:54:00:45:00:8a in network mk-old-k8s-version-968094
I0314 19:14:42.186035 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:45:00:8a", ip: ""} in network mk-old-k8s-version-968094: {Iface:virbr4 ExpiryTime:2024-03-14 20:14:31 +0000 UTC Type:0 Mac:52:54:00:45:00:8a Iaid: IPaddr:192.168.72.211 Prefix:24 Hostname:old-k8s-version-968094 Clientid:01:52:54:00:45:00:8a}
I0314 19:14:42.186066 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | domain old-k8s-version-968094 has defined IP address 192.168.72.211 and MAC address 52:54:00:45:00:8a in network mk-old-k8s-version-968094
I0314 19:14:42.186285 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetSSHPort
I0314 19:14:42.186534 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetSSHKeyPath
I0314 19:14:42.186705 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetSSHUsername
I0314 19:14:42.186852 988436 sshutil.go:53] new ssh client: &{IP:192.168.72.211 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18384-942544/.minikube/machines/old-k8s-version-968094/id_rsa Username:docker}
I0314 19:14:42.270889 988436 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18384-942544/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0314 19:14:42.298651 988436 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18384-942544/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0314 19:14:42.325621 988436 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18384-942544/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0314 19:14:42.352639 988436 provision.go:87] duration metric: took 425.90336ms to configureAuth
I0314 19:14:42.352669 988436 buildroot.go:189] setting minikube options for container-runtime
I0314 19:14:42.352875 988436 config.go:182] Loaded profile config "old-k8s-version-968094": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0314 19:14:42.352965 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetSSHHostname
I0314 19:14:42.355723 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | domain old-k8s-version-968094 has defined MAC address 52:54:00:45:00:8a in network mk-old-k8s-version-968094
I0314 19:14:42.356124 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:45:00:8a", ip: ""} in network mk-old-k8s-version-968094: {Iface:virbr4 ExpiryTime:2024-03-14 20:14:31 +0000 UTC Type:0 Mac:52:54:00:45:00:8a Iaid: IPaddr:192.168.72.211 Prefix:24 Hostname:old-k8s-version-968094 Clientid:01:52:54:00:45:00:8a}
I0314 19:14:42.356146 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | domain old-k8s-version-968094 has defined IP address 192.168.72.211 and MAC address 52:54:00:45:00:8a in network mk-old-k8s-version-968094
I0314 19:14:42.356341 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetSSHPort
I0314 19:14:42.356546 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetSSHKeyPath
I0314 19:14:42.356722 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetSSHKeyPath
I0314 19:14:42.356840 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetSSHUsername
I0314 19:14:42.357004 988436 main.go:141] libmachine: Using SSH client type: native
I0314 19:14:42.357172 988436 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4a0] 0x830200 <nil> [] 0s} 192.168.72.211 22 <nil> <nil>}
I0314 19:14:42.357189 988436 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0314 19:14:42.642868 988436 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0314 19:14:42.642901 988436 main.go:141] libmachine: Checking connection to Docker...
I0314 19:14:42.642912 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetURL
I0314 19:14:42.644372 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | Using libvirt version 6000000
I0314 19:14:42.647311 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | domain old-k8s-version-968094 has defined MAC address 52:54:00:45:00:8a in network mk-old-k8s-version-968094
I0314 19:14:42.647702 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:45:00:8a", ip: ""} in network mk-old-k8s-version-968094: {Iface:virbr4 ExpiryTime:2024-03-14 20:14:31 +0000 UTC Type:0 Mac:52:54:00:45:00:8a Iaid: IPaddr:192.168.72.211 Prefix:24 Hostname:old-k8s-version-968094 Clientid:01:52:54:00:45:00:8a}
I0314 19:14:42.647731 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | domain old-k8s-version-968094 has defined IP address 192.168.72.211 and MAC address 52:54:00:45:00:8a in network mk-old-k8s-version-968094
I0314 19:14:42.647954 988436 main.go:141] libmachine: Docker is up and running!
I0314 19:14:42.647972 988436 main.go:141] libmachine: Reticulating splines...
I0314 19:14:42.647981 988436 client.go:171] duration metric: took 27.648891803s to LocalClient.Create
I0314 19:14:42.648014 988436 start.go:167] duration metric: took 27.648964706s to libmachine.API.Create "old-k8s-version-968094"
I0314 19:14:42.648041 988436 start.go:293] postStartSetup for "old-k8s-version-968094" (driver="kvm2")
I0314 19:14:42.648055 988436 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0314 19:14:42.648075 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .DriverName
I0314 19:14:42.648374 988436 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0314 19:14:42.648405 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetSSHHostname
I0314 19:14:42.650521 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | domain old-k8s-version-968094 has defined MAC address 52:54:00:45:00:8a in network mk-old-k8s-version-968094
I0314 19:14:42.650849 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:45:00:8a", ip: ""} in network mk-old-k8s-version-968094: {Iface:virbr4 ExpiryTime:2024-03-14 20:14:31 +0000 UTC Type:0 Mac:52:54:00:45:00:8a Iaid: IPaddr:192.168.72.211 Prefix:24 Hostname:old-k8s-version-968094 Clientid:01:52:54:00:45:00:8a}
I0314 19:14:42.650879 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | domain old-k8s-version-968094 has defined IP address 192.168.72.211 and MAC address 52:54:00:45:00:8a in network mk-old-k8s-version-968094
I0314 19:14:42.650950 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetSSHPort
I0314 19:14:42.651149 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetSSHKeyPath
I0314 19:14:42.651350 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetSSHUsername
I0314 19:14:42.651499 988436 sshutil.go:53] new ssh client: &{IP:192.168.72.211 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18384-942544/.minikube/machines/old-k8s-version-968094/id_rsa Username:docker}
I0314 19:14:42.735116 988436 ssh_runner.go:195] Run: cat /etc/os-release
I0314 19:14:42.740327 988436 info.go:137] Remote host: Buildroot 2023.02.9
I0314 19:14:42.740353 988436 filesync.go:126] Scanning /home/jenkins/minikube-integration/18384-942544/.minikube/addons for local assets ...
I0314 19:14:42.740417 988436 filesync.go:126] Scanning /home/jenkins/minikube-integration/18384-942544/.minikube/files for local assets ...
I0314 19:14:42.740498 988436 filesync.go:149] local asset: /home/jenkins/minikube-integration/18384-942544/.minikube/files/etc/ssl/certs/9513112.pem -> 9513112.pem in /etc/ssl/certs
I0314 19:14:42.740607 988436 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0314 19:14:42.750455 988436 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18384-942544/.minikube/files/etc/ssl/certs/9513112.pem --> /etc/ssl/certs/9513112.pem (1708 bytes)
I0314 19:14:42.777266 988436 start.go:296] duration metric: took 129.209637ms for postStartSetup
I0314 19:14:42.777327 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetConfigRaw
I0314 19:14:42.778098 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetIP
I0314 19:14:42.781186 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | domain old-k8s-version-968094 has defined MAC address 52:54:00:45:00:8a in network mk-old-k8s-version-968094
I0314 19:14:42.781563 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:45:00:8a", ip: ""} in network mk-old-k8s-version-968094: {Iface:virbr4 ExpiryTime:2024-03-14 20:14:31 +0000 UTC Type:0 Mac:52:54:00:45:00:8a Iaid: IPaddr:192.168.72.211 Prefix:24 Hostname:old-k8s-version-968094 Clientid:01:52:54:00:45:00:8a}
I0314 19:14:42.781594 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | domain old-k8s-version-968094 has defined IP address 192.168.72.211 and MAC address 52:54:00:45:00:8a in network mk-old-k8s-version-968094
I0314 19:14:42.781820 988436 profile.go:142] Saving config to /home/jenkins/minikube-integration/18384-942544/.minikube/profiles/old-k8s-version-968094/config.json ...
I0314 19:14:42.782042 988436 start.go:128] duration metric: took 27.804406667s to createHost
I0314 19:14:42.782072 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetSSHHostname
I0314 19:14:42.784251 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | domain old-k8s-version-968094 has defined MAC address 52:54:00:45:00:8a in network mk-old-k8s-version-968094
I0314 19:14:42.784637 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:45:00:8a", ip: ""} in network mk-old-k8s-version-968094: {Iface:virbr4 ExpiryTime:2024-03-14 20:14:31 +0000 UTC Type:0 Mac:52:54:00:45:00:8a Iaid: IPaddr:192.168.72.211 Prefix:24 Hostname:old-k8s-version-968094 Clientid:01:52:54:00:45:00:8a}
I0314 19:14:42.784668 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | domain old-k8s-version-968094 has defined IP address 192.168.72.211 and MAC address 52:54:00:45:00:8a in network mk-old-k8s-version-968094
I0314 19:14:42.784784 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetSSHPort
I0314 19:14:42.785002 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetSSHKeyPath
I0314 19:14:42.785154 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetSSHKeyPath
I0314 19:14:42.785274 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetSSHUsername
I0314 19:14:42.785446 988436 main.go:141] libmachine: Using SSH client type: native
I0314 19:14:42.785606 988436 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4a0] 0x830200 <nil> [] 0s} 192.168.72.211 22 <nil> <nil>}
I0314 19:14:42.785617 988436 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0314 19:14:42.897283 988436 main.go:141] libmachine: SSH cmd err, output: <nil>: 1710443682.880012035
I0314 19:14:42.897308 988436 fix.go:216] guest clock: 1710443682.880012035
I0314 19:14:42.897317 988436 fix.go:229] Guest: 2024-03-14 19:14:42.880012035 +0000 UTC Remote: 2024-03-14 19:14:42.78205842 +0000 UTC m=+48.630554959 (delta=97.953615ms)
I0314 19:14:42.897367 988436 fix.go:200] guest clock delta is within tolerance: 97.953615ms
I0314 19:14:42.897374 988436 start.go:83] releasing machines lock for "old-k8s-version-968094", held for 27.91994048s
I0314 19:14:42.897416 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .DriverName
I0314 19:14:42.897723 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetIP
I0314 19:14:42.900723 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | domain old-k8s-version-968094 has defined MAC address 52:54:00:45:00:8a in network mk-old-k8s-version-968094
I0314 19:14:42.901123 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:45:00:8a", ip: ""} in network mk-old-k8s-version-968094: {Iface:virbr4 ExpiryTime:2024-03-14 20:14:31 +0000 UTC Type:0 Mac:52:54:00:45:00:8a Iaid: IPaddr:192.168.72.211 Prefix:24 Hostname:old-k8s-version-968094 Clientid:01:52:54:00:45:00:8a}
I0314 19:14:42.901151 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | domain old-k8s-version-968094 has defined IP address 192.168.72.211 and MAC address 52:54:00:45:00:8a in network mk-old-k8s-version-968094
I0314 19:14:42.901341 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .DriverName
I0314 19:14:42.901889 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .DriverName
I0314 19:14:42.902093 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .DriverName
I0314 19:14:42.902180 988436 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0314 19:14:42.902248 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetSSHHostname
I0314 19:14:42.902358 988436 ssh_runner.go:195] Run: cat /version.json
I0314 19:14:42.902387 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetSSHHostname
I0314 19:14:42.905112 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | domain old-k8s-version-968094 has defined MAC address 52:54:00:45:00:8a in network mk-old-k8s-version-968094
I0314 19:14:42.905330 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | domain old-k8s-version-968094 has defined MAC address 52:54:00:45:00:8a in network mk-old-k8s-version-968094
I0314 19:14:42.905535 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:45:00:8a", ip: ""} in network mk-old-k8s-version-968094: {Iface:virbr4 ExpiryTime:2024-03-14 20:14:31 +0000 UTC Type:0 Mac:52:54:00:45:00:8a Iaid: IPaddr:192.168.72.211 Prefix:24 Hostname:old-k8s-version-968094 Clientid:01:52:54:00:45:00:8a}
I0314 19:14:42.905578 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | domain old-k8s-version-968094 has defined IP address 192.168.72.211 and MAC address 52:54:00:45:00:8a in network mk-old-k8s-version-968094
I0314 19:14:42.905671 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetSSHPort
I0314 19:14:42.905808 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:45:00:8a", ip: ""} in network mk-old-k8s-version-968094: {Iface:virbr4 ExpiryTime:2024-03-14 20:14:31 +0000 UTC Type:0 Mac:52:54:00:45:00:8a Iaid: IPaddr:192.168.72.211 Prefix:24 Hostname:old-k8s-version-968094 Clientid:01:52:54:00:45:00:8a}
I0314 19:14:42.905848 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | domain old-k8s-version-968094 has defined IP address 192.168.72.211 and MAC address 52:54:00:45:00:8a in network mk-old-k8s-version-968094
I0314 19:14:42.905853 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetSSHKeyPath
I0314 19:14:42.906019 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetSSHUsername
I0314 19:14:42.906067 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetSSHPort
I0314 19:14:42.906174 988436 sshutil.go:53] new ssh client: &{IP:192.168.72.211 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18384-942544/.minikube/machines/old-k8s-version-968094/id_rsa Username:docker}
I0314 19:14:42.906247 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetSSHKeyPath
I0314 19:14:42.906407 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetSSHUsername
I0314 19:14:42.906529 988436 sshutil.go:53] new ssh client: &{IP:192.168.72.211 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18384-942544/.minikube/machines/old-k8s-version-968094/id_rsa Username:docker}
I0314 19:14:42.990403 988436 ssh_runner.go:195] Run: systemctl --version
I0314 19:14:43.019894 988436 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0314 19:14:43.181275 988436 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0314 19:14:43.188411 988436 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0314 19:14:43.188469 988436 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0314 19:14:43.207426 988436 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0314 19:14:43.207460 988436 start.go:494] detecting cgroup driver to use...
I0314 19:14:43.207540 988436 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0314 19:14:43.227408 988436 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0314 19:14:43.244322 988436 docker.go:217] disabling cri-docker service (if available) ...
I0314 19:14:43.244390 988436 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0314 19:14:43.259914 988436 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0314 19:14:43.274439 988436 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0314 19:14:43.400707 988436 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0314 19:14:43.553766 988436 docker.go:233] disabling docker service ...
I0314 19:14:43.553836 988436 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0314 19:14:43.573799 988436 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0314 19:14:43.592832 988436 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0314 19:14:43.747673 988436 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0314 19:14:43.893550 988436 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0314 19:14:43.911407 988436 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0314 19:14:43.932872 988436 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0314 19:14:43.932936 988436 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0314 19:14:43.945499 988436 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0314 19:14:43.945550 988436 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0314 19:14:43.958055 988436 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0314 19:14:43.970771 988436 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0314 19:14:43.983243 988436 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0314 19:14:43.995576 988436 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0314 19:14:44.006455 988436 crio.go:148] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0314 19:14:44.006510 988436 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0314 19:14:44.021079 988436 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0314 19:14:44.033636 988436 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0314 19:14:44.197240 988436 ssh_runner.go:195] Run: sudo systemctl restart crio
I0314 19:14:44.339817 988436 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0314 19:14:44.339902 988436 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0314 19:14:44.345568 988436 start.go:562] Will wait 60s for crictl version
I0314 19:14:44.345619 988436 ssh_runner.go:195] Run: which crictl
I0314 19:14:44.350149 988436 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0314 19:14:44.396503 988436 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0314 19:14:44.396591 988436 ssh_runner.go:195] Run: crio --version
I0314 19:14:44.430497 988436 ssh_runner.go:195] Run: crio --version
I0314 19:14:44.461214 988436 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0314 19:14:44.462594 988436 main.go:141] libmachine: (old-k8s-version-968094) Calling .GetIP
I0314 19:14:44.465246 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | domain old-k8s-version-968094 has defined MAC address 52:54:00:45:00:8a in network mk-old-k8s-version-968094
I0314 19:14:44.465634 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:45:00:8a", ip: ""} in network mk-old-k8s-version-968094: {Iface:virbr4 ExpiryTime:2024-03-14 20:14:31 +0000 UTC Type:0 Mac:52:54:00:45:00:8a Iaid: IPaddr:192.168.72.211 Prefix:24 Hostname:old-k8s-version-968094 Clientid:01:52:54:00:45:00:8a}
I0314 19:14:44.465666 988436 main.go:141] libmachine: (old-k8s-version-968094) DBG | domain old-k8s-version-968094 has defined IP address 192.168.72.211 and MAC address 52:54:00:45:00:8a in network mk-old-k8s-version-968094
I0314 19:14:44.465826 988436 ssh_runner.go:195] Run: grep 192.168.72.1 host.minikube.internal$ /etc/hosts
I0314 19:14:44.470671 988436 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.72.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0314 19:14:44.484305 988436 kubeadm.go:877] updating cluster {Name:old-k8s-version-968094 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18375/minikube-v1.32.1-1710348681-18375-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-968094 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.211 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] M
ountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0314 19:14:44.484460 988436 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0314 19:14:44.484509 988436 ssh_runner.go:195] Run: sudo crictl images --output json
I0314 19:14:44.516937 988436 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0314 19:14:44.517028 988436 ssh_runner.go:195] Run: which lz4
I0314 19:14:44.521485 988436 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0314 19:14:44.526625 988436 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0314 19:14:44.526663 988436 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18384-942544/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0314 19:14:46.456066 988436 crio.go:444] duration metric: took 1.93461575s to copy over tarball
I0314 19:14:46.456155 988436 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0314 19:14:49.494219 988436 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (3.038019069s)
I0314 19:14:49.494250 988436 crio.go:451] duration metric: took 3.038150607s to extract the tarball
I0314 19:14:49.494258 988436 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0314 19:14:49.539603 988436 ssh_runner.go:195] Run: sudo crictl images --output json
I0314 19:14:49.599773 988436 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0314 19:14:49.599810 988436 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0314 19:14:49.599941 988436 image.go:134] retrieving image: registry.k8s.io/pause:3.2
I0314 19:14:49.599966 988436 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0314 19:14:49.599924 988436 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0314 19:14:49.599981 988436 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0314 19:14:49.599911 988436 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0314 19:14:49.600074 988436 image.go:134] retrieving image: registry.k8s.io/coredns:1.7.0
I0314 19:14:49.600089 988436 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0314 19:14:49.599915 988436 image.go:134] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0314 19:14:49.601714 988436 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0314 19:14:49.601723 988436 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0314 19:14:49.601724 988436 image.go:177] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0314 19:14:49.601742 988436 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0314 19:14:49.601714 988436 image.go:177] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0314 19:14:49.601714 988436 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0314 19:14:49.601714 988436 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0314 19:14:49.602122 988436 image.go:177] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0314 19:14:49.749995 988436 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0314 19:14:49.749995 988436 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0314 19:14:49.760203 988436 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0314 19:14:49.761697 988436 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0314 19:14:49.777652 988436 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0314 19:14:49.797979 988436 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0314 19:14:49.819214 988436 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0314 19:14:49.865166 988436 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0314 19:14:49.865239 988436 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0314 19:14:49.865275 988436 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0314 19:14:49.865304 988436 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0314 19:14:49.865319 988436 ssh_runner.go:195] Run: which crictl
I0314 19:14:49.865332 988436 ssh_runner.go:195] Run: which crictl
I0314 19:14:49.922233 988436 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0314 19:14:49.942607 988436 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0314 19:14:49.942662 988436 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0314 19:14:49.942720 988436 ssh_runner.go:195] Run: which crictl
I0314 19:14:49.954508 988436 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0314 19:14:49.954619 988436 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0314 19:14:49.954671 988436 ssh_runner.go:195] Run: which crictl
I0314 19:14:49.954534 988436 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0314 19:14:49.954702 988436 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0314 19:14:49.954751 988436 ssh_runner.go:195] Run: which crictl
I0314 19:14:50.013099 988436 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0314 19:14:50.013154 988436 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0314 19:14:50.013171 988436 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0314 19:14:50.013205 988436 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0314 19:14:50.013209 988436 ssh_runner.go:195] Run: which crictl
I0314 19:14:50.013228 988436 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0314 19:14:50.013243 988436 ssh_runner.go:195] Run: which crictl
I0314 19:14:50.013327 988436 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0314 19:14:50.149874 988436 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0314 19:14:50.149946 988436 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0314 19:14:50.149985 988436 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0314 19:14:50.150036 988436 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0314 19:14:50.150086 988436 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18384-942544/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0314 19:14:50.150159 988436 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18384-942544/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0314 19:14:50.150203 988436 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0314 19:14:50.235991 988436 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18384-942544/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0314 19:14:50.259400 988436 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18384-942544/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0314 19:14:50.266436 988436 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18384-942544/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0314 19:14:50.266551 988436 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18384-942544/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0314 19:14:50.266635 988436 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18384-942544/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0314 19:14:50.266695 988436 cache_images.go:92] duration metric: took 666.868199ms to LoadCachedImages
W0314 19:14:50.266776 988436 out.go:239] X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/18384-942544/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0: no such file or directory
X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/18384-942544/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0: no such file or directory
I0314 19:14:50.266792 988436 kubeadm.go:928] updating node { 192.168.72.211 8443 v1.20.0 crio true true} ...
I0314 19:14:50.266959 988436 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-968094 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.72.211
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-968094 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0314 19:14:50.267049 988436 ssh_runner.go:195] Run: crio config
I0314 19:14:50.319163 988436 cni.go:84] Creating CNI manager for ""
I0314 19:14:50.319196 988436 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0314 19:14:50.319219 988436 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0314 19:14:50.319247 988436 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.72.211 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-968094 NodeName:old-k8s-version-968094 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.72.211"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.72.211 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0314 19:14:50.319462 988436 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.72.211
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-968094"
kubeletExtraArgs:
node-ip: 192.168.72.211
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.72.211"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0314 19:14:50.319554 988436 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0314 19:14:50.332194 988436 binaries.go:44] Found k8s binaries, skipping transfer
I0314 19:14:50.332289 988436 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0314 19:14:50.344452 988436 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0314 19:14:50.365405 988436 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0314 19:14:50.387571 988436 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2123 bytes)
I0314 19:14:50.406541 988436 ssh_runner.go:195] Run: grep 192.168.72.211 control-plane.minikube.internal$ /etc/hosts
I0314 19:14:50.410989 988436 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.72.211 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0314 19:14:50.425781 988436 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0314 19:14:50.574672 988436 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0314 19:14:50.595348 988436 certs.go:68] Setting up /home/jenkins/minikube-integration/18384-942544/.minikube/profiles/old-k8s-version-968094 for IP: 192.168.72.211
I0314 19:14:50.595393 988436 certs.go:194] generating shared ca certs ...
I0314 19:14:50.595448 988436 certs.go:226] acquiring lock for ca certs: {Name:mk519b55811360e7e353529ea1812eea6fe7a085 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0314 19:14:50.595631 988436 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/18384-942544/.minikube/ca.key
I0314 19:14:50.595675 988436 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/18384-942544/.minikube/proxy-client-ca.key
I0314 19:14:50.595685 988436 certs.go:256] generating profile certs ...
I0314 19:14:50.595751 988436 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/18384-942544/.minikube/profiles/old-k8s-version-968094/client.key
I0314 19:14:50.595766 988436 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18384-942544/.minikube/profiles/old-k8s-version-968094/client.crt with IP's: []
I0314 19:14:50.961687 988436 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18384-942544/.minikube/profiles/old-k8s-version-968094/client.crt ...
I0314 19:14:50.961725 988436 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18384-942544/.minikube/profiles/old-k8s-version-968094/client.crt: {Name:mk462f1a561c7e853d83f1337f12dd54e1b11a10 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0314 19:14:50.961917 988436 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18384-942544/.minikube/profiles/old-k8s-version-968094/client.key ...
I0314 19:14:50.961937 988436 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18384-942544/.minikube/profiles/old-k8s-version-968094/client.key: {Name:mk13cbe9bade4e0c0e1e8edb424f78800ee373b7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0314 19:14:50.962043 988436 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/18384-942544/.minikube/profiles/old-k8s-version-968094/apiserver.key.8692dcff
I0314 19:14:50.962064 988436 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18384-942544/.minikube/profiles/old-k8s-version-968094/apiserver.crt.8692dcff with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.72.211]
I0314 19:14:51.207477 988436 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18384-942544/.minikube/profiles/old-k8s-version-968094/apiserver.crt.8692dcff ...
I0314 19:14:51.207520 988436 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18384-942544/.minikube/profiles/old-k8s-version-968094/apiserver.crt.8692dcff: {Name:mkf44ad6b646a50ac6bf1e23895fadd371a28f91 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0314 19:14:51.209199 988436 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18384-942544/.minikube/profiles/old-k8s-version-968094/apiserver.key.8692dcff ...
I0314 19:14:51.209232 988436 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18384-942544/.minikube/profiles/old-k8s-version-968094/apiserver.key.8692dcff: {Name:mkcc29eb399e964534b152a6b8e9d73e64611845 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0314 19:14:51.209378 988436 certs.go:381] copying /home/jenkins/minikube-integration/18384-942544/.minikube/profiles/old-k8s-version-968094/apiserver.crt.8692dcff -> /home/jenkins/minikube-integration/18384-942544/.minikube/profiles/old-k8s-version-968094/apiserver.crt
I0314 19:14:51.209493 988436 certs.go:385] copying /home/jenkins/minikube-integration/18384-942544/.minikube/profiles/old-k8s-version-968094/apiserver.key.8692dcff -> /home/jenkins/minikube-integration/18384-942544/.minikube/profiles/old-k8s-version-968094/apiserver.key
I0314 19:14:51.209583 988436 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/18384-942544/.minikube/profiles/old-k8s-version-968094/proxy-client.key
I0314 19:14:51.209610 988436 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18384-942544/.minikube/profiles/old-k8s-version-968094/proxy-client.crt with IP's: []
I0314 19:14:51.305439 988436 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18384-942544/.minikube/profiles/old-k8s-version-968094/proxy-client.crt ...
I0314 19:14:51.305472 988436 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18384-942544/.minikube/profiles/old-k8s-version-968094/proxy-client.crt: {Name:mk17654c8a0256296f6afb11e28f678027798ce1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0314 19:14:51.324122 988436 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18384-942544/.minikube/profiles/old-k8s-version-968094/proxy-client.key ...
I0314 19:14:51.324154 988436 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18384-942544/.minikube/profiles/old-k8s-version-968094/proxy-client.key: {Name:mk04faffa245e09a31a95155ce70b6b328f12ffd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0314 19:14:51.324471 988436 certs.go:484] found cert: /home/jenkins/minikube-integration/18384-942544/.minikube/certs/951311.pem (1338 bytes)
W0314 19:14:51.324528 988436 certs.go:480] ignoring /home/jenkins/minikube-integration/18384-942544/.minikube/certs/951311_empty.pem, impossibly tiny 0 bytes
I0314 19:14:51.324544 988436 certs.go:484] found cert: /home/jenkins/minikube-integration/18384-942544/.minikube/certs/ca-key.pem (1679 bytes)
I0314 19:14:51.324575 988436 certs.go:484] found cert: /home/jenkins/minikube-integration/18384-942544/.minikube/certs/ca.pem (1082 bytes)
I0314 19:14:51.324606 988436 certs.go:484] found cert: /home/jenkins/minikube-integration/18384-942544/.minikube/certs/cert.pem (1123 bytes)
I0314 19:14:51.324637 988436 certs.go:484] found cert: /home/jenkins/minikube-integration/18384-942544/.minikube/certs/key.pem (1675 bytes)
I0314 19:14:51.324702 988436 certs.go:484] found cert: /home/jenkins/minikube-integration/18384-942544/.minikube/files/etc/ssl/certs/9513112.pem (1708 bytes)
I0314 19:14:51.325477 988436 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18384-942544/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0314 19:14:51.354119 988436 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18384-942544/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0314 19:14:51.380946 988436 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18384-942544/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0314 19:14:51.411789 988436 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18384-942544/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0314 19:14:51.458353 988436 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18384-942544/.minikube/profiles/old-k8s-version-968094/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0314 19:14:51.483171 988436 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18384-942544/.minikube/profiles/old-k8s-version-968094/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0314 19:14:51.520147 988436 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18384-942544/.minikube/profiles/old-k8s-version-968094/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0314 19:14:51.548815 988436 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18384-942544/.minikube/profiles/old-k8s-version-968094/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0314 19:14:51.604141 988436 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18384-942544/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0314 19:14:51.632783 988436 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18384-942544/.minikube/certs/951311.pem --> /usr/share/ca-certificates/951311.pem (1338 bytes)
I0314 19:14:51.660399 988436 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18384-942544/.minikube/files/etc/ssl/certs/9513112.pem --> /usr/share/ca-certificates/9513112.pem (1708 bytes)
I0314 19:14:51.687968 988436 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0314 19:14:51.707887 988436 ssh_runner.go:195] Run: openssl version
I0314 19:14:51.714430 988436 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0314 19:14:51.726481 988436 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0314 19:14:51.731724 988436 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Mar 14 18:05 /usr/share/ca-certificates/minikubeCA.pem
I0314 19:14:51.731802 988436 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0314 19:14:51.738051 988436 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0314 19:14:51.749973 988436 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/951311.pem && ln -fs /usr/share/ca-certificates/951311.pem /etc/ssl/certs/951311.pem"
I0314 19:14:51.763098 988436 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/951311.pem
I0314 19:14:51.768588 988436 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Mar 14 18:14 /usr/share/ca-certificates/951311.pem
I0314 19:14:51.768668 988436 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/951311.pem
I0314 19:14:51.775323 988436 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/951311.pem /etc/ssl/certs/51391683.0"
I0314 19:14:51.787855 988436 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/9513112.pem && ln -fs /usr/share/ca-certificates/9513112.pem /etc/ssl/certs/9513112.pem"
I0314 19:14:51.800610 988436 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/9513112.pem
I0314 19:14:51.805963 988436 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Mar 14 18:14 /usr/share/ca-certificates/9513112.pem
I0314 19:14:51.806041 988436 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/9513112.pem
I0314 19:14:51.813261 988436 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/9513112.pem /etc/ssl/certs/3ec20f2e.0"
I0314 19:14:51.827741 988436 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0314 19:14:51.832613 988436 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0314 19:14:51.832672 988436 kubeadm.go:391] StartCluster: {Name:old-k8s-version-968094 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18375/minikube-v1.32.1-1710348681-18375-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-968094 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.211 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Moun
tPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0314 19:14:51.832794 988436 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0314 19:14:51.832852 988436 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0314 19:14:51.878164 988436 cri.go:89] found id: ""
I0314 19:14:51.878252 988436 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0314 19:14:51.892635 988436 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0314 19:14:51.903863 988436 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0314 19:14:51.917871 988436 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0314 19:14:51.917895 988436 kubeadm.go:156] found existing configuration files:
I0314 19:14:51.917936 988436 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0314 19:14:51.931245 988436 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0314 19:14:51.931311 988436 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0314 19:14:51.944845 988436 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0314 19:14:51.956603 988436 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0314 19:14:51.956662 988436 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0314 19:14:51.968586 988436 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0314 19:14:51.981838 988436 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0314 19:14:51.981904 988436 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0314 19:14:51.995108 988436 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0314 19:14:52.006432 988436 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0314 19:14:52.006578 988436 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0314 19:14:52.019652 988436 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0314 19:14:52.181954 988436 kubeadm.go:309] [init] Using Kubernetes version: v1.20.0
I0314 19:14:52.182145 988436 kubeadm.go:309] [preflight] Running pre-flight checks
I0314 19:14:52.399528 988436 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0314 19:14:52.399727 988436 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0314 19:14:52.399901 988436 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0314 19:14:52.638472 988436 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0314 19:14:52.640883 988436 out.go:204] - Generating certificates and keys ...
I0314 19:14:52.640989 988436 kubeadm.go:309] [certs] Using existing ca certificate authority
I0314 19:14:52.641067 988436 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0314 19:14:52.764665 988436 kubeadm.go:309] [certs] Generating "apiserver-kubelet-client" certificate and key
I0314 19:14:52.875694 988436 kubeadm.go:309] [certs] Generating "front-proxy-ca" certificate and key
I0314 19:14:53.088130 988436 kubeadm.go:309] [certs] Generating "front-proxy-client" certificate and key
I0314 19:14:53.299437 988436 kubeadm.go:309] [certs] Generating "etcd/ca" certificate and key
I0314 19:14:53.592735 988436 kubeadm.go:309] [certs] Generating "etcd/server" certificate and key
I0314 19:14:53.593022 988436 kubeadm.go:309] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-968094] and IPs [192.168.72.211 127.0.0.1 ::1]
I0314 19:14:53.727136 988436 kubeadm.go:309] [certs] Generating "etcd/peer" certificate and key
I0314 19:14:53.727390 988436 kubeadm.go:309] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-968094] and IPs [192.168.72.211 127.0.0.1 ::1]
I0314 19:14:53.898136 988436 kubeadm.go:309] [certs] Generating "etcd/healthcheck-client" certificate and key
I0314 19:14:53.986921 988436 kubeadm.go:309] [certs] Generating "apiserver-etcd-client" certificate and key
I0314 19:14:54.116669 988436 kubeadm.go:309] [certs] Generating "sa" key and public key
I0314 19:14:54.117618 988436 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0314 19:14:54.265449 988436 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0314 19:14:54.426924 988436 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0314 19:14:54.691508 988436 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0314 19:14:54.890034 988436 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0314 19:14:54.919278 988436 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0314 19:14:54.919408 988436 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0314 19:14:54.920348 988436 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0314 19:14:55.126092 988436 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0314 19:14:55.127662 988436 out.go:204] - Booting up control plane ...
I0314 19:14:55.127792 988436 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0314 19:14:55.137884 988436 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0314 19:14:55.139279 988436 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0314 19:14:55.140805 988436 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0314 19:14:55.148289 988436 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0314 19:15:35.145794 988436 kubeadm.go:309] [kubelet-check] Initial timeout of 40s passed.
I0314 19:15:35.145917 988436 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0314 19:15:35.146198 988436 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0314 19:15:40.146846 988436 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0314 19:15:40.147134 988436 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0314 19:15:50.148070 988436 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0314 19:15:50.148322 988436 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0314 19:16:10.149627 988436 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0314 19:16:10.150257 988436 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0314 19:16:50.150204 988436 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0314 19:16:50.150544 988436 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0314 19:16:50.150813 988436 kubeadm.go:309]
I0314 19:16:50.150891 988436 kubeadm.go:309] Unfortunately, an error has occurred:
I0314 19:16:50.151362 988436 kubeadm.go:309] timed out waiting for the condition
I0314 19:16:50.151394 988436 kubeadm.go:309]
I0314 19:16:50.151434 988436 kubeadm.go:309] This error is likely caused by:
I0314 19:16:50.151489 988436 kubeadm.go:309] - The kubelet is not running
I0314 19:16:50.151672 988436 kubeadm.go:309] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0314 19:16:50.151693 988436 kubeadm.go:309]
I0314 19:16:50.151834 988436 kubeadm.go:309] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0314 19:16:50.151883 988436 kubeadm.go:309] - 'systemctl status kubelet'
I0314 19:16:50.151960 988436 kubeadm.go:309] - 'journalctl -xeu kubelet'
I0314 19:16:50.151988 988436 kubeadm.go:309]
I0314 19:16:50.152160 988436 kubeadm.go:309] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0314 19:16:50.152293 988436 kubeadm.go:309] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0314 19:16:50.152305 988436 kubeadm.go:309]
I0314 19:16:50.152460 988436 kubeadm.go:309] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0314 19:16:50.152563 988436 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0314 19:16:50.152657 988436 kubeadm.go:309] Once you have found the failing container, you can inspect its logs with:
I0314 19:16:50.152765 988436 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0314 19:16:50.152783 988436 kubeadm.go:309]
I0314 19:16:50.155410 988436 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0314 19:16:50.155543 988436 kubeadm.go:309] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0314 19:16:50.155641 988436 kubeadm.go:309] To see the stack trace of this error execute with --v=5 or higher
W0314 19:16:50.155846 988436 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-968094] and IPs [192.168.72.211 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-968094] and IPs [192.168.72.211 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-968094] and IPs [192.168.72.211 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-968094] and IPs [192.168.72.211 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0314 19:16:50.155909 988436 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0314 19:16:51.407071 988436 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (1.251129296s)
I0314 19:16:51.407163 988436 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0314 19:16:51.424006 988436 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0314 19:16:51.434854 988436 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0314 19:16:51.434876 988436 kubeadm.go:156] found existing configuration files:
I0314 19:16:51.434923 988436 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0314 19:16:51.445124 988436 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0314 19:16:51.445183 988436 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0314 19:16:51.455566 988436 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0314 19:16:51.465135 988436 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0314 19:16:51.465189 988436 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0314 19:16:51.475110 988436 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0314 19:16:51.485763 988436 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0314 19:16:51.485810 988436 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0314 19:16:51.496117 988436 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0314 19:16:51.506699 988436 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0314 19:16:51.506758 988436 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0314 19:16:51.516477 988436 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0314 19:16:51.590549 988436 kubeadm.go:309] [init] Using Kubernetes version: v1.20.0
I0314 19:16:51.590634 988436 kubeadm.go:309] [preflight] Running pre-flight checks
I0314 19:16:51.760561 988436 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0314 19:16:51.760680 988436 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0314 19:16:51.760801 988436 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0314 19:16:51.957979 988436 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0314 19:16:51.959959 988436 out.go:204] - Generating certificates and keys ...
I0314 19:16:51.960052 988436 kubeadm.go:309] [certs] Using existing ca certificate authority
I0314 19:16:51.960159 988436 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0314 19:16:51.960306 988436 kubeadm.go:309] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0314 19:16:51.960398 988436 kubeadm.go:309] [certs] Using existing front-proxy-ca certificate authority
I0314 19:16:51.960507 988436 kubeadm.go:309] [certs] Using existing front-proxy-client certificate and key on disk
I0314 19:16:51.960633 988436 kubeadm.go:309] [certs] Using existing etcd/ca certificate authority
I0314 19:16:51.961258 988436 kubeadm.go:309] [certs] Using existing etcd/server certificate and key on disk
I0314 19:16:51.961656 988436 kubeadm.go:309] [certs] Using existing etcd/peer certificate and key on disk
I0314 19:16:51.962128 988436 kubeadm.go:309] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0314 19:16:51.962582 988436 kubeadm.go:309] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0314 19:16:51.962651 988436 kubeadm.go:309] [certs] Using the existing "sa" key
I0314 19:16:51.962743 988436 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0314 19:16:52.078598 988436 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0314 19:16:52.339527 988436 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0314 19:16:52.623486 988436 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0314 19:16:52.767984 988436 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0314 19:16:52.787498 988436 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0314 19:16:52.788979 988436 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0314 19:16:52.789211 988436 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0314 19:16:52.951283 988436 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0314 19:16:52.953237 988436 out.go:204] - Booting up control plane ...
I0314 19:16:52.953375 988436 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0314 19:16:52.968262 988436 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0314 19:16:52.968407 988436 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0314 19:16:52.968894 988436 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0314 19:16:52.971585 988436 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0314 19:17:32.973944 988436 kubeadm.go:309] [kubelet-check] Initial timeout of 40s passed.
I0314 19:17:32.974090 988436 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0314 19:17:32.974371 988436 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0314 19:17:37.974205 988436 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0314 19:17:37.974440 988436 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0314 19:17:47.975157 988436 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0314 19:17:47.975418 988436 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0314 19:18:07.976719 988436 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0314 19:18:07.976924 988436 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0314 19:18:47.976368 988436 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0314 19:18:47.976614 988436 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0314 19:18:47.976640 988436 kubeadm.go:309]
I0314 19:18:47.976686 988436 kubeadm.go:309] Unfortunately, an error has occurred:
I0314 19:18:47.976759 988436 kubeadm.go:309] timed out waiting for the condition
I0314 19:18:47.976776 988436 kubeadm.go:309]
I0314 19:18:47.976829 988436 kubeadm.go:309] This error is likely caused by:
I0314 19:18:47.976878 988436 kubeadm.go:309] - The kubelet is not running
I0314 19:18:47.977023 988436 kubeadm.go:309] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0314 19:18:47.977036 988436 kubeadm.go:309]
I0314 19:18:47.977139 988436 kubeadm.go:309] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0314 19:18:47.977191 988436 kubeadm.go:309] - 'systemctl status kubelet'
I0314 19:18:47.977245 988436 kubeadm.go:309] - 'journalctl -xeu kubelet'
I0314 19:18:47.977259 988436 kubeadm.go:309]
I0314 19:18:47.977371 988436 kubeadm.go:309] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0314 19:18:47.977463 988436 kubeadm.go:309] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0314 19:18:47.977472 988436 kubeadm.go:309]
I0314 19:18:47.977618 988436 kubeadm.go:309] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0314 19:18:47.977747 988436 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0314 19:18:47.977873 988436 kubeadm.go:309] Once you have found the failing container, you can inspect its logs with:
I0314 19:18:47.977967 988436 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0314 19:18:47.977978 988436 kubeadm.go:309]
I0314 19:18:47.979252 988436 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0314 19:18:47.979370 988436 kubeadm.go:309] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0314 19:18:47.979466 988436 kubeadm.go:309] To see the stack trace of this error execute with --v=5 or higher
I0314 19:18:47.979553 988436 kubeadm.go:393] duration metric: took 3m56.146886343s to StartCluster
I0314 19:18:47.979606 988436 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0314 19:18:47.979672 988436 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0314 19:18:48.027209 988436 cri.go:89] found id: ""
I0314 19:18:48.027249 988436 logs.go:276] 0 containers: []
W0314 19:18:48.027262 988436 logs.go:278] No container was found matching "kube-apiserver"
I0314 19:18:48.027270 988436 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0314 19:18:48.027343 988436 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0314 19:18:48.065354 988436 cri.go:89] found id: ""
I0314 19:18:48.065388 988436 logs.go:276] 0 containers: []
W0314 19:18:48.065400 988436 logs.go:278] No container was found matching "etcd"
I0314 19:18:48.065408 988436 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0314 19:18:48.065484 988436 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0314 19:18:48.105266 988436 cri.go:89] found id: ""
I0314 19:18:48.105300 988436 logs.go:276] 0 containers: []
W0314 19:18:48.105313 988436 logs.go:278] No container was found matching "coredns"
I0314 19:18:48.105322 988436 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0314 19:18:48.105393 988436 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0314 19:18:48.145934 988436 cri.go:89] found id: ""
I0314 19:18:48.145965 988436 logs.go:276] 0 containers: []
W0314 19:18:48.145973 988436 logs.go:278] No container was found matching "kube-scheduler"
I0314 19:18:48.145980 988436 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0314 19:18:48.146031 988436 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0314 19:18:48.180977 988436 cri.go:89] found id: ""
I0314 19:18:48.181010 988436 logs.go:276] 0 containers: []
W0314 19:18:48.181020 988436 logs.go:278] No container was found matching "kube-proxy"
I0314 19:18:48.181028 988436 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0314 19:18:48.181089 988436 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0314 19:18:48.219151 988436 cri.go:89] found id: ""
I0314 19:18:48.219182 988436 logs.go:276] 0 containers: []
W0314 19:18:48.219192 988436 logs.go:278] No container was found matching "kube-controller-manager"
I0314 19:18:48.219199 988436 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0314 19:18:48.219255 988436 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0314 19:18:48.264715 988436 cri.go:89] found id: ""
I0314 19:18:48.264737 988436 logs.go:276] 0 containers: []
W0314 19:18:48.264745 988436 logs.go:278] No container was found matching "kindnet"
I0314 19:18:48.264761 988436 logs.go:123] Gathering logs for describe nodes ...
I0314 19:18:48.264776 988436 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0314 19:18:48.376115 988436 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0314 19:18:48.376137 988436 logs.go:123] Gathering logs for CRI-O ...
I0314 19:18:48.376152 988436 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0314 19:18:48.475719 988436 logs.go:123] Gathering logs for container status ...
I0314 19:18:48.475765 988436 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0314 19:18:48.518520 988436 logs.go:123] Gathering logs for kubelet ...
I0314 19:18:48.518564 988436 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0314 19:18:48.569420 988436 logs.go:123] Gathering logs for dmesg ...
I0314 19:18:48.569457 988436 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
W0314 19:18:48.593696 988436 out.go:364] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0314 19:18:48.593763 988436 out.go:239] *
*
W0314 19:18:48.593834 988436 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0314 19:18:48.593867 988436 out.go:239] *
*
W0314 19:18:48.595038 988436 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0314 19:18:48.598742 988436 out.go:177]
W0314 19:18:48.600336 988436 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0314 19:18:48.600393 988436 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0314 19:18:48.600421 988436 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0314 19:18:48.602194 988436 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-968094 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-968094 -n old-k8s-version-968094
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-968094 -n old-k8s-version-968094: exit status 6 (246.006388ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0314 19:18:48.893946 991510 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-968094" does not appear in /home/jenkins/minikube-integration/18384-942544/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-968094" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (294.76s)