=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-163608 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-163608 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m44.626899815s)
-- stdout --
* [old-k8s-version-163608] minikube v1.33.0-beta.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=18233
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/18233-10493/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/18233-10493/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-163608" primary control-plane node in "old-k8s-version-163608" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0401 19:21:18.097323 64332 out.go:291] Setting OutFile to fd 1 ...
I0401 19:21:18.097428 64332 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0401 19:21:18.097438 64332 out.go:304] Setting ErrFile to fd 2...
I0401 19:21:18.097442 64332 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0401 19:21:18.097629 64332 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18233-10493/.minikube/bin
I0401 19:21:18.098230 64332 out.go:298] Setting JSON to false
I0401 19:21:18.099170 64332 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-13","uptime":7430,"bootTime":1711991848,"procs":233,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1054-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0401 19:21:18.099234 64332 start.go:139] virtualization: kvm guest
I0401 19:21:18.101790 64332 out.go:177] * [old-k8s-version-163608] minikube v1.33.0-beta.0 on Ubuntu 20.04 (kvm/amd64)
I0401 19:21:18.103354 64332 out.go:177] - MINIKUBE_LOCATION=18233
I0401 19:21:18.103238 64332 notify.go:220] Checking for updates...
I0401 19:21:18.104826 64332 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0401 19:21:18.106060 64332 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/18233-10493/kubeconfig
I0401 19:21:18.107378 64332 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/18233-10493/.minikube
I0401 19:21:18.108705 64332 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0401 19:21:18.110037 64332 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0401 19:21:18.111809 64332 config.go:182] Loaded profile config "bridge-408543": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.29.3
I0401 19:21:18.111918 64332 config.go:182] Loaded profile config "enable-default-cni-408543": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.29.3
I0401 19:21:18.112028 64332 config.go:182] Loaded profile config "flannel-408543": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.29.3
I0401 19:21:18.112136 64332 driver.go:392] Setting default libvirt URI to qemu:///system
I0401 19:21:18.152385 64332 out.go:177] * Using the kvm2 driver based on user configuration
I0401 19:21:18.153685 64332 start.go:297] selected driver: kvm2
I0401 19:21:18.153705 64332 start.go:901] validating driver "kvm2" against <nil>
I0401 19:21:18.153720 64332 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0401 19:21:18.154705 64332 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0401 19:21:18.154789 64332 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/18233-10493/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0401 19:21:18.169882 64332 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.0-beta.0
I0401 19:21:18.169935 64332 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0401 19:21:18.170177 64332 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0401 19:21:18.170265 64332 cni.go:84] Creating CNI manager for ""
I0401 19:21:18.170284 64332 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0401 19:21:18.170298 64332 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0401 19:21:18.170376 64332 start.go:340] cluster config:
{Name:old-k8s-version-163608 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1711559786-18485@sha256:2dcab64da240d825290a528fa79ad3c32db45fe5f8be5150468234a7114eff82 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-163608 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0401 19:21:18.170516 64332 iso.go:125] acquiring lock: {Name:mka511ffe42ecd86bd7f46e7a17ddcdd3e5e4327 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0401 19:21:18.172640 64332 out.go:177] * Starting "old-k8s-version-163608" primary control-plane node in "old-k8s-version-163608" cluster
I0401 19:21:18.174222 64332 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0401 19:21:18.174273 64332 preload.go:147] Found local preload: /home/jenkins/minikube-integration/18233-10493/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0401 19:21:18.174288 64332 cache.go:56] Caching tarball of preloaded images
I0401 19:21:18.174382 64332 preload.go:173] Found /home/jenkins/minikube-integration/18233-10493/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0401 19:21:18.174397 64332 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0401 19:21:18.174541 64332 profile.go:143] Saving config to /home/jenkins/minikube-integration/18233-10493/.minikube/profiles/old-k8s-version-163608/config.json ...
I0401 19:21:18.174571 64332 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18233-10493/.minikube/profiles/old-k8s-version-163608/config.json: {Name:mk912c2271b664999a1c806f839f7ea083f35664 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 19:21:18.174797 64332 start.go:360] acquireMachinesLock for old-k8s-version-163608: {Name:mk6b7472209a8db5f40be4c2f0565da7e0094c19 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0401 19:21:28.743550 64332 start.go:364] duration metric: took 10.568720337s to acquireMachinesLock for "old-k8s-version-163608"
I0401 19:21:28.743629 64332 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-163608 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18485/minikube-v1.33.0-1711559712-18485-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1711559786-18485@sha256:2dcab64da240d825290a528fa79ad3c32db45fe5f8be5150468234a7114eff82 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-163608 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0401 19:21:28.743749 64332 start.go:125] createHost starting for "" (driver="kvm2")
I0401 19:21:28.745874 64332 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0401 19:21:28.746097 64332 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0401 19:21:28.746155 64332 main.go:141] libmachine: Launching plugin server for driver kvm2
I0401 19:21:28.765720 64332 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44709
I0401 19:21:28.766115 64332 main.go:141] libmachine: () Calling .GetVersion
I0401 19:21:28.766957 64332 main.go:141] libmachine: Using API Version 1
I0401 19:21:28.766985 64332 main.go:141] libmachine: () Calling .SetConfigRaw
I0401 19:21:28.767381 64332 main.go:141] libmachine: () Calling .GetMachineName
I0401 19:21:28.768800 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetMachineName
I0401 19:21:28.768991 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .DriverName
I0401 19:21:28.769142 64332 start.go:159] libmachine.API.Create for "old-k8s-version-163608" (driver="kvm2")
I0401 19:21:28.769166 64332 client.go:168] LocalClient.Create starting
I0401 19:21:28.769212 64332 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18233-10493/.minikube/certs/ca.pem
I0401 19:21:28.769263 64332 main.go:141] libmachine: Decoding PEM data...
I0401 19:21:28.769297 64332 main.go:141] libmachine: Parsing certificate...
I0401 19:21:28.769386 64332 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18233-10493/.minikube/certs/cert.pem
I0401 19:21:28.769416 64332 main.go:141] libmachine: Decoding PEM data...
I0401 19:21:28.769435 64332 main.go:141] libmachine: Parsing certificate...
I0401 19:21:28.769460 64332 main.go:141] libmachine: Running pre-create checks...
I0401 19:21:28.769478 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .PreCreateCheck
I0401 19:21:28.769878 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetConfigRaw
I0401 19:21:28.770271 64332 main.go:141] libmachine: Creating machine...
I0401 19:21:28.770287 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .Create
I0401 19:21:28.770439 64332 main.go:141] libmachine: (old-k8s-version-163608) Creating KVM machine...
I0401 19:21:28.771733 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | found existing default KVM network
I0401 19:21:28.772795 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | I0401 19:21:28.772618 65494 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:66:e9:7e} reservation:<nil>}
I0401 19:21:28.773961 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | I0401 19:21:28.773873 65494 network.go:206] using free private subnet 192.168.50.0/24: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0002923e0}
I0401 19:21:28.774001 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | created network xml:
I0401 19:21:28.774015 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | <network>
I0401 19:21:28.774026 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | <name>mk-old-k8s-version-163608</name>
I0401 19:21:28.774034 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | <dns enable='no'/>
I0401 19:21:28.774042 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG |
I0401 19:21:28.774051 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | <ip address='192.168.50.1' netmask='255.255.255.0'>
I0401 19:21:28.774059 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | <dhcp>
I0401 19:21:28.774072 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | <range start='192.168.50.2' end='192.168.50.253'/>
I0401 19:21:28.774081 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | </dhcp>
I0401 19:21:28.774089 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | </ip>
I0401 19:21:28.774098 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG |
I0401 19:21:28.774109 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | </network>
I0401 19:21:28.774118 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG |
I0401 19:21:28.780203 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | trying to create private KVM network mk-old-k8s-version-163608 192.168.50.0/24...
I0401 19:21:28.860018 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | private KVM network mk-old-k8s-version-163608 192.168.50.0/24 created
I0401 19:21:28.860056 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | I0401 19:21:28.859991 65494 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/18233-10493/.minikube
I0401 19:21:28.860075 64332 main.go:141] libmachine: (old-k8s-version-163608) Setting up store path in /home/jenkins/minikube-integration/18233-10493/.minikube/machines/old-k8s-version-163608 ...
I0401 19:21:28.860095 64332 main.go:141] libmachine: (old-k8s-version-163608) Building disk image from file:///home/jenkins/minikube-integration/18233-10493/.minikube/cache/iso/amd64/minikube-v1.33.0-1711559712-18485-amd64.iso
I0401 19:21:28.860153 64332 main.go:141] libmachine: (old-k8s-version-163608) Downloading /home/jenkins/minikube-integration/18233-10493/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/18233-10493/.minikube/cache/iso/amd64/minikube-v1.33.0-1711559712-18485-amd64.iso...
I0401 19:21:29.113090 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | I0401 19:21:29.112958 65494 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/18233-10493/.minikube/machines/old-k8s-version-163608/id_rsa...
I0401 19:21:29.246223 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | I0401 19:21:29.246107 65494 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/18233-10493/.minikube/machines/old-k8s-version-163608/old-k8s-version-163608.rawdisk...
I0401 19:21:29.246258 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | Writing magic tar header
I0401 19:21:29.246275 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | Writing SSH key tar header
I0401 19:21:29.246288 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | I0401 19:21:29.246221 65494 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/18233-10493/.minikube/machines/old-k8s-version-163608 ...
I0401 19:21:29.246327 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18233-10493/.minikube/machines/old-k8s-version-163608
I0401 19:21:29.246351 64332 main.go:141] libmachine: (old-k8s-version-163608) Setting executable bit set on /home/jenkins/minikube-integration/18233-10493/.minikube/machines/old-k8s-version-163608 (perms=drwx------)
I0401 19:21:29.246410 64332 main.go:141] libmachine: (old-k8s-version-163608) Setting executable bit set on /home/jenkins/minikube-integration/18233-10493/.minikube/machines (perms=drwxr-xr-x)
I0401 19:21:29.246435 64332 main.go:141] libmachine: (old-k8s-version-163608) Setting executable bit set on /home/jenkins/minikube-integration/18233-10493/.minikube (perms=drwxr-xr-x)
I0401 19:21:29.246447 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18233-10493/.minikube/machines
I0401 19:21:29.246465 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18233-10493/.minikube
I0401 19:21:29.246494 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18233-10493
I0401 19:21:29.246515 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0401 19:21:29.246530 64332 main.go:141] libmachine: (old-k8s-version-163608) Setting executable bit set on /home/jenkins/minikube-integration/18233-10493 (perms=drwxrwxr-x)
I0401 19:21:29.246548 64332 main.go:141] libmachine: (old-k8s-version-163608) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0401 19:21:29.246561 64332 main.go:141] libmachine: (old-k8s-version-163608) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0401 19:21:29.246576 64332 main.go:141] libmachine: (old-k8s-version-163608) Creating domain...
I0401 19:21:29.246586 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | Checking permissions on dir: /home/jenkins
I0401 19:21:29.246602 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | Checking permissions on dir: /home
I0401 19:21:29.246616 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | Skipping /home - not owner
I0401 19:21:29.247609 64332 main.go:141] libmachine: (old-k8s-version-163608) define libvirt domain using xml:
I0401 19:21:29.247633 64332 main.go:141] libmachine: (old-k8s-version-163608) <domain type='kvm'>
I0401 19:21:29.247640 64332 main.go:141] libmachine: (old-k8s-version-163608) <name>old-k8s-version-163608</name>
I0401 19:21:29.247645 64332 main.go:141] libmachine: (old-k8s-version-163608) <memory unit='MiB'>2200</memory>
I0401 19:21:29.247651 64332 main.go:141] libmachine: (old-k8s-version-163608) <vcpu>2</vcpu>
I0401 19:21:29.247655 64332 main.go:141] libmachine: (old-k8s-version-163608) <features>
I0401 19:21:29.247664 64332 main.go:141] libmachine: (old-k8s-version-163608) <acpi/>
I0401 19:21:29.247670 64332 main.go:141] libmachine: (old-k8s-version-163608) <apic/>
I0401 19:21:29.247691 64332 main.go:141] libmachine: (old-k8s-version-163608) <pae/>
I0401 19:21:29.247702 64332 main.go:141] libmachine: (old-k8s-version-163608)
I0401 19:21:29.247711 64332 main.go:141] libmachine: (old-k8s-version-163608) </features>
I0401 19:21:29.247720 64332 main.go:141] libmachine: (old-k8s-version-163608) <cpu mode='host-passthrough'>
I0401 19:21:29.247726 64332 main.go:141] libmachine: (old-k8s-version-163608)
I0401 19:21:29.247734 64332 main.go:141] libmachine: (old-k8s-version-163608) </cpu>
I0401 19:21:29.247765 64332 main.go:141] libmachine: (old-k8s-version-163608) <os>
I0401 19:21:29.247792 64332 main.go:141] libmachine: (old-k8s-version-163608) <type>hvm</type>
I0401 19:21:29.247803 64332 main.go:141] libmachine: (old-k8s-version-163608) <boot dev='cdrom'/>
I0401 19:21:29.247814 64332 main.go:141] libmachine: (old-k8s-version-163608) <boot dev='hd'/>
I0401 19:21:29.247825 64332 main.go:141] libmachine: (old-k8s-version-163608) <bootmenu enable='no'/>
I0401 19:21:29.247832 64332 main.go:141] libmachine: (old-k8s-version-163608) </os>
I0401 19:21:29.247838 64332 main.go:141] libmachine: (old-k8s-version-163608) <devices>
I0401 19:21:29.247845 64332 main.go:141] libmachine: (old-k8s-version-163608) <disk type='file' device='cdrom'>
I0401 19:21:29.247855 64332 main.go:141] libmachine: (old-k8s-version-163608) <source file='/home/jenkins/minikube-integration/18233-10493/.minikube/machines/old-k8s-version-163608/boot2docker.iso'/>
I0401 19:21:29.247872 64332 main.go:141] libmachine: (old-k8s-version-163608) <target dev='hdc' bus='scsi'/>
I0401 19:21:29.247888 64332 main.go:141] libmachine: (old-k8s-version-163608) <readonly/>
I0401 19:21:29.247896 64332 main.go:141] libmachine: (old-k8s-version-163608) </disk>
I0401 19:21:29.247906 64332 main.go:141] libmachine: (old-k8s-version-163608) <disk type='file' device='disk'>
I0401 19:21:29.247913 64332 main.go:141] libmachine: (old-k8s-version-163608) <driver name='qemu' type='raw' cache='default' io='threads' />
I0401 19:21:29.247927 64332 main.go:141] libmachine: (old-k8s-version-163608) <source file='/home/jenkins/minikube-integration/18233-10493/.minikube/machines/old-k8s-version-163608/old-k8s-version-163608.rawdisk'/>
I0401 19:21:29.247935 64332 main.go:141] libmachine: (old-k8s-version-163608) <target dev='hda' bus='virtio'/>
I0401 19:21:29.247999 64332 main.go:141] libmachine: (old-k8s-version-163608) </disk>
I0401 19:21:29.248025 64332 main.go:141] libmachine: (old-k8s-version-163608) <interface type='network'>
I0401 19:21:29.248039 64332 main.go:141] libmachine: (old-k8s-version-163608) <source network='mk-old-k8s-version-163608'/>
I0401 19:21:29.248052 64332 main.go:141] libmachine: (old-k8s-version-163608) <model type='virtio'/>
I0401 19:21:29.248063 64332 main.go:141] libmachine: (old-k8s-version-163608) </interface>
I0401 19:21:29.248075 64332 main.go:141] libmachine: (old-k8s-version-163608) <interface type='network'>
I0401 19:21:29.248089 64332 main.go:141] libmachine: (old-k8s-version-163608) <source network='default'/>
I0401 19:21:29.248106 64332 main.go:141] libmachine: (old-k8s-version-163608) <model type='virtio'/>
I0401 19:21:29.248121 64332 main.go:141] libmachine: (old-k8s-version-163608) </interface>
I0401 19:21:29.248133 64332 main.go:141] libmachine: (old-k8s-version-163608) <serial type='pty'>
I0401 19:21:29.248144 64332 main.go:141] libmachine: (old-k8s-version-163608) <target port='0'/>
I0401 19:21:29.248155 64332 main.go:141] libmachine: (old-k8s-version-163608) </serial>
I0401 19:21:29.248182 64332 main.go:141] libmachine: (old-k8s-version-163608) <console type='pty'>
I0401 19:21:29.248206 64332 main.go:141] libmachine: (old-k8s-version-163608) <target type='serial' port='0'/>
I0401 19:21:29.248219 64332 main.go:141] libmachine: (old-k8s-version-163608) </console>
I0401 19:21:29.248232 64332 main.go:141] libmachine: (old-k8s-version-163608) <rng model='virtio'>
I0401 19:21:29.248251 64332 main.go:141] libmachine: (old-k8s-version-163608) <backend model='random'>/dev/random</backend>
I0401 19:21:29.248269 64332 main.go:141] libmachine: (old-k8s-version-163608) </rng>
I0401 19:21:29.248281 64332 main.go:141] libmachine: (old-k8s-version-163608)
I0401 19:21:29.248290 64332 main.go:141] libmachine: (old-k8s-version-163608)
I0401 19:21:29.248303 64332 main.go:141] libmachine: (old-k8s-version-163608) </devices>
I0401 19:21:29.248313 64332 main.go:141] libmachine: (old-k8s-version-163608) </domain>
I0401 19:21:29.248325 64332 main.go:141] libmachine: (old-k8s-version-163608)
I0401 19:21:29.253287 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | domain old-k8s-version-163608 has defined MAC address 52:54:00:9b:d7:b6 in network default
I0401 19:21:29.254071 64332 main.go:141] libmachine: (old-k8s-version-163608) Ensuring networks are active...
I0401 19:21:29.254094 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | domain old-k8s-version-163608 has defined MAC address 52:54:00:fe:1b:e7 in network mk-old-k8s-version-163608
I0401 19:21:29.254786 64332 main.go:141] libmachine: (old-k8s-version-163608) Ensuring network default is active
I0401 19:21:29.255117 64332 main.go:141] libmachine: (old-k8s-version-163608) Ensuring network mk-old-k8s-version-163608 is active
I0401 19:21:29.255676 64332 main.go:141] libmachine: (old-k8s-version-163608) Getting domain xml...
I0401 19:21:29.256391 64332 main.go:141] libmachine: (old-k8s-version-163608) Creating domain...
I0401 19:21:30.619148 64332 main.go:141] libmachine: (old-k8s-version-163608) Waiting to get IP...
I0401 19:21:30.619902 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | domain old-k8s-version-163608 has defined MAC address 52:54:00:fe:1b:e7 in network mk-old-k8s-version-163608
I0401 19:21:30.620299 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | unable to find current IP address of domain old-k8s-version-163608 in network mk-old-k8s-version-163608
I0401 19:21:30.620335 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | I0401 19:21:30.620270 65494 retry.go:31] will retry after 285.351579ms: waiting for machine to come up
I0401 19:21:30.906952 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | domain old-k8s-version-163608 has defined MAC address 52:54:00:fe:1b:e7 in network mk-old-k8s-version-163608
I0401 19:21:30.907581 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | unable to find current IP address of domain old-k8s-version-163608 in network mk-old-k8s-version-163608
I0401 19:21:30.907610 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | I0401 19:21:30.907528 65494 retry.go:31] will retry after 237.382752ms: waiting for machine to come up
I0401 19:21:31.147079 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | domain old-k8s-version-163608 has defined MAC address 52:54:00:fe:1b:e7 in network mk-old-k8s-version-163608
I0401 19:21:31.147654 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | unable to find current IP address of domain old-k8s-version-163608 in network mk-old-k8s-version-163608
I0401 19:21:31.147683 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | I0401 19:21:31.147621 65494 retry.go:31] will retry after 331.306185ms: waiting for machine to come up
I0401 19:21:31.480094 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | domain old-k8s-version-163608 has defined MAC address 52:54:00:fe:1b:e7 in network mk-old-k8s-version-163608
I0401 19:21:31.480698 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | unable to find current IP address of domain old-k8s-version-163608 in network mk-old-k8s-version-163608
I0401 19:21:31.480719 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | I0401 19:21:31.480668 65494 retry.go:31] will retry after 422.653134ms: waiting for machine to come up
I0401 19:21:31.905053 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | domain old-k8s-version-163608 has defined MAC address 52:54:00:fe:1b:e7 in network mk-old-k8s-version-163608
I0401 19:21:31.905612 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | unable to find current IP address of domain old-k8s-version-163608 in network mk-old-k8s-version-163608
I0401 19:21:31.905634 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | I0401 19:21:31.905530 65494 retry.go:31] will retry after 643.549401ms: waiting for machine to come up
I0401 19:21:32.550548 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | domain old-k8s-version-163608 has defined MAC address 52:54:00:fe:1b:e7 in network mk-old-k8s-version-163608
I0401 19:21:32.551109 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | unable to find current IP address of domain old-k8s-version-163608 in network mk-old-k8s-version-163608
I0401 19:21:32.551136 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | I0401 19:21:32.551074 65494 retry.go:31] will retry after 584.677993ms: waiting for machine to come up
I0401 19:21:33.136924 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | domain old-k8s-version-163608 has defined MAC address 52:54:00:fe:1b:e7 in network mk-old-k8s-version-163608
I0401 19:21:33.145888 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | unable to find current IP address of domain old-k8s-version-163608 in network mk-old-k8s-version-163608
I0401 19:21:33.145913 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | I0401 19:21:33.137329 65494 retry.go:31] will retry after 744.241781ms: waiting for machine to come up
I0401 19:21:33.883663 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | domain old-k8s-version-163608 has defined MAC address 52:54:00:fe:1b:e7 in network mk-old-k8s-version-163608
I0401 19:21:33.884109 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | unable to find current IP address of domain old-k8s-version-163608 in network mk-old-k8s-version-163608
I0401 19:21:33.884135 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | I0401 19:21:33.884069 65494 retry.go:31] will retry after 1.210213814s: waiting for machine to come up
I0401 19:21:35.095432 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | domain old-k8s-version-163608 has defined MAC address 52:54:00:fe:1b:e7 in network mk-old-k8s-version-163608
I0401 19:21:35.095902 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | unable to find current IP address of domain old-k8s-version-163608 in network mk-old-k8s-version-163608
I0401 19:21:35.095951 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | I0401 19:21:35.095853 65494 retry.go:31] will retry after 1.746129707s: waiting for machine to come up
I0401 19:21:36.843074 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | domain old-k8s-version-163608 has defined MAC address 52:54:00:fe:1b:e7 in network mk-old-k8s-version-163608
I0401 19:21:36.843612 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | unable to find current IP address of domain old-k8s-version-163608 in network mk-old-k8s-version-163608
I0401 19:21:36.843641 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | I0401 19:21:36.843562 65494 retry.go:31] will retry after 2.101668612s: waiting for machine to come up
I0401 19:21:38.946528 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | domain old-k8s-version-163608 has defined MAC address 52:54:00:fe:1b:e7 in network mk-old-k8s-version-163608
I0401 19:21:38.947173 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | unable to find current IP address of domain old-k8s-version-163608 in network mk-old-k8s-version-163608
I0401 19:21:38.947202 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | I0401 19:21:38.947114 65494 retry.go:31] will retry after 2.331383647s: waiting for machine to come up
I0401 19:21:41.281590 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | domain old-k8s-version-163608 has defined MAC address 52:54:00:fe:1b:e7 in network mk-old-k8s-version-163608
I0401 19:21:41.282035 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | unable to find current IP address of domain old-k8s-version-163608 in network mk-old-k8s-version-163608
I0401 19:21:41.282062 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | I0401 19:21:41.282000 65494 retry.go:31] will retry after 2.687098646s: waiting for machine to come up
I0401 19:21:43.971003 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | domain old-k8s-version-163608 has defined MAC address 52:54:00:fe:1b:e7 in network mk-old-k8s-version-163608
I0401 19:21:43.971576 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | unable to find current IP address of domain old-k8s-version-163608 in network mk-old-k8s-version-163608
I0401 19:21:43.971607 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | I0401 19:21:43.971514 65494 retry.go:31] will retry after 3.521386795s: waiting for machine to come up
I0401 19:21:47.495169 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | domain old-k8s-version-163608 has defined MAC address 52:54:00:fe:1b:e7 in network mk-old-k8s-version-163608
I0401 19:21:47.495585 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | unable to find current IP address of domain old-k8s-version-163608 in network mk-old-k8s-version-163608
I0401 19:21:47.495607 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | I0401 19:21:47.495544 65494 retry.go:31] will retry after 4.398566984s: waiting for machine to come up
I0401 19:21:51.895355 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | domain old-k8s-version-163608 has defined MAC address 52:54:00:fe:1b:e7 in network mk-old-k8s-version-163608
I0401 19:21:51.895900 64332 main.go:141] libmachine: (old-k8s-version-163608) Found IP for machine: 192.168.50.106
I0401 19:21:51.895932 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | domain old-k8s-version-163608 has current primary IP address 192.168.50.106 and MAC address 52:54:00:fe:1b:e7 in network mk-old-k8s-version-163608
I0401 19:21:51.895942 64332 main.go:141] libmachine: (old-k8s-version-163608) Reserving static IP address...
I0401 19:21:51.896313 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-163608", mac: "52:54:00:fe:1b:e7", ip: "192.168.50.106"} in network mk-old-k8s-version-163608
I0401 19:21:51.977441 64332 main.go:141] libmachine: (old-k8s-version-163608) Reserved static IP address: 192.168.50.106
I0401 19:21:51.977466 64332 main.go:141] libmachine: (old-k8s-version-163608) Waiting for SSH to be available...
I0401 19:21:51.977486 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | Getting to WaitForSSH function...
I0401 19:21:51.980802 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | domain old-k8s-version-163608 has defined MAC address 52:54:00:fe:1b:e7 in network mk-old-k8s-version-163608
I0401 19:21:51.981304 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fe:1b:e7", ip: ""} in network mk-old-k8s-version-163608: {Iface:virbr2 ExpiryTime:2024-04-01 20:21:46 +0000 UTC Type:0 Mac:52:54:00:fe:1b:e7 Iaid: IPaddr:192.168.50.106 Prefix:24 Hostname:minikube Clientid:01:52:54:00:fe:1b:e7}
I0401 19:21:51.981333 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | domain old-k8s-version-163608 has defined IP address 192.168.50.106 and MAC address 52:54:00:fe:1b:e7 in network mk-old-k8s-version-163608
I0401 19:21:51.981606 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | Using SSH client type: external
I0401 19:21:51.981633 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | Using SSH private key: /home/jenkins/minikube-integration/18233-10493/.minikube/machines/old-k8s-version-163608/id_rsa (-rw-------)
I0401 19:21:51.981695 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.50.106 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/18233-10493/.minikube/machines/old-k8s-version-163608/id_rsa -p 22] /usr/bin/ssh <nil>}
I0401 19:21:51.981710 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | About to run SSH command:
I0401 19:21:51.981725 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | exit 0
I0401 19:21:52.113998 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | SSH cmd err, output: <nil>:
I0401 19:21:52.114232 64332 main.go:141] libmachine: (old-k8s-version-163608) KVM machine creation complete!
I0401 19:21:52.114587 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetConfigRaw
I0401 19:21:52.115174 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .DriverName
I0401 19:21:52.115409 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .DriverName
I0401 19:21:52.115614 64332 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0401 19:21:52.115634 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetState
I0401 19:21:52.117046 64332 main.go:141] libmachine: Detecting operating system of created instance...
I0401 19:21:52.117063 64332 main.go:141] libmachine: Waiting for SSH to be available...
I0401 19:21:52.117070 64332 main.go:141] libmachine: Getting to WaitForSSH function...
I0401 19:21:52.117080 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetSSHHostname
I0401 19:21:52.119664 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | domain old-k8s-version-163608 has defined MAC address 52:54:00:fe:1b:e7 in network mk-old-k8s-version-163608
I0401 19:21:52.120048 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fe:1b:e7", ip: ""} in network mk-old-k8s-version-163608: {Iface:virbr2 ExpiryTime:2024-04-01 20:21:46 +0000 UTC Type:0 Mac:52:54:00:fe:1b:e7 Iaid: IPaddr:192.168.50.106 Prefix:24 Hostname:old-k8s-version-163608 Clientid:01:52:54:00:fe:1b:e7}
I0401 19:21:52.120080 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | domain old-k8s-version-163608 has defined IP address 192.168.50.106 and MAC address 52:54:00:fe:1b:e7 in network mk-old-k8s-version-163608
I0401 19:21:52.120224 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetSSHPort
I0401 19:21:52.120411 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetSSHKeyPath
I0401 19:21:52.120573 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetSSHKeyPath
I0401 19:21:52.120707 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetSSHUsername
I0401 19:21:52.120891 64332 main.go:141] libmachine: Using SSH client type: native
I0401 19:21:52.121091 64332 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4a0] 0x830200 <nil> [] 0s} 192.168.50.106 22 <nil> <nil>}
I0401 19:21:52.121106 64332 main.go:141] libmachine: About to run SSH command:
exit 0
I0401 19:21:52.237611 64332 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0401 19:21:52.237653 64332 main.go:141] libmachine: Detecting the provisioner...
I0401 19:21:52.237664 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetSSHHostname
I0401 19:21:52.240726 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | domain old-k8s-version-163608 has defined MAC address 52:54:00:fe:1b:e7 in network mk-old-k8s-version-163608
I0401 19:21:52.241161 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fe:1b:e7", ip: ""} in network mk-old-k8s-version-163608: {Iface:virbr2 ExpiryTime:2024-04-01 20:21:46 +0000 UTC Type:0 Mac:52:54:00:fe:1b:e7 Iaid: IPaddr:192.168.50.106 Prefix:24 Hostname:old-k8s-version-163608 Clientid:01:52:54:00:fe:1b:e7}
I0401 19:21:52.241187 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | domain old-k8s-version-163608 has defined IP address 192.168.50.106 and MAC address 52:54:00:fe:1b:e7 in network mk-old-k8s-version-163608
I0401 19:21:52.241384 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetSSHPort
I0401 19:21:52.241568 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetSSHKeyPath
I0401 19:21:52.241712 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetSSHKeyPath
I0401 19:21:52.241848 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetSSHUsername
I0401 19:21:52.241992 64332 main.go:141] libmachine: Using SSH client type: native
I0401 19:21:52.242215 64332 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4a0] 0x830200 <nil> [] 0s} 192.168.50.106 22 <nil> <nil>}
I0401 19:21:52.242229 64332 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0401 19:21:52.362929 64332 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0401 19:21:52.362998 64332 main.go:141] libmachine: found compatible host: buildroot
I0401 19:21:52.363009 64332 main.go:141] libmachine: Provisioning with buildroot...
I0401 19:21:52.363024 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetMachineName
I0401 19:21:52.363292 64332 buildroot.go:166] provisioning hostname "old-k8s-version-163608"
I0401 19:21:52.363312 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetMachineName
I0401 19:21:52.363518 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetSSHHostname
I0401 19:21:52.366696 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | domain old-k8s-version-163608 has defined MAC address 52:54:00:fe:1b:e7 in network mk-old-k8s-version-163608
I0401 19:21:52.367149 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fe:1b:e7", ip: ""} in network mk-old-k8s-version-163608: {Iface:virbr2 ExpiryTime:2024-04-01 20:21:46 +0000 UTC Type:0 Mac:52:54:00:fe:1b:e7 Iaid: IPaddr:192.168.50.106 Prefix:24 Hostname:old-k8s-version-163608 Clientid:01:52:54:00:fe:1b:e7}
I0401 19:21:52.367184 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | domain old-k8s-version-163608 has defined IP address 192.168.50.106 and MAC address 52:54:00:fe:1b:e7 in network mk-old-k8s-version-163608
I0401 19:21:52.367319 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetSSHPort
I0401 19:21:52.367510 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetSSHKeyPath
I0401 19:21:52.367712 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetSSHKeyPath
I0401 19:21:52.367883 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetSSHUsername
I0401 19:21:52.368063 64332 main.go:141] libmachine: Using SSH client type: native
I0401 19:21:52.368264 64332 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4a0] 0x830200 <nil> [] 0s} 192.168.50.106 22 <nil> <nil>}
I0401 19:21:52.368279 64332 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-163608 && echo "old-k8s-version-163608" | sudo tee /etc/hostname
I0401 19:21:52.499285 64332 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-163608
I0401 19:21:52.499321 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetSSHHostname
I0401 19:21:52.502632 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | domain old-k8s-version-163608 has defined MAC address 52:54:00:fe:1b:e7 in network mk-old-k8s-version-163608
I0401 19:21:52.503075 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fe:1b:e7", ip: ""} in network mk-old-k8s-version-163608: {Iface:virbr2 ExpiryTime:2024-04-01 20:21:46 +0000 UTC Type:0 Mac:52:54:00:fe:1b:e7 Iaid: IPaddr:192.168.50.106 Prefix:24 Hostname:old-k8s-version-163608 Clientid:01:52:54:00:fe:1b:e7}
I0401 19:21:52.503108 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | domain old-k8s-version-163608 has defined IP address 192.168.50.106 and MAC address 52:54:00:fe:1b:e7 in network mk-old-k8s-version-163608
I0401 19:21:52.503400 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetSSHPort
I0401 19:21:52.503640 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetSSHKeyPath
I0401 19:21:52.503883 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetSSHKeyPath
I0401 19:21:52.504042 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetSSHUsername
I0401 19:21:52.504223 64332 main.go:141] libmachine: Using SSH client type: native
I0401 19:21:52.504463 64332 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4a0] 0x830200 <nil> [] 0s} 192.168.50.106 22 <nil> <nil>}
I0401 19:21:52.504490 64332 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-163608' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-163608/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-163608' | sudo tee -a /etc/hosts;
fi
fi
I0401 19:21:52.630994 64332 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0401 19:21:52.631029 64332 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/18233-10493/.minikube CaCertPath:/home/jenkins/minikube-integration/18233-10493/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18233-10493/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18233-10493/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18233-10493/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18233-10493/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18233-10493/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18233-10493/.minikube}
I0401 19:21:52.631075 64332 buildroot.go:174] setting up certificates
I0401 19:21:52.631091 64332 provision.go:84] configureAuth start
I0401 19:21:52.631109 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetMachineName
I0401 19:21:52.631397 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetIP
I0401 19:21:52.634450 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | domain old-k8s-version-163608 has defined MAC address 52:54:00:fe:1b:e7 in network mk-old-k8s-version-163608
I0401 19:21:52.634913 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fe:1b:e7", ip: ""} in network mk-old-k8s-version-163608: {Iface:virbr2 ExpiryTime:2024-04-01 20:21:46 +0000 UTC Type:0 Mac:52:54:00:fe:1b:e7 Iaid: IPaddr:192.168.50.106 Prefix:24 Hostname:old-k8s-version-163608 Clientid:01:52:54:00:fe:1b:e7}
I0401 19:21:52.634951 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | domain old-k8s-version-163608 has defined IP address 192.168.50.106 and MAC address 52:54:00:fe:1b:e7 in network mk-old-k8s-version-163608
I0401 19:21:52.635127 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetSSHHostname
I0401 19:21:52.637721 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | domain old-k8s-version-163608 has defined MAC address 52:54:00:fe:1b:e7 in network mk-old-k8s-version-163608
I0401 19:21:52.638115 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fe:1b:e7", ip: ""} in network mk-old-k8s-version-163608: {Iface:virbr2 ExpiryTime:2024-04-01 20:21:46 +0000 UTC Type:0 Mac:52:54:00:fe:1b:e7 Iaid: IPaddr:192.168.50.106 Prefix:24 Hostname:old-k8s-version-163608 Clientid:01:52:54:00:fe:1b:e7}
I0401 19:21:52.638142 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | domain old-k8s-version-163608 has defined IP address 192.168.50.106 and MAC address 52:54:00:fe:1b:e7 in network mk-old-k8s-version-163608
I0401 19:21:52.638327 64332 provision.go:143] copyHostCerts
I0401 19:21:52.638396 64332 exec_runner.go:144] found /home/jenkins/minikube-integration/18233-10493/.minikube/ca.pem, removing ...
I0401 19:21:52.638406 64332 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18233-10493/.minikube/ca.pem
I0401 19:21:52.638450 64332 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18233-10493/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18233-10493/.minikube/ca.pem (1082 bytes)
I0401 19:21:52.638552 64332 exec_runner.go:144] found /home/jenkins/minikube-integration/18233-10493/.minikube/cert.pem, removing ...
I0401 19:21:52.638561 64332 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18233-10493/.minikube/cert.pem
I0401 19:21:52.638582 64332 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18233-10493/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18233-10493/.minikube/cert.pem (1123 bytes)
I0401 19:21:52.638638 64332 exec_runner.go:144] found /home/jenkins/minikube-integration/18233-10493/.minikube/key.pem, removing ...
I0401 19:21:52.638645 64332 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18233-10493/.minikube/key.pem
I0401 19:21:52.638660 64332 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18233-10493/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18233-10493/.minikube/key.pem (1679 bytes)
I0401 19:21:52.638706 64332 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18233-10493/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18233-10493/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18233-10493/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-163608 san=[127.0.0.1 192.168.50.106 localhost minikube old-k8s-version-163608]
I0401 19:21:52.735198 64332 provision.go:177] copyRemoteCerts
I0401 19:21:52.735267 64332 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0401 19:21:52.735295 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetSSHHostname
I0401 19:21:52.738411 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | domain old-k8s-version-163608 has defined MAC address 52:54:00:fe:1b:e7 in network mk-old-k8s-version-163608
I0401 19:21:52.738808 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fe:1b:e7", ip: ""} in network mk-old-k8s-version-163608: {Iface:virbr2 ExpiryTime:2024-04-01 20:21:46 +0000 UTC Type:0 Mac:52:54:00:fe:1b:e7 Iaid: IPaddr:192.168.50.106 Prefix:24 Hostname:old-k8s-version-163608 Clientid:01:52:54:00:fe:1b:e7}
I0401 19:21:52.738839 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | domain old-k8s-version-163608 has defined IP address 192.168.50.106 and MAC address 52:54:00:fe:1b:e7 in network mk-old-k8s-version-163608
I0401 19:21:52.739118 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetSSHPort
I0401 19:21:52.739324 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetSSHKeyPath
I0401 19:21:52.739512 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetSSHUsername
I0401 19:21:52.739775 64332 sshutil.go:53] new ssh client: &{IP:192.168.50.106 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18233-10493/.minikube/machines/old-k8s-version-163608/id_rsa Username:docker}
I0401 19:21:52.824942 64332 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18233-10493/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0401 19:21:52.854661 64332 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18233-10493/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0401 19:21:52.885575 64332 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18233-10493/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0401 19:21:52.914073 64332 provision.go:87] duration metric: took 282.965833ms to configureAuth
I0401 19:21:52.914103 64332 buildroot.go:189] setting minikube options for container-runtime
I0401 19:21:52.914336 64332 config.go:182] Loaded profile config "old-k8s-version-163608": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0401 19:21:52.914429 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetSSHHostname
I0401 19:21:52.917661 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | domain old-k8s-version-163608 has defined MAC address 52:54:00:fe:1b:e7 in network mk-old-k8s-version-163608
I0401 19:21:52.918105 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fe:1b:e7", ip: ""} in network mk-old-k8s-version-163608: {Iface:virbr2 ExpiryTime:2024-04-01 20:21:46 +0000 UTC Type:0 Mac:52:54:00:fe:1b:e7 Iaid: IPaddr:192.168.50.106 Prefix:24 Hostname:old-k8s-version-163608 Clientid:01:52:54:00:fe:1b:e7}
I0401 19:21:52.918145 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | domain old-k8s-version-163608 has defined IP address 192.168.50.106 and MAC address 52:54:00:fe:1b:e7 in network mk-old-k8s-version-163608
I0401 19:21:52.918517 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetSSHPort
I0401 19:21:52.918757 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetSSHKeyPath
I0401 19:21:52.918945 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetSSHKeyPath
I0401 19:21:52.919108 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetSSHUsername
I0401 19:21:52.919302 64332 main.go:141] libmachine: Using SSH client type: native
I0401 19:21:52.919509 64332 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4a0] 0x830200 <nil> [] 0s} 192.168.50.106 22 <nil> <nil>}
I0401 19:21:52.919534 64332 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0401 19:21:53.228265 64332 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0401 19:21:53.228298 64332 main.go:141] libmachine: Checking connection to Docker...
I0401 19:21:53.228318 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetURL
I0401 19:21:53.229669 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | Using libvirt version 6000000
I0401 19:21:53.232329 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | domain old-k8s-version-163608 has defined MAC address 52:54:00:fe:1b:e7 in network mk-old-k8s-version-163608
I0401 19:21:53.232743 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fe:1b:e7", ip: ""} in network mk-old-k8s-version-163608: {Iface:virbr2 ExpiryTime:2024-04-01 20:21:46 +0000 UTC Type:0 Mac:52:54:00:fe:1b:e7 Iaid: IPaddr:192.168.50.106 Prefix:24 Hostname:old-k8s-version-163608 Clientid:01:52:54:00:fe:1b:e7}
I0401 19:21:53.232807 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | domain old-k8s-version-163608 has defined IP address 192.168.50.106 and MAC address 52:54:00:fe:1b:e7 in network mk-old-k8s-version-163608
I0401 19:21:53.233055 64332 main.go:141] libmachine: Docker is up and running!
I0401 19:21:53.233070 64332 main.go:141] libmachine: Reticulating splines...
I0401 19:21:53.233076 64332 client.go:171] duration metric: took 24.463898617s to LocalClient.Create
I0401 19:21:53.233102 64332 start.go:167] duration metric: took 24.463961547s to libmachine.API.Create "old-k8s-version-163608"
I0401 19:21:53.233142 64332 start.go:293] postStartSetup for "old-k8s-version-163608" (driver="kvm2")
I0401 19:21:53.233160 64332 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0401 19:21:53.233181 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .DriverName
I0401 19:21:53.233468 64332 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0401 19:21:53.233497 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetSSHHostname
I0401 19:21:53.235914 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | domain old-k8s-version-163608 has defined MAC address 52:54:00:fe:1b:e7 in network mk-old-k8s-version-163608
I0401 19:21:53.236261 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fe:1b:e7", ip: ""} in network mk-old-k8s-version-163608: {Iface:virbr2 ExpiryTime:2024-04-01 20:21:46 +0000 UTC Type:0 Mac:52:54:00:fe:1b:e7 Iaid: IPaddr:192.168.50.106 Prefix:24 Hostname:old-k8s-version-163608 Clientid:01:52:54:00:fe:1b:e7}
I0401 19:21:53.236288 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | domain old-k8s-version-163608 has defined IP address 192.168.50.106 and MAC address 52:54:00:fe:1b:e7 in network mk-old-k8s-version-163608
I0401 19:21:53.236555 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetSSHPort
I0401 19:21:53.236742 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetSSHKeyPath
I0401 19:21:53.236924 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetSSHUsername
I0401 19:21:53.237089 64332 sshutil.go:53] new ssh client: &{IP:192.168.50.106 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18233-10493/.minikube/machines/old-k8s-version-163608/id_rsa Username:docker}
I0401 19:21:53.325518 64332 ssh_runner.go:195] Run: cat /etc/os-release
I0401 19:21:53.330941 64332 info.go:137] Remote host: Buildroot 2023.02.9
I0401 19:21:53.330973 64332 filesync.go:126] Scanning /home/jenkins/minikube-integration/18233-10493/.minikube/addons for local assets ...
I0401 19:21:53.331045 64332 filesync.go:126] Scanning /home/jenkins/minikube-integration/18233-10493/.minikube/files for local assets ...
I0401 19:21:53.331160 64332 filesync.go:149] local asset: /home/jenkins/minikube-integration/18233-10493/.minikube/files/etc/ssl/certs/177512.pem -> 177512.pem in /etc/ssl/certs
I0401 19:21:53.331279 64332 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0401 19:21:53.341946 64332 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18233-10493/.minikube/files/etc/ssl/certs/177512.pem --> /etc/ssl/certs/177512.pem (1708 bytes)
I0401 19:21:53.375869 64332 start.go:296] duration metric: took 142.707887ms for postStartSetup
I0401 19:21:53.375930 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetConfigRaw
I0401 19:21:53.376552 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetIP
I0401 19:21:53.379576 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | domain old-k8s-version-163608 has defined MAC address 52:54:00:fe:1b:e7 in network mk-old-k8s-version-163608
I0401 19:21:53.379962 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fe:1b:e7", ip: ""} in network mk-old-k8s-version-163608: {Iface:virbr2 ExpiryTime:2024-04-01 20:21:46 +0000 UTC Type:0 Mac:52:54:00:fe:1b:e7 Iaid: IPaddr:192.168.50.106 Prefix:24 Hostname:old-k8s-version-163608 Clientid:01:52:54:00:fe:1b:e7}
I0401 19:21:53.379993 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | domain old-k8s-version-163608 has defined IP address 192.168.50.106 and MAC address 52:54:00:fe:1b:e7 in network mk-old-k8s-version-163608
I0401 19:21:53.380264 64332 profile.go:143] Saving config to /home/jenkins/minikube-integration/18233-10493/.minikube/profiles/old-k8s-version-163608/config.json ...
I0401 19:21:53.380502 64332 start.go:128] duration metric: took 24.636740376s to createHost
I0401 19:21:53.380532 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetSSHHostname
I0401 19:21:53.382693 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | domain old-k8s-version-163608 has defined MAC address 52:54:00:fe:1b:e7 in network mk-old-k8s-version-163608
I0401 19:21:53.383081 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fe:1b:e7", ip: ""} in network mk-old-k8s-version-163608: {Iface:virbr2 ExpiryTime:2024-04-01 20:21:46 +0000 UTC Type:0 Mac:52:54:00:fe:1b:e7 Iaid: IPaddr:192.168.50.106 Prefix:24 Hostname:old-k8s-version-163608 Clientid:01:52:54:00:fe:1b:e7}
I0401 19:21:53.383097 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | domain old-k8s-version-163608 has defined IP address 192.168.50.106 and MAC address 52:54:00:fe:1b:e7 in network mk-old-k8s-version-163608
I0401 19:21:53.383268 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetSSHPort
I0401 19:21:53.383456 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetSSHKeyPath
I0401 19:21:53.383640 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetSSHKeyPath
I0401 19:21:53.383765 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetSSHUsername
I0401 19:21:53.383921 64332 main.go:141] libmachine: Using SSH client type: native
I0401 19:21:53.384119 64332 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4a0] 0x830200 <nil> [] 0s} 192.168.50.106 22 <nil> <nil>}
I0401 19:21:53.384130 64332 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0401 19:21:53.495396 64332 main.go:141] libmachine: SSH cmd err, output: <nil>: 1711999313.462534481
I0401 19:21:53.495424 64332 fix.go:216] guest clock: 1711999313.462534481
I0401 19:21:53.495434 64332 fix.go:229] Guest: 2024-04-01 19:21:53.462534481 +0000 UTC Remote: 2024-04-01 19:21:53.38051794 +0000 UTC m=+35.331578637 (delta=82.016541ms)
I0401 19:21:53.495458 64332 fix.go:200] guest clock delta is within tolerance: 82.016541ms
I0401 19:21:53.495465 64332 start.go:83] releasing machines lock for "old-k8s-version-163608", held for 24.751868928s
I0401 19:21:53.495504 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .DriverName
I0401 19:21:53.495808 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetIP
I0401 19:21:53.499034 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | domain old-k8s-version-163608 has defined MAC address 52:54:00:fe:1b:e7 in network mk-old-k8s-version-163608
I0401 19:21:53.499619 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fe:1b:e7", ip: ""} in network mk-old-k8s-version-163608: {Iface:virbr2 ExpiryTime:2024-04-01 20:21:46 +0000 UTC Type:0 Mac:52:54:00:fe:1b:e7 Iaid: IPaddr:192.168.50.106 Prefix:24 Hostname:old-k8s-version-163608 Clientid:01:52:54:00:fe:1b:e7}
I0401 19:21:53.499641 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | domain old-k8s-version-163608 has defined IP address 192.168.50.106 and MAC address 52:54:00:fe:1b:e7 in network mk-old-k8s-version-163608
I0401 19:21:53.499925 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .DriverName
I0401 19:21:53.500664 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .DriverName
I0401 19:21:53.500864 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .DriverName
I0401 19:21:53.500956 64332 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0401 19:21:53.501033 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetSSHHostname
I0401 19:21:53.501098 64332 ssh_runner.go:195] Run: cat /version.json
I0401 19:21:53.501127 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetSSHHostname
I0401 19:21:53.504605 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | domain old-k8s-version-163608 has defined MAC address 52:54:00:fe:1b:e7 in network mk-old-k8s-version-163608
I0401 19:21:53.505347 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | domain old-k8s-version-163608 has defined MAC address 52:54:00:fe:1b:e7 in network mk-old-k8s-version-163608
I0401 19:21:53.505547 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fe:1b:e7", ip: ""} in network mk-old-k8s-version-163608: {Iface:virbr2 ExpiryTime:2024-04-01 20:21:46 +0000 UTC Type:0 Mac:52:54:00:fe:1b:e7 Iaid: IPaddr:192.168.50.106 Prefix:24 Hostname:old-k8s-version-163608 Clientid:01:52:54:00:fe:1b:e7}
I0401 19:21:53.505596 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | domain old-k8s-version-163608 has defined IP address 192.168.50.106 and MAC address 52:54:00:fe:1b:e7 in network mk-old-k8s-version-163608
I0401 19:21:53.505876 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetSSHPort
I0401 19:21:53.505925 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fe:1b:e7", ip: ""} in network mk-old-k8s-version-163608: {Iface:virbr2 ExpiryTime:2024-04-01 20:21:46 +0000 UTC Type:0 Mac:52:54:00:fe:1b:e7 Iaid: IPaddr:192.168.50.106 Prefix:24 Hostname:old-k8s-version-163608 Clientid:01:52:54:00:fe:1b:e7}
I0401 19:21:53.505957 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | domain old-k8s-version-163608 has defined IP address 192.168.50.106 and MAC address 52:54:00:fe:1b:e7 in network mk-old-k8s-version-163608
I0401 19:21:53.506090 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetSSHKeyPath
I0401 19:21:53.506203 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetSSHPort
I0401 19:21:53.506275 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetSSHUsername
I0401 19:21:53.506320 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetSSHKeyPath
I0401 19:21:53.506360 64332 sshutil.go:53] new ssh client: &{IP:192.168.50.106 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18233-10493/.minikube/machines/old-k8s-version-163608/id_rsa Username:docker}
I0401 19:21:53.506437 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetSSHUsername
I0401 19:21:53.506780 64332 sshutil.go:53] new ssh client: &{IP:192.168.50.106 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18233-10493/.minikube/machines/old-k8s-version-163608/id_rsa Username:docker}
I0401 19:21:53.597012 64332 ssh_runner.go:195] Run: systemctl --version
I0401 19:21:53.620032 64332 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0401 19:21:53.799671 64332 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0401 19:21:53.810551 64332 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0401 19:21:53.810634 64332 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0401 19:21:53.840707 64332 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0401 19:21:53.840730 64332 start.go:494] detecting cgroup driver to use...
I0401 19:21:53.840787 64332 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0401 19:21:53.867102 64332 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0401 19:21:53.885720 64332 docker.go:217] disabling cri-docker service (if available) ...
I0401 19:21:53.885788 64332 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0401 19:21:53.907613 64332 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0401 19:21:53.926800 64332 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0401 19:21:54.081934 64332 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0401 19:21:54.251483 64332 docker.go:233] disabling docker service ...
I0401 19:21:54.251550 64332 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0401 19:21:54.282336 64332 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0401 19:21:54.301773 64332 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0401 19:21:54.482827 64332 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0401 19:21:54.653763 64332 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0401 19:21:54.670468 64332 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0401 19:21:54.693806 64332 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0401 19:21:54.693860 64332 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0401 19:21:54.708911 64332 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0401 19:21:54.708972 64332 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0401 19:21:54.724165 64332 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0401 19:21:54.741290 64332 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0401 19:21:54.758557 64332 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0401 19:21:54.775536 64332 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0401 19:21:54.789294 64332 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0401 19:21:54.789401 64332 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0401 19:21:54.810121 64332 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0401 19:21:54.822445 64332 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0401 19:21:55.012578 64332 ssh_runner.go:195] Run: sudo systemctl restart crio
I0401 19:21:55.201790 64332 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0401 19:21:55.201869 64332 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0401 19:21:55.207759 64332 start.go:562] Will wait 60s for crictl version
I0401 19:21:55.207822 64332 ssh_runner.go:195] Run: which crictl
I0401 19:21:55.212415 64332 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0401 19:21:55.258126 64332 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0401 19:21:55.258205 64332 ssh_runner.go:195] Run: crio --version
I0401 19:21:55.296320 64332 ssh_runner.go:195] Run: crio --version
I0401 19:21:55.335150 64332 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0401 19:21:55.336602 64332 main.go:141] libmachine: (old-k8s-version-163608) Calling .GetIP
I0401 19:21:55.339557 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | domain old-k8s-version-163608 has defined MAC address 52:54:00:fe:1b:e7 in network mk-old-k8s-version-163608
I0401 19:21:55.339956 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fe:1b:e7", ip: ""} in network mk-old-k8s-version-163608: {Iface:virbr2 ExpiryTime:2024-04-01 20:21:46 +0000 UTC Type:0 Mac:52:54:00:fe:1b:e7 Iaid: IPaddr:192.168.50.106 Prefix:24 Hostname:old-k8s-version-163608 Clientid:01:52:54:00:fe:1b:e7}
I0401 19:21:55.339994 64332 main.go:141] libmachine: (old-k8s-version-163608) DBG | domain old-k8s-version-163608 has defined IP address 192.168.50.106 and MAC address 52:54:00:fe:1b:e7 in network mk-old-k8s-version-163608
I0401 19:21:55.340149 64332 ssh_runner.go:195] Run: grep 192.168.50.1 host.minikube.internal$ /etc/hosts
I0401 19:21:55.345088 64332 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.50.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0401 19:21:55.360734 64332 kubeadm.go:877] updating cluster {Name:old-k8s-version-163608 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18485/minikube-v1.33.0-1711559712-18485-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1711559786-18485@sha256:2dcab64da240d825290a528fa79ad3c32db45fe5f8be5150468234a7114eff82 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-163608 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.50.106 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] M
ountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0401 19:21:55.360866 64332 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0401 19:21:55.360926 64332 ssh_runner.go:195] Run: sudo crictl images --output json
I0401 19:21:55.403881 64332 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0401 19:21:55.403966 64332 ssh_runner.go:195] Run: which lz4
I0401 19:21:55.409107 64332 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0401 19:21:55.414459 64332 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0401 19:21:55.414490 64332 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18233-10493/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0401 19:21:57.527589 64332 crio.go:462] duration metric: took 2.118509582s to copy over tarball
I0401 19:21:57.527669 64332 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0401 19:22:00.694117 64332 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (3.166415986s)
I0401 19:22:00.694143 64332 crio.go:469] duration metric: took 3.16652444s to extract the tarball
I0401 19:22:00.694153 64332 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0401 19:22:00.774370 64332 ssh_runner.go:195] Run: sudo crictl images --output json
I0401 19:22:00.920462 64332 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0401 19:22:00.920487 64332 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0401 19:22:00.920561 64332 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0401 19:22:00.920816 64332 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0401 19:22:00.920947 64332 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0401 19:22:00.921061 64332 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0401 19:22:00.921165 64332 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0401 19:22:00.921290 64332 image.go:134] retrieving image: registry.k8s.io/pause:3.2
I0401 19:22:00.921423 64332 image.go:134] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0401 19:22:00.921533 64332 image.go:134] retrieving image: registry.k8s.io/coredns:1.7.0
I0401 19:22:00.923385 64332 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0401 19:22:00.923394 64332 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0401 19:22:00.923389 64332 image.go:177] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0401 19:22:00.923490 64332 image.go:177] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0401 19:22:00.924520 64332 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0401 19:22:00.924532 64332 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0401 19:22:00.924615 64332 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0401 19:22:00.930046 64332 image.go:177] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0401 19:22:01.084552 64332 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0401 19:22:01.098443 64332 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0401 19:22:01.099175 64332 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0401 19:22:01.102961 64332 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0401 19:22:01.124509 64332 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0401 19:22:01.127536 64332 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0401 19:22:01.141359 64332 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0401 19:22:01.225993 64332 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0401 19:22:01.294969 64332 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0401 19:22:01.295023 64332 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0401 19:22:01.295069 64332 ssh_runner.go:195] Run: which crictl
I0401 19:22:01.305867 64332 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0401 19:22:01.305909 64332 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0401 19:22:01.305950 64332 ssh_runner.go:195] Run: which crictl
I0401 19:22:01.431081 64332 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0401 19:22:01.431127 64332 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0401 19:22:01.431179 64332 ssh_runner.go:195] Run: which crictl
I0401 19:22:01.466551 64332 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0401 19:22:01.466593 64332 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0401 19:22:01.466658 64332 ssh_runner.go:195] Run: which crictl
I0401 19:22:01.508993 64332 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0401 19:22:01.509043 64332 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0401 19:22:01.509098 64332 ssh_runner.go:195] Run: which crictl
I0401 19:22:01.509167 64332 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0401 19:22:01.509202 64332 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0401 19:22:01.509238 64332 ssh_runner.go:195] Run: which crictl
I0401 19:22:01.509257 64332 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0401 19:22:01.509280 64332 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0401 19:22:01.509318 64332 ssh_runner.go:195] Run: which crictl
I0401 19:22:01.537905 64332 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0401 19:22:01.537966 64332 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0401 19:22:01.538020 64332 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0401 19:22:01.538053 64332 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0401 19:22:01.538085 64332 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0401 19:22:01.538117 64332 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0401 19:22:01.538146 64332 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0401 19:22:01.765325 64332 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18233-10493/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0401 19:22:01.765394 64332 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18233-10493/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0401 19:22:01.765438 64332 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18233-10493/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0401 19:22:01.765480 64332 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18233-10493/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0401 19:22:01.767582 64332 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18233-10493/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0401 19:22:01.784415 64332 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18233-10493/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0401 19:22:01.784509 64332 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18233-10493/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0401 19:22:01.784541 64332 cache_images.go:92] duration metric: took 864.039664ms to LoadCachedImages
W0401 19:22:01.784622 64332 out.go:239] X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/18233-10493/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0: no such file or directory
X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/18233-10493/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0: no such file or directory
I0401 19:22:01.784638 64332 kubeadm.go:928] updating node { 192.168.50.106 8443 v1.20.0 crio true true} ...
I0401 19:22:01.784760 64332 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-163608 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.50.106
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-163608 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0401 19:22:01.784842 64332 ssh_runner.go:195] Run: crio config
I0401 19:22:01.863346 64332 cni.go:84] Creating CNI manager for ""
I0401 19:22:01.863376 64332 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0401 19:22:01.863392 64332 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0401 19:22:01.863417 64332 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.50.106 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-163608 NodeName:old-k8s-version-163608 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.50.106"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.50.106 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0401 19:22:01.863619 64332 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.50.106
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-163608"
kubeletExtraArgs:
node-ip: 192.168.50.106
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.50.106"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0401 19:22:01.863698 64332 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0401 19:22:01.875442 64332 binaries.go:44] Found k8s binaries, skipping transfer
I0401 19:22:01.875518 64332 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0401 19:22:01.886256 64332 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0401 19:22:01.905921 64332 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0401 19:22:01.925862 64332 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2123 bytes)
I0401 19:22:01.946731 64332 ssh_runner.go:195] Run: grep 192.168.50.106 control-plane.minikube.internal$ /etc/hosts
I0401 19:22:01.951149 64332 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.50.106 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0401 19:22:01.966200 64332 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0401 19:22:02.097488 64332 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0401 19:22:02.122996 64332 certs.go:68] Setting up /home/jenkins/minikube-integration/18233-10493/.minikube/profiles/old-k8s-version-163608 for IP: 192.168.50.106
I0401 19:22:02.123023 64332 certs.go:194] generating shared ca certs ...
I0401 19:22:02.123045 64332 certs.go:226] acquiring lock for ca certs: {Name:mk348b3e250c104b662139cd7212c6c6dfda3180 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 19:22:02.123216 64332 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/18233-10493/.minikube/ca.key
I0401 19:22:02.123292 64332 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/18233-10493/.minikube/proxy-client-ca.key
I0401 19:22:02.123306 64332 certs.go:256] generating profile certs ...
I0401 19:22:02.123398 64332 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/18233-10493/.minikube/profiles/old-k8s-version-163608/client.key
I0401 19:22:02.123428 64332 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18233-10493/.minikube/profiles/old-k8s-version-163608/client.crt with IP's: []
I0401 19:22:02.234642 64332 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18233-10493/.minikube/profiles/old-k8s-version-163608/client.crt ...
I0401 19:22:02.234675 64332 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18233-10493/.minikube/profiles/old-k8s-version-163608/client.crt: {Name:mka621f26e362f7e72c5aeb7f1f6d1bcef6dc2e7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 19:22:02.234863 64332 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18233-10493/.minikube/profiles/old-k8s-version-163608/client.key ...
I0401 19:22:02.234879 64332 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18233-10493/.minikube/profiles/old-k8s-version-163608/client.key: {Name:mk72a529f205a754a229d3aea4173d8542dfd367 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 19:22:02.234991 64332 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/18233-10493/.minikube/profiles/old-k8s-version-163608/apiserver.key.f2de0982
I0401 19:22:02.235023 64332 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18233-10493/.minikube/profiles/old-k8s-version-163608/apiserver.crt.f2de0982 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.50.106]
I0401 19:22:02.663927 64332 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18233-10493/.minikube/profiles/old-k8s-version-163608/apiserver.crt.f2de0982 ...
I0401 19:22:02.663954 64332 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18233-10493/.minikube/profiles/old-k8s-version-163608/apiserver.crt.f2de0982: {Name:mk5481f5b5333d2ff5a3004e1647272c72d2a4d9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 19:22:02.664108 64332 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18233-10493/.minikube/profiles/old-k8s-version-163608/apiserver.key.f2de0982 ...
I0401 19:22:02.664122 64332 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18233-10493/.minikube/profiles/old-k8s-version-163608/apiserver.key.f2de0982: {Name:mk16de14624d3aa251c14d0ffb327c3bd0af9b0f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 19:22:02.664192 64332 certs.go:381] copying /home/jenkins/minikube-integration/18233-10493/.minikube/profiles/old-k8s-version-163608/apiserver.crt.f2de0982 -> /home/jenkins/minikube-integration/18233-10493/.minikube/profiles/old-k8s-version-163608/apiserver.crt
I0401 19:22:02.664277 64332 certs.go:385] copying /home/jenkins/minikube-integration/18233-10493/.minikube/profiles/old-k8s-version-163608/apiserver.key.f2de0982 -> /home/jenkins/minikube-integration/18233-10493/.minikube/profiles/old-k8s-version-163608/apiserver.key
I0401 19:22:02.664332 64332 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/18233-10493/.minikube/profiles/old-k8s-version-163608/proxy-client.key
I0401 19:22:02.664346 64332 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18233-10493/.minikube/profiles/old-k8s-version-163608/proxy-client.crt with IP's: []
I0401 19:22:03.007277 64332 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18233-10493/.minikube/profiles/old-k8s-version-163608/proxy-client.crt ...
I0401 19:22:03.007318 64332 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18233-10493/.minikube/profiles/old-k8s-version-163608/proxy-client.crt: {Name:mk148d51671583c6677a879c334f6355218be012 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 19:22:03.007533 64332 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18233-10493/.minikube/profiles/old-k8s-version-163608/proxy-client.key ...
I0401 19:22:03.007555 64332 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18233-10493/.minikube/profiles/old-k8s-version-163608/proxy-client.key: {Name:mk9cf3e2f3c16e8e24fd65a7c23d78aa6fcdbd14 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 19:22:03.007798 64332 certs.go:484] found cert: /home/jenkins/minikube-integration/18233-10493/.minikube/certs/17751.pem (1338 bytes)
W0401 19:22:03.007855 64332 certs.go:480] ignoring /home/jenkins/minikube-integration/18233-10493/.minikube/certs/17751_empty.pem, impossibly tiny 0 bytes
I0401 19:22:03.007870 64332 certs.go:484] found cert: /home/jenkins/minikube-integration/18233-10493/.minikube/certs/ca-key.pem (1675 bytes)
I0401 19:22:03.007899 64332 certs.go:484] found cert: /home/jenkins/minikube-integration/18233-10493/.minikube/certs/ca.pem (1082 bytes)
I0401 19:22:03.007938 64332 certs.go:484] found cert: /home/jenkins/minikube-integration/18233-10493/.minikube/certs/cert.pem (1123 bytes)
I0401 19:22:03.007981 64332 certs.go:484] found cert: /home/jenkins/minikube-integration/18233-10493/.minikube/certs/key.pem (1679 bytes)
I0401 19:22:03.008024 64332 certs.go:484] found cert: /home/jenkins/minikube-integration/18233-10493/.minikube/files/etc/ssl/certs/177512.pem (1708 bytes)
I0401 19:22:03.008623 64332 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18233-10493/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0401 19:22:03.047948 64332 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18233-10493/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0401 19:22:03.087078 64332 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18233-10493/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0401 19:22:03.134400 64332 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18233-10493/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0401 19:22:03.170892 64332 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18233-10493/.minikube/profiles/old-k8s-version-163608/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0401 19:22:03.205256 64332 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18233-10493/.minikube/profiles/old-k8s-version-163608/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0401 19:22:03.237357 64332 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18233-10493/.minikube/profiles/old-k8s-version-163608/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0401 19:22:03.268181 64332 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18233-10493/.minikube/profiles/old-k8s-version-163608/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0401 19:22:03.302042 64332 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18233-10493/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0401 19:22:03.332226 64332 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18233-10493/.minikube/certs/17751.pem --> /usr/share/ca-certificates/17751.pem (1338 bytes)
I0401 19:22:03.365430 64332 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18233-10493/.minikube/files/etc/ssl/certs/177512.pem --> /usr/share/ca-certificates/177512.pem (1708 bytes)
I0401 19:22:03.400661 64332 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (752 bytes)
I0401 19:22:03.420641 64332 ssh_runner.go:195] Run: openssl version
I0401 19:22:03.427188 64332 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0401 19:22:03.440444 64332 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0401 19:22:03.446548 64332 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Apr 1 18:07 /usr/share/ca-certificates/minikubeCA.pem
I0401 19:22:03.446625 64332 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0401 19:22:03.453549 64332 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0401 19:22:03.466430 64332 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/17751.pem && ln -fs /usr/share/ca-certificates/17751.pem /etc/ssl/certs/17751.pem"
I0401 19:22:03.483639 64332 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/17751.pem
I0401 19:22:03.489322 64332 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Apr 1 18:15 /usr/share/ca-certificates/17751.pem
I0401 19:22:03.489395 64332 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/17751.pem
I0401 19:22:03.496215 64332 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/17751.pem /etc/ssl/certs/51391683.0"
I0401 19:22:03.512893 64332 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/177512.pem && ln -fs /usr/share/ca-certificates/177512.pem /etc/ssl/certs/177512.pem"
I0401 19:22:03.527273 64332 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/177512.pem
I0401 19:22:03.534104 64332 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Apr 1 18:15 /usr/share/ca-certificates/177512.pem
I0401 19:22:03.534167 64332 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/177512.pem
I0401 19:22:03.542965 64332 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/177512.pem /etc/ssl/certs/3ec20f2e.0"
I0401 19:22:03.557332 64332 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0401 19:22:03.562927 64332 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0401 19:22:03.562988 64332 kubeadm.go:391] StartCluster: {Name:old-k8s-version-163608 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18485/minikube-v1.33.0-1711559712-18485-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1711559786-18485@sha256:2dcab64da240d825290a528fa79ad3c32db45fe5f8be5150468234a7114eff82 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-163608 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.50.106 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Moun
tPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0401 19:22:03.563071 64332 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0401 19:22:03.563119 64332 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0401 19:22:03.611607 64332 cri.go:89] found id: ""
I0401 19:22:03.611699 64332 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0401 19:22:03.626566 64332 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0401 19:22:03.641690 64332 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0401 19:22:03.656026 64332 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0401 19:22:03.656045 64332 kubeadm.go:156] found existing configuration files:
I0401 19:22:03.656096 64332 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0401 19:22:03.669288 64332 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0401 19:22:03.669355 64332 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0401 19:22:03.682071 64332 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0401 19:22:03.695146 64332 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0401 19:22:03.695212 64332 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0401 19:22:03.709345 64332 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0401 19:22:03.722425 64332 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0401 19:22:03.722519 64332 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0401 19:22:03.733827 64332 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0401 19:22:03.747838 64332 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0401 19:22:03.747911 64332 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0401 19:22:03.758927 64332 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0401 19:22:03.902597 64332 kubeadm.go:309] [init] Using Kubernetes version: v1.20.0
I0401 19:22:03.902692 64332 kubeadm.go:309] [preflight] Running pre-flight checks
I0401 19:22:04.136018 64332 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0401 19:22:04.136160 64332 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0401 19:22:04.136289 64332 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0401 19:22:04.386099 64332 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0401 19:22:04.389242 64332 out.go:204] - Generating certificates and keys ...
I0401 19:22:04.389360 64332 kubeadm.go:309] [certs] Using existing ca certificate authority
I0401 19:22:04.389459 64332 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0401 19:22:04.583291 64332 kubeadm.go:309] [certs] Generating "apiserver-kubelet-client" certificate and key
I0401 19:22:04.789416 64332 kubeadm.go:309] [certs] Generating "front-proxy-ca" certificate and key
I0401 19:22:04.932598 64332 kubeadm.go:309] [certs] Generating "front-proxy-client" certificate and key
I0401 19:22:05.057207 64332 kubeadm.go:309] [certs] Generating "etcd/ca" certificate and key
I0401 19:22:05.330488 64332 kubeadm.go:309] [certs] Generating "etcd/server" certificate and key
I0401 19:22:05.331252 64332 kubeadm.go:309] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-163608] and IPs [192.168.50.106 127.0.0.1 ::1]
I0401 19:22:05.408381 64332 kubeadm.go:309] [certs] Generating "etcd/peer" certificate and key
I0401 19:22:05.408632 64332 kubeadm.go:309] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-163608] and IPs [192.168.50.106 127.0.0.1 ::1]
I0401 19:22:06.038170 64332 kubeadm.go:309] [certs] Generating "etcd/healthcheck-client" certificate and key
I0401 19:22:06.167702 64332 kubeadm.go:309] [certs] Generating "apiserver-etcd-client" certificate and key
I0401 19:22:06.296475 64332 kubeadm.go:309] [certs] Generating "sa" key and public key
I0401 19:22:06.296804 64332 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0401 19:22:06.504815 64332 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0401 19:22:06.631663 64332 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0401 19:22:06.955081 64332 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0401 19:22:07.319315 64332 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0401 19:22:07.339260 64332 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0401 19:22:07.342628 64332 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0401 19:22:07.342766 64332 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0401 19:22:07.518487 64332 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0401 19:22:07.520352 64332 out.go:204] - Booting up control plane ...
I0401 19:22:07.520488 64332 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0401 19:22:07.525725 64332 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0401 19:22:07.528051 64332 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0401 19:22:07.532779 64332 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0401 19:22:07.539918 64332 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0401 19:22:47.531699 64332 kubeadm.go:309] [kubelet-check] Initial timeout of 40s passed.
I0401 19:22:47.532299 64332 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0401 19:22:47.532553 64332 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0401 19:22:52.533020 64332 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0401 19:22:52.533288 64332 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0401 19:23:02.532613 64332 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0401 19:23:02.532850 64332 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0401 19:23:22.532572 64332 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0401 19:23:22.532842 64332 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0401 19:24:02.534097 64332 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0401 19:24:02.534386 64332 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0401 19:24:02.534404 64332 kubeadm.go:309]
I0401 19:24:02.534442 64332 kubeadm.go:309] Unfortunately, an error has occurred:
I0401 19:24:02.534517 64332 kubeadm.go:309] timed out waiting for the condition
I0401 19:24:02.534538 64332 kubeadm.go:309]
I0401 19:24:02.534586 64332 kubeadm.go:309] This error is likely caused by:
I0401 19:24:02.534641 64332 kubeadm.go:309] - The kubelet is not running
I0401 19:24:02.534834 64332 kubeadm.go:309] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0401 19:24:02.534851 64332 kubeadm.go:309]
I0401 19:24:02.535003 64332 kubeadm.go:309] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0401 19:24:02.535052 64332 kubeadm.go:309] - 'systemctl status kubelet'
I0401 19:24:02.535099 64332 kubeadm.go:309] - 'journalctl -xeu kubelet'
I0401 19:24:02.535110 64332 kubeadm.go:309]
I0401 19:24:02.535235 64332 kubeadm.go:309] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0401 19:24:02.535339 64332 kubeadm.go:309] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0401 19:24:02.535352 64332 kubeadm.go:309]
I0401 19:24:02.535488 64332 kubeadm.go:309] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0401 19:24:02.535594 64332 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0401 19:24:02.535692 64332 kubeadm.go:309] Once you have found the failing container, you can inspect its logs with:
I0401 19:24:02.535812 64332 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0401 19:24:02.535827 64332 kubeadm.go:309]
I0401 19:24:02.536493 64332 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0401 19:24:02.536607 64332 kubeadm.go:309] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0401 19:24:02.536696 64332 kubeadm.go:309] To see the stack trace of this error execute with --v=5 or higher
W0401 19:24:02.536820 64332 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-163608] and IPs [192.168.50.106 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-163608] and IPs [192.168.50.106 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-163608] and IPs [192.168.50.106 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-163608] and IPs [192.168.50.106 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0401 19:24:02.536872 64332 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0401 19:24:05.554319 64332 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (3.017412567s)
I0401 19:24:05.554403 64332 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0401 19:24:05.569309 64332 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0401 19:24:05.579276 64332 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0401 19:24:05.579300 64332 kubeadm.go:156] found existing configuration files:
I0401 19:24:05.579359 64332 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0401 19:24:05.589088 64332 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0401 19:24:05.589146 64332 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0401 19:24:05.598928 64332 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0401 19:24:05.609193 64332 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0401 19:24:05.609250 64332 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0401 19:24:05.619298 64332 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0401 19:24:05.629198 64332 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0401 19:24:05.629255 64332 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0401 19:24:05.638933 64332 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0401 19:24:05.648754 64332 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0401 19:24:05.648798 64332 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0401 19:24:05.659034 64332 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0401 19:24:05.727215 64332 kubeadm.go:309] [init] Using Kubernetes version: v1.20.0
I0401 19:24:05.727316 64332 kubeadm.go:309] [preflight] Running pre-flight checks
I0401 19:24:05.899028 64332 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0401 19:24:05.899177 64332 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0401 19:24:05.899296 64332 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0401 19:24:06.115337 64332 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0401 19:24:06.117349 64332 out.go:204] - Generating certificates and keys ...
I0401 19:24:06.117468 64332 kubeadm.go:309] [certs] Using existing ca certificate authority
I0401 19:24:06.117581 64332 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0401 19:24:06.117703 64332 kubeadm.go:309] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0401 19:24:06.117772 64332 kubeadm.go:309] [certs] Using existing front-proxy-ca certificate authority
I0401 19:24:06.117866 64332 kubeadm.go:309] [certs] Using existing front-proxy-client certificate and key on disk
I0401 19:24:06.117943 64332 kubeadm.go:309] [certs] Using existing etcd/ca certificate authority
I0401 19:24:06.118028 64332 kubeadm.go:309] [certs] Using existing etcd/server certificate and key on disk
I0401 19:24:06.118458 64332 kubeadm.go:309] [certs] Using existing etcd/peer certificate and key on disk
I0401 19:24:06.119407 64332 kubeadm.go:309] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0401 19:24:06.120346 64332 kubeadm.go:309] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0401 19:24:06.120794 64332 kubeadm.go:309] [certs] Using the existing "sa" key
I0401 19:24:06.120847 64332 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0401 19:24:06.309987 64332 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0401 19:24:06.566399 64332 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0401 19:24:06.671724 64332 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0401 19:24:06.759378 64332 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0401 19:24:06.776186 64332 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0401 19:24:06.777416 64332 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0401 19:24:06.777493 64332 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0401 19:24:06.967580 64332 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0401 19:24:06.969085 64332 out.go:204] - Booting up control plane ...
I0401 19:24:06.969223 64332 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0401 19:24:06.995661 64332 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0401 19:24:06.995741 64332 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0401 19:24:06.995866 64332 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0401 19:24:07.002154 64332 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0401 19:24:47.005429 64332 kubeadm.go:309] [kubelet-check] Initial timeout of 40s passed.
I0401 19:24:47.005568 64332 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0401 19:24:47.006190 64332 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0401 19:24:52.006910 64332 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0401 19:24:52.007171 64332 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0401 19:25:02.008145 64332 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0401 19:25:02.008408 64332 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0401 19:25:22.007178 64332 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0401 19:25:22.007351 64332 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0401 19:26:02.007007 64332 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0401 19:26:02.007263 64332 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0401 19:26:02.007276 64332 kubeadm.go:309]
I0401 19:26:02.007324 64332 kubeadm.go:309] Unfortunately, an error has occurred:
I0401 19:26:02.007394 64332 kubeadm.go:309] timed out waiting for the condition
I0401 19:26:02.007418 64332 kubeadm.go:309]
I0401 19:26:02.007466 64332 kubeadm.go:309] This error is likely caused by:
I0401 19:26:02.007515 64332 kubeadm.go:309] - The kubelet is not running
I0401 19:26:02.007665 64332 kubeadm.go:309] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0401 19:26:02.007677 64332 kubeadm.go:309]
I0401 19:26:02.007780 64332 kubeadm.go:309] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0401 19:26:02.007810 64332 kubeadm.go:309] - 'systemctl status kubelet'
I0401 19:26:02.007838 64332 kubeadm.go:309] - 'journalctl -xeu kubelet'
I0401 19:26:02.007850 64332 kubeadm.go:309]
I0401 19:26:02.007937 64332 kubeadm.go:309] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0401 19:26:02.008055 64332 kubeadm.go:309] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0401 19:26:02.008073 64332 kubeadm.go:309]
I0401 19:26:02.008210 64332 kubeadm.go:309] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0401 19:26:02.008337 64332 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0401 19:26:02.008437 64332 kubeadm.go:309] Once you have found the failing container, you can inspect its logs with:
I0401 19:26:02.008533 64332 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0401 19:26:02.008545 64332 kubeadm.go:309]
I0401 19:26:02.009823 64332 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0401 19:26:02.009946 64332 kubeadm.go:309] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0401 19:26:02.010066 64332 kubeadm.go:309] To see the stack trace of this error execute with --v=5 or higher
I0401 19:26:02.010130 64332 kubeadm.go:393] duration metric: took 3m58.447146496s to StartCluster
I0401 19:26:02.010169 64332 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0401 19:26:02.010215 64332 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0401 19:26:02.067444 64332 cri.go:89] found id: ""
I0401 19:26:02.067466 64332 logs.go:276] 0 containers: []
W0401 19:26:02.067476 64332 logs.go:278] No container was found matching "kube-apiserver"
I0401 19:26:02.067481 64332 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0401 19:26:02.067521 64332 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0401 19:26:02.114766 64332 cri.go:89] found id: ""
I0401 19:26:02.114789 64332 logs.go:276] 0 containers: []
W0401 19:26:02.114796 64332 logs.go:278] No container was found matching "etcd"
I0401 19:26:02.114802 64332 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0401 19:26:02.114854 64332 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0401 19:26:02.164005 64332 cri.go:89] found id: ""
I0401 19:26:02.164039 64332 logs.go:276] 0 containers: []
W0401 19:26:02.164048 64332 logs.go:278] No container was found matching "coredns"
I0401 19:26:02.164054 64332 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0401 19:26:02.164107 64332 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0401 19:26:02.205343 64332 cri.go:89] found id: ""
I0401 19:26:02.205365 64332 logs.go:276] 0 containers: []
W0401 19:26:02.205373 64332 logs.go:278] No container was found matching "kube-scheduler"
I0401 19:26:02.205378 64332 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0401 19:26:02.205440 64332 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0401 19:26:02.247235 64332 cri.go:89] found id: ""
I0401 19:26:02.247261 64332 logs.go:276] 0 containers: []
W0401 19:26:02.247270 64332 logs.go:278] No container was found matching "kube-proxy"
I0401 19:26:02.247276 64332 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0401 19:26:02.247331 64332 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0401 19:26:02.290858 64332 cri.go:89] found id: ""
I0401 19:26:02.290884 64332 logs.go:276] 0 containers: []
W0401 19:26:02.290892 64332 logs.go:278] No container was found matching "kube-controller-manager"
I0401 19:26:02.290897 64332 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0401 19:26:02.290958 64332 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0401 19:26:02.328562 64332 cri.go:89] found id: ""
I0401 19:26:02.328596 64332 logs.go:276] 0 containers: []
W0401 19:26:02.328607 64332 logs.go:278] No container was found matching "kindnet"
I0401 19:26:02.328618 64332 logs.go:123] Gathering logs for kubelet ...
I0401 19:26:02.328630 64332 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0401 19:26:02.383310 64332 logs.go:123] Gathering logs for dmesg ...
I0401 19:26:02.383335 64332 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0401 19:26:02.397922 64332 logs.go:123] Gathering logs for describe nodes ...
I0401 19:26:02.397952 64332 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0401 19:26:02.514395 64332 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0401 19:26:02.514418 64332 logs.go:123] Gathering logs for CRI-O ...
I0401 19:26:02.514433 64332 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0401 19:26:02.605441 64332 logs.go:123] Gathering logs for container status ...
I0401 19:26:02.605485 64332 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0401 19:26:02.658736 64332 out.go:364] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0401 19:26:02.658778 64332 out.go:239] *
*
W0401 19:26:02.658825 64332 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0401 19:26:02.658845 64332 out.go:239] *
*
W0401 19:26:02.659626 64332 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0401 19:26:02.663045 64332 out.go:177]
W0401 19:26:02.664406 64332 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0401 19:26:02.664446 64332 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0401 19:26:02.664465 64332 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0401 19:26:02.665995 64332 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-163608 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-163608 -n old-k8s-version-163608
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-163608 -n old-k8s-version-163608: exit status 6 (233.573636ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0401 19:26:02.938635 70327 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-163608" does not appear in /home/jenkins/minikube-integration/18233-10493/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-163608" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (284.91s)