=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-003661 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-003661 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m41.085822902s)
-- stdout --
* [old-k8s-version-003661] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=19084
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19084-112967/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19084-112967/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-003661" primary control-plane node in "old-k8s-version-003661" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0617 11:51:58.819939 161767 out.go:291] Setting OutFile to fd 1 ...
I0617 11:51:58.820079 161767 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0617 11:51:58.820089 161767 out.go:304] Setting ErrFile to fd 2...
I0617 11:51:58.820093 161767 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0617 11:51:58.820758 161767 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19084-112967/.minikube/bin
I0617 11:51:58.821563 161767 out.go:298] Setting JSON to false
I0617 11:51:58.822556 161767 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-14","uptime":5666,"bootTime":1718619453,"procs":219,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1062-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0617 11:51:58.822613 161767 start.go:139] virtualization: kvm guest
I0617 11:51:58.824831 161767 out.go:177] * [old-k8s-version-003661] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
I0617 11:51:58.826595 161767 notify.go:220] Checking for updates...
I0617 11:51:58.826610 161767 out.go:177] - MINIKUBE_LOCATION=19084
I0617 11:51:58.828024 161767 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0617 11:51:58.829480 161767 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19084-112967/kubeconfig
I0617 11:51:58.831014 161767 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19084-112967/.minikube
I0617 11:51:58.832371 161767 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0617 11:51:58.833548 161767 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0617 11:51:58.835181 161767 config.go:182] Loaded profile config "cert-expiration-514753": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.1
I0617 11:51:58.835327 161767 config.go:182] Loaded profile config "kubernetes-upgrade-717156": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0617 11:51:58.835428 161767 config.go:182] Loaded profile config "stopped-upgrade-066761": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.24.1
I0617 11:51:58.835563 161767 driver.go:392] Setting default libvirt URI to qemu:///system
I0617 11:51:58.871063 161767 out.go:177] * Using the kvm2 driver based on user configuration
I0617 11:51:58.872429 161767 start.go:297] selected driver: kvm2
I0617 11:51:58.872444 161767 start.go:901] validating driver "kvm2" against <nil>
I0617 11:51:58.872455 161767 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0617 11:51:58.873213 161767 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0617 11:51:58.873279 161767 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19084-112967/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0617 11:51:58.888435 161767 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.1
I0617 11:51:58.888488 161767 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0617 11:51:58.888717 161767 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0617 11:51:58.888809 161767 cni.go:84] Creating CNI manager for ""
I0617 11:51:58.888827 161767 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0617 11:51:58.888839 161767 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0617 11:51:58.888904 161767 start.go:340] cluster config:
{Name:old-k8s-version-003661 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1718296336-19068@sha256:b31b1f456eebc10b590403d2cc052bb20a70156f4629e3514cbb38ecd550e2c8 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-003661 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0617 11:51:58.889017 161767 iso.go:125] acquiring lock: {Name:mk4a199ad46ed9ee04de7b54caf7cc64218fe80c Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0617 11:51:58.890877 161767 out.go:177] * Starting "old-k8s-version-003661" primary control-plane node in "old-k8s-version-003661" cluster
I0617 11:51:58.892022 161767 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0617 11:51:58.892068 161767 preload.go:147] Found local preload: /home/jenkins/minikube-integration/19084-112967/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0617 11:51:58.892082 161767 cache.go:56] Caching tarball of preloaded images
I0617 11:51:58.892157 161767 preload.go:173] Found /home/jenkins/minikube-integration/19084-112967/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0617 11:51:58.892169 161767 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0617 11:51:58.892264 161767 profile.go:143] Saving config to /home/jenkins/minikube-integration/19084-112967/.minikube/profiles/old-k8s-version-003661/config.json ...
I0617 11:51:58.892287 161767 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19084-112967/.minikube/profiles/old-k8s-version-003661/config.json: {Name:mkbc177614f5f50bc471d57520b3134dfdc8af9b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0617 11:51:58.892439 161767 start.go:360] acquireMachinesLock for old-k8s-version-003661: {Name:mk519b8956d160a9d2b042f25b899a5ee0efa72e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0617 11:52:11.812605 161767 start.go:364] duration metric: took 12.92013885s to acquireMachinesLock for "old-k8s-version-003661"
I0617 11:52:11.812678 161767 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-003661 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19044/minikube-v1.33.1-1718047936-19044-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1718296336-19068@sha256:b31b1f456eebc10b590403d2cc052bb20a70156f4629e3514cbb38ecd550e2c8 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-003661 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0617 11:52:11.812803 161767 start.go:125] createHost starting for "" (driver="kvm2")
I0617 11:52:11.847982 161767 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0617 11:52:11.848210 161767 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0617 11:52:11.848276 161767 main.go:141] libmachine: Launching plugin server for driver kvm2
I0617 11:52:11.863986 161767 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41189
I0617 11:52:11.864441 161767 main.go:141] libmachine: () Calling .GetVersion
I0617 11:52:11.864997 161767 main.go:141] libmachine: Using API Version 1
I0617 11:52:11.865023 161767 main.go:141] libmachine: () Calling .SetConfigRaw
I0617 11:52:11.865349 161767 main.go:141] libmachine: () Calling .GetMachineName
I0617 11:52:11.865545 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetMachineName
I0617 11:52:11.865735 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .DriverName
I0617 11:52:11.865904 161767 start.go:159] libmachine.API.Create for "old-k8s-version-003661" (driver="kvm2")
I0617 11:52:11.865938 161767 client.go:168] LocalClient.Create starting
I0617 11:52:11.865971 161767 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19084-112967/.minikube/certs/ca.pem
I0617 11:52:11.866002 161767 main.go:141] libmachine: Decoding PEM data...
I0617 11:52:11.866029 161767 main.go:141] libmachine: Parsing certificate...
I0617 11:52:11.866084 161767 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19084-112967/.minikube/certs/cert.pem
I0617 11:52:11.866106 161767 main.go:141] libmachine: Decoding PEM data...
I0617 11:52:11.866117 161767 main.go:141] libmachine: Parsing certificate...
I0617 11:52:11.866130 161767 main.go:141] libmachine: Running pre-create checks...
I0617 11:52:11.866140 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .PreCreateCheck
I0617 11:52:11.866470 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetConfigRaw
I0617 11:52:11.866848 161767 main.go:141] libmachine: Creating machine...
I0617 11:52:11.866862 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .Create
I0617 11:52:11.867081 161767 main.go:141] libmachine: (old-k8s-version-003661) Creating KVM machine...
I0617 11:52:11.868516 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | found existing default KVM network
I0617 11:52:11.870069 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | I0617 11:52:11.869860 161879 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr2 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:b1:ae:a2} reservation:<nil>}
I0617 11:52:11.871035 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | I0617 11:52:11.870929 161879 network.go:211] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:f6:36:2e} reservation:<nil>}
I0617 11:52:11.872387 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | I0617 11:52:11.872295 161879 network.go:206] using free private subnet 192.168.61.0/24: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0003ae170}
I0617 11:52:11.872415 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | created network xml:
I0617 11:52:11.872426 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | <network>
I0617 11:52:11.872435 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | <name>mk-old-k8s-version-003661</name>
I0617 11:52:11.872450 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | <dns enable='no'/>
I0617 11:52:11.872463 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG |
I0617 11:52:11.872478 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | <ip address='192.168.61.1' netmask='255.255.255.0'>
I0617 11:52:11.872489 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | <dhcp>
I0617 11:52:11.872507 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | <range start='192.168.61.2' end='192.168.61.253'/>
I0617 11:52:11.872520 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | </dhcp>
I0617 11:52:11.872529 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | </ip>
I0617 11:52:11.872536 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG |
I0617 11:52:11.872544 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | </network>
I0617 11:52:11.872556 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG |
I0617 11:52:12.055840 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | trying to create private KVM network mk-old-k8s-version-003661 192.168.61.0/24...
I0617 11:52:12.126822 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | private KVM network mk-old-k8s-version-003661 192.168.61.0/24 created
I0617 11:52:12.126865 161767 main.go:141] libmachine: (old-k8s-version-003661) Setting up store path in /home/jenkins/minikube-integration/19084-112967/.minikube/machines/old-k8s-version-003661 ...
I0617 11:52:12.126879 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | I0617 11:52:12.126785 161879 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19084-112967/.minikube
I0617 11:52:12.126896 161767 main.go:141] libmachine: (old-k8s-version-003661) Building disk image from file:///home/jenkins/minikube-integration/19084-112967/.minikube/cache/iso/amd64/minikube-v1.33.1-1718047936-19044-amd64.iso
I0617 11:52:12.127068 161767 main.go:141] libmachine: (old-k8s-version-003661) Downloading /home/jenkins/minikube-integration/19084-112967/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19084-112967/.minikube/cache/iso/amd64/minikube-v1.33.1-1718047936-19044-amd64.iso...
I0617 11:52:12.367582 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | I0617 11:52:12.367389 161879 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19084-112967/.minikube/machines/old-k8s-version-003661/id_rsa...
I0617 11:52:12.468249 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | I0617 11:52:12.468112 161879 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19084-112967/.minikube/machines/old-k8s-version-003661/old-k8s-version-003661.rawdisk...
I0617 11:52:12.468301 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | Writing magic tar header
I0617 11:52:12.468319 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | Writing SSH key tar header
I0617 11:52:12.468334 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | I0617 11:52:12.468246 161879 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19084-112967/.minikube/machines/old-k8s-version-003661 ...
I0617 11:52:12.468356 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19084-112967/.minikube/machines/old-k8s-version-003661
I0617 11:52:12.468431 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19084-112967/.minikube/machines
I0617 11:52:12.468453 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19084-112967/.minikube
I0617 11:52:12.468471 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19084-112967
I0617 11:52:12.468492 161767 main.go:141] libmachine: (old-k8s-version-003661) Setting executable bit set on /home/jenkins/minikube-integration/19084-112967/.minikube/machines/old-k8s-version-003661 (perms=drwx------)
I0617 11:52:12.468505 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0617 11:52:12.468516 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | Checking permissions on dir: /home/jenkins
I0617 11:52:12.468524 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | Checking permissions on dir: /home
I0617 11:52:12.468534 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | Skipping /home - not owner
I0617 11:52:12.468550 161767 main.go:141] libmachine: (old-k8s-version-003661) Setting executable bit set on /home/jenkins/minikube-integration/19084-112967/.minikube/machines (perms=drwxr-xr-x)
I0617 11:52:12.468564 161767 main.go:141] libmachine: (old-k8s-version-003661) Setting executable bit set on /home/jenkins/minikube-integration/19084-112967/.minikube (perms=drwxr-xr-x)
I0617 11:52:12.468576 161767 main.go:141] libmachine: (old-k8s-version-003661) Setting executable bit set on /home/jenkins/minikube-integration/19084-112967 (perms=drwxrwxr-x)
I0617 11:52:12.468586 161767 main.go:141] libmachine: (old-k8s-version-003661) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0617 11:52:12.468597 161767 main.go:141] libmachine: (old-k8s-version-003661) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0617 11:52:12.468604 161767 main.go:141] libmachine: (old-k8s-version-003661) Creating domain...
I0617 11:52:12.469701 161767 main.go:141] libmachine: (old-k8s-version-003661) define libvirt domain using xml:
I0617 11:52:12.469726 161767 main.go:141] libmachine: (old-k8s-version-003661) <domain type='kvm'>
I0617 11:52:12.469748 161767 main.go:141] libmachine: (old-k8s-version-003661) <name>old-k8s-version-003661</name>
I0617 11:52:12.469767 161767 main.go:141] libmachine: (old-k8s-version-003661) <memory unit='MiB'>2200</memory>
I0617 11:52:12.469780 161767 main.go:141] libmachine: (old-k8s-version-003661) <vcpu>2</vcpu>
I0617 11:52:12.469787 161767 main.go:141] libmachine: (old-k8s-version-003661) <features>
I0617 11:52:12.469795 161767 main.go:141] libmachine: (old-k8s-version-003661) <acpi/>
I0617 11:52:12.469809 161767 main.go:141] libmachine: (old-k8s-version-003661) <apic/>
I0617 11:52:12.469820 161767 main.go:141] libmachine: (old-k8s-version-003661) <pae/>
I0617 11:52:12.469827 161767 main.go:141] libmachine: (old-k8s-version-003661)
I0617 11:52:12.469839 161767 main.go:141] libmachine: (old-k8s-version-003661) </features>
I0617 11:52:12.469847 161767 main.go:141] libmachine: (old-k8s-version-003661) <cpu mode='host-passthrough'>
I0617 11:52:12.469855 161767 main.go:141] libmachine: (old-k8s-version-003661)
I0617 11:52:12.469869 161767 main.go:141] libmachine: (old-k8s-version-003661) </cpu>
I0617 11:52:12.469877 161767 main.go:141] libmachine: (old-k8s-version-003661) <os>
I0617 11:52:12.469888 161767 main.go:141] libmachine: (old-k8s-version-003661) <type>hvm</type>
I0617 11:52:12.469899 161767 main.go:141] libmachine: (old-k8s-version-003661) <boot dev='cdrom'/>
I0617 11:52:12.469909 161767 main.go:141] libmachine: (old-k8s-version-003661) <boot dev='hd'/>
I0617 11:52:12.469920 161767 main.go:141] libmachine: (old-k8s-version-003661) <bootmenu enable='no'/>
I0617 11:52:12.469931 161767 main.go:141] libmachine: (old-k8s-version-003661) </os>
I0617 11:52:12.469938 161767 main.go:141] libmachine: (old-k8s-version-003661) <devices>
I0617 11:52:12.469956 161767 main.go:141] libmachine: (old-k8s-version-003661) <disk type='file' device='cdrom'>
I0617 11:52:12.469975 161767 main.go:141] libmachine: (old-k8s-version-003661) <source file='/home/jenkins/minikube-integration/19084-112967/.minikube/machines/old-k8s-version-003661/boot2docker.iso'/>
I0617 11:52:12.469993 161767 main.go:141] libmachine: (old-k8s-version-003661) <target dev='hdc' bus='scsi'/>
I0617 11:52:12.470004 161767 main.go:141] libmachine: (old-k8s-version-003661) <readonly/>
I0617 11:52:12.470011 161767 main.go:141] libmachine: (old-k8s-version-003661) </disk>
I0617 11:52:12.470024 161767 main.go:141] libmachine: (old-k8s-version-003661) <disk type='file' device='disk'>
I0617 11:52:12.470038 161767 main.go:141] libmachine: (old-k8s-version-003661) <driver name='qemu' type='raw' cache='default' io='threads' />
I0617 11:52:12.470057 161767 main.go:141] libmachine: (old-k8s-version-003661) <source file='/home/jenkins/minikube-integration/19084-112967/.minikube/machines/old-k8s-version-003661/old-k8s-version-003661.rawdisk'/>
I0617 11:52:12.470069 161767 main.go:141] libmachine: (old-k8s-version-003661) <target dev='hda' bus='virtio'/>
I0617 11:52:12.470083 161767 main.go:141] libmachine: (old-k8s-version-003661) </disk>
I0617 11:52:12.470093 161767 main.go:141] libmachine: (old-k8s-version-003661) <interface type='network'>
I0617 11:52:12.470112 161767 main.go:141] libmachine: (old-k8s-version-003661) <source network='mk-old-k8s-version-003661'/>
I0617 11:52:12.470128 161767 main.go:141] libmachine: (old-k8s-version-003661) <model type='virtio'/>
I0617 11:52:12.470140 161767 main.go:141] libmachine: (old-k8s-version-003661) </interface>
I0617 11:52:12.470151 161767 main.go:141] libmachine: (old-k8s-version-003661) <interface type='network'>
I0617 11:52:12.470163 161767 main.go:141] libmachine: (old-k8s-version-003661) <source network='default'/>
I0617 11:52:12.470173 161767 main.go:141] libmachine: (old-k8s-version-003661) <model type='virtio'/>
I0617 11:52:12.470183 161767 main.go:141] libmachine: (old-k8s-version-003661) </interface>
I0617 11:52:12.470193 161767 main.go:141] libmachine: (old-k8s-version-003661) <serial type='pty'>
I0617 11:52:12.470205 161767 main.go:141] libmachine: (old-k8s-version-003661) <target port='0'/>
I0617 11:52:12.470217 161767 main.go:141] libmachine: (old-k8s-version-003661) </serial>
I0617 11:52:12.470255 161767 main.go:141] libmachine: (old-k8s-version-003661) <console type='pty'>
I0617 11:52:12.470276 161767 main.go:141] libmachine: (old-k8s-version-003661) <target type='serial' port='0'/>
I0617 11:52:12.470290 161767 main.go:141] libmachine: (old-k8s-version-003661) </console>
I0617 11:52:12.470301 161767 main.go:141] libmachine: (old-k8s-version-003661) <rng model='virtio'>
I0617 11:52:12.470316 161767 main.go:141] libmachine: (old-k8s-version-003661) <backend model='random'>/dev/random</backend>
I0617 11:52:12.470328 161767 main.go:141] libmachine: (old-k8s-version-003661) </rng>
I0617 11:52:12.470340 161767 main.go:141] libmachine: (old-k8s-version-003661)
I0617 11:52:12.470349 161767 main.go:141] libmachine: (old-k8s-version-003661)
I0617 11:52:12.470359 161767 main.go:141] libmachine: (old-k8s-version-003661) </devices>
I0617 11:52:12.470369 161767 main.go:141] libmachine: (old-k8s-version-003661) </domain>
I0617 11:52:12.470385 161767 main.go:141] libmachine: (old-k8s-version-003661)
I0617 11:52:12.473933 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | domain old-k8s-version-003661 has defined MAC address 52:54:00:8b:15:01 in network default
I0617 11:52:12.474688 161767 main.go:141] libmachine: (old-k8s-version-003661) Ensuring networks are active...
I0617 11:52:12.474715 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | domain old-k8s-version-003661 has defined MAC address 52:54:00:76:66:a0 in network mk-old-k8s-version-003661
I0617 11:52:12.475526 161767 main.go:141] libmachine: (old-k8s-version-003661) Ensuring network default is active
I0617 11:52:12.475964 161767 main.go:141] libmachine: (old-k8s-version-003661) Ensuring network mk-old-k8s-version-003661 is active
I0617 11:52:12.476704 161767 main.go:141] libmachine: (old-k8s-version-003661) Getting domain xml...
I0617 11:52:12.477700 161767 main.go:141] libmachine: (old-k8s-version-003661) Creating domain...
I0617 11:52:13.844414 161767 main.go:141] libmachine: (old-k8s-version-003661) Waiting to get IP...
I0617 11:52:13.845618 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | domain old-k8s-version-003661 has defined MAC address 52:54:00:76:66:a0 in network mk-old-k8s-version-003661
I0617 11:52:13.846243 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | unable to find current IP address of domain old-k8s-version-003661 in network mk-old-k8s-version-003661
I0617 11:52:13.846274 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | I0617 11:52:13.846224 161879 retry.go:31] will retry after 241.039494ms: waiting for machine to come up
I0617 11:52:14.088992 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | domain old-k8s-version-003661 has defined MAC address 52:54:00:76:66:a0 in network mk-old-k8s-version-003661
I0617 11:52:14.089656 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | unable to find current IP address of domain old-k8s-version-003661 in network mk-old-k8s-version-003661
I0617 11:52:14.089692 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | I0617 11:52:14.089606 161879 retry.go:31] will retry after 366.685912ms: waiting for machine to come up
I0617 11:52:14.458266 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | domain old-k8s-version-003661 has defined MAC address 52:54:00:76:66:a0 in network mk-old-k8s-version-003661
I0617 11:52:14.458834 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | unable to find current IP address of domain old-k8s-version-003661 in network mk-old-k8s-version-003661
I0617 11:52:14.458863 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | I0617 11:52:14.458795 161879 retry.go:31] will retry after 439.362838ms: waiting for machine to come up
I0617 11:52:14.899542 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | domain old-k8s-version-003661 has defined MAC address 52:54:00:76:66:a0 in network mk-old-k8s-version-003661
I0617 11:52:14.900117 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | unable to find current IP address of domain old-k8s-version-003661 in network mk-old-k8s-version-003661
I0617 11:52:14.900150 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | I0617 11:52:14.900068 161879 retry.go:31] will retry after 575.411118ms: waiting for machine to come up
I0617 11:52:15.476697 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | domain old-k8s-version-003661 has defined MAC address 52:54:00:76:66:a0 in network mk-old-k8s-version-003661
I0617 11:52:15.477416 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | unable to find current IP address of domain old-k8s-version-003661 in network mk-old-k8s-version-003661
I0617 11:52:15.477450 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | I0617 11:52:15.477346 161879 retry.go:31] will retry after 475.150413ms: waiting for machine to come up
I0617 11:52:15.954141 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | domain old-k8s-version-003661 has defined MAC address 52:54:00:76:66:a0 in network mk-old-k8s-version-003661
I0617 11:52:15.954701 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | unable to find current IP address of domain old-k8s-version-003661 in network mk-old-k8s-version-003661
I0617 11:52:15.954725 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | I0617 11:52:15.954655 161879 retry.go:31] will retry after 855.594386ms: waiting for machine to come up
I0617 11:52:16.811550 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | domain old-k8s-version-003661 has defined MAC address 52:54:00:76:66:a0 in network mk-old-k8s-version-003661
I0617 11:52:16.812009 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | unable to find current IP address of domain old-k8s-version-003661 in network mk-old-k8s-version-003661
I0617 11:52:16.812039 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | I0617 11:52:16.811958 161879 retry.go:31] will retry after 1.176264217s: waiting for machine to come up
I0617 11:52:17.989789 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | domain old-k8s-version-003661 has defined MAC address 52:54:00:76:66:a0 in network mk-old-k8s-version-003661
I0617 11:52:17.990328 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | unable to find current IP address of domain old-k8s-version-003661 in network mk-old-k8s-version-003661
I0617 11:52:17.990375 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | I0617 11:52:17.990275 161879 retry.go:31] will retry after 1.022700668s: waiting for machine to come up
I0617 11:52:19.014434 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | domain old-k8s-version-003661 has defined MAC address 52:54:00:76:66:a0 in network mk-old-k8s-version-003661
I0617 11:52:19.014981 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | unable to find current IP address of domain old-k8s-version-003661 in network mk-old-k8s-version-003661
I0617 11:52:19.015030 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | I0617 11:52:19.014926 161879 retry.go:31] will retry after 1.343236868s: waiting for machine to come up
I0617 11:52:20.359540 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | domain old-k8s-version-003661 has defined MAC address 52:54:00:76:66:a0 in network mk-old-k8s-version-003661
I0617 11:52:20.360056 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | unable to find current IP address of domain old-k8s-version-003661 in network mk-old-k8s-version-003661
I0617 11:52:20.360094 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | I0617 11:52:20.360004 161879 retry.go:31] will retry after 2.237514841s: waiting for machine to come up
I0617 11:52:22.599013 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | domain old-k8s-version-003661 has defined MAC address 52:54:00:76:66:a0 in network mk-old-k8s-version-003661
I0617 11:52:22.599583 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | unable to find current IP address of domain old-k8s-version-003661 in network mk-old-k8s-version-003661
I0617 11:52:22.599612 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | I0617 11:52:22.599532 161879 retry.go:31] will retry after 1.83856174s: waiting for machine to come up
I0617 11:52:24.439852 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | domain old-k8s-version-003661 has defined MAC address 52:54:00:76:66:a0 in network mk-old-k8s-version-003661
I0617 11:52:24.440447 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | unable to find current IP address of domain old-k8s-version-003661 in network mk-old-k8s-version-003661
I0617 11:52:24.440480 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | I0617 11:52:24.440380 161879 retry.go:31] will retry after 3.449543528s: waiting for machine to come up
I0617 11:52:27.892105 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | domain old-k8s-version-003661 has defined MAC address 52:54:00:76:66:a0 in network mk-old-k8s-version-003661
I0617 11:52:27.892709 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | unable to find current IP address of domain old-k8s-version-003661 in network mk-old-k8s-version-003661
I0617 11:52:27.892744 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | I0617 11:52:27.892640 161879 retry.go:31] will retry after 2.851626611s: waiting for machine to come up
I0617 11:52:30.745399 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | domain old-k8s-version-003661 has defined MAC address 52:54:00:76:66:a0 in network mk-old-k8s-version-003661
I0617 11:52:30.745992 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | unable to find current IP address of domain old-k8s-version-003661 in network mk-old-k8s-version-003661
I0617 11:52:30.746021 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | I0617 11:52:30.745945 161879 retry.go:31] will retry after 3.623407337s: waiting for machine to come up
I0617 11:52:34.372239 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | domain old-k8s-version-003661 has defined MAC address 52:54:00:76:66:a0 in network mk-old-k8s-version-003661
I0617 11:52:34.372823 161767 main.go:141] libmachine: (old-k8s-version-003661) Found IP for machine: 192.168.61.164
I0617 11:52:34.372842 161767 main.go:141] libmachine: (old-k8s-version-003661) Reserving static IP address...
I0617 11:52:34.372857 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | domain old-k8s-version-003661 has current primary IP address 192.168.61.164 and MAC address 52:54:00:76:66:a0 in network mk-old-k8s-version-003661
I0617 11:52:34.373251 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-003661", mac: "52:54:00:76:66:a0", ip: "192.168.61.164"} in network mk-old-k8s-version-003661
I0617 11:52:34.454314 161767 main.go:141] libmachine: (old-k8s-version-003661) Reserved static IP address: 192.168.61.164
I0617 11:52:34.454345 161767 main.go:141] libmachine: (old-k8s-version-003661) Waiting for SSH to be available...
I0617 11:52:34.454355 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | Getting to WaitForSSH function...
I0617 11:52:34.457077 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | domain old-k8s-version-003661 has defined MAC address 52:54:00:76:66:a0 in network mk-old-k8s-version-003661
I0617 11:52:34.457562 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:76:66:a0", ip: ""} in network mk-old-k8s-version-003661: {Iface:virbr3 ExpiryTime:2024-06-17 12:52:26 +0000 UTC Type:0 Mac:52:54:00:76:66:a0 Iaid: IPaddr:192.168.61.164 Prefix:24 Hostname:minikube Clientid:01:52:54:00:76:66:a0}
I0617 11:52:34.457603 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | domain old-k8s-version-003661 has defined IP address 192.168.61.164 and MAC address 52:54:00:76:66:a0 in network mk-old-k8s-version-003661
I0617 11:52:34.457772 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | Using SSH client type: external
I0617 11:52:34.457803 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | Using SSH private key: /home/jenkins/minikube-integration/19084-112967/.minikube/machines/old-k8s-version-003661/id_rsa (-rw-------)
I0617 11:52:34.457842 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.61.164 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19084-112967/.minikube/machines/old-k8s-version-003661/id_rsa -p 22] /usr/bin/ssh <nil>}
I0617 11:52:34.457854 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | About to run SSH command:
I0617 11:52:34.457875 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | exit 0
I0617 11:52:34.587594 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | SSH cmd err, output: <nil>:
I0617 11:52:34.587849 161767 main.go:141] libmachine: (old-k8s-version-003661) KVM machine creation complete!
I0617 11:52:34.588228 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetConfigRaw
I0617 11:52:34.588787 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .DriverName
I0617 11:52:34.589008 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .DriverName
I0617 11:52:34.589163 161767 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0617 11:52:34.589180 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetState
I0617 11:52:34.590398 161767 main.go:141] libmachine: Detecting operating system of created instance...
I0617 11:52:34.590416 161767 main.go:141] libmachine: Waiting for SSH to be available...
I0617 11:52:34.590424 161767 main.go:141] libmachine: Getting to WaitForSSH function...
I0617 11:52:34.590432 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetSSHHostname
I0617 11:52:34.592533 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | domain old-k8s-version-003661 has defined MAC address 52:54:00:76:66:a0 in network mk-old-k8s-version-003661
I0617 11:52:34.592891 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:76:66:a0", ip: ""} in network mk-old-k8s-version-003661: {Iface:virbr3 ExpiryTime:2024-06-17 12:52:26 +0000 UTC Type:0 Mac:52:54:00:76:66:a0 Iaid: IPaddr:192.168.61.164 Prefix:24 Hostname:old-k8s-version-003661 Clientid:01:52:54:00:76:66:a0}
I0617 11:52:34.592924 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | domain old-k8s-version-003661 has defined IP address 192.168.61.164 and MAC address 52:54:00:76:66:a0 in network mk-old-k8s-version-003661
I0617 11:52:34.593103 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetSSHPort
I0617 11:52:34.593293 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetSSHKeyPath
I0617 11:52:34.593452 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetSSHKeyPath
I0617 11:52:34.593613 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetSSHUsername
I0617 11:52:34.593770 161767 main.go:141] libmachine: Using SSH client type: native
I0617 11:52:34.594014 161767 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d880] 0x8305e0 <nil> [] 0s} 192.168.61.164 22 <nil> <nil>}
I0617 11:52:34.594028 161767 main.go:141] libmachine: About to run SSH command:
exit 0
I0617 11:52:34.706856 161767 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0617 11:52:34.706880 161767 main.go:141] libmachine: Detecting the provisioner...
I0617 11:52:34.706890 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetSSHHostname
I0617 11:52:34.709520 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | domain old-k8s-version-003661 has defined MAC address 52:54:00:76:66:a0 in network mk-old-k8s-version-003661
I0617 11:52:34.709854 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:76:66:a0", ip: ""} in network mk-old-k8s-version-003661: {Iface:virbr3 ExpiryTime:2024-06-17 12:52:26 +0000 UTC Type:0 Mac:52:54:00:76:66:a0 Iaid: IPaddr:192.168.61.164 Prefix:24 Hostname:old-k8s-version-003661 Clientid:01:52:54:00:76:66:a0}
I0617 11:52:34.709886 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | domain old-k8s-version-003661 has defined IP address 192.168.61.164 and MAC address 52:54:00:76:66:a0 in network mk-old-k8s-version-003661
I0617 11:52:34.710127 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetSSHPort
I0617 11:52:34.710323 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetSSHKeyPath
I0617 11:52:34.710494 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetSSHKeyPath
I0617 11:52:34.710600 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetSSHUsername
I0617 11:52:34.710771 161767 main.go:141] libmachine: Using SSH client type: native
I0617 11:52:34.710998 161767 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d880] 0x8305e0 <nil> [] 0s} 192.168.61.164 22 <nil> <nil>}
I0617 11:52:34.711017 161767 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0617 11:52:34.824462 161767 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0617 11:52:34.824531 161767 main.go:141] libmachine: found compatible host: buildroot
I0617 11:52:34.824542 161767 main.go:141] libmachine: Provisioning with buildroot...
I0617 11:52:34.824550 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetMachineName
I0617 11:52:34.824787 161767 buildroot.go:166] provisioning hostname "old-k8s-version-003661"
I0617 11:52:34.824815 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetMachineName
I0617 11:52:34.825047 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetSSHHostname
I0617 11:52:34.827593 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | domain old-k8s-version-003661 has defined MAC address 52:54:00:76:66:a0 in network mk-old-k8s-version-003661
I0617 11:52:34.827986 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:76:66:a0", ip: ""} in network mk-old-k8s-version-003661: {Iface:virbr3 ExpiryTime:2024-06-17 12:52:26 +0000 UTC Type:0 Mac:52:54:00:76:66:a0 Iaid: IPaddr:192.168.61.164 Prefix:24 Hostname:old-k8s-version-003661 Clientid:01:52:54:00:76:66:a0}
I0617 11:52:34.828012 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | domain old-k8s-version-003661 has defined IP address 192.168.61.164 and MAC address 52:54:00:76:66:a0 in network mk-old-k8s-version-003661
I0617 11:52:34.828177 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetSSHPort
I0617 11:52:34.828346 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetSSHKeyPath
I0617 11:52:34.828476 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetSSHKeyPath
I0617 11:52:34.828582 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetSSHUsername
I0617 11:52:34.828775 161767 main.go:141] libmachine: Using SSH client type: native
I0617 11:52:34.828946 161767 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d880] 0x8305e0 <nil> [] 0s} 192.168.61.164 22 <nil> <nil>}
I0617 11:52:34.828958 161767 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-003661 && echo "old-k8s-version-003661" | sudo tee /etc/hostname
I0617 11:52:34.953485 161767 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-003661
I0617 11:52:34.953519 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetSSHHostname
I0617 11:52:34.956423 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | domain old-k8s-version-003661 has defined MAC address 52:54:00:76:66:a0 in network mk-old-k8s-version-003661
I0617 11:52:34.957019 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:76:66:a0", ip: ""} in network mk-old-k8s-version-003661: {Iface:virbr3 ExpiryTime:2024-06-17 12:52:26 +0000 UTC Type:0 Mac:52:54:00:76:66:a0 Iaid: IPaddr:192.168.61.164 Prefix:24 Hostname:old-k8s-version-003661 Clientid:01:52:54:00:76:66:a0}
I0617 11:52:34.957043 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | domain old-k8s-version-003661 has defined IP address 192.168.61.164 and MAC address 52:54:00:76:66:a0 in network mk-old-k8s-version-003661
I0617 11:52:34.957303 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetSSHPort
I0617 11:52:34.957505 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetSSHKeyPath
I0617 11:52:34.957696 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetSSHKeyPath
I0617 11:52:34.957851 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetSSHUsername
I0617 11:52:34.958015 161767 main.go:141] libmachine: Using SSH client type: native
I0617 11:52:34.958240 161767 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d880] 0x8305e0 <nil> [] 0s} 192.168.61.164 22 <nil> <nil>}
I0617 11:52:34.958272 161767 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-003661' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-003661/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-003661' | sudo tee -a /etc/hosts;
fi
fi
I0617 11:52:35.076250 161767 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0617 11:52:35.076286 161767 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19084-112967/.minikube CaCertPath:/home/jenkins/minikube-integration/19084-112967/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19084-112967/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19084-112967/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19084-112967/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19084-112967/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19084-112967/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19084-112967/.minikube}
I0617 11:52:35.076325 161767 buildroot.go:174] setting up certificates
I0617 11:52:35.076335 161767 provision.go:84] configureAuth start
I0617 11:52:35.076348 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetMachineName
I0617 11:52:35.076598 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetIP
I0617 11:52:35.078996 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | domain old-k8s-version-003661 has defined MAC address 52:54:00:76:66:a0 in network mk-old-k8s-version-003661
I0617 11:52:35.079386 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:76:66:a0", ip: ""} in network mk-old-k8s-version-003661: {Iface:virbr3 ExpiryTime:2024-06-17 12:52:26 +0000 UTC Type:0 Mac:52:54:00:76:66:a0 Iaid: IPaddr:192.168.61.164 Prefix:24 Hostname:old-k8s-version-003661 Clientid:01:52:54:00:76:66:a0}
I0617 11:52:35.079416 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | domain old-k8s-version-003661 has defined IP address 192.168.61.164 and MAC address 52:54:00:76:66:a0 in network mk-old-k8s-version-003661
I0617 11:52:35.079606 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetSSHHostname
I0617 11:52:35.081661 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | domain old-k8s-version-003661 has defined MAC address 52:54:00:76:66:a0 in network mk-old-k8s-version-003661
I0617 11:52:35.081967 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:76:66:a0", ip: ""} in network mk-old-k8s-version-003661: {Iface:virbr3 ExpiryTime:2024-06-17 12:52:26 +0000 UTC Type:0 Mac:52:54:00:76:66:a0 Iaid: IPaddr:192.168.61.164 Prefix:24 Hostname:old-k8s-version-003661 Clientid:01:52:54:00:76:66:a0}
I0617 11:52:35.081988 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | domain old-k8s-version-003661 has defined IP address 192.168.61.164 and MAC address 52:54:00:76:66:a0 in network mk-old-k8s-version-003661
I0617 11:52:35.082118 161767 provision.go:143] copyHostCerts
I0617 11:52:35.082183 161767 exec_runner.go:144] found /home/jenkins/minikube-integration/19084-112967/.minikube/ca.pem, removing ...
I0617 11:52:35.082193 161767 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19084-112967/.minikube/ca.pem
I0617 11:52:35.082257 161767 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19084-112967/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19084-112967/.minikube/ca.pem (1082 bytes)
I0617 11:52:35.082351 161767 exec_runner.go:144] found /home/jenkins/minikube-integration/19084-112967/.minikube/cert.pem, removing ...
I0617 11:52:35.082359 161767 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19084-112967/.minikube/cert.pem
I0617 11:52:35.082383 161767 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19084-112967/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19084-112967/.minikube/cert.pem (1123 bytes)
I0617 11:52:35.082436 161767 exec_runner.go:144] found /home/jenkins/minikube-integration/19084-112967/.minikube/key.pem, removing ...
I0617 11:52:35.082443 161767 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19084-112967/.minikube/key.pem
I0617 11:52:35.082468 161767 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19084-112967/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19084-112967/.minikube/key.pem (1679 bytes)
I0617 11:52:35.082511 161767 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19084-112967/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19084-112967/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19084-112967/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-003661 san=[127.0.0.1 192.168.61.164 localhost minikube old-k8s-version-003661]
I0617 11:52:35.173289 161767 provision.go:177] copyRemoteCerts
I0617 11:52:35.173344 161767 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0617 11:52:35.173369 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetSSHHostname
I0617 11:52:35.175988 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | domain old-k8s-version-003661 has defined MAC address 52:54:00:76:66:a0 in network mk-old-k8s-version-003661
I0617 11:52:35.176321 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:76:66:a0", ip: ""} in network mk-old-k8s-version-003661: {Iface:virbr3 ExpiryTime:2024-06-17 12:52:26 +0000 UTC Type:0 Mac:52:54:00:76:66:a0 Iaid: IPaddr:192.168.61.164 Prefix:24 Hostname:old-k8s-version-003661 Clientid:01:52:54:00:76:66:a0}
I0617 11:52:35.176354 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | domain old-k8s-version-003661 has defined IP address 192.168.61.164 and MAC address 52:54:00:76:66:a0 in network mk-old-k8s-version-003661
I0617 11:52:35.176537 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetSSHPort
I0617 11:52:35.176731 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetSSHKeyPath
I0617 11:52:35.176877 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetSSHUsername
I0617 11:52:35.176980 161767 sshutil.go:53] new ssh client: &{IP:192.168.61.164 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19084-112967/.minikube/machines/old-k8s-version-003661/id_rsa Username:docker}
I0617 11:52:35.262154 161767 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19084-112967/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0617 11:52:35.286235 161767 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19084-112967/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0617 11:52:35.310158 161767 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19084-112967/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0617 11:52:35.333576 161767 provision.go:87] duration metric: took 257.229592ms to configureAuth
I0617 11:52:35.333598 161767 buildroot.go:189] setting minikube options for container-runtime
I0617 11:52:35.333751 161767 config.go:182] Loaded profile config "old-k8s-version-003661": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0617 11:52:35.333817 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetSSHHostname
I0617 11:52:35.336474 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | domain old-k8s-version-003661 has defined MAC address 52:54:00:76:66:a0 in network mk-old-k8s-version-003661
I0617 11:52:35.336847 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:76:66:a0", ip: ""} in network mk-old-k8s-version-003661: {Iface:virbr3 ExpiryTime:2024-06-17 12:52:26 +0000 UTC Type:0 Mac:52:54:00:76:66:a0 Iaid: IPaddr:192.168.61.164 Prefix:24 Hostname:old-k8s-version-003661 Clientid:01:52:54:00:76:66:a0}
I0617 11:52:35.336876 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | domain old-k8s-version-003661 has defined IP address 192.168.61.164 and MAC address 52:54:00:76:66:a0 in network mk-old-k8s-version-003661
I0617 11:52:35.337110 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetSSHPort
I0617 11:52:35.337329 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetSSHKeyPath
I0617 11:52:35.337488 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetSSHKeyPath
I0617 11:52:35.337633 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetSSHUsername
I0617 11:52:35.337834 161767 main.go:141] libmachine: Using SSH client type: native
I0617 11:52:35.338010 161767 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d880] 0x8305e0 <nil> [] 0s} 192.168.61.164 22 <nil> <nil>}
I0617 11:52:35.338029 161767 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0617 11:52:35.603249 161767 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0617 11:52:35.603283 161767 main.go:141] libmachine: Checking connection to Docker...
I0617 11:52:35.603293 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetURL
I0617 11:52:35.604511 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | Using libvirt version 6000000
I0617 11:52:35.606541 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | domain old-k8s-version-003661 has defined MAC address 52:54:00:76:66:a0 in network mk-old-k8s-version-003661
I0617 11:52:35.606892 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:76:66:a0", ip: ""} in network mk-old-k8s-version-003661: {Iface:virbr3 ExpiryTime:2024-06-17 12:52:26 +0000 UTC Type:0 Mac:52:54:00:76:66:a0 Iaid: IPaddr:192.168.61.164 Prefix:24 Hostname:old-k8s-version-003661 Clientid:01:52:54:00:76:66:a0}
I0617 11:52:35.606924 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | domain old-k8s-version-003661 has defined IP address 192.168.61.164 and MAC address 52:54:00:76:66:a0 in network mk-old-k8s-version-003661
I0617 11:52:35.607033 161767 main.go:141] libmachine: Docker is up and running!
I0617 11:52:35.607047 161767 main.go:141] libmachine: Reticulating splines...
I0617 11:52:35.607056 161767 client.go:171] duration metric: took 23.741106433s to LocalClient.Create
I0617 11:52:35.607088 161767 start.go:167] duration metric: took 23.741185149s to libmachine.API.Create "old-k8s-version-003661"
I0617 11:52:35.607100 161767 start.go:293] postStartSetup for "old-k8s-version-003661" (driver="kvm2")
I0617 11:52:35.607114 161767 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0617 11:52:35.607137 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .DriverName
I0617 11:52:35.607379 161767 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0617 11:52:35.607402 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetSSHHostname
I0617 11:52:35.609442 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | domain old-k8s-version-003661 has defined MAC address 52:54:00:76:66:a0 in network mk-old-k8s-version-003661
I0617 11:52:35.609794 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:76:66:a0", ip: ""} in network mk-old-k8s-version-003661: {Iface:virbr3 ExpiryTime:2024-06-17 12:52:26 +0000 UTC Type:0 Mac:52:54:00:76:66:a0 Iaid: IPaddr:192.168.61.164 Prefix:24 Hostname:old-k8s-version-003661 Clientid:01:52:54:00:76:66:a0}
I0617 11:52:35.609820 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | domain old-k8s-version-003661 has defined IP address 192.168.61.164 and MAC address 52:54:00:76:66:a0 in network mk-old-k8s-version-003661
I0617 11:52:35.609966 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetSSHPort
I0617 11:52:35.610178 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetSSHKeyPath
I0617 11:52:35.610326 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetSSHUsername
I0617 11:52:35.610478 161767 sshutil.go:53] new ssh client: &{IP:192.168.61.164 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19084-112967/.minikube/machines/old-k8s-version-003661/id_rsa Username:docker}
I0617 11:52:35.698297 161767 ssh_runner.go:195] Run: cat /etc/os-release
I0617 11:52:35.702786 161767 info.go:137] Remote host: Buildroot 2023.02.9
I0617 11:52:35.702813 161767 filesync.go:126] Scanning /home/jenkins/minikube-integration/19084-112967/.minikube/addons for local assets ...
I0617 11:52:35.702875 161767 filesync.go:126] Scanning /home/jenkins/minikube-integration/19084-112967/.minikube/files for local assets ...
I0617 11:52:35.702947 161767 filesync.go:149] local asset: /home/jenkins/minikube-integration/19084-112967/.minikube/files/etc/ssl/certs/1201742.pem -> 1201742.pem in /etc/ssl/certs
I0617 11:52:35.703035 161767 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0617 11:52:35.713188 161767 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19084-112967/.minikube/files/etc/ssl/certs/1201742.pem --> /etc/ssl/certs/1201742.pem (1708 bytes)
I0617 11:52:35.737934 161767 start.go:296] duration metric: took 130.815119ms for postStartSetup
I0617 11:52:35.738008 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetConfigRaw
I0617 11:52:35.738571 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetIP
I0617 11:52:35.741147 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | domain old-k8s-version-003661 has defined MAC address 52:54:00:76:66:a0 in network mk-old-k8s-version-003661
I0617 11:52:35.741525 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:76:66:a0", ip: ""} in network mk-old-k8s-version-003661: {Iface:virbr3 ExpiryTime:2024-06-17 12:52:26 +0000 UTC Type:0 Mac:52:54:00:76:66:a0 Iaid: IPaddr:192.168.61.164 Prefix:24 Hostname:old-k8s-version-003661 Clientid:01:52:54:00:76:66:a0}
I0617 11:52:35.741556 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | domain old-k8s-version-003661 has defined IP address 192.168.61.164 and MAC address 52:54:00:76:66:a0 in network mk-old-k8s-version-003661
I0617 11:52:35.741833 161767 profile.go:143] Saving config to /home/jenkins/minikube-integration/19084-112967/.minikube/profiles/old-k8s-version-003661/config.json ...
I0617 11:52:35.742019 161767 start.go:128] duration metric: took 23.929203476s to createHost
I0617 11:52:35.742059 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetSSHHostname
I0617 11:52:35.744246 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | domain old-k8s-version-003661 has defined MAC address 52:54:00:76:66:a0 in network mk-old-k8s-version-003661
I0617 11:52:35.744593 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:76:66:a0", ip: ""} in network mk-old-k8s-version-003661: {Iface:virbr3 ExpiryTime:2024-06-17 12:52:26 +0000 UTC Type:0 Mac:52:54:00:76:66:a0 Iaid: IPaddr:192.168.61.164 Prefix:24 Hostname:old-k8s-version-003661 Clientid:01:52:54:00:76:66:a0}
I0617 11:52:35.744623 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | domain old-k8s-version-003661 has defined IP address 192.168.61.164 and MAC address 52:54:00:76:66:a0 in network mk-old-k8s-version-003661
I0617 11:52:35.744729 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetSSHPort
I0617 11:52:35.744924 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetSSHKeyPath
I0617 11:52:35.745081 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetSSHKeyPath
I0617 11:52:35.745250 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetSSHUsername
I0617 11:52:35.745416 161767 main.go:141] libmachine: Using SSH client type: native
I0617 11:52:35.745641 161767 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d880] 0x8305e0 <nil> [] 0s} 192.168.61.164 22 <nil> <nil>}
I0617 11:52:35.745661 161767 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0617 11:52:35.860868 161767 main.go:141] libmachine: SSH cmd err, output: <nil>: 1718625155.835034218
I0617 11:52:35.860892 161767 fix.go:216] guest clock: 1718625155.835034218
I0617 11:52:35.860900 161767 fix.go:229] Guest: 2024-06-17 11:52:35.835034218 +0000 UTC Remote: 2024-06-17 11:52:35.742031364 +0000 UTC m=+36.957650609 (delta=93.002854ms)
I0617 11:52:35.860919 161767 fix.go:200] guest clock delta is within tolerance: 93.002854ms
I0617 11:52:35.860924 161767 start.go:83] releasing machines lock for "old-k8s-version-003661", held for 24.048289159s
I0617 11:52:35.860946 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .DriverName
I0617 11:52:35.861276 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetIP
I0617 11:52:35.864579 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | domain old-k8s-version-003661 has defined MAC address 52:54:00:76:66:a0 in network mk-old-k8s-version-003661
I0617 11:52:35.865037 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:76:66:a0", ip: ""} in network mk-old-k8s-version-003661: {Iface:virbr3 ExpiryTime:2024-06-17 12:52:26 +0000 UTC Type:0 Mac:52:54:00:76:66:a0 Iaid: IPaddr:192.168.61.164 Prefix:24 Hostname:old-k8s-version-003661 Clientid:01:52:54:00:76:66:a0}
I0617 11:52:35.865148 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | domain old-k8s-version-003661 has defined IP address 192.168.61.164 and MAC address 52:54:00:76:66:a0 in network mk-old-k8s-version-003661
I0617 11:52:35.865320 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .DriverName
I0617 11:52:35.865965 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .DriverName
I0617 11:52:35.866224 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .DriverName
I0617 11:52:35.866316 161767 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0617 11:52:35.866374 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetSSHHostname
I0617 11:52:35.866441 161767 ssh_runner.go:195] Run: cat /version.json
I0617 11:52:35.866466 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetSSHHostname
I0617 11:52:35.869198 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | domain old-k8s-version-003661 has defined MAC address 52:54:00:76:66:a0 in network mk-old-k8s-version-003661
I0617 11:52:35.869594 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:76:66:a0", ip: ""} in network mk-old-k8s-version-003661: {Iface:virbr3 ExpiryTime:2024-06-17 12:52:26 +0000 UTC Type:0 Mac:52:54:00:76:66:a0 Iaid: IPaddr:192.168.61.164 Prefix:24 Hostname:old-k8s-version-003661 Clientid:01:52:54:00:76:66:a0}
I0617 11:52:35.869624 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | domain old-k8s-version-003661 has defined MAC address 52:54:00:76:66:a0 in network mk-old-k8s-version-003661
I0617 11:52:35.869644 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | domain old-k8s-version-003661 has defined IP address 192.168.61.164 and MAC address 52:54:00:76:66:a0 in network mk-old-k8s-version-003661
I0617 11:52:35.869954 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetSSHPort
I0617 11:52:35.870013 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:76:66:a0", ip: ""} in network mk-old-k8s-version-003661: {Iface:virbr3 ExpiryTime:2024-06-17 12:52:26 +0000 UTC Type:0 Mac:52:54:00:76:66:a0 Iaid: IPaddr:192.168.61.164 Prefix:24 Hostname:old-k8s-version-003661 Clientid:01:52:54:00:76:66:a0}
I0617 11:52:35.870071 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | domain old-k8s-version-003661 has defined IP address 192.168.61.164 and MAC address 52:54:00:76:66:a0 in network mk-old-k8s-version-003661
I0617 11:52:35.870161 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetSSHKeyPath
I0617 11:52:35.870329 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetSSHPort
I0617 11:52:35.870347 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetSSHUsername
I0617 11:52:35.870497 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetSSHKeyPath
I0617 11:52:35.870516 161767 sshutil.go:53] new ssh client: &{IP:192.168.61.164 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19084-112967/.minikube/machines/old-k8s-version-003661/id_rsa Username:docker}
I0617 11:52:35.870647 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetSSHUsername
I0617 11:52:35.870793 161767 sshutil.go:53] new ssh client: &{IP:192.168.61.164 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19084-112967/.minikube/machines/old-k8s-version-003661/id_rsa Username:docker}
I0617 11:52:35.952916 161767 ssh_runner.go:195] Run: systemctl --version
I0617 11:52:35.976966 161767 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0617 11:52:36.154788 161767 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0617 11:52:36.161405 161767 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0617 11:52:36.161470 161767 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0617 11:52:36.178633 161767 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0617 11:52:36.178667 161767 start.go:494] detecting cgroup driver to use...
I0617 11:52:36.178751 161767 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0617 11:52:36.195595 161767 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0617 11:52:36.210671 161767 docker.go:217] disabling cri-docker service (if available) ...
I0617 11:52:36.210753 161767 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0617 11:52:36.226611 161767 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0617 11:52:36.241118 161767 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0617 11:52:36.353261 161767 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0617 11:52:36.527076 161767 docker.go:233] disabling docker service ...
I0617 11:52:36.527144 161767 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0617 11:52:36.541736 161767 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0617 11:52:36.555223 161767 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0617 11:52:36.678636 161767 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0617 11:52:36.799219 161767 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0617 11:52:36.813066 161767 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0617 11:52:36.831703 161767 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0617 11:52:36.831776 161767 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0617 11:52:36.842101 161767 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0617 11:52:36.842151 161767 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0617 11:52:36.852946 161767 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0617 11:52:36.863565 161767 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0617 11:52:36.874721 161767 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0617 11:52:36.885538 161767 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0617 11:52:36.895430 161767 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0617 11:52:36.895517 161767 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0617 11:52:36.911217 161767 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0617 11:52:36.924768 161767 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0617 11:52:37.045332 161767 ssh_runner.go:195] Run: sudo systemctl restart crio
I0617 11:52:37.191643 161767 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0617 11:52:37.191728 161767 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0617 11:52:37.196947 161767 start.go:562] Will wait 60s for crictl version
I0617 11:52:37.197030 161767 ssh_runner.go:195] Run: which crictl
I0617 11:52:37.201251 161767 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0617 11:52:37.245145 161767 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0617 11:52:37.245242 161767 ssh_runner.go:195] Run: crio --version
I0617 11:52:37.279952 161767 ssh_runner.go:195] Run: crio --version
I0617 11:52:37.310602 161767 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0617 11:52:37.311781 161767 main.go:141] libmachine: (old-k8s-version-003661) Calling .GetIP
I0617 11:52:37.314523 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | domain old-k8s-version-003661 has defined MAC address 52:54:00:76:66:a0 in network mk-old-k8s-version-003661
I0617 11:52:37.314906 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:76:66:a0", ip: ""} in network mk-old-k8s-version-003661: {Iface:virbr3 ExpiryTime:2024-06-17 12:52:26 +0000 UTC Type:0 Mac:52:54:00:76:66:a0 Iaid: IPaddr:192.168.61.164 Prefix:24 Hostname:old-k8s-version-003661 Clientid:01:52:54:00:76:66:a0}
I0617 11:52:37.314938 161767 main.go:141] libmachine: (old-k8s-version-003661) DBG | domain old-k8s-version-003661 has defined IP address 192.168.61.164 and MAC address 52:54:00:76:66:a0 in network mk-old-k8s-version-003661
I0617 11:52:37.315136 161767 ssh_runner.go:195] Run: grep 192.168.61.1 host.minikube.internal$ /etc/hosts
I0617 11:52:37.319562 161767 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.61.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0617 11:52:37.332055 161767 kubeadm.go:877] updating cluster {Name:old-k8s-version-003661 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19044/minikube-v1.33.1-1718047936-19044-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1718296336-19068@sha256:b31b1f456eebc10b590403d2cc052bb20a70156f4629e3514cbb38ecd550e2c8 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-003661 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.164 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] M
ountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0617 11:52:37.332190 161767 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0617 11:52:37.332240 161767 ssh_runner.go:195] Run: sudo crictl images --output json
I0617 11:52:37.368917 161767 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0617 11:52:37.368982 161767 ssh_runner.go:195] Run: which lz4
I0617 11:52:37.373290 161767 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0617 11:52:37.377719 161767 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0617 11:52:37.377762 161767 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19084-112967/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0617 11:52:39.162373 161767 crio.go:462] duration metric: took 1.789098824s to copy over tarball
I0617 11:52:39.162480 161767 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0617 11:52:41.729323 161767 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.566809289s)
I0617 11:52:41.729350 161767 crio.go:469] duration metric: took 2.566944502s to extract the tarball
I0617 11:52:41.729364 161767 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0617 11:52:41.771987 161767 ssh_runner.go:195] Run: sudo crictl images --output json
I0617 11:52:41.816465 161767 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0617 11:52:41.816492 161767 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0617 11:52:41.816570 161767 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0617 11:52:41.816584 161767 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0617 11:52:41.816585 161767 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0617 11:52:41.816585 161767 image.go:134] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0617 11:52:41.816628 161767 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0617 11:52:41.816649 161767 image.go:134] retrieving image: registry.k8s.io/pause:3.2
I0617 11:52:41.816628 161767 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0617 11:52:41.816837 161767 image.go:134] retrieving image: registry.k8s.io/coredns:1.7.0
I0617 11:52:41.817971 161767 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0617 11:52:41.818144 161767 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0617 11:52:41.818196 161767 image.go:177] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0617 11:52:41.818154 161767 image.go:177] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0617 11:52:41.818155 161767 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0617 11:52:41.818160 161767 image.go:177] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0617 11:52:41.818211 161767 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0617 11:52:41.818561 161767 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0617 11:52:41.978161 161767 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0617 11:52:41.995497 161767 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0617 11:52:41.995701 161767 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0617 11:52:42.002285 161767 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0617 11:52:42.003677 161767 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0617 11:52:42.009600 161767 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0617 11:52:42.055216 161767 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0617 11:52:42.055282 161767 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0617 11:52:42.055345 161767 ssh_runner.go:195] Run: which crictl
I0617 11:52:42.127520 161767 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0617 11:52:42.137719 161767 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0617 11:52:42.177139 161767 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0617 11:52:42.177179 161767 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0617 11:52:42.177198 161767 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0617 11:52:42.177223 161767 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0617 11:52:42.177251 161767 ssh_runner.go:195] Run: which crictl
I0617 11:52:42.177267 161767 ssh_runner.go:195] Run: which crictl
I0617 11:52:42.177304 161767 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0617 11:52:42.177334 161767 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0617 11:52:42.177336 161767 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0617 11:52:42.177362 161767 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0617 11:52:42.177369 161767 ssh_runner.go:195] Run: which crictl
I0617 11:52:42.177380 161767 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0617 11:52:42.177399 161767 ssh_runner.go:195] Run: which crictl
I0617 11:52:42.177400 161767 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0617 11:52:42.177440 161767 ssh_runner.go:195] Run: which crictl
I0617 11:52:42.177442 161767 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0617 11:52:42.308719 161767 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0617 11:52:42.308771 161767 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0617 11:52:42.308825 161767 ssh_runner.go:195] Run: which crictl
I0617 11:52:42.308833 161767 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0617 11:52:42.308860 161767 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0617 11:52:42.308925 161767 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0617 11:52:42.308959 161767 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/19084-112967/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0617 11:52:42.308974 161767 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0617 11:52:42.309060 161767 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0617 11:52:42.377385 161767 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0617 11:52:42.377536 161767 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/19084-112967/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0617 11:52:42.387182 161767 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/19084-112967/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0617 11:52:42.446148 161767 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/19084-112967/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0617 11:52:42.446209 161767 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/19084-112967/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0617 11:52:42.446418 161767 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/19084-112967/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0617 11:52:42.446578 161767 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/19084-112967/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0617 11:52:42.446628 161767 cache_images.go:92] duration metric: took 630.118103ms to LoadCachedImages
W0617 11:52:42.446723 161767 out.go:239] X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/19084-112967/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0: no such file or directory
X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/19084-112967/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0: no such file or directory
I0617 11:52:42.446739 161767 kubeadm.go:928] updating node { 192.168.61.164 8443 v1.20.0 crio true true} ...
I0617 11:52:42.446856 161767 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-003661 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.61.164
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-003661 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0617 11:52:42.446932 161767 ssh_runner.go:195] Run: crio config
I0617 11:52:42.502579 161767 cni.go:84] Creating CNI manager for ""
I0617 11:52:42.502604 161767 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0617 11:52:42.502616 161767 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0617 11:52:42.502644 161767 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.61.164 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-003661 NodeName:old-k8s-version-003661 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.61.164"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.61.164 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0617 11:52:42.502829 161767 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.61.164
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-003661"
kubeletExtraArgs:
node-ip: 192.168.61.164
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.61.164"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0617 11:52:42.502910 161767 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0617 11:52:42.513418 161767 binaries.go:44] Found k8s binaries, skipping transfer
I0617 11:52:42.513480 161767 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0617 11:52:42.523393 161767 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0617 11:52:42.540890 161767 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0617 11:52:42.561885 161767 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2123 bytes)
I0617 11:52:42.582411 161767 ssh_runner.go:195] Run: grep 192.168.61.164 control-plane.minikube.internal$ /etc/hosts
I0617 11:52:42.586381 161767 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.61.164 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0617 11:52:42.599627 161767 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0617 11:52:42.748886 161767 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0617 11:52:42.766455 161767 certs.go:68] Setting up /home/jenkins/minikube-integration/19084-112967/.minikube/profiles/old-k8s-version-003661 for IP: 192.168.61.164
I0617 11:52:42.766475 161767 certs.go:194] generating shared ca certs ...
I0617 11:52:42.766491 161767 certs.go:226] acquiring lock for ca certs: {Name:mkc28eb5421bdfb1631820073ca3e7c4e42a3845 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0617 11:52:42.766653 161767 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19084-112967/.minikube/ca.key
I0617 11:52:42.766720 161767 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19084-112967/.minikube/proxy-client-ca.key
I0617 11:52:42.766735 161767 certs.go:256] generating profile certs ...
I0617 11:52:42.766812 161767 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19084-112967/.minikube/profiles/old-k8s-version-003661/client.key
I0617 11:52:42.766827 161767 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19084-112967/.minikube/profiles/old-k8s-version-003661/client.crt with IP's: []
I0617 11:52:42.828167 161767 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19084-112967/.minikube/profiles/old-k8s-version-003661/client.crt ...
I0617 11:52:42.828192 161767 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19084-112967/.minikube/profiles/old-k8s-version-003661/client.crt: {Name:mkb6771524326df43debc1e5b7dc1b5c8725798b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0617 11:52:42.828373 161767 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19084-112967/.minikube/profiles/old-k8s-version-003661/client.key ...
I0617 11:52:42.828391 161767 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19084-112967/.minikube/profiles/old-k8s-version-003661/client.key: {Name:mk5766cfc51e9d055e8e303d1b362bfdfbf50925 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0617 11:52:42.828500 161767 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19084-112967/.minikube/profiles/old-k8s-version-003661/apiserver.key.6c1f259c
I0617 11:52:42.828523 161767 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19084-112967/.minikube/profiles/old-k8s-version-003661/apiserver.crt.6c1f259c with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.61.164]
I0617 11:52:43.164244 161767 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19084-112967/.minikube/profiles/old-k8s-version-003661/apiserver.crt.6c1f259c ...
I0617 11:52:43.164279 161767 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19084-112967/.minikube/profiles/old-k8s-version-003661/apiserver.crt.6c1f259c: {Name:mkcda7577f0d3703bff5abccc0b6188388fae4ea Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0617 11:52:43.164476 161767 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19084-112967/.minikube/profiles/old-k8s-version-003661/apiserver.key.6c1f259c ...
I0617 11:52:43.164503 161767 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19084-112967/.minikube/profiles/old-k8s-version-003661/apiserver.key.6c1f259c: {Name:mkb9bddf29a4ba5ddb6399c7587890b25cdc6bdf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0617 11:52:43.164609 161767 certs.go:381] copying /home/jenkins/minikube-integration/19084-112967/.minikube/profiles/old-k8s-version-003661/apiserver.crt.6c1f259c -> /home/jenkins/minikube-integration/19084-112967/.minikube/profiles/old-k8s-version-003661/apiserver.crt
I0617 11:52:43.164733 161767 certs.go:385] copying /home/jenkins/minikube-integration/19084-112967/.minikube/profiles/old-k8s-version-003661/apiserver.key.6c1f259c -> /home/jenkins/minikube-integration/19084-112967/.minikube/profiles/old-k8s-version-003661/apiserver.key
I0617 11:52:43.164821 161767 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19084-112967/.minikube/profiles/old-k8s-version-003661/proxy-client.key
I0617 11:52:43.164845 161767 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19084-112967/.minikube/profiles/old-k8s-version-003661/proxy-client.crt with IP's: []
I0617 11:52:43.315066 161767 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19084-112967/.minikube/profiles/old-k8s-version-003661/proxy-client.crt ...
I0617 11:52:43.315124 161767 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19084-112967/.minikube/profiles/old-k8s-version-003661/proxy-client.crt: {Name:mkd3cdacd2e732d17bc57089336395bed0e55297 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0617 11:52:43.315330 161767 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19084-112967/.minikube/profiles/old-k8s-version-003661/proxy-client.key ...
I0617 11:52:43.315355 161767 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19084-112967/.minikube/profiles/old-k8s-version-003661/proxy-client.key: {Name:mk8cb424a47a9a133330c233f54380f79fe330a3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0617 11:52:43.315665 161767 certs.go:484] found cert: /home/jenkins/minikube-integration/19084-112967/.minikube/certs/120174.pem (1338 bytes)
W0617 11:52:43.315725 161767 certs.go:480] ignoring /home/jenkins/minikube-integration/19084-112967/.minikube/certs/120174_empty.pem, impossibly tiny 0 bytes
I0617 11:52:43.315741 161767 certs.go:484] found cert: /home/jenkins/minikube-integration/19084-112967/.minikube/certs/ca-key.pem (1679 bytes)
I0617 11:52:43.315777 161767 certs.go:484] found cert: /home/jenkins/minikube-integration/19084-112967/.minikube/certs/ca.pem (1082 bytes)
I0617 11:52:43.315807 161767 certs.go:484] found cert: /home/jenkins/minikube-integration/19084-112967/.minikube/certs/cert.pem (1123 bytes)
I0617 11:52:43.315838 161767 certs.go:484] found cert: /home/jenkins/minikube-integration/19084-112967/.minikube/certs/key.pem (1679 bytes)
I0617 11:52:43.315895 161767 certs.go:484] found cert: /home/jenkins/minikube-integration/19084-112967/.minikube/files/etc/ssl/certs/1201742.pem (1708 bytes)
I0617 11:52:43.316752 161767 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19084-112967/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0617 11:52:43.342625 161767 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19084-112967/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0617 11:52:43.367672 161767 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19084-112967/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0617 11:52:43.393228 161767 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19084-112967/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0617 11:52:43.418653 161767 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19084-112967/.minikube/profiles/old-k8s-version-003661/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0617 11:52:43.443950 161767 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19084-112967/.minikube/profiles/old-k8s-version-003661/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0617 11:52:43.468959 161767 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19084-112967/.minikube/profiles/old-k8s-version-003661/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0617 11:52:43.494533 161767 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19084-112967/.minikube/profiles/old-k8s-version-003661/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0617 11:52:43.519499 161767 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19084-112967/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0617 11:52:43.544032 161767 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19084-112967/.minikube/certs/120174.pem --> /usr/share/ca-certificates/120174.pem (1338 bytes)
I0617 11:52:43.573020 161767 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19084-112967/.minikube/files/etc/ssl/certs/1201742.pem --> /usr/share/ca-certificates/1201742.pem (1708 bytes)
I0617 11:52:43.599997 161767 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0617 11:52:43.616787 161767 ssh_runner.go:195] Run: openssl version
I0617 11:52:43.623750 161767 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0617 11:52:43.642589 161767 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0617 11:52:43.649633 161767 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jun 17 10:45 /usr/share/ca-certificates/minikubeCA.pem
I0617 11:52:43.649711 161767 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0617 11:52:43.658087 161767 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0617 11:52:43.673978 161767 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/120174.pem && ln -fs /usr/share/ca-certificates/120174.pem /etc/ssl/certs/120174.pem"
I0617 11:52:43.694003 161767 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/120174.pem
I0617 11:52:43.699043 161767 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jun 17 10:56 /usr/share/ca-certificates/120174.pem
I0617 11:52:43.699112 161767 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/120174.pem
I0617 11:52:43.705350 161767 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/120174.pem /etc/ssl/certs/51391683.0"
I0617 11:52:43.716306 161767 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1201742.pem && ln -fs /usr/share/ca-certificates/1201742.pem /etc/ssl/certs/1201742.pem"
I0617 11:52:43.727211 161767 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1201742.pem
I0617 11:52:43.731697 161767 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jun 17 10:56 /usr/share/ca-certificates/1201742.pem
I0617 11:52:43.731745 161767 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1201742.pem
I0617 11:52:43.737485 161767 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/1201742.pem /etc/ssl/certs/3ec20f2e.0"
I0617 11:52:43.748319 161767 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0617 11:52:43.752563 161767 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0617 11:52:43.752616 161767 kubeadm.go:391] StartCluster: {Name:old-k8s-version-003661 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19044/minikube-v1.33.1-1718047936-19044-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1718296336-19068@sha256:b31b1f456eebc10b590403d2cc052bb20a70156f4629e3514cbb38ecd550e2c8 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-003661 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.164 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Moun
tPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0617 11:52:43.752716 161767 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0617 11:52:43.752769 161767 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0617 11:52:43.790279 161767 cri.go:89] found id: ""
I0617 11:52:43.790343 161767 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0617 11:52:43.800683 161767 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0617 11:52:43.810211 161767 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0617 11:52:43.819904 161767 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0617 11:52:43.819928 161767 kubeadm.go:156] found existing configuration files:
I0617 11:52:43.819977 161767 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0617 11:52:43.830044 161767 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0617 11:52:43.911294 161767 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0617 11:52:43.921925 161767 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0617 11:52:43.931552 161767 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0617 11:52:43.931626 161767 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0617 11:52:43.941453 161767 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0617 11:52:43.951013 161767 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0617 11:52:43.951097 161767 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0617 11:52:43.960627 161767 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0617 11:52:43.969937 161767 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0617 11:52:43.969998 161767 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0617 11:52:43.979331 161767 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0617 11:52:44.092160 161767 kubeadm.go:309] [init] Using Kubernetes version: v1.20.0
I0617 11:52:44.092224 161767 kubeadm.go:309] [preflight] Running pre-flight checks
I0617 11:52:44.241804 161767 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0617 11:52:44.241972 161767 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0617 11:52:44.242087 161767 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0617 11:52:44.428763 161767 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0617 11:52:44.544013 161767 out.go:204] - Generating certificates and keys ...
I0617 11:52:44.544165 161767 kubeadm.go:309] [certs] Using existing ca certificate authority
I0617 11:52:44.544259 161767 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0617 11:52:44.575357 161767 kubeadm.go:309] [certs] Generating "apiserver-kubelet-client" certificate and key
I0617 11:52:44.754852 161767 kubeadm.go:309] [certs] Generating "front-proxy-ca" certificate and key
I0617 11:52:45.069348 161767 kubeadm.go:309] [certs] Generating "front-proxy-client" certificate and key
I0617 11:52:45.205413 161767 kubeadm.go:309] [certs] Generating "etcd/ca" certificate and key
I0617 11:52:45.382059 161767 kubeadm.go:309] [certs] Generating "etcd/server" certificate and key
I0617 11:52:45.382279 161767 kubeadm.go:309] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-003661] and IPs [192.168.61.164 127.0.0.1 ::1]
I0617 11:52:45.507859 161767 kubeadm.go:309] [certs] Generating "etcd/peer" certificate and key
I0617 11:52:45.508134 161767 kubeadm.go:309] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-003661] and IPs [192.168.61.164 127.0.0.1 ::1]
I0617 11:52:45.783772 161767 kubeadm.go:309] [certs] Generating "etcd/healthcheck-client" certificate and key
I0617 11:52:45.846672 161767 kubeadm.go:309] [certs] Generating "apiserver-etcd-client" certificate and key
I0617 11:52:46.047604 161767 kubeadm.go:309] [certs] Generating "sa" key and public key
I0617 11:52:46.047711 161767 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0617 11:52:46.225448 161767 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0617 11:52:46.544626 161767 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0617 11:52:46.858925 161767 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0617 11:52:47.026061 161767 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0617 11:52:47.045588 161767 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0617 11:52:47.046755 161767 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0617 11:52:47.047884 161767 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0617 11:52:47.200410 161767 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0617 11:52:47.202318 161767 out.go:204] - Booting up control plane ...
I0617 11:52:47.202471 161767 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0617 11:52:47.217190 161767 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0617 11:52:47.221346 161767 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0617 11:52:47.226137 161767 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0617 11:52:47.233575 161767 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0617 11:53:27.226454 161767 kubeadm.go:309] [kubelet-check] Initial timeout of 40s passed.
I0617 11:53:27.227573 161767 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0617 11:53:27.227871 161767 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0617 11:53:32.228242 161767 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0617 11:53:32.228510 161767 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0617 11:53:42.228007 161767 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0617 11:53:42.228280 161767 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0617 11:54:02.227892 161767 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0617 11:54:02.228198 161767 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0617 11:54:42.229281 161767 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0617 11:54:42.229568 161767 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0617 11:54:42.229583 161767 kubeadm.go:309]
I0617 11:54:42.229673 161767 kubeadm.go:309] Unfortunately, an error has occurred:
I0617 11:54:42.229748 161767 kubeadm.go:309] timed out waiting for the condition
I0617 11:54:42.229759 161767 kubeadm.go:309]
I0617 11:54:42.229807 161767 kubeadm.go:309] This error is likely caused by:
I0617 11:54:42.229862 161767 kubeadm.go:309] - The kubelet is not running
I0617 11:54:42.230009 161767 kubeadm.go:309] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0617 11:54:42.230020 161767 kubeadm.go:309]
I0617 11:54:42.230192 161767 kubeadm.go:309] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0617 11:54:42.230256 161767 kubeadm.go:309] - 'systemctl status kubelet'
I0617 11:54:42.230306 161767 kubeadm.go:309] - 'journalctl -xeu kubelet'
I0617 11:54:42.230318 161767 kubeadm.go:309]
I0617 11:54:42.230492 161767 kubeadm.go:309] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0617 11:54:42.230599 161767 kubeadm.go:309] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0617 11:54:42.230613 161767 kubeadm.go:309]
I0617 11:54:42.230744 161767 kubeadm.go:309] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0617 11:54:42.230857 161767 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0617 11:54:42.230946 161767 kubeadm.go:309] Once you have found the failing container, you can inspect its logs with:
I0617 11:54:42.231041 161767 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0617 11:54:42.231052 161767 kubeadm.go:309]
I0617 11:54:42.231799 161767 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0617 11:54:42.231902 161767 kubeadm.go:309] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0617 11:54:42.231998 161767 kubeadm.go:309] To see the stack trace of this error execute with --v=5 or higher
W0617 11:54:42.232167 161767 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-003661] and IPs [192.168.61.164 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-003661] and IPs [192.168.61.164 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-003661] and IPs [192.168.61.164 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-003661] and IPs [192.168.61.164 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0617 11:54:42.232227 161767 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0617 11:54:42.688142 161767 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0617 11:54:42.703713 161767 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0617 11:54:42.713879 161767 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0617 11:54:42.713896 161767 kubeadm.go:156] found existing configuration files:
I0617 11:54:42.713926 161767 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0617 11:54:42.723259 161767 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0617 11:54:42.723314 161767 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0617 11:54:42.732883 161767 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0617 11:54:42.742013 161767 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0617 11:54:42.742069 161767 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0617 11:54:42.751654 161767 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0617 11:54:42.760820 161767 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0617 11:54:42.760855 161767 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0617 11:54:42.770307 161767 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0617 11:54:42.779129 161767 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0617 11:54:42.779158 161767 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0617 11:54:42.788495 161767 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0617 11:54:43.000491 161767 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0617 11:56:39.203166 161767 kubeadm.go:309] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0617 11:56:39.203288 161767 kubeadm.go:309] To see the stack trace of this error execute with --v=5 or higher
I0617 11:56:39.205158 161767 kubeadm.go:309] [init] Using Kubernetes version: v1.20.0
I0617 11:56:39.205236 161767 kubeadm.go:309] [preflight] Running pre-flight checks
I0617 11:56:39.205307 161767 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0617 11:56:39.205436 161767 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0617 11:56:39.205563 161767 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0617 11:56:39.205636 161767 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0617 11:56:39.207150 161767 out.go:204] - Generating certificates and keys ...
I0617 11:56:39.207218 161767 kubeadm.go:309] [certs] Using existing ca certificate authority
I0617 11:56:39.207276 161767 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0617 11:56:39.207344 161767 kubeadm.go:309] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0617 11:56:39.207395 161767 kubeadm.go:309] [certs] Using existing front-proxy-ca certificate authority
I0617 11:56:39.207510 161767 kubeadm.go:309] [certs] Using existing front-proxy-client certificate and key on disk
I0617 11:56:39.207592 161767 kubeadm.go:309] [certs] Using existing etcd/ca certificate authority
I0617 11:56:39.207682 161767 kubeadm.go:309] [certs] Using existing etcd/server certificate and key on disk
I0617 11:56:39.207767 161767 kubeadm.go:309] [certs] Using existing etcd/peer certificate and key on disk
I0617 11:56:39.207860 161767 kubeadm.go:309] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0617 11:56:39.207987 161767 kubeadm.go:309] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0617 11:56:39.208047 161767 kubeadm.go:309] [certs] Using the existing "sa" key
I0617 11:56:39.208118 161767 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0617 11:56:39.208161 161767 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0617 11:56:39.208206 161767 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0617 11:56:39.208259 161767 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0617 11:56:39.208328 161767 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0617 11:56:39.208458 161767 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0617 11:56:39.208573 161767 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0617 11:56:39.208629 161767 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0617 11:56:39.208717 161767 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0617 11:56:39.210176 161767 out.go:204] - Booting up control plane ...
I0617 11:56:39.210264 161767 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0617 11:56:39.210349 161767 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0617 11:56:39.210430 161767 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0617 11:56:39.210530 161767 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0617 11:56:39.210678 161767 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0617 11:56:39.210731 161767 kubeadm.go:309] [kubelet-check] Initial timeout of 40s passed.
I0617 11:56:39.210788 161767 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0617 11:56:39.210955 161767 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0617 11:56:39.211020 161767 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0617 11:56:39.211175 161767 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0617 11:56:39.211236 161767 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0617 11:56:39.211389 161767 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0617 11:56:39.211450 161767 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0617 11:56:39.211632 161767 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0617 11:56:39.211706 161767 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0617 11:56:39.211890 161767 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0617 11:56:39.211903 161767 kubeadm.go:309]
I0617 11:56:39.211954 161767 kubeadm.go:309] Unfortunately, an error has occurred:
I0617 11:56:39.211988 161767 kubeadm.go:309] timed out waiting for the condition
I0617 11:56:39.211996 161767 kubeadm.go:309]
I0617 11:56:39.212024 161767 kubeadm.go:309] This error is likely caused by:
I0617 11:56:39.212054 161767 kubeadm.go:309] - The kubelet is not running
I0617 11:56:39.212150 161767 kubeadm.go:309] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0617 11:56:39.212158 161767 kubeadm.go:309]
I0617 11:56:39.212241 161767 kubeadm.go:309] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0617 11:56:39.212280 161767 kubeadm.go:309] - 'systemctl status kubelet'
I0617 11:56:39.212308 161767 kubeadm.go:309] - 'journalctl -xeu kubelet'
I0617 11:56:39.212314 161767 kubeadm.go:309]
I0617 11:56:39.212403 161767 kubeadm.go:309] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0617 11:56:39.212481 161767 kubeadm.go:309] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0617 11:56:39.212491 161767 kubeadm.go:309]
I0617 11:56:39.212584 161767 kubeadm.go:309] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0617 11:56:39.212662 161767 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0617 11:56:39.212729 161767 kubeadm.go:309] Once you have found the failing container, you can inspect its logs with:
I0617 11:56:39.212789 161767 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0617 11:56:39.212810 161767 kubeadm.go:309]
I0617 11:56:39.212850 161767 kubeadm.go:393] duration metric: took 3m55.460240214s to StartCluster
I0617 11:56:39.212886 161767 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0617 11:56:39.212934 161767 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0617 11:56:39.257344 161767 cri.go:89] found id: ""
I0617 11:56:39.257385 161767 logs.go:276] 0 containers: []
W0617 11:56:39.257396 161767 logs.go:278] No container was found matching "kube-apiserver"
I0617 11:56:39.257403 161767 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0617 11:56:39.257464 161767 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0617 11:56:39.295336 161767 cri.go:89] found id: ""
I0617 11:56:39.295361 161767 logs.go:276] 0 containers: []
W0617 11:56:39.295369 161767 logs.go:278] No container was found matching "etcd"
I0617 11:56:39.295375 161767 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0617 11:56:39.295425 161767 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0617 11:56:39.332771 161767 cri.go:89] found id: ""
I0617 11:56:39.332797 161767 logs.go:276] 0 containers: []
W0617 11:56:39.332805 161767 logs.go:278] No container was found matching "coredns"
I0617 11:56:39.332811 161767 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0617 11:56:39.332881 161767 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0617 11:56:39.372539 161767 cri.go:89] found id: ""
I0617 11:56:39.372573 161767 logs.go:276] 0 containers: []
W0617 11:56:39.372584 161767 logs.go:278] No container was found matching "kube-scheduler"
I0617 11:56:39.372594 161767 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0617 11:56:39.372659 161767 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0617 11:56:39.411579 161767 cri.go:89] found id: ""
I0617 11:56:39.411608 161767 logs.go:276] 0 containers: []
W0617 11:56:39.411618 161767 logs.go:278] No container was found matching "kube-proxy"
I0617 11:56:39.411626 161767 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0617 11:56:39.411693 161767 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0617 11:56:39.448186 161767 cri.go:89] found id: ""
I0617 11:56:39.448221 161767 logs.go:276] 0 containers: []
W0617 11:56:39.448232 161767 logs.go:278] No container was found matching "kube-controller-manager"
I0617 11:56:39.448239 161767 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0617 11:56:39.448300 161767 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0617 11:56:39.488022 161767 cri.go:89] found id: ""
I0617 11:56:39.488055 161767 logs.go:276] 0 containers: []
W0617 11:56:39.488066 161767 logs.go:278] No container was found matching "kindnet"
I0617 11:56:39.488081 161767 logs.go:123] Gathering logs for describe nodes ...
I0617 11:56:39.488098 161767 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0617 11:56:39.641180 161767 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0617 11:56:39.641211 161767 logs.go:123] Gathering logs for CRI-O ...
I0617 11:56:39.641230 161767 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0617 11:56:39.746542 161767 logs.go:123] Gathering logs for container status ...
I0617 11:56:39.746580 161767 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0617 11:56:39.787175 161767 logs.go:123] Gathering logs for kubelet ...
I0617 11:56:39.787202 161767 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0617 11:56:39.838091 161767 logs.go:123] Gathering logs for dmesg ...
I0617 11:56:39.838121 161767 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
W0617 11:56:39.852128 161767 out.go:364] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0617 11:56:39.852166 161767 out.go:239] *
*
W0617 11:56:39.852229 161767 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0617 11:56:39.852250 161767 out.go:239] *
*
W0617 11:56:39.853057 161767 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0617 11:56:39.856306 161767 out.go:177]
W0617 11:56:39.857546 161767 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0617 11:56:39.857599 161767 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0617 11:56:39.857617 161767 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0617 11:56:39.859724 161767 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-003661 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-003661 -n old-k8s-version-003661
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-003661 -n old-k8s-version-003661: exit status 6 (233.851023ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0617 11:56:40.130549 164885 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-003661" does not appear in /home/jenkins/minikube-integration/19084-112967/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-003661" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (281.37s)