=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:184: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-517711 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:184: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-517711 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m32.240659169s)
-- stdout --
* [old-k8s-version-517711] minikube v1.35.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=20354
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/20354-109432/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/20354-109432/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-517711" primary control-plane node in "old-k8s-version-517711" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0203 11:41:26.865901 166532 out.go:345] Setting OutFile to fd 1 ...
I0203 11:41:26.866066 166532 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0203 11:41:26.866091 166532 out.go:358] Setting ErrFile to fd 2...
I0203 11:41:26.866095 166532 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0203 11:41:26.866252 166532 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20354-109432/.minikube/bin
I0203 11:41:26.866823 166532 out.go:352] Setting JSON to false
I0203 11:41:26.868077 166532 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-9","uptime":8629,"bootTime":1738574258,"procs":305,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1075-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0203 11:41:26.868191 166532 start.go:139] virtualization: kvm guest
I0203 11:41:26.870359 166532 out.go:177] * [old-k8s-version-517711] minikube v1.35.0 on Ubuntu 20.04 (kvm/amd64)
I0203 11:41:26.871528 166532 notify.go:220] Checking for updates...
I0203 11:41:26.871551 166532 out.go:177] - MINIKUBE_LOCATION=20354
I0203 11:41:26.872770 166532 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0203 11:41:26.874106 166532 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/20354-109432/kubeconfig
I0203 11:41:26.875191 166532 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/20354-109432/.minikube
I0203 11:41:26.876242 166532 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0203 11:41:26.877308 166532 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0203 11:41:26.878824 166532 config.go:182] Loaded profile config "bridge-927018": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.1
I0203 11:41:26.878926 166532 config.go:182] Loaded profile config "flannel-927018": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.1
I0203 11:41:26.879006 166532 config.go:182] Loaded profile config "kubernetes-upgrade-700839": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.1
I0203 11:41:26.879091 166532 driver.go:394] Setting default libvirt URI to qemu:///system
I0203 11:41:26.915059 166532 out.go:177] * Using the kvm2 driver based on user configuration
I0203 11:41:26.916220 166532 start.go:297] selected driver: kvm2
I0203 11:41:26.916232 166532 start.go:901] validating driver "kvm2" against <nil>
I0203 11:41:26.916259 166532 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0203 11:41:26.916946 166532 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0203 11:41:26.917045 166532 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/20354-109432/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0203 11:41:26.932544 166532 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.35.0
I0203 11:41:26.932607 166532 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0203 11:41:26.932891 166532 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0203 11:41:26.932926 166532 cni.go:84] Creating CNI manager for ""
I0203 11:41:26.932986 166532 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0203 11:41:26.932998 166532 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0203 11:41:26.933057 166532 start.go:340] cluster config:
{Name:old-k8s-version-517711 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-517711 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRI
Socket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:
0 GPUs: AutoPauseInterval:1m0s}
I0203 11:41:26.933172 166532 iso.go:125] acquiring lock: {Name:mk9b6d47934249a6b2a57c0b698dce274826cd59 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0203 11:41:26.934976 166532 out.go:177] * Starting "old-k8s-version-517711" primary control-plane node in "old-k8s-version-517711" cluster
I0203 11:41:26.936291 166532 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0203 11:41:26.936338 166532 preload.go:146] Found local preload: /home/jenkins/minikube-integration/20354-109432/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0203 11:41:26.936357 166532 cache.go:56] Caching tarball of preloaded images
I0203 11:41:26.936783 166532 preload.go:172] Found /home/jenkins/minikube-integration/20354-109432/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0203 11:41:26.936815 166532 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0203 11:41:26.936945 166532 profile.go:143] Saving config to /home/jenkins/minikube-integration/20354-109432/.minikube/profiles/old-k8s-version-517711/config.json ...
I0203 11:41:26.936977 166532 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20354-109432/.minikube/profiles/old-k8s-version-517711/config.json: {Name:mk4dcbba19913098aa7d6976ed46cfbb452fb29b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0203 11:41:26.937263 166532 start.go:360] acquireMachinesLock for old-k8s-version-517711: {Name:mk4d774b88f87fe0539ca3e30dd98aae8a4d5437 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0203 11:41:28.590854 166532 start.go:364] duration metric: took 1.65352527s to acquireMachinesLock for "old-k8s-version-517711"
I0203 11:41:28.590941 166532 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-517711 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-versi
on-517711 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMir
ror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0203 11:41:28.591040 166532 start.go:125] createHost starting for "" (driver="kvm2")
I0203 11:41:28.593182 166532 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0203 11:41:28.593400 166532 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0203 11:41:28.593458 166532 main.go:141] libmachine: Launching plugin server for driver kvm2
I0203 11:41:28.613338 166532 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45871
I0203 11:41:28.613844 166532 main.go:141] libmachine: () Calling .GetVersion
I0203 11:41:28.614480 166532 main.go:141] libmachine: Using API Version 1
I0203 11:41:28.614503 166532 main.go:141] libmachine: () Calling .SetConfigRaw
I0203 11:41:28.614820 166532 main.go:141] libmachine: () Calling .GetMachineName
I0203 11:41:28.615028 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetMachineName
I0203 11:41:28.615166 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .DriverName
I0203 11:41:28.615317 166532 start.go:159] libmachine.API.Create for "old-k8s-version-517711" (driver="kvm2")
I0203 11:41:28.615340 166532 client.go:168] LocalClient.Create starting
I0203 11:41:28.615379 166532 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20354-109432/.minikube/certs/ca.pem
I0203 11:41:28.615422 166532 main.go:141] libmachine: Decoding PEM data...
I0203 11:41:28.615442 166532 main.go:141] libmachine: Parsing certificate...
I0203 11:41:28.615525 166532 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20354-109432/.minikube/certs/cert.pem
I0203 11:41:28.615559 166532 main.go:141] libmachine: Decoding PEM data...
I0203 11:41:28.615577 166532 main.go:141] libmachine: Parsing certificate...
I0203 11:41:28.615603 166532 main.go:141] libmachine: Running pre-create checks...
I0203 11:41:28.615616 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .PreCreateCheck
I0203 11:41:28.615929 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetConfigRaw
I0203 11:41:28.616293 166532 main.go:141] libmachine: Creating machine...
I0203 11:41:28.616302 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .Create
I0203 11:41:28.616496 166532 main.go:141] libmachine: (old-k8s-version-517711) creating KVM machine...
I0203 11:41:28.616520 166532 main.go:141] libmachine: (old-k8s-version-517711) creating network...
I0203 11:41:28.617909 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | found existing default KVM network
I0203 11:41:28.619432 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | I0203 11:41:28.619281 166585 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr3 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:75:e3:f1} reservation:<nil>}
I0203 11:41:28.620358 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | I0203 11:41:28.620277 166585 network.go:211] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr2 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:96:e5:75} reservation:<nil>}
I0203 11:41:28.621571 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | I0203 11:41:28.621495 166585 network.go:206] using free private subnet 192.168.61.0/24: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc00030cc90}
I0203 11:41:28.621619 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | created network xml:
I0203 11:41:28.621639 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | <network>
I0203 11:41:28.621664 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | <name>mk-old-k8s-version-517711</name>
I0203 11:41:28.621674 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | <dns enable='no'/>
I0203 11:41:28.621682 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG |
I0203 11:41:28.621705 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | <ip address='192.168.61.1' netmask='255.255.255.0'>
I0203 11:41:28.621737 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | <dhcp>
I0203 11:41:28.621763 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | <range start='192.168.61.2' end='192.168.61.253'/>
I0203 11:41:28.621816 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | </dhcp>
I0203 11:41:28.621849 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | </ip>
I0203 11:41:28.621864 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG |
I0203 11:41:28.621878 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | </network>
I0203 11:41:28.621888 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG |
I0203 11:41:28.627066 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | trying to create private KVM network mk-old-k8s-version-517711 192.168.61.0/24...
I0203 11:41:28.710113 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | private KVM network mk-old-k8s-version-517711 192.168.61.0/24 created
I0203 11:41:28.710154 166532 main.go:141] libmachine: (old-k8s-version-517711) setting up store path in /home/jenkins/minikube-integration/20354-109432/.minikube/machines/old-k8s-version-517711 ...
I0203 11:41:28.710167 166532 main.go:141] libmachine: (old-k8s-version-517711) building disk image from file:///home/jenkins/minikube-integration/20354-109432/.minikube/cache/iso/amd64/minikube-v1.35.0-amd64.iso
I0203 11:41:28.710185 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | I0203 11:41:28.710136 166585 common.go:144] Making disk image using store path: /home/jenkins/minikube-integration/20354-109432/.minikube
I0203 11:41:28.710351 166532 main.go:141] libmachine: (old-k8s-version-517711) Downloading /home/jenkins/minikube-integration/20354-109432/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/20354-109432/.minikube/cache/iso/amd64/minikube-v1.35.0-amd64.iso...
I0203 11:41:29.015223 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | I0203 11:41:29.014524 166585 common.go:151] Creating ssh key: /home/jenkins/minikube-integration/20354-109432/.minikube/machines/old-k8s-version-517711/id_rsa...
I0203 11:41:29.183178 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | I0203 11:41:29.182990 166585 common.go:157] Creating raw disk image: /home/jenkins/minikube-integration/20354-109432/.minikube/machines/old-k8s-version-517711/old-k8s-version-517711.rawdisk...
I0203 11:41:29.183218 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | Writing magic tar header
I0203 11:41:29.183238 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | Writing SSH key tar header
I0203 11:41:29.183251 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | I0203 11:41:29.183219 166585 common.go:171] Fixing permissions on /home/jenkins/minikube-integration/20354-109432/.minikube/machines/old-k8s-version-517711 ...
I0203 11:41:29.183416 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20354-109432/.minikube/machines/old-k8s-version-517711
I0203 11:41:29.183481 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20354-109432/.minikube/machines
I0203 11:41:29.183501 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20354-109432/.minikube
I0203 11:41:29.183516 166532 main.go:141] libmachine: (old-k8s-version-517711) setting executable bit set on /home/jenkins/minikube-integration/20354-109432/.minikube/machines/old-k8s-version-517711 (perms=drwx------)
I0203 11:41:29.183608 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20354-109432
I0203 11:41:29.183676 166532 main.go:141] libmachine: (old-k8s-version-517711) setting executable bit set on /home/jenkins/minikube-integration/20354-109432/.minikube/machines (perms=drwxr-xr-x)
I0203 11:41:29.183707 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | checking permissions on dir: /home/jenkins/minikube-integration
I0203 11:41:29.183732 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | checking permissions on dir: /home/jenkins
I0203 11:41:29.183758 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | checking permissions on dir: /home
I0203 11:41:29.183776 166532 main.go:141] libmachine: (old-k8s-version-517711) setting executable bit set on /home/jenkins/minikube-integration/20354-109432/.minikube (perms=drwxr-xr-x)
I0203 11:41:29.183798 166532 main.go:141] libmachine: (old-k8s-version-517711) setting executable bit set on /home/jenkins/minikube-integration/20354-109432 (perms=drwxrwxr-x)
I0203 11:41:29.183807 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | skipping /home - not owner
I0203 11:41:29.183836 166532 main.go:141] libmachine: (old-k8s-version-517711) setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0203 11:41:29.183870 166532 main.go:141] libmachine: (old-k8s-version-517711) setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0203 11:41:29.183897 166532 main.go:141] libmachine: (old-k8s-version-517711) creating domain...
I0203 11:41:29.186489 166532 main.go:141] libmachine: (old-k8s-version-517711) define libvirt domain using xml:
I0203 11:41:29.186513 166532 main.go:141] libmachine: (old-k8s-version-517711) <domain type='kvm'>
I0203 11:41:29.186524 166532 main.go:141] libmachine: (old-k8s-version-517711) <name>old-k8s-version-517711</name>
I0203 11:41:29.186531 166532 main.go:141] libmachine: (old-k8s-version-517711) <memory unit='MiB'>2200</memory>
I0203 11:41:29.186538 166532 main.go:141] libmachine: (old-k8s-version-517711) <vcpu>2</vcpu>
I0203 11:41:29.186545 166532 main.go:141] libmachine: (old-k8s-version-517711) <features>
I0203 11:41:29.186556 166532 main.go:141] libmachine: (old-k8s-version-517711) <acpi/>
I0203 11:41:29.186566 166532 main.go:141] libmachine: (old-k8s-version-517711) <apic/>
I0203 11:41:29.186574 166532 main.go:141] libmachine: (old-k8s-version-517711) <pae/>
I0203 11:41:29.186584 166532 main.go:141] libmachine: (old-k8s-version-517711)
I0203 11:41:29.186591 166532 main.go:141] libmachine: (old-k8s-version-517711) </features>
I0203 11:41:29.186601 166532 main.go:141] libmachine: (old-k8s-version-517711) <cpu mode='host-passthrough'>
I0203 11:41:29.186608 166532 main.go:141] libmachine: (old-k8s-version-517711)
I0203 11:41:29.186621 166532 main.go:141] libmachine: (old-k8s-version-517711) </cpu>
I0203 11:41:29.186629 166532 main.go:141] libmachine: (old-k8s-version-517711) <os>
I0203 11:41:29.186635 166532 main.go:141] libmachine: (old-k8s-version-517711) <type>hvm</type>
I0203 11:41:29.186643 166532 main.go:141] libmachine: (old-k8s-version-517711) <boot dev='cdrom'/>
I0203 11:41:29.186649 166532 main.go:141] libmachine: (old-k8s-version-517711) <boot dev='hd'/>
I0203 11:41:29.186657 166532 main.go:141] libmachine: (old-k8s-version-517711) <bootmenu enable='no'/>
I0203 11:41:29.186663 166532 main.go:141] libmachine: (old-k8s-version-517711) </os>
I0203 11:41:29.186670 166532 main.go:141] libmachine: (old-k8s-version-517711) <devices>
I0203 11:41:29.186677 166532 main.go:141] libmachine: (old-k8s-version-517711) <disk type='file' device='cdrom'>
I0203 11:41:29.186690 166532 main.go:141] libmachine: (old-k8s-version-517711) <source file='/home/jenkins/minikube-integration/20354-109432/.minikube/machines/old-k8s-version-517711/boot2docker.iso'/>
I0203 11:41:29.186703 166532 main.go:141] libmachine: (old-k8s-version-517711) <target dev='hdc' bus='scsi'/>
I0203 11:41:29.186710 166532 main.go:141] libmachine: (old-k8s-version-517711) <readonly/>
I0203 11:41:29.186723 166532 main.go:141] libmachine: (old-k8s-version-517711) </disk>
I0203 11:41:29.186734 166532 main.go:141] libmachine: (old-k8s-version-517711) <disk type='file' device='disk'>
I0203 11:41:29.186743 166532 main.go:141] libmachine: (old-k8s-version-517711) <driver name='qemu' type='raw' cache='default' io='threads' />
I0203 11:41:29.186762 166532 main.go:141] libmachine: (old-k8s-version-517711) <source file='/home/jenkins/minikube-integration/20354-109432/.minikube/machines/old-k8s-version-517711/old-k8s-version-517711.rawdisk'/>
I0203 11:41:29.186776 166532 main.go:141] libmachine: (old-k8s-version-517711) <target dev='hda' bus='virtio'/>
I0203 11:41:29.186784 166532 main.go:141] libmachine: (old-k8s-version-517711) </disk>
I0203 11:41:29.186795 166532 main.go:141] libmachine: (old-k8s-version-517711) <interface type='network'>
I0203 11:41:29.186803 166532 main.go:141] libmachine: (old-k8s-version-517711) <source network='mk-old-k8s-version-517711'/>
I0203 11:41:29.186810 166532 main.go:141] libmachine: (old-k8s-version-517711) <model type='virtio'/>
I0203 11:41:29.186818 166532 main.go:141] libmachine: (old-k8s-version-517711) </interface>
I0203 11:41:29.186829 166532 main.go:141] libmachine: (old-k8s-version-517711) <interface type='network'>
I0203 11:41:29.186837 166532 main.go:141] libmachine: (old-k8s-version-517711) <source network='default'/>
I0203 11:41:29.186845 166532 main.go:141] libmachine: (old-k8s-version-517711) <model type='virtio'/>
I0203 11:41:29.186852 166532 main.go:141] libmachine: (old-k8s-version-517711) </interface>
I0203 11:41:29.186862 166532 main.go:141] libmachine: (old-k8s-version-517711) <serial type='pty'>
I0203 11:41:29.186870 166532 main.go:141] libmachine: (old-k8s-version-517711) <target port='0'/>
I0203 11:41:29.186879 166532 main.go:141] libmachine: (old-k8s-version-517711) </serial>
I0203 11:41:29.186887 166532 main.go:141] libmachine: (old-k8s-version-517711) <console type='pty'>
I0203 11:41:29.186894 166532 main.go:141] libmachine: (old-k8s-version-517711) <target type='serial' port='0'/>
I0203 11:41:29.186906 166532 main.go:141] libmachine: (old-k8s-version-517711) </console>
I0203 11:41:29.186912 166532 main.go:141] libmachine: (old-k8s-version-517711) <rng model='virtio'>
I0203 11:41:29.186924 166532 main.go:141] libmachine: (old-k8s-version-517711) <backend model='random'>/dev/random</backend>
I0203 11:41:29.186937 166532 main.go:141] libmachine: (old-k8s-version-517711) </rng>
I0203 11:41:29.186944 166532 main.go:141] libmachine: (old-k8s-version-517711)
I0203 11:41:29.186954 166532 main.go:141] libmachine: (old-k8s-version-517711)
I0203 11:41:29.186961 166532 main.go:141] libmachine: (old-k8s-version-517711) </devices>
I0203 11:41:29.186967 166532 main.go:141] libmachine: (old-k8s-version-517711) </domain>
I0203 11:41:29.186978 166532 main.go:141] libmachine: (old-k8s-version-517711)
I0203 11:41:29.192539 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | domain old-k8s-version-517711 has defined MAC address 52:54:00:6c:98:20 in network default
I0203 11:41:29.193289 166532 main.go:141] libmachine: (old-k8s-version-517711) starting domain...
I0203 11:41:29.193323 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | domain old-k8s-version-517711 has defined MAC address 52:54:00:e5:0b:11 in network mk-old-k8s-version-517711
I0203 11:41:29.193332 166532 main.go:141] libmachine: (old-k8s-version-517711) ensuring networks are active...
I0203 11:41:29.194158 166532 main.go:141] libmachine: (old-k8s-version-517711) Ensuring network default is active
I0203 11:41:29.194566 166532 main.go:141] libmachine: (old-k8s-version-517711) Ensuring network mk-old-k8s-version-517711 is active
I0203 11:41:29.195252 166532 main.go:141] libmachine: (old-k8s-version-517711) getting domain XML...
I0203 11:41:29.196192 166532 main.go:141] libmachine: (old-k8s-version-517711) creating domain...
I0203 11:41:30.595230 166532 main.go:141] libmachine: (old-k8s-version-517711) waiting for IP...
I0203 11:41:30.596211 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | domain old-k8s-version-517711 has defined MAC address 52:54:00:e5:0b:11 in network mk-old-k8s-version-517711
I0203 11:41:30.596769 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | unable to find current IP address of domain old-k8s-version-517711 in network mk-old-k8s-version-517711
I0203 11:41:30.596848 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | I0203 11:41:30.596797 166585 retry.go:31] will retry after 188.638955ms: waiting for domain to come up
I0203 11:41:30.787921 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | domain old-k8s-version-517711 has defined MAC address 52:54:00:e5:0b:11 in network mk-old-k8s-version-517711
I0203 11:41:30.788690 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | unable to find current IP address of domain old-k8s-version-517711 in network mk-old-k8s-version-517711
I0203 11:41:30.788725 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | I0203 11:41:30.788648 166585 retry.go:31] will retry after 299.90555ms: waiting for domain to come up
I0203 11:41:31.090527 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | domain old-k8s-version-517711 has defined MAC address 52:54:00:e5:0b:11 in network mk-old-k8s-version-517711
I0203 11:41:31.091045 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | unable to find current IP address of domain old-k8s-version-517711 in network mk-old-k8s-version-517711
I0203 11:41:31.091072 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | I0203 11:41:31.090995 166585 retry.go:31] will retry after 395.922052ms: waiting for domain to come up
I0203 11:41:31.488852 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | domain old-k8s-version-517711 has defined MAC address 52:54:00:e5:0b:11 in network mk-old-k8s-version-517711
I0203 11:41:31.489818 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | unable to find current IP address of domain old-k8s-version-517711 in network mk-old-k8s-version-517711
I0203 11:41:31.489876 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | I0203 11:41:31.489800 166585 retry.go:31] will retry after 578.898423ms: waiting for domain to come up
I0203 11:41:32.070941 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | domain old-k8s-version-517711 has defined MAC address 52:54:00:e5:0b:11 in network mk-old-k8s-version-517711
I0203 11:41:32.071608 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | unable to find current IP address of domain old-k8s-version-517711 in network mk-old-k8s-version-517711
I0203 11:41:32.071631 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | I0203 11:41:32.071574 166585 retry.go:31] will retry after 706.5192ms: waiting for domain to come up
I0203 11:41:32.780456 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | domain old-k8s-version-517711 has defined MAC address 52:54:00:e5:0b:11 in network mk-old-k8s-version-517711
I0203 11:41:32.781091 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | unable to find current IP address of domain old-k8s-version-517711 in network mk-old-k8s-version-517711
I0203 11:41:32.781123 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | I0203 11:41:32.781057 166585 retry.go:31] will retry after 804.047535ms: waiting for domain to come up
I0203 11:41:33.587298 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | domain old-k8s-version-517711 has defined MAC address 52:54:00:e5:0b:11 in network mk-old-k8s-version-517711
I0203 11:41:33.587844 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | unable to find current IP address of domain old-k8s-version-517711 in network mk-old-k8s-version-517711
I0203 11:41:33.587875 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | I0203 11:41:33.587807 166585 retry.go:31] will retry after 912.319933ms: waiting for domain to come up
I0203 11:41:34.501523 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | domain old-k8s-version-517711 has defined MAC address 52:54:00:e5:0b:11 in network mk-old-k8s-version-517711
I0203 11:41:34.502119 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | unable to find current IP address of domain old-k8s-version-517711 in network mk-old-k8s-version-517711
I0203 11:41:34.502147 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | I0203 11:41:34.502104 166585 retry.go:31] will retry after 1.13391392s: waiting for domain to come up
I0203 11:41:35.637314 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | domain old-k8s-version-517711 has defined MAC address 52:54:00:e5:0b:11 in network mk-old-k8s-version-517711
I0203 11:41:35.637847 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | unable to find current IP address of domain old-k8s-version-517711 in network mk-old-k8s-version-517711
I0203 11:41:35.637912 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | I0203 11:41:35.637837 166585 retry.go:31] will retry after 1.13199998s: waiting for domain to come up
I0203 11:41:36.771306 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | domain old-k8s-version-517711 has defined MAC address 52:54:00:e5:0b:11 in network mk-old-k8s-version-517711
I0203 11:41:36.771759 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | unable to find current IP address of domain old-k8s-version-517711 in network mk-old-k8s-version-517711
I0203 11:41:36.771814 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | I0203 11:41:36.771739 166585 retry.go:31] will retry after 1.632808893s: waiting for domain to come up
I0203 11:41:38.405840 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | domain old-k8s-version-517711 has defined MAC address 52:54:00:e5:0b:11 in network mk-old-k8s-version-517711
I0203 11:41:38.406394 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | unable to find current IP address of domain old-k8s-version-517711 in network mk-old-k8s-version-517711
I0203 11:41:38.406424 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | I0203 11:41:38.406354 166585 retry.go:31] will retry after 2.223756189s: waiting for domain to come up
I0203 11:41:40.632375 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | domain old-k8s-version-517711 has defined MAC address 52:54:00:e5:0b:11 in network mk-old-k8s-version-517711
I0203 11:41:40.633012 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | unable to find current IP address of domain old-k8s-version-517711 in network mk-old-k8s-version-517711
I0203 11:41:40.633048 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | I0203 11:41:40.632945 166585 retry.go:31] will retry after 2.448781389s: waiting for domain to come up
I0203 11:41:43.083253 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | domain old-k8s-version-517711 has defined MAC address 52:54:00:e5:0b:11 in network mk-old-k8s-version-517711
I0203 11:41:43.083826 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | unable to find current IP address of domain old-k8s-version-517711 in network mk-old-k8s-version-517711
I0203 11:41:43.083849 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | I0203 11:41:43.083793 166585 retry.go:31] will retry after 3.15170325s: waiting for domain to come up
I0203 11:41:46.239090 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | domain old-k8s-version-517711 has defined MAC address 52:54:00:e5:0b:11 in network mk-old-k8s-version-517711
I0203 11:41:46.239554 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | unable to find current IP address of domain old-k8s-version-517711 in network mk-old-k8s-version-517711
I0203 11:41:46.239600 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | I0203 11:41:46.239527 166585 retry.go:31] will retry after 4.456059482s: waiting for domain to come up
I0203 11:41:50.697566 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | domain old-k8s-version-517711 has defined MAC address 52:54:00:e5:0b:11 in network mk-old-k8s-version-517711
I0203 11:41:50.698116 166532 main.go:141] libmachine: (old-k8s-version-517711) found domain IP: 192.168.61.203
I0203 11:41:50.698153 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | domain old-k8s-version-517711 has current primary IP address 192.168.61.203 and MAC address 52:54:00:e5:0b:11 in network mk-old-k8s-version-517711
I0203 11:41:50.698163 166532 main.go:141] libmachine: (old-k8s-version-517711) reserving static IP address...
I0203 11:41:50.698536 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-517711", mac: "52:54:00:e5:0b:11", ip: "192.168.61.203"} in network mk-old-k8s-version-517711
I0203 11:41:50.787671 166532 main.go:141] libmachine: (old-k8s-version-517711) reserved static IP address 192.168.61.203 for domain old-k8s-version-517711
I0203 11:41:50.787702 166532 main.go:141] libmachine: (old-k8s-version-517711) waiting for SSH...
I0203 11:41:50.787713 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | Getting to WaitForSSH function...
I0203 11:41:50.791019 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | domain old-k8s-version-517711 has defined MAC address 52:54:00:e5:0b:11 in network mk-old-k8s-version-517711
I0203 11:41:50.791593 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e5:0b:11", ip: ""} in network mk-old-k8s-version-517711: {Iface:virbr1 ExpiryTime:2025-02-03 12:41:45 +0000 UTC Type:0 Mac:52:54:00:e5:0b:11 Iaid: IPaddr:192.168.61.203 Prefix:24 Hostname:minikube Clientid:01:52:54:00:e5:0b:11}
I0203 11:41:50.791620 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | domain old-k8s-version-517711 has defined IP address 192.168.61.203 and MAC address 52:54:00:e5:0b:11 in network mk-old-k8s-version-517711
I0203 11:41:50.792115 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | Using SSH client type: external
I0203 11:41:50.792145 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | Using SSH private key: /home/jenkins/minikube-integration/20354-109432/.minikube/machines/old-k8s-version-517711/id_rsa (-rw-------)
I0203 11:41:50.792184 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.61.203 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/20354-109432/.minikube/machines/old-k8s-version-517711/id_rsa -p 22] /usr/bin/ssh <nil>}
I0203 11:41:50.792203 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | About to run SSH command:
I0203 11:41:50.792216 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | exit 0
I0203 11:41:50.935020 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | SSH cmd err, output: <nil>:
I0203 11:41:50.935352 166532 main.go:141] libmachine: (old-k8s-version-517711) KVM machine creation complete
I0203 11:41:50.935663 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetConfigRaw
I0203 11:41:50.936278 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .DriverName
I0203 11:41:50.936508 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .DriverName
I0203 11:41:50.936670 166532 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0203 11:41:50.936687 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetState
I0203 11:41:50.938468 166532 main.go:141] libmachine: Detecting operating system of created instance...
I0203 11:41:50.938486 166532 main.go:141] libmachine: Waiting for SSH to be available...
I0203 11:41:50.938494 166532 main.go:141] libmachine: Getting to WaitForSSH function...
I0203 11:41:50.938502 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetSSHHostname
I0203 11:41:50.941576 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | domain old-k8s-version-517711 has defined MAC address 52:54:00:e5:0b:11 in network mk-old-k8s-version-517711
I0203 11:41:50.942081 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e5:0b:11", ip: ""} in network mk-old-k8s-version-517711: {Iface:virbr1 ExpiryTime:2025-02-03 12:41:45 +0000 UTC Type:0 Mac:52:54:00:e5:0b:11 Iaid: IPaddr:192.168.61.203 Prefix:24 Hostname:old-k8s-version-517711 Clientid:01:52:54:00:e5:0b:11}
I0203 11:41:50.942114 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | domain old-k8s-version-517711 has defined IP address 192.168.61.203 and MAC address 52:54:00:e5:0b:11 in network mk-old-k8s-version-517711
I0203 11:41:50.942291 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetSSHPort
I0203 11:41:50.942474 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetSSHKeyPath
I0203 11:41:50.942654 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetSSHKeyPath
I0203 11:41:50.942850 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetSSHUsername
I0203 11:41:50.943044 166532 main.go:141] libmachine: Using SSH client type: native
I0203 11:41:50.943394 166532 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.61.203 22 <nil> <nil>}
I0203 11:41:50.943415 166532 main.go:141] libmachine: About to run SSH command:
exit 0
I0203 11:41:51.057468 166532 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0203 11:41:51.057500 166532 main.go:141] libmachine: Detecting the provisioner...
I0203 11:41:51.057511 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetSSHHostname
I0203 11:41:51.061168 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | domain old-k8s-version-517711 has defined MAC address 52:54:00:e5:0b:11 in network mk-old-k8s-version-517711
I0203 11:41:51.061614 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e5:0b:11", ip: ""} in network mk-old-k8s-version-517711: {Iface:virbr1 ExpiryTime:2025-02-03 12:41:45 +0000 UTC Type:0 Mac:52:54:00:e5:0b:11 Iaid: IPaddr:192.168.61.203 Prefix:24 Hostname:old-k8s-version-517711 Clientid:01:52:54:00:e5:0b:11}
I0203 11:41:51.061645 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | domain old-k8s-version-517711 has defined IP address 192.168.61.203 and MAC address 52:54:00:e5:0b:11 in network mk-old-k8s-version-517711
I0203 11:41:51.061816 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetSSHPort
I0203 11:41:51.062035 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetSSHKeyPath
I0203 11:41:51.062225 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetSSHKeyPath
I0203 11:41:51.062426 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetSSHUsername
I0203 11:41:51.062635 166532 main.go:141] libmachine: Using SSH client type: native
I0203 11:41:51.062864 166532 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.61.203 22 <nil> <nil>}
I0203 11:41:51.062878 166532 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0203 11:41:51.175950 166532 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0203 11:41:51.176027 166532 main.go:141] libmachine: found compatible host: buildroot
I0203 11:41:51.176039 166532 main.go:141] libmachine: Provisioning with buildroot...
I0203 11:41:51.176050 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetMachineName
I0203 11:41:51.176327 166532 buildroot.go:166] provisioning hostname "old-k8s-version-517711"
I0203 11:41:51.176353 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetMachineName
I0203 11:41:51.176552 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetSSHHostname
I0203 11:41:51.180114 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | domain old-k8s-version-517711 has defined MAC address 52:54:00:e5:0b:11 in network mk-old-k8s-version-517711
I0203 11:41:51.180725 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e5:0b:11", ip: ""} in network mk-old-k8s-version-517711: {Iface:virbr1 ExpiryTime:2025-02-03 12:41:45 +0000 UTC Type:0 Mac:52:54:00:e5:0b:11 Iaid: IPaddr:192.168.61.203 Prefix:24 Hostname:old-k8s-version-517711 Clientid:01:52:54:00:e5:0b:11}
I0203 11:41:51.180763 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | domain old-k8s-version-517711 has defined IP address 192.168.61.203 and MAC address 52:54:00:e5:0b:11 in network mk-old-k8s-version-517711
I0203 11:41:51.181131 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetSSHPort
I0203 11:41:51.181378 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetSSHKeyPath
I0203 11:41:51.181559 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetSSHKeyPath
I0203 11:41:51.181729 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetSSHUsername
I0203 11:41:51.181892 166532 main.go:141] libmachine: Using SSH client type: native
I0203 11:41:51.182125 166532 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.61.203 22 <nil> <nil>}
I0203 11:41:51.182145 166532 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-517711 && echo "old-k8s-version-517711" | sudo tee /etc/hostname
I0203 11:41:51.325226 166532 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-517711
I0203 11:41:51.325271 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetSSHHostname
I0203 11:41:51.333412 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | domain old-k8s-version-517711 has defined MAC address 52:54:00:e5:0b:11 in network mk-old-k8s-version-517711
I0203 11:41:51.333973 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e5:0b:11", ip: ""} in network mk-old-k8s-version-517711: {Iface:virbr1 ExpiryTime:2025-02-03 12:41:45 +0000 UTC Type:0 Mac:52:54:00:e5:0b:11 Iaid: IPaddr:192.168.61.203 Prefix:24 Hostname:old-k8s-version-517711 Clientid:01:52:54:00:e5:0b:11}
I0203 11:41:51.334017 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | domain old-k8s-version-517711 has defined IP address 192.168.61.203 and MAC address 52:54:00:e5:0b:11 in network mk-old-k8s-version-517711
I0203 11:41:51.334398 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetSSHPort
I0203 11:41:51.334576 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetSSHKeyPath
I0203 11:41:51.334715 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetSSHKeyPath
I0203 11:41:51.334841 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetSSHUsername
I0203 11:41:51.335087 166532 main.go:141] libmachine: Using SSH client type: native
I0203 11:41:51.335340 166532 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.61.203 22 <nil> <nil>}
I0203 11:41:51.335362 166532 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-517711' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-517711/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-517711' | sudo tee -a /etc/hosts;
fi
fi
I0203 11:41:51.492919 166532 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0203 11:41:51.492951 166532 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/20354-109432/.minikube CaCertPath:/home/jenkins/minikube-integration/20354-109432/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20354-109432/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20354-109432/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20354-109432/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20354-109432/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20354-109432/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20354-109432/.minikube}
I0203 11:41:51.492973 166532 buildroot.go:174] setting up certificates
I0203 11:41:51.492986 166532 provision.go:84] configureAuth start
I0203 11:41:51.492997 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetMachineName
I0203 11:41:51.493394 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetIP
I0203 11:41:51.497618 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | domain old-k8s-version-517711 has defined MAC address 52:54:00:e5:0b:11 in network mk-old-k8s-version-517711
I0203 11:41:51.498261 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e5:0b:11", ip: ""} in network mk-old-k8s-version-517711: {Iface:virbr1 ExpiryTime:2025-02-03 12:41:45 +0000 UTC Type:0 Mac:52:54:00:e5:0b:11 Iaid: IPaddr:192.168.61.203 Prefix:24 Hostname:old-k8s-version-517711 Clientid:01:52:54:00:e5:0b:11}
I0203 11:41:51.498286 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | domain old-k8s-version-517711 has defined IP address 192.168.61.203 and MAC address 52:54:00:e5:0b:11 in network mk-old-k8s-version-517711
I0203 11:41:51.498525 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetSSHHostname
I0203 11:41:51.502113 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | domain old-k8s-version-517711 has defined MAC address 52:54:00:e5:0b:11 in network mk-old-k8s-version-517711
I0203 11:41:51.502658 166532 provision.go:143] copyHostCerts
I0203 11:41:51.502720 166532 exec_runner.go:144] found /home/jenkins/minikube-integration/20354-109432/.minikube/ca.pem, removing ...
I0203 11:41:51.502738 166532 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20354-109432/.minikube/ca.pem
I0203 11:41:51.502817 166532 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20354-109432/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20354-109432/.minikube/ca.pem (1078 bytes)
I0203 11:41:51.502955 166532 exec_runner.go:144] found /home/jenkins/minikube-integration/20354-109432/.minikube/cert.pem, removing ...
I0203 11:41:51.502963 166532 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20354-109432/.minikube/cert.pem
I0203 11:41:51.502991 166532 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20354-109432/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20354-109432/.minikube/cert.pem (1123 bytes)
I0203 11:41:51.503058 166532 exec_runner.go:144] found /home/jenkins/minikube-integration/20354-109432/.minikube/key.pem, removing ...
I0203 11:41:51.503064 166532 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20354-109432/.minikube/key.pem
I0203 11:41:51.503087 166532 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20354-109432/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20354-109432/.minikube/key.pem (1679 bytes)
I0203 11:41:51.503146 166532 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20354-109432/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20354-109432/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20354-109432/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-517711 san=[127.0.0.1 192.168.61.203 localhost minikube old-k8s-version-517711]
I0203 11:41:51.506104 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e5:0b:11", ip: ""} in network mk-old-k8s-version-517711: {Iface:virbr1 ExpiryTime:2025-02-03 12:41:45 +0000 UTC Type:0 Mac:52:54:00:e5:0b:11 Iaid: IPaddr:192.168.61.203 Prefix:24 Hostname:old-k8s-version-517711 Clientid:01:52:54:00:e5:0b:11}
I0203 11:41:51.506130 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | domain old-k8s-version-517711 has defined IP address 192.168.61.203 and MAC address 52:54:00:e5:0b:11 in network mk-old-k8s-version-517711
I0203 11:41:51.611916 166532 provision.go:177] copyRemoteCerts
I0203 11:41:51.612046 166532 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0203 11:41:51.612104 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetSSHHostname
I0203 11:41:51.615736 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | domain old-k8s-version-517711 has defined MAC address 52:54:00:e5:0b:11 in network mk-old-k8s-version-517711
I0203 11:41:51.616487 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e5:0b:11", ip: ""} in network mk-old-k8s-version-517711: {Iface:virbr1 ExpiryTime:2025-02-03 12:41:45 +0000 UTC Type:0 Mac:52:54:00:e5:0b:11 Iaid: IPaddr:192.168.61.203 Prefix:24 Hostname:old-k8s-version-517711 Clientid:01:52:54:00:e5:0b:11}
I0203 11:41:51.616547 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | domain old-k8s-version-517711 has defined IP address 192.168.61.203 and MAC address 52:54:00:e5:0b:11 in network mk-old-k8s-version-517711
I0203 11:41:51.617136 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetSSHPort
I0203 11:41:51.617333 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetSSHKeyPath
I0203 11:41:51.617434 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetSSHUsername
I0203 11:41:51.617586 166532 sshutil.go:53] new ssh client: &{IP:192.168.61.203 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20354-109432/.minikube/machines/old-k8s-version-517711/id_rsa Username:docker}
I0203 11:41:51.720953 166532 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20354-109432/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0203 11:41:51.758701 166532 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20354-109432/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0203 11:41:51.788747 166532 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20354-109432/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0203 11:41:51.821617 166532 provision.go:87] duration metric: took 328.614256ms to configureAuth
I0203 11:41:51.821653 166532 buildroot.go:189] setting minikube options for container-runtime
I0203 11:41:51.821903 166532 config.go:182] Loaded profile config "old-k8s-version-517711": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0203 11:41:51.822038 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetSSHHostname
I0203 11:41:51.825460 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | domain old-k8s-version-517711 has defined MAC address 52:54:00:e5:0b:11 in network mk-old-k8s-version-517711
I0203 11:41:51.825990 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e5:0b:11", ip: ""} in network mk-old-k8s-version-517711: {Iface:virbr1 ExpiryTime:2025-02-03 12:41:45 +0000 UTC Type:0 Mac:52:54:00:e5:0b:11 Iaid: IPaddr:192.168.61.203 Prefix:24 Hostname:old-k8s-version-517711 Clientid:01:52:54:00:e5:0b:11}
I0203 11:41:51.826055 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | domain old-k8s-version-517711 has defined IP address 192.168.61.203 and MAC address 52:54:00:e5:0b:11 in network mk-old-k8s-version-517711
I0203 11:41:51.826310 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetSSHPort
I0203 11:41:51.826519 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetSSHKeyPath
I0203 11:41:51.826675 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetSSHKeyPath
I0203 11:41:51.826836 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetSSHUsername
I0203 11:41:51.827067 166532 main.go:141] libmachine: Using SSH client type: native
I0203 11:41:51.827295 166532 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.61.203 22 <nil> <nil>}
I0203 11:41:51.827320 166532 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0203 11:41:52.213361 166532 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0203 11:41:52.213393 166532 main.go:141] libmachine: Checking connection to Docker...
I0203 11:41:52.213405 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetURL
I0203 11:41:52.214656 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | using libvirt version 6000000
I0203 11:41:52.217196 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | domain old-k8s-version-517711 has defined MAC address 52:54:00:e5:0b:11 in network mk-old-k8s-version-517711
I0203 11:41:52.217603 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e5:0b:11", ip: ""} in network mk-old-k8s-version-517711: {Iface:virbr1 ExpiryTime:2025-02-03 12:41:45 +0000 UTC Type:0 Mac:52:54:00:e5:0b:11 Iaid: IPaddr:192.168.61.203 Prefix:24 Hostname:old-k8s-version-517711 Clientid:01:52:54:00:e5:0b:11}
I0203 11:41:52.217628 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | domain old-k8s-version-517711 has defined IP address 192.168.61.203 and MAC address 52:54:00:e5:0b:11 in network mk-old-k8s-version-517711
I0203 11:41:52.217817 166532 main.go:141] libmachine: Docker is up and running!
I0203 11:41:52.217832 166532 main.go:141] libmachine: Reticulating splines...
I0203 11:41:52.217841 166532 client.go:171] duration metric: took 23.602489665s to LocalClient.Create
I0203 11:41:52.217869 166532 start.go:167] duration metric: took 23.602554071s to libmachine.API.Create "old-k8s-version-517711"
I0203 11:41:52.217883 166532 start.go:293] postStartSetup for "old-k8s-version-517711" (driver="kvm2")
I0203 11:41:52.217899 166532 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0203 11:41:52.217924 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .DriverName
I0203 11:41:52.218172 166532 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0203 11:41:52.218205 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetSSHHostname
I0203 11:41:52.220785 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | domain old-k8s-version-517711 has defined MAC address 52:54:00:e5:0b:11 in network mk-old-k8s-version-517711
I0203 11:41:52.221147 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e5:0b:11", ip: ""} in network mk-old-k8s-version-517711: {Iface:virbr1 ExpiryTime:2025-02-03 12:41:45 +0000 UTC Type:0 Mac:52:54:00:e5:0b:11 Iaid: IPaddr:192.168.61.203 Prefix:24 Hostname:old-k8s-version-517711 Clientid:01:52:54:00:e5:0b:11}
I0203 11:41:52.221179 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | domain old-k8s-version-517711 has defined IP address 192.168.61.203 and MAC address 52:54:00:e5:0b:11 in network mk-old-k8s-version-517711
I0203 11:41:52.221331 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetSSHPort
I0203 11:41:52.221547 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetSSHKeyPath
I0203 11:41:52.221722 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetSSHUsername
I0203 11:41:52.221890 166532 sshutil.go:53] new ssh client: &{IP:192.168.61.203 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20354-109432/.minikube/machines/old-k8s-version-517711/id_rsa Username:docker}
I0203 11:41:52.304589 166532 ssh_runner.go:195] Run: cat /etc/os-release
I0203 11:41:52.309039 166532 info.go:137] Remote host: Buildroot 2023.02.9
I0203 11:41:52.309073 166532 filesync.go:126] Scanning /home/jenkins/minikube-integration/20354-109432/.minikube/addons for local assets ...
I0203 11:41:52.309158 166532 filesync.go:126] Scanning /home/jenkins/minikube-integration/20354-109432/.minikube/files for local assets ...
I0203 11:41:52.309286 166532 filesync.go:149] local asset: /home/jenkins/minikube-integration/20354-109432/.minikube/files/etc/ssl/certs/1166062.pem -> 1166062.pem in /etc/ssl/certs
I0203 11:41:52.309417 166532 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0203 11:41:52.322326 166532 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20354-109432/.minikube/files/etc/ssl/certs/1166062.pem --> /etc/ssl/certs/1166062.pem (1708 bytes)
I0203 11:41:52.352314 166532 start.go:296] duration metric: took 134.411542ms for postStartSetup
I0203 11:41:52.352373 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetConfigRaw
I0203 11:41:52.353063 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetIP
I0203 11:41:52.356044 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | domain old-k8s-version-517711 has defined MAC address 52:54:00:e5:0b:11 in network mk-old-k8s-version-517711
I0203 11:41:52.356419 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e5:0b:11", ip: ""} in network mk-old-k8s-version-517711: {Iface:virbr1 ExpiryTime:2025-02-03 12:41:45 +0000 UTC Type:0 Mac:52:54:00:e5:0b:11 Iaid: IPaddr:192.168.61.203 Prefix:24 Hostname:old-k8s-version-517711 Clientid:01:52:54:00:e5:0b:11}
I0203 11:41:52.356452 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | domain old-k8s-version-517711 has defined IP address 192.168.61.203 and MAC address 52:54:00:e5:0b:11 in network mk-old-k8s-version-517711
I0203 11:41:52.356710 166532 profile.go:143] Saving config to /home/jenkins/minikube-integration/20354-109432/.minikube/profiles/old-k8s-version-517711/config.json ...
I0203 11:41:52.356961 166532 start.go:128] duration metric: took 23.765906676s to createHost
I0203 11:41:52.356997 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetSSHHostname
I0203 11:41:52.359267 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | domain old-k8s-version-517711 has defined MAC address 52:54:00:e5:0b:11 in network mk-old-k8s-version-517711
I0203 11:41:52.359588 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e5:0b:11", ip: ""} in network mk-old-k8s-version-517711: {Iface:virbr1 ExpiryTime:2025-02-03 12:41:45 +0000 UTC Type:0 Mac:52:54:00:e5:0b:11 Iaid: IPaddr:192.168.61.203 Prefix:24 Hostname:old-k8s-version-517711 Clientid:01:52:54:00:e5:0b:11}
I0203 11:41:52.359616 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | domain old-k8s-version-517711 has defined IP address 192.168.61.203 and MAC address 52:54:00:e5:0b:11 in network mk-old-k8s-version-517711
I0203 11:41:52.359783 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetSSHPort
I0203 11:41:52.359947 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetSSHKeyPath
I0203 11:41:52.360140 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetSSHKeyPath
I0203 11:41:52.360309 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetSSHUsername
I0203 11:41:52.360483 166532 main.go:141] libmachine: Using SSH client type: native
I0203 11:41:52.360702 166532 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.61.203 22 <nil> <nil>}
I0203 11:41:52.360714 166532 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0203 11:41:52.466526 166532 main.go:141] libmachine: SSH cmd err, output: <nil>: 1738582912.434953751
I0203 11:41:52.466555 166532 fix.go:216] guest clock: 1738582912.434953751
I0203 11:41:52.466562 166532 fix.go:229] Guest: 2025-02-03 11:41:52.434953751 +0000 UTC Remote: 2025-02-03 11:41:52.356980595 +0000 UTC m=+25.529203955 (delta=77.973156ms)
I0203 11:41:52.466619 166532 fix.go:200] guest clock delta is within tolerance: 77.973156ms
I0203 11:41:52.466627 166532 start.go:83] releasing machines lock for "old-k8s-version-517711", held for 23.875727284s
I0203 11:41:52.466660 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .DriverName
I0203 11:41:52.466943 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetIP
I0203 11:41:52.469890 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | domain old-k8s-version-517711 has defined MAC address 52:54:00:e5:0b:11 in network mk-old-k8s-version-517711
I0203 11:41:52.470275 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e5:0b:11", ip: ""} in network mk-old-k8s-version-517711: {Iface:virbr1 ExpiryTime:2025-02-03 12:41:45 +0000 UTC Type:0 Mac:52:54:00:e5:0b:11 Iaid: IPaddr:192.168.61.203 Prefix:24 Hostname:old-k8s-version-517711 Clientid:01:52:54:00:e5:0b:11}
I0203 11:41:52.470307 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | domain old-k8s-version-517711 has defined IP address 192.168.61.203 and MAC address 52:54:00:e5:0b:11 in network mk-old-k8s-version-517711
I0203 11:41:52.470511 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .DriverName
I0203 11:41:52.470984 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .DriverName
I0203 11:41:52.471191 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .DriverName
I0203 11:41:52.471272 166532 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0203 11:41:52.471320 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetSSHHostname
I0203 11:41:52.471424 166532 ssh_runner.go:195] Run: cat /version.json
I0203 11:41:52.471453 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetSSHHostname
I0203 11:41:52.474250 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | domain old-k8s-version-517711 has defined MAC address 52:54:00:e5:0b:11 in network mk-old-k8s-version-517711
I0203 11:41:52.474540 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | domain old-k8s-version-517711 has defined MAC address 52:54:00:e5:0b:11 in network mk-old-k8s-version-517711
I0203 11:41:52.474633 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e5:0b:11", ip: ""} in network mk-old-k8s-version-517711: {Iface:virbr1 ExpiryTime:2025-02-03 12:41:45 +0000 UTC Type:0 Mac:52:54:00:e5:0b:11 Iaid: IPaddr:192.168.61.203 Prefix:24 Hostname:old-k8s-version-517711 Clientid:01:52:54:00:e5:0b:11}
I0203 11:41:52.474665 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | domain old-k8s-version-517711 has defined IP address 192.168.61.203 and MAC address 52:54:00:e5:0b:11 in network mk-old-k8s-version-517711
I0203 11:41:52.474822 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetSSHPort
I0203 11:41:52.474941 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e5:0b:11", ip: ""} in network mk-old-k8s-version-517711: {Iface:virbr1 ExpiryTime:2025-02-03 12:41:45 +0000 UTC Type:0 Mac:52:54:00:e5:0b:11 Iaid: IPaddr:192.168.61.203 Prefix:24 Hostname:old-k8s-version-517711 Clientid:01:52:54:00:e5:0b:11}
I0203 11:41:52.474987 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | domain old-k8s-version-517711 has defined IP address 192.168.61.203 and MAC address 52:54:00:e5:0b:11 in network mk-old-k8s-version-517711
I0203 11:41:52.474993 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetSSHKeyPath
I0203 11:41:52.475113 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetSSHPort
I0203 11:41:52.475158 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetSSHUsername
I0203 11:41:52.475311 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetSSHKeyPath
I0203 11:41:52.475308 166532 sshutil.go:53] new ssh client: &{IP:192.168.61.203 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20354-109432/.minikube/machines/old-k8s-version-517711/id_rsa Username:docker}
I0203 11:41:52.475468 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetSSHUsername
I0203 11:41:52.475614 166532 sshutil.go:53] new ssh client: &{IP:192.168.61.203 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20354-109432/.minikube/machines/old-k8s-version-517711/id_rsa Username:docker}
I0203 11:41:52.582776 166532 ssh_runner.go:195] Run: systemctl --version
I0203 11:41:52.589179 166532 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0203 11:41:52.751534 166532 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0203 11:41:52.757419 166532 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0203 11:41:52.757502 166532 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0203 11:41:52.773261 166532 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0203 11:41:52.773286 166532 start.go:495] detecting cgroup driver to use...
I0203 11:41:52.773346 166532 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0203 11:41:52.794698 166532 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0203 11:41:52.809443 166532 docker.go:217] disabling cri-docker service (if available) ...
I0203 11:41:52.809503 166532 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0203 11:41:52.825339 166532 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0203 11:41:52.839131 166532 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0203 11:41:52.962949 166532 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0203 11:41:53.122020 166532 docker.go:233] disabling docker service ...
I0203 11:41:53.122100 166532 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0203 11:41:53.138614 166532 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0203 11:41:53.152548 166532 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0203 11:41:53.308012 166532 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0203 11:41:53.430822 166532 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0203 11:41:53.445542 166532 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0203 11:41:53.463493 166532 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0203 11:41:53.463573 166532 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0203 11:41:53.473516 166532 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0203 11:41:53.473578 166532 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0203 11:41:53.483021 166532 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0203 11:41:53.493158 166532 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0203 11:41:53.503758 166532 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0203 11:41:53.513631 166532 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0203 11:41:53.522154 166532 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0203 11:41:53.522212 166532 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0203 11:41:53.534949 166532 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0203 11:41:53.545018 166532 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0203 11:41:53.663201 166532 ssh_runner.go:195] Run: sudo systemctl restart crio
I0203 11:41:53.759899 166532 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0203 11:41:53.759984 166532 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0203 11:41:53.764700 166532 start.go:563] Will wait 60s for crictl version
I0203 11:41:53.764769 166532 ssh_runner.go:195] Run: which crictl
I0203 11:41:53.768852 166532 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0203 11:41:53.814326 166532 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0203 11:41:53.814415 166532 ssh_runner.go:195] Run: crio --version
I0203 11:41:53.842121 166532 ssh_runner.go:195] Run: crio --version
I0203 11:41:53.877425 166532 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0203 11:41:53.878483 166532 main.go:141] libmachine: (old-k8s-version-517711) Calling .GetIP
I0203 11:41:53.882158 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | domain old-k8s-version-517711 has defined MAC address 52:54:00:e5:0b:11 in network mk-old-k8s-version-517711
I0203 11:41:53.882663 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e5:0b:11", ip: ""} in network mk-old-k8s-version-517711: {Iface:virbr1 ExpiryTime:2025-02-03 12:41:45 +0000 UTC Type:0 Mac:52:54:00:e5:0b:11 Iaid: IPaddr:192.168.61.203 Prefix:24 Hostname:old-k8s-version-517711 Clientid:01:52:54:00:e5:0b:11}
I0203 11:41:53.882702 166532 main.go:141] libmachine: (old-k8s-version-517711) DBG | domain old-k8s-version-517711 has defined IP address 192.168.61.203 and MAC address 52:54:00:e5:0b:11 in network mk-old-k8s-version-517711
I0203 11:41:53.883024 166532 ssh_runner.go:195] Run: grep 192.168.61.1 host.minikube.internal$ /etc/hosts
I0203 11:41:53.887263 166532 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.61.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0203 11:41:53.901959 166532 kubeadm.go:883] updating cluster {Name:old-k8s-version-517711 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-517711 Namespace
:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.203 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror:
DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0203 11:41:53.902093 166532 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0203 11:41:53.902145 166532 ssh_runner.go:195] Run: sudo crictl images --output json
I0203 11:41:53.938784 166532 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0203 11:41:53.938854 166532 ssh_runner.go:195] Run: which lz4
I0203 11:41:53.942921 166532 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0203 11:41:53.947002 166532 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0203 11:41:53.947035 166532 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20354-109432/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0203 11:41:55.486187 166532 crio.go:462] duration metric: took 1.543289845s to copy over tarball
I0203 11:41:55.486279 166532 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0203 11:41:58.167026 166532 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.680719666s)
I0203 11:41:58.167055 166532 crio.go:469] duration metric: took 2.680831152s to extract the tarball
I0203 11:41:58.167063 166532 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0203 11:41:58.212320 166532 ssh_runner.go:195] Run: sudo crictl images --output json
I0203 11:41:58.258405 166532 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0203 11:41:58.258446 166532 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0203 11:41:58.258574 166532 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0203 11:41:58.258625 166532 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I0203 11:41:58.258627 166532 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0203 11:41:58.258586 166532 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0203 11:41:58.258683 166532 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I0203 11:41:58.258718 166532 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0203 11:41:58.258602 166532 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0203 11:41:58.258762 166532 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0203 11:41:58.260587 166532 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0203 11:41:58.260598 166532 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0203 11:41:58.260617 166532 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0203 11:41:58.260619 166532 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0203 11:41:58.260587 166532 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0203 11:41:58.260707 166532 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0203 11:41:58.260704 166532 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0203 11:41:58.260999 166532 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0203 11:41:58.421589 166532 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0203 11:41:58.446311 166532 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0203 11:41:58.456462 166532 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0203 11:41:58.456640 166532 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0203 11:41:58.464451 166532 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0203 11:41:58.471399 166532 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0203 11:41:58.475976 166532 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0203 11:41:58.479998 166532 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0203 11:41:58.480048 166532 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0203 11:41:58.480088 166532 ssh_runner.go:195] Run: which crictl
I0203 11:41:58.534991 166532 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0203 11:41:58.535056 166532 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0203 11:41:58.535115 166532 ssh_runner.go:195] Run: which crictl
I0203 11:41:58.589082 166532 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0203 11:41:58.589135 166532 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0203 11:41:58.589197 166532 ssh_runner.go:195] Run: which crictl
I0203 11:41:58.589268 166532 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0203 11:41:58.589343 166532 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0203 11:41:58.589383 166532 ssh_runner.go:195] Run: which crictl
I0203 11:41:58.622330 166532 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0203 11:41:58.622381 166532 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0203 11:41:58.622420 166532 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0203 11:41:58.622446 166532 ssh_runner.go:195] Run: which crictl
I0203 11:41:58.622445 166532 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0203 11:41:58.622473 166532 ssh_runner.go:195] Run: which crictl
I0203 11:41:58.622498 166532 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0203 11:41:58.622525 166532 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0203 11:41:58.622541 166532 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0203 11:41:58.622563 166532 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0203 11:41:58.622587 166532 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0203 11:41:58.622605 166532 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0203 11:41:58.622591 166532 ssh_runner.go:195] Run: which crictl
I0203 11:41:58.639649 166532 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0203 11:41:58.731223 166532 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0203 11:41:58.731288 166532 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0203 11:41:58.731376 166532 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0203 11:41:58.731286 166532 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0203 11:41:58.731430 166532 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0203 11:41:58.731489 166532 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0203 11:41:58.754801 166532 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0203 11:41:58.888894 166532 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0203 11:41:58.888929 166532 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0203 11:41:58.888990 166532 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0203 11:41:58.889033 166532 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0203 11:41:58.889108 166532 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0203 11:41:58.889188 166532 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0203 11:41:58.902792 166532 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0203 11:41:59.037661 166532 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0203 11:41:59.037678 166532 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20354-109432/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0203 11:41:59.037721 166532 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20354-109432/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0203 11:41:59.043761 166532 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0203 11:41:59.043822 166532 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20354-109432/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0203 11:41:59.043872 166532 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20354-109432/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0203 11:41:59.043891 166532 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20354-109432/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0203 11:41:59.097064 166532 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20354-109432/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0203 11:41:59.101206 166532 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20354-109432/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0203 11:41:59.492709 166532 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0203 11:41:59.662626 166532 cache_images.go:92] duration metric: took 1.404155022s to LoadCachedImages
W0203 11:41:59.662734 166532 out.go:270] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20354-109432/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20354-109432/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0: no such file or directory
I0203 11:41:59.662754 166532 kubeadm.go:934] updating node { 192.168.61.203 8443 v1.20.0 crio true true} ...
I0203 11:41:59.662884 166532 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-517711 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.61.203
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-517711 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0203 11:41:59.662979 166532 ssh_runner.go:195] Run: crio config
I0203 11:41:59.712751 166532 cni.go:84] Creating CNI manager for ""
I0203 11:41:59.712778 166532 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0203 11:41:59.712793 166532 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0203 11:41:59.712821 166532 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.61.203 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-517711 NodeName:old-k8s-version-517711 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.61.203"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.61.203 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0203 11:41:59.713015 166532 kubeadm.go:195] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.61.203
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-517711"
kubeletExtraArgs:
node-ip: 192.168.61.203
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.61.203"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0203 11:41:59.713093 166532 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0203 11:41:59.723617 166532 binaries.go:44] Found k8s binaries, skipping transfer
I0203 11:41:59.723709 166532 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0203 11:41:59.733930 166532 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0203 11:41:59.752923 166532 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0203 11:41:59.770781 166532 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2123 bytes)
I0203 11:41:59.793895 166532 ssh_runner.go:195] Run: grep 192.168.61.203 control-plane.minikube.internal$ /etc/hosts
I0203 11:41:59.798059 166532 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.61.203 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0203 11:41:59.811265 166532 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0203 11:41:59.974492 166532 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0203 11:41:59.998428 166532 certs.go:68] Setting up /home/jenkins/minikube-integration/20354-109432/.minikube/profiles/old-k8s-version-517711 for IP: 192.168.61.203
I0203 11:41:59.998461 166532 certs.go:194] generating shared ca certs ...
I0203 11:41:59.998485 166532 certs.go:226] acquiring lock for ca certs: {Name:mkceafe81f89678b7cbc2a7f6faab4e784fcb207 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0203 11:41:59.998655 166532 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20354-109432/.minikube/ca.key
I0203 11:41:59.998702 166532 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20354-109432/.minikube/proxy-client-ca.key
I0203 11:41:59.998716 166532 certs.go:256] generating profile certs ...
I0203 11:41:59.998789 166532 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/20354-109432/.minikube/profiles/old-k8s-version-517711/client.key
I0203 11:41:59.998811 166532 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20354-109432/.minikube/profiles/old-k8s-version-517711/client.crt with IP's: []
I0203 11:42:00.447099 166532 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20354-109432/.minikube/profiles/old-k8s-version-517711/client.crt ...
I0203 11:42:00.447138 166532 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20354-109432/.minikube/profiles/old-k8s-version-517711/client.crt: {Name:mkb8972667b8b5346ebf6b697ad51681d7b93e7f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0203 11:42:00.447340 166532 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20354-109432/.minikube/profiles/old-k8s-version-517711/client.key ...
I0203 11:42:00.447359 166532 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20354-109432/.minikube/profiles/old-k8s-version-517711/client.key: {Name:mkb4be1a0e91ff983dc683821c253276e45f44d8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0203 11:42:00.447468 166532 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/20354-109432/.minikube/profiles/old-k8s-version-517711/apiserver.key.067e8325
I0203 11:42:00.447490 166532 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20354-109432/.minikube/profiles/old-k8s-version-517711/apiserver.crt.067e8325 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.61.203]
I0203 11:42:00.510458 166532 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20354-109432/.minikube/profiles/old-k8s-version-517711/apiserver.crt.067e8325 ...
I0203 11:42:00.510496 166532 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20354-109432/.minikube/profiles/old-k8s-version-517711/apiserver.crt.067e8325: {Name:mk94fadf90d0772eedcc3935aef8367adbfc4ef4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0203 11:42:00.510685 166532 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20354-109432/.minikube/profiles/old-k8s-version-517711/apiserver.key.067e8325 ...
I0203 11:42:00.510703 166532 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20354-109432/.minikube/profiles/old-k8s-version-517711/apiserver.key.067e8325: {Name:mk390f247a4ba4d21e1fdc8453b9f9d52d8bfe50 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0203 11:42:00.510800 166532 certs.go:381] copying /home/jenkins/minikube-integration/20354-109432/.minikube/profiles/old-k8s-version-517711/apiserver.crt.067e8325 -> /home/jenkins/minikube-integration/20354-109432/.minikube/profiles/old-k8s-version-517711/apiserver.crt
I0203 11:42:00.510907 166532 certs.go:385] copying /home/jenkins/minikube-integration/20354-109432/.minikube/profiles/old-k8s-version-517711/apiserver.key.067e8325 -> /home/jenkins/minikube-integration/20354-109432/.minikube/profiles/old-k8s-version-517711/apiserver.key
I0203 11:42:00.510994 166532 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/20354-109432/.minikube/profiles/old-k8s-version-517711/proxy-client.key
I0203 11:42:00.511016 166532 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20354-109432/.minikube/profiles/old-k8s-version-517711/proxy-client.crt with IP's: []
I0203 11:42:00.602036 166532 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20354-109432/.minikube/profiles/old-k8s-version-517711/proxy-client.crt ...
I0203 11:42:00.602069 166532 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20354-109432/.minikube/profiles/old-k8s-version-517711/proxy-client.crt: {Name:mk35a3cbbb7f99c000adb2422a6fbcae74bc048a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0203 11:42:00.602232 166532 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20354-109432/.minikube/profiles/old-k8s-version-517711/proxy-client.key ...
I0203 11:42:00.602245 166532 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20354-109432/.minikube/profiles/old-k8s-version-517711/proxy-client.key: {Name:mkfeffeb123adb8ecdbfd97892e72edd94714b4f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0203 11:42:00.602413 166532 certs.go:484] found cert: /home/jenkins/minikube-integration/20354-109432/.minikube/certs/116606.pem (1338 bytes)
W0203 11:42:00.602451 166532 certs.go:480] ignoring /home/jenkins/minikube-integration/20354-109432/.minikube/certs/116606_empty.pem, impossibly tiny 0 bytes
I0203 11:42:00.602462 166532 certs.go:484] found cert: /home/jenkins/minikube-integration/20354-109432/.minikube/certs/ca-key.pem (1679 bytes)
I0203 11:42:00.602485 166532 certs.go:484] found cert: /home/jenkins/minikube-integration/20354-109432/.minikube/certs/ca.pem (1078 bytes)
I0203 11:42:00.602506 166532 certs.go:484] found cert: /home/jenkins/minikube-integration/20354-109432/.minikube/certs/cert.pem (1123 bytes)
I0203 11:42:00.602527 166532 certs.go:484] found cert: /home/jenkins/minikube-integration/20354-109432/.minikube/certs/key.pem (1679 bytes)
I0203 11:42:00.602561 166532 certs.go:484] found cert: /home/jenkins/minikube-integration/20354-109432/.minikube/files/etc/ssl/certs/1166062.pem (1708 bytes)
I0203 11:42:00.603184 166532 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20354-109432/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0203 11:42:00.629396 166532 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20354-109432/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0203 11:42:00.654522 166532 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20354-109432/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0203 11:42:00.678064 166532 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20354-109432/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0203 11:42:00.703455 166532 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20354-109432/.minikube/profiles/old-k8s-version-517711/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0203 11:42:00.728762 166532 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20354-109432/.minikube/profiles/old-k8s-version-517711/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0203 11:42:00.818933 166532 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20354-109432/.minikube/profiles/old-k8s-version-517711/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0203 11:42:00.845001 166532 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20354-109432/.minikube/profiles/old-k8s-version-517711/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0203 11:42:00.873400 166532 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20354-109432/.minikube/files/etc/ssl/certs/1166062.pem --> /usr/share/ca-certificates/1166062.pem (1708 bytes)
I0203 11:42:00.921785 166532 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20354-109432/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0203 11:42:00.963397 166532 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20354-109432/.minikube/certs/116606.pem --> /usr/share/ca-certificates/116606.pem (1338 bytes)
I0203 11:42:01.000564 166532 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0203 11:42:01.019439 166532 ssh_runner.go:195] Run: openssl version
I0203 11:42:01.025331 166532 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1166062.pem && ln -fs /usr/share/ca-certificates/1166062.pem /etc/ssl/certs/1166062.pem"
I0203 11:42:01.036697 166532 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1166062.pem
I0203 11:42:01.041636 166532 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Feb 3 10:41 /usr/share/ca-certificates/1166062.pem
I0203 11:42:01.041707 166532 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1166062.pem
I0203 11:42:01.047834 166532 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/1166062.pem /etc/ssl/certs/3ec20f2e.0"
I0203 11:42:01.059585 166532 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0203 11:42:01.071368 166532 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0203 11:42:01.076267 166532 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Feb 3 10:33 /usr/share/ca-certificates/minikubeCA.pem
I0203 11:42:01.076331 166532 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0203 11:42:01.082319 166532 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0203 11:42:01.093970 166532 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/116606.pem && ln -fs /usr/share/ca-certificates/116606.pem /etc/ssl/certs/116606.pem"
I0203 11:42:01.104884 166532 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/116606.pem
I0203 11:42:01.109552 166532 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Feb 3 10:41 /usr/share/ca-certificates/116606.pem
I0203 11:42:01.109620 166532 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/116606.pem
I0203 11:42:01.115301 166532 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/116606.pem /etc/ssl/certs/51391683.0"
I0203 11:42:01.129627 166532 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0203 11:42:01.134637 166532 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0203 11:42:01.134710 166532 kubeadm.go:392] StartCluster: {Name:old-k8s-version-517711 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-517711 Namespace:de
fault APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.203 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Dis
ableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0203 11:42:01.134819 166532 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0203 11:42:01.134875 166532 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0203 11:42:01.177905 166532 cri.go:89] found id: ""
I0203 11:42:01.178024 166532 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0203 11:42:01.189625 166532 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0203 11:42:01.200103 166532 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0203 11:42:01.210054 166532 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0203 11:42:01.210079 166532 kubeadm.go:157] found existing configuration files:
I0203 11:42:01.210140 166532 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0203 11:42:01.219210 166532 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0203 11:42:01.219283 166532 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0203 11:42:01.228548 166532 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0203 11:42:01.237663 166532 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0203 11:42:01.237744 166532 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0203 11:42:01.248155 166532 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0203 11:42:01.257395 166532 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0203 11:42:01.257476 166532 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0203 11:42:01.267554 166532 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0203 11:42:01.277100 166532 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0203 11:42:01.277186 166532 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0203 11:42:01.288422 166532 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0203 11:42:01.548520 166532 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0203 11:44:00.064397 166532 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0203 11:44:00.064508 166532 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0203 11:44:00.066106 166532 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0203 11:44:00.066183 166532 kubeadm.go:310] [preflight] Running pre-flight checks
I0203 11:44:00.066285 166532 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0203 11:44:00.066371 166532 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0203 11:44:00.066451 166532 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0203 11:44:00.066509 166532 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0203 11:44:00.068502 166532 out.go:235] - Generating certificates and keys ...
I0203 11:44:00.068599 166532 kubeadm.go:310] [certs] Using existing ca certificate authority
I0203 11:44:00.068666 166532 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0203 11:44:00.068729 166532 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0203 11:44:00.068775 166532 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0203 11:44:00.068823 166532 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0203 11:44:00.068865 166532 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0203 11:44:00.068908 166532 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0203 11:44:00.069015 166532 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-517711] and IPs [192.168.61.203 127.0.0.1 ::1]
I0203 11:44:00.069073 166532 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0203 11:44:00.069234 166532 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-517711] and IPs [192.168.61.203 127.0.0.1 ::1]
I0203 11:44:00.069340 166532 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0203 11:44:00.069428 166532 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0203 11:44:00.069487 166532 kubeadm.go:310] [certs] Generating "sa" key and public key
I0203 11:44:00.069560 166532 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0203 11:44:00.069604 166532 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0203 11:44:00.069649 166532 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0203 11:44:00.069703 166532 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0203 11:44:00.069771 166532 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0203 11:44:00.069883 166532 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0203 11:44:00.069969 166532 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0203 11:44:00.070059 166532 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0203 11:44:00.070222 166532 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0203 11:44:00.072632 166532 out.go:235] - Booting up control plane ...
I0203 11:44:00.072719 166532 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0203 11:44:00.072802 166532 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0203 11:44:00.072869 166532 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0203 11:44:00.072938 166532 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0203 11:44:00.073074 166532 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0203 11:44:00.073137 166532 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0203 11:44:00.073221 166532 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0203 11:44:00.073384 166532 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0203 11:44:00.073447 166532 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0203 11:44:00.073658 166532 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0203 11:44:00.073719 166532 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0203 11:44:00.073908 166532 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0203 11:44:00.073973 166532 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0203 11:44:00.074154 166532 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0203 11:44:00.074216 166532 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0203 11:44:00.074408 166532 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0203 11:44:00.074426 166532 kubeadm.go:310]
I0203 11:44:00.074513 166532 kubeadm.go:310] Unfortunately, an error has occurred:
I0203 11:44:00.074582 166532 kubeadm.go:310] timed out waiting for the condition
I0203 11:44:00.074592 166532 kubeadm.go:310]
I0203 11:44:00.074647 166532 kubeadm.go:310] This error is likely caused by:
I0203 11:44:00.074681 166532 kubeadm.go:310] - The kubelet is not running
I0203 11:44:00.074783 166532 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0203 11:44:00.074793 166532 kubeadm.go:310]
I0203 11:44:00.074888 166532 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0203 11:44:00.074942 166532 kubeadm.go:310] - 'systemctl status kubelet'
I0203 11:44:00.074993 166532 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0203 11:44:00.075003 166532 kubeadm.go:310]
I0203 11:44:00.075143 166532 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0203 11:44:00.075222 166532 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0203 11:44:00.075229 166532 kubeadm.go:310]
I0203 11:44:00.075351 166532 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0203 11:44:00.075462 166532 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0203 11:44:00.075534 166532 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0203 11:44:00.075597 166532 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0203 11:44:00.075666 166532 kubeadm.go:310]
W0203 11:44:00.075752 166532 out.go:270] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-517711] and IPs [192.168.61.203 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-517711] and IPs [192.168.61.203 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-517711] and IPs [192.168.61.203 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-517711] and IPs [192.168.61.203 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0203 11:44:00.075793 166532 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0203 11:44:01.385479 166532 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (1.309659311s)
I0203 11:44:01.385602 166532 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0203 11:44:01.399884 166532 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0203 11:44:01.409959 166532 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0203 11:44:01.409980 166532 kubeadm.go:157] found existing configuration files:
I0203 11:44:01.410046 166532 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0203 11:44:01.420154 166532 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0203 11:44:01.420228 166532 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0203 11:44:01.430498 166532 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0203 11:44:01.440042 166532 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0203 11:44:01.440107 166532 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0203 11:44:01.450058 166532 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0203 11:44:01.458822 166532 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0203 11:44:01.458880 166532 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0203 11:44:01.469384 166532 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0203 11:44:01.481090 166532 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0203 11:44:01.481164 166532 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0203 11:44:01.493966 166532 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0203 11:44:01.584433 166532 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0203 11:44:01.584507 166532 kubeadm.go:310] [preflight] Running pre-flight checks
I0203 11:44:01.734344 166532 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0203 11:44:01.734512 166532 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0203 11:44:01.734643 166532 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0203 11:44:01.940530 166532 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0203 11:44:01.942467 166532 out.go:235] - Generating certificates and keys ...
I0203 11:44:01.942572 166532 kubeadm.go:310] [certs] Using existing ca certificate authority
I0203 11:44:01.942677 166532 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0203 11:44:01.942807 166532 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0203 11:44:01.942889 166532 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0203 11:44:01.942978 166532 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0203 11:44:01.943048 166532 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0203 11:44:01.943122 166532 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0203 11:44:01.943180 166532 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0203 11:44:01.943242 166532 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0203 11:44:01.943306 166532 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0203 11:44:01.943340 166532 kubeadm.go:310] [certs] Using the existing "sa" key
I0203 11:44:01.943393 166532 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0203 11:44:02.097952 166532 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0203 11:44:02.366303 166532 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0203 11:44:02.672013 166532 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0203 11:44:03.179833 166532 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0203 11:44:03.197506 166532 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0203 11:44:03.198727 166532 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0203 11:44:03.198796 166532 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0203 11:44:03.333876 166532 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0203 11:44:03.336200 166532 out.go:235] - Booting up control plane ...
I0203 11:44:03.336349 166532 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0203 11:44:03.341330 166532 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0203 11:44:03.344199 166532 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0203 11:44:03.344329 166532 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0203 11:44:03.349348 166532 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0203 11:44:43.352000 166532 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0203 11:44:43.352109 166532 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0203 11:44:43.352322 166532 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0203 11:44:48.352775 166532 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0203 11:44:48.352986 166532 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0203 11:44:58.353582 166532 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0203 11:44:58.353869 166532 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0203 11:45:18.353244 166532 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0203 11:45:18.353551 166532 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0203 11:45:58.353113 166532 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0203 11:45:58.353373 166532 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0203 11:45:58.353503 166532 kubeadm.go:310]
I0203 11:45:58.353579 166532 kubeadm.go:310] Unfortunately, an error has occurred:
I0203 11:45:58.353876 166532 kubeadm.go:310] timed out waiting for the condition
I0203 11:45:58.353897 166532 kubeadm.go:310]
I0203 11:45:58.353935 166532 kubeadm.go:310] This error is likely caused by:
I0203 11:45:58.353977 166532 kubeadm.go:310] - The kubelet is not running
I0203 11:45:58.354137 166532 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0203 11:45:58.354163 166532 kubeadm.go:310]
I0203 11:45:58.354276 166532 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0203 11:45:58.354319 166532 kubeadm.go:310] - 'systemctl status kubelet'
I0203 11:45:58.354357 166532 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0203 11:45:58.354364 166532 kubeadm.go:310]
I0203 11:45:58.354477 166532 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0203 11:45:58.354563 166532 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0203 11:45:58.354597 166532 kubeadm.go:310]
I0203 11:45:58.354712 166532 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0203 11:45:58.354801 166532 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0203 11:45:58.354879 166532 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0203 11:45:58.354985 166532 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0203 11:45:58.354994 166532 kubeadm.go:310]
I0203 11:45:58.356694 166532 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0203 11:45:58.356800 166532 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0203 11:45:58.356868 166532 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0203 11:45:58.357016 166532 kubeadm.go:394] duration metric: took 3m57.222311714s to StartCluster
I0203 11:45:58.357062 166532 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0203 11:45:58.357129 166532 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0203 11:45:58.409958 166532 cri.go:89] found id: ""
I0203 11:45:58.410021 166532 logs.go:282] 0 containers: []
W0203 11:45:58.410036 166532 logs.go:284] No container was found matching "kube-apiserver"
I0203 11:45:58.410045 166532 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0203 11:45:58.410127 166532 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0203 11:45:58.455461 166532 cri.go:89] found id: ""
I0203 11:45:58.455497 166532 logs.go:282] 0 containers: []
W0203 11:45:58.455508 166532 logs.go:284] No container was found matching "etcd"
I0203 11:45:58.455516 166532 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0203 11:45:58.455581 166532 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0203 11:45:58.490684 166532 cri.go:89] found id: ""
I0203 11:45:58.490723 166532 logs.go:282] 0 containers: []
W0203 11:45:58.490731 166532 logs.go:284] No container was found matching "coredns"
I0203 11:45:58.490737 166532 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0203 11:45:58.490800 166532 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0203 11:45:58.527834 166532 cri.go:89] found id: ""
I0203 11:45:58.527864 166532 logs.go:282] 0 containers: []
W0203 11:45:58.527876 166532 logs.go:284] No container was found matching "kube-scheduler"
I0203 11:45:58.527885 166532 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0203 11:45:58.527975 166532 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0203 11:45:58.566697 166532 cri.go:89] found id: ""
I0203 11:45:58.566736 166532 logs.go:282] 0 containers: []
W0203 11:45:58.566748 166532 logs.go:284] No container was found matching "kube-proxy"
I0203 11:45:58.566756 166532 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0203 11:45:58.566823 166532 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0203 11:45:58.628617 166532 cri.go:89] found id: ""
I0203 11:45:58.628658 166532 logs.go:282] 0 containers: []
W0203 11:45:58.628669 166532 logs.go:284] No container was found matching "kube-controller-manager"
I0203 11:45:58.628678 166532 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0203 11:45:58.628747 166532 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0203 11:45:58.670365 166532 cri.go:89] found id: ""
I0203 11:45:58.670400 166532 logs.go:282] 0 containers: []
W0203 11:45:58.670411 166532 logs.go:284] No container was found matching "kindnet"
I0203 11:45:58.670426 166532 logs.go:123] Gathering logs for kubelet ...
I0203 11:45:58.670445 166532 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0203 11:45:58.737071 166532 logs.go:123] Gathering logs for dmesg ...
I0203 11:45:58.737111 166532 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0203 11:45:58.751076 166532 logs.go:123] Gathering logs for describe nodes ...
I0203 11:45:58.751118 166532 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0203 11:45:58.900814 166532 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0203 11:45:58.900855 166532 logs.go:123] Gathering logs for CRI-O ...
I0203 11:45:58.900873 166532 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0203 11:45:59.010218 166532 logs.go:123] Gathering logs for container status ...
I0203 11:45:59.010261 166532 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0203 11:45:59.050788 166532 out.go:418] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0203 11:45:59.050848 166532 out.go:270] *
*
W0203 11:45:59.050922 166532 out.go:270] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0203 11:45:59.050939 166532 out.go:270] *
*
W0203 11:45:59.051840 166532 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0203 11:45:59.055012 166532 out.go:201]
W0203 11:45:59.056333 166532 out.go:270] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0203 11:45:59.056391 166532 out.go:270] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0203 11:45:59.056420 166532 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0203 11:45:59.057989 166532 out.go:201]
** /stderr **
start_stop_delete_test.go:186: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-517711 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-517711 -n old-k8s-version-517711
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-517711 -n old-k8s-version-517711: exit status 6 (291.163426ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0203 11:45:59.402291 172462 status.go:458] kubeconfig endpoint: get endpoint: "old-k8s-version-517711" does not appear in /home/jenkins/minikube-integration/20354-109432/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-517711" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (272.60s)