=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:184: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-134433 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:184: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-134433 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m30.51319818s)
-- stdout --
* [old-k8s-version-134433] minikube v1.35.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=20151
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/20151-942401/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/20151-942401/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-134433" primary control-plane node in "old-k8s-version-134433" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0120 12:24:57.012243 989425 out.go:345] Setting OutFile to fd 1 ...
I0120 12:24:57.012582 989425 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0120 12:24:57.012595 989425 out.go:358] Setting ErrFile to fd 2...
I0120 12:24:57.012600 989425 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0120 12:24:57.012911 989425 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20151-942401/.minikube/bin
I0120 12:24:57.013735 989425 out.go:352] Setting JSON to false
I0120 12:24:57.015148 989425 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-9","uptime":18440,"bootTime":1737357457,"procs":205,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1074-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0120 12:24:57.015238 989425 start.go:139] virtualization: kvm guest
I0120 12:24:57.017774 989425 out.go:177] * [old-k8s-version-134433] minikube v1.35.0 on Ubuntu 20.04 (kvm/amd64)
I0120 12:24:57.019470 989425 out.go:177] - MINIKUBE_LOCATION=20151
I0120 12:24:57.019486 989425 notify.go:220] Checking for updates...
I0120 12:24:57.021145 989425 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0120 12:24:57.022676 989425 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/20151-942401/kubeconfig
I0120 12:24:57.024188 989425 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/20151-942401/.minikube
I0120 12:24:57.025677 989425 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0120 12:24:57.027094 989425 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0120 12:24:57.028901 989425 config.go:182] Loaded profile config "cert-expiration-673364": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.0
I0120 12:24:57.029028 989425 config.go:182] Loaded profile config "cert-options-600668": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.0
I0120 12:24:57.029145 989425 config.go:182] Loaded profile config "kubernetes-upgrade-049625": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0120 12:24:57.029310 989425 driver.go:394] Setting default libvirt URI to qemu:///system
I0120 12:24:57.074616 989425 out.go:177] * Using the kvm2 driver based on user configuration
I0120 12:24:57.076284 989425 start.go:297] selected driver: kvm2
I0120 12:24:57.076310 989425 start.go:901] validating driver "kvm2" against <nil>
I0120 12:24:57.076326 989425 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0120 12:24:57.077462 989425 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0120 12:24:57.077601 989425 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/20151-942401/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0120 12:24:57.098465 989425 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.35.0
I0120 12:24:57.098564 989425 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0120 12:24:57.098957 989425 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0120 12:24:57.099008 989425 cni.go:84] Creating CNI manager for ""
I0120 12:24:57.099084 989425 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0120 12:24:57.099097 989425 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0120 12:24:57.099188 989425 start.go:340] cluster config:
{Name:old-k8s-version-134433 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-134433 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRI
Socket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:
0 GPUs: AutoPauseInterval:1m0s}
I0120 12:24:57.099341 989425 iso.go:125] acquiring lock: {Name:mk7f0ac9e7ba04626414e742c3e5292d79996a4f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0120 12:24:57.101339 989425 out.go:177] * Starting "old-k8s-version-134433" primary control-plane node in "old-k8s-version-134433" cluster
I0120 12:24:57.102741 989425 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0120 12:24:57.102844 989425 preload.go:146] Found local preload: /home/jenkins/minikube-integration/20151-942401/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0120 12:24:57.103173 989425 cache.go:56] Caching tarball of preloaded images
I0120 12:24:57.103341 989425 preload.go:172] Found /home/jenkins/minikube-integration/20151-942401/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0120 12:24:57.103360 989425 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0120 12:24:57.103506 989425 profile.go:143] Saving config to /home/jenkins/minikube-integration/20151-942401/.minikube/profiles/old-k8s-version-134433/config.json ...
I0120 12:24:57.103540 989425 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20151-942401/.minikube/profiles/old-k8s-version-134433/config.json: {Name:mkec4f17d249bc59d3e2da840bcbc2f85399c1b4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0120 12:24:57.103845 989425 start.go:360] acquireMachinesLock for old-k8s-version-134433: {Name:mkd5527ce9753efd08511b23d71dbb6bbf416f1b Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0120 12:24:57.103921 989425 start.go:364] duration metric: took 46.825µs to acquireMachinesLock for "old-k8s-version-134433"
I0120 12:24:57.103951 989425 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-134433 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-versi
on-134433 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMir
ror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0120 12:24:57.104044 989425 start.go:125] createHost starting for "" (driver="kvm2")
I0120 12:24:57.105691 989425 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0120 12:24:57.105887 989425 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0120 12:24:57.105919 989425 main.go:141] libmachine: Launching plugin server for driver kvm2
I0120 12:24:57.125931 989425 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36757
I0120 12:24:57.126482 989425 main.go:141] libmachine: () Calling .GetVersion
I0120 12:24:57.127158 989425 main.go:141] libmachine: Using API Version 1
I0120 12:24:57.127190 989425 main.go:141] libmachine: () Calling .SetConfigRaw
I0120 12:24:57.127655 989425 main.go:141] libmachine: () Calling .GetMachineName
I0120 12:24:57.127927 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetMachineName
I0120 12:24:57.128097 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .DriverName
I0120 12:24:57.128301 989425 start.go:159] libmachine.API.Create for "old-k8s-version-134433" (driver="kvm2")
I0120 12:24:57.128334 989425 client.go:168] LocalClient.Create starting
I0120 12:24:57.128376 989425 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20151-942401/.minikube/certs/ca.pem
I0120 12:24:57.128411 989425 main.go:141] libmachine: Decoding PEM data...
I0120 12:24:57.128429 989425 main.go:141] libmachine: Parsing certificate...
I0120 12:24:57.128500 989425 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20151-942401/.minikube/certs/cert.pem
I0120 12:24:57.128532 989425 main.go:141] libmachine: Decoding PEM data...
I0120 12:24:57.128549 989425 main.go:141] libmachine: Parsing certificate...
I0120 12:24:57.128571 989425 main.go:141] libmachine: Running pre-create checks...
I0120 12:24:57.128587 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .PreCreateCheck
I0120 12:24:57.128959 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetConfigRaw
I0120 12:24:57.129440 989425 main.go:141] libmachine: Creating machine...
I0120 12:24:57.129458 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .Create
I0120 12:24:57.129625 989425 main.go:141] libmachine: (old-k8s-version-134433) creating KVM machine...
I0120 12:24:57.129650 989425 main.go:141] libmachine: (old-k8s-version-134433) creating network...
I0120 12:24:57.131069 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | found existing default KVM network
I0120 12:24:57.133280 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | I0120 12:24:57.133065 989449 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:65:e8:f5} reservation:<nil>}
I0120 12:24:57.135000 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | I0120 12:24:57.134922 989449 network.go:206] using free private subnet 192.168.50.0/24: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0002a6cb0}
I0120 12:24:57.135073 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | created network xml:
I0120 12:24:57.135093 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | <network>
I0120 12:24:57.135116 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | <name>mk-old-k8s-version-134433</name>
I0120 12:24:57.135125 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | <dns enable='no'/>
I0120 12:24:57.135134 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG |
I0120 12:24:57.135153 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | <ip address='192.168.50.1' netmask='255.255.255.0'>
I0120 12:24:57.135167 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | <dhcp>
I0120 12:24:57.135177 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | <range start='192.168.50.2' end='192.168.50.253'/>
I0120 12:24:57.135188 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | </dhcp>
I0120 12:24:57.135192 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | </ip>
I0120 12:24:57.135199 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG |
I0120 12:24:57.135204 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | </network>
I0120 12:24:57.135217 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG |
I0120 12:24:57.140534 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | trying to create private KVM network mk-old-k8s-version-134433 192.168.50.0/24...
I0120 12:24:57.227122 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | private KVM network mk-old-k8s-version-134433 192.168.50.0/24 created
I0120 12:24:57.228370 989425 main.go:141] libmachine: (old-k8s-version-134433) setting up store path in /home/jenkins/minikube-integration/20151-942401/.minikube/machines/old-k8s-version-134433 ...
I0120 12:24:57.228413 989425 main.go:141] libmachine: (old-k8s-version-134433) building disk image from file:///home/jenkins/minikube-integration/20151-942401/.minikube/cache/iso/amd64/minikube-v1.35.0-amd64.iso
I0120 12:24:57.228430 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | I0120 12:24:57.227257 989449 common.go:144] Making disk image using store path: /home/jenkins/minikube-integration/20151-942401/.minikube
I0120 12:24:57.228452 989425 main.go:141] libmachine: (old-k8s-version-134433) Downloading /home/jenkins/minikube-integration/20151-942401/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/20151-942401/.minikube/cache/iso/amd64/minikube-v1.35.0-amd64.iso...
I0120 12:24:57.596590 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | I0120 12:24:57.596391 989449 common.go:151] Creating ssh key: /home/jenkins/minikube-integration/20151-942401/.minikube/machines/old-k8s-version-134433/id_rsa...
I0120 12:24:57.952218 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | I0120 12:24:57.952075 989449 common.go:157] Creating raw disk image: /home/jenkins/minikube-integration/20151-942401/.minikube/machines/old-k8s-version-134433/old-k8s-version-134433.rawdisk...
I0120 12:24:57.952252 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | Writing magic tar header
I0120 12:24:57.952265 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | Writing SSH key tar header
I0120 12:24:57.952274 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | I0120 12:24:57.952239 989449 common.go:171] Fixing permissions on /home/jenkins/minikube-integration/20151-942401/.minikube/machines/old-k8s-version-134433 ...
I0120 12:24:57.952444 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20151-942401/.minikube/machines/old-k8s-version-134433
I0120 12:24:57.952485 989425 main.go:141] libmachine: (old-k8s-version-134433) setting executable bit set on /home/jenkins/minikube-integration/20151-942401/.minikube/machines/old-k8s-version-134433 (perms=drwx------)
I0120 12:24:57.952496 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20151-942401/.minikube/machines
I0120 12:24:57.952511 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20151-942401/.minikube
I0120 12:24:57.952521 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20151-942401
I0120 12:24:57.952538 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | checking permissions on dir: /home/jenkins/minikube-integration
I0120 12:24:57.952549 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | checking permissions on dir: /home/jenkins
I0120 12:24:57.952560 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | checking permissions on dir: /home
I0120 12:24:57.952571 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | skipping /home - not owner
I0120 12:24:57.952621 989425 main.go:141] libmachine: (old-k8s-version-134433) setting executable bit set on /home/jenkins/minikube-integration/20151-942401/.minikube/machines (perms=drwxr-xr-x)
I0120 12:24:57.952664 989425 main.go:141] libmachine: (old-k8s-version-134433) setting executable bit set on /home/jenkins/minikube-integration/20151-942401/.minikube (perms=drwxr-xr-x)
I0120 12:24:57.952718 989425 main.go:141] libmachine: (old-k8s-version-134433) setting executable bit set on /home/jenkins/minikube-integration/20151-942401 (perms=drwxrwxr-x)
I0120 12:24:57.952750 989425 main.go:141] libmachine: (old-k8s-version-134433) setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0120 12:24:57.952770 989425 main.go:141] libmachine: (old-k8s-version-134433) setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0120 12:24:57.952783 989425 main.go:141] libmachine: (old-k8s-version-134433) creating domain...
I0120 12:24:57.953773 989425 main.go:141] libmachine: (old-k8s-version-134433) define libvirt domain using xml:
I0120 12:24:57.953798 989425 main.go:141] libmachine: (old-k8s-version-134433) <domain type='kvm'>
I0120 12:24:57.953810 989425 main.go:141] libmachine: (old-k8s-version-134433) <name>old-k8s-version-134433</name>
I0120 12:24:57.953818 989425 main.go:141] libmachine: (old-k8s-version-134433) <memory unit='MiB'>2200</memory>
I0120 12:24:57.953826 989425 main.go:141] libmachine: (old-k8s-version-134433) <vcpu>2</vcpu>
I0120 12:24:57.953832 989425 main.go:141] libmachine: (old-k8s-version-134433) <features>
I0120 12:24:57.953845 989425 main.go:141] libmachine: (old-k8s-version-134433) <acpi/>
I0120 12:24:57.953855 989425 main.go:141] libmachine: (old-k8s-version-134433) <apic/>
I0120 12:24:57.953863 989425 main.go:141] libmachine: (old-k8s-version-134433) <pae/>
I0120 12:24:57.953874 989425 main.go:141] libmachine: (old-k8s-version-134433)
I0120 12:24:57.953901 989425 main.go:141] libmachine: (old-k8s-version-134433) </features>
I0120 12:24:57.953923 989425 main.go:141] libmachine: (old-k8s-version-134433) <cpu mode='host-passthrough'>
I0120 12:24:57.953962 989425 main.go:141] libmachine: (old-k8s-version-134433)
I0120 12:24:57.953989 989425 main.go:141] libmachine: (old-k8s-version-134433) </cpu>
I0120 12:24:57.954010 989425 main.go:141] libmachine: (old-k8s-version-134433) <os>
I0120 12:24:57.954028 989425 main.go:141] libmachine: (old-k8s-version-134433) <type>hvm</type>
I0120 12:24:57.954038 989425 main.go:141] libmachine: (old-k8s-version-134433) <boot dev='cdrom'/>
I0120 12:24:57.954049 989425 main.go:141] libmachine: (old-k8s-version-134433) <boot dev='hd'/>
I0120 12:24:57.954058 989425 main.go:141] libmachine: (old-k8s-version-134433) <bootmenu enable='no'/>
I0120 12:24:57.954067 989425 main.go:141] libmachine: (old-k8s-version-134433) </os>
I0120 12:24:57.954075 989425 main.go:141] libmachine: (old-k8s-version-134433) <devices>
I0120 12:24:57.954086 989425 main.go:141] libmachine: (old-k8s-version-134433) <disk type='file' device='cdrom'>
I0120 12:24:57.954098 989425 main.go:141] libmachine: (old-k8s-version-134433) <source file='/home/jenkins/minikube-integration/20151-942401/.minikube/machines/old-k8s-version-134433/boot2docker.iso'/>
I0120 12:24:57.954110 989425 main.go:141] libmachine: (old-k8s-version-134433) <target dev='hdc' bus='scsi'/>
I0120 12:24:57.954123 989425 main.go:141] libmachine: (old-k8s-version-134433) <readonly/>
I0120 12:24:57.954131 989425 main.go:141] libmachine: (old-k8s-version-134433) </disk>
I0120 12:24:57.954143 989425 main.go:141] libmachine: (old-k8s-version-134433) <disk type='file' device='disk'>
I0120 12:24:57.954156 989425 main.go:141] libmachine: (old-k8s-version-134433) <driver name='qemu' type='raw' cache='default' io='threads' />
I0120 12:24:57.954173 989425 main.go:141] libmachine: (old-k8s-version-134433) <source file='/home/jenkins/minikube-integration/20151-942401/.minikube/machines/old-k8s-version-134433/old-k8s-version-134433.rawdisk'/>
I0120 12:24:57.954189 989425 main.go:141] libmachine: (old-k8s-version-134433) <target dev='hda' bus='virtio'/>
I0120 12:24:57.954199 989425 main.go:141] libmachine: (old-k8s-version-134433) </disk>
I0120 12:24:57.954204 989425 main.go:141] libmachine: (old-k8s-version-134433) <interface type='network'>
I0120 12:24:57.954215 989425 main.go:141] libmachine: (old-k8s-version-134433) <source network='mk-old-k8s-version-134433'/>
I0120 12:24:57.954227 989425 main.go:141] libmachine: (old-k8s-version-134433) <model type='virtio'/>
I0120 12:24:57.954235 989425 main.go:141] libmachine: (old-k8s-version-134433) </interface>
I0120 12:24:57.954247 989425 main.go:141] libmachine: (old-k8s-version-134433) <interface type='network'>
I0120 12:24:57.954263 989425 main.go:141] libmachine: (old-k8s-version-134433) <source network='default'/>
I0120 12:24:57.954273 989425 main.go:141] libmachine: (old-k8s-version-134433) <model type='virtio'/>
I0120 12:24:57.954294 989425 main.go:141] libmachine: (old-k8s-version-134433) </interface>
I0120 12:24:57.954307 989425 main.go:141] libmachine: (old-k8s-version-134433) <serial type='pty'>
I0120 12:24:57.954314 989425 main.go:141] libmachine: (old-k8s-version-134433) <target port='0'/>
I0120 12:24:57.954324 989425 main.go:141] libmachine: (old-k8s-version-134433) </serial>
I0120 12:24:57.954332 989425 main.go:141] libmachine: (old-k8s-version-134433) <console type='pty'>
I0120 12:24:57.954344 989425 main.go:141] libmachine: (old-k8s-version-134433) <target type='serial' port='0'/>
I0120 12:24:57.954351 989425 main.go:141] libmachine: (old-k8s-version-134433) </console>
I0120 12:24:57.954360 989425 main.go:141] libmachine: (old-k8s-version-134433) <rng model='virtio'>
I0120 12:24:57.954368 989425 main.go:141] libmachine: (old-k8s-version-134433) <backend model='random'>/dev/random</backend>
I0120 12:24:57.954408 989425 main.go:141] libmachine: (old-k8s-version-134433) </rng>
I0120 12:24:57.954434 989425 main.go:141] libmachine: (old-k8s-version-134433)
I0120 12:24:57.954449 989425 main.go:141] libmachine: (old-k8s-version-134433)
I0120 12:24:57.954461 989425 main.go:141] libmachine: (old-k8s-version-134433) </devices>
I0120 12:24:57.954474 989425 main.go:141] libmachine: (old-k8s-version-134433) </domain>
I0120 12:24:57.954486 989425 main.go:141] libmachine: (old-k8s-version-134433)
I0120 12:24:57.959191 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | domain old-k8s-version-134433 has defined MAC address 52:54:00:6c:e1:53 in network default
I0120 12:24:57.959846 989425 main.go:141] libmachine: (old-k8s-version-134433) starting domain...
I0120 12:24:57.959873 989425 main.go:141] libmachine: (old-k8s-version-134433) ensuring networks are active...
I0120 12:24:57.959886 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | domain old-k8s-version-134433 has defined MAC address 52:54:00:4a:b6:e2 in network mk-old-k8s-version-134433
I0120 12:24:57.960583 989425 main.go:141] libmachine: (old-k8s-version-134433) Ensuring network default is active
I0120 12:24:57.960931 989425 main.go:141] libmachine: (old-k8s-version-134433) Ensuring network mk-old-k8s-version-134433 is active
I0120 12:24:57.961466 989425 main.go:141] libmachine: (old-k8s-version-134433) getting domain XML...
I0120 12:24:57.962310 989425 main.go:141] libmachine: (old-k8s-version-134433) creating domain...
I0120 12:24:59.328594 989425 main.go:141] libmachine: (old-k8s-version-134433) waiting for IP...
I0120 12:24:59.329363 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | domain old-k8s-version-134433 has defined MAC address 52:54:00:4a:b6:e2 in network mk-old-k8s-version-134433
I0120 12:24:59.329830 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | unable to find current IP address of domain old-k8s-version-134433 in network mk-old-k8s-version-134433
I0120 12:24:59.329896 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | I0120 12:24:59.329835 989449 retry.go:31] will retry after 297.389487ms: waiting for domain to come up
I0120 12:24:59.629540 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | domain old-k8s-version-134433 has defined MAC address 52:54:00:4a:b6:e2 in network mk-old-k8s-version-134433
I0120 12:24:59.630105 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | unable to find current IP address of domain old-k8s-version-134433 in network mk-old-k8s-version-134433
I0120 12:24:59.630133 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | I0120 12:24:59.630069 989449 retry.go:31] will retry after 269.329201ms: waiting for domain to come up
I0120 12:24:59.900708 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | domain old-k8s-version-134433 has defined MAC address 52:54:00:4a:b6:e2 in network mk-old-k8s-version-134433
I0120 12:24:59.901281 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | unable to find current IP address of domain old-k8s-version-134433 in network mk-old-k8s-version-134433
I0120 12:24:59.901340 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | I0120 12:24:59.901269 989449 retry.go:31] will retry after 355.572884ms: waiting for domain to come up
I0120 12:25:00.258854 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | domain old-k8s-version-134433 has defined MAC address 52:54:00:4a:b6:e2 in network mk-old-k8s-version-134433
I0120 12:25:00.259449 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | unable to find current IP address of domain old-k8s-version-134433 in network mk-old-k8s-version-134433
I0120 12:25:00.259478 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | I0120 12:25:00.259371 989449 retry.go:31] will retry after 372.609615ms: waiting for domain to come up
I0120 12:25:00.634273 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | domain old-k8s-version-134433 has defined MAC address 52:54:00:4a:b6:e2 in network mk-old-k8s-version-134433
I0120 12:25:00.635021 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | unable to find current IP address of domain old-k8s-version-134433 in network mk-old-k8s-version-134433
I0120 12:25:00.635051 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | I0120 12:25:00.634997 989449 retry.go:31] will retry after 628.145422ms: waiting for domain to come up
I0120 12:25:01.264366 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | domain old-k8s-version-134433 has defined MAC address 52:54:00:4a:b6:e2 in network mk-old-k8s-version-134433
I0120 12:25:01.264906 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | unable to find current IP address of domain old-k8s-version-134433 in network mk-old-k8s-version-134433
I0120 12:25:01.264943 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | I0120 12:25:01.264880 989449 retry.go:31] will retry after 876.333086ms: waiting for domain to come up
I0120 12:25:02.143189 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | domain old-k8s-version-134433 has defined MAC address 52:54:00:4a:b6:e2 in network mk-old-k8s-version-134433
I0120 12:25:02.143741 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | unable to find current IP address of domain old-k8s-version-134433 in network mk-old-k8s-version-134433
I0120 12:25:02.143797 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | I0120 12:25:02.143702 989449 retry.go:31] will retry after 983.835016ms: waiting for domain to come up
I0120 12:25:03.128908 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | domain old-k8s-version-134433 has defined MAC address 52:54:00:4a:b6:e2 in network mk-old-k8s-version-134433
I0120 12:25:03.129534 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | unable to find current IP address of domain old-k8s-version-134433 in network mk-old-k8s-version-134433
I0120 12:25:03.129559 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | I0120 12:25:03.129514 989449 retry.go:31] will retry after 1.006804684s: waiting for domain to come up
I0120 12:25:04.138356 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | domain old-k8s-version-134433 has defined MAC address 52:54:00:4a:b6:e2 in network mk-old-k8s-version-134433
I0120 12:25:04.138990 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | unable to find current IP address of domain old-k8s-version-134433 in network mk-old-k8s-version-134433
I0120 12:25:04.139027 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | I0120 12:25:04.138913 989449 retry.go:31] will retry after 1.698132486s: waiting for domain to come up
I0120 12:25:05.839702 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | domain old-k8s-version-134433 has defined MAC address 52:54:00:4a:b6:e2 in network mk-old-k8s-version-134433
I0120 12:25:05.840361 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | unable to find current IP address of domain old-k8s-version-134433 in network mk-old-k8s-version-134433
I0120 12:25:05.840398 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | I0120 12:25:05.840276 989449 retry.go:31] will retry after 1.773615131s: waiting for domain to come up
I0120 12:25:07.616220 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | domain old-k8s-version-134433 has defined MAC address 52:54:00:4a:b6:e2 in network mk-old-k8s-version-134433
I0120 12:25:07.616837 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | unable to find current IP address of domain old-k8s-version-134433 in network mk-old-k8s-version-134433
I0120 12:25:07.616896 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | I0120 12:25:07.616796 989449 retry.go:31] will retry after 2.381680903s: waiting for domain to come up
I0120 12:25:09.999759 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | domain old-k8s-version-134433 has defined MAC address 52:54:00:4a:b6:e2 in network mk-old-k8s-version-134433
I0120 12:25:10.000299 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | unable to find current IP address of domain old-k8s-version-134433 in network mk-old-k8s-version-134433
I0120 12:25:10.000328 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | I0120 12:25:10.000256 989449 retry.go:31] will retry after 2.624643786s: waiting for domain to come up
I0120 12:25:12.626821 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | domain old-k8s-version-134433 has defined MAC address 52:54:00:4a:b6:e2 in network mk-old-k8s-version-134433
I0120 12:25:12.627385 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | unable to find current IP address of domain old-k8s-version-134433 in network mk-old-k8s-version-134433
I0120 12:25:12.627419 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | I0120 12:25:12.627343 989449 retry.go:31] will retry after 4.467337721s: waiting for domain to come up
I0120 12:25:17.099751 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | domain old-k8s-version-134433 has defined MAC address 52:54:00:4a:b6:e2 in network mk-old-k8s-version-134433
I0120 12:25:17.100340 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | unable to find current IP address of domain old-k8s-version-134433 in network mk-old-k8s-version-134433
I0120 12:25:17.100369 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | I0120 12:25:17.100287 989449 retry.go:31] will retry after 5.029432808s: waiting for domain to come up
I0120 12:25:22.132296 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | domain old-k8s-version-134433 has defined MAC address 52:54:00:4a:b6:e2 in network mk-old-k8s-version-134433
I0120 12:25:22.132911 989425 main.go:141] libmachine: (old-k8s-version-134433) found domain IP: 192.168.50.250
I0120 12:25:22.132954 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | domain old-k8s-version-134433 has current primary IP address 192.168.50.250 and MAC address 52:54:00:4a:b6:e2 in network mk-old-k8s-version-134433
I0120 12:25:22.132976 989425 main.go:141] libmachine: (old-k8s-version-134433) reserving static IP address...
I0120 12:25:22.133282 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-134433", mac: "52:54:00:4a:b6:e2", ip: "192.168.50.250"} in network mk-old-k8s-version-134433
I0120 12:25:22.210565 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | Getting to WaitForSSH function...
I0120 12:25:22.210601 989425 main.go:141] libmachine: (old-k8s-version-134433) reserved static IP address 192.168.50.250 for domain old-k8s-version-134433
I0120 12:25:22.210614 989425 main.go:141] libmachine: (old-k8s-version-134433) waiting for SSH...
I0120 12:25:22.213385 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | domain old-k8s-version-134433 has defined MAC address 52:54:00:4a:b6:e2 in network mk-old-k8s-version-134433
I0120 12:25:22.213776 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:4a:b6:e2", ip: ""} in network mk-old-k8s-version-134433: {Iface:virbr2 ExpiryTime:2025-01-20 13:25:12 +0000 UTC Type:0 Mac:52:54:00:4a:b6:e2 Iaid: IPaddr:192.168.50.250 Prefix:24 Hostname:minikube Clientid:01:52:54:00:4a:b6:e2}
I0120 12:25:22.213800 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | domain old-k8s-version-134433 has defined IP address 192.168.50.250 and MAC address 52:54:00:4a:b6:e2 in network mk-old-k8s-version-134433
I0120 12:25:22.213976 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | Using SSH client type: external
I0120 12:25:22.213999 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | Using SSH private key: /home/jenkins/minikube-integration/20151-942401/.minikube/machines/old-k8s-version-134433/id_rsa (-rw-------)
I0120 12:25:22.214032 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.50.250 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/20151-942401/.minikube/machines/old-k8s-version-134433/id_rsa -p 22] /usr/bin/ssh <nil>}
I0120 12:25:22.214047 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | About to run SSH command:
I0120 12:25:22.214080 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | exit 0
I0120 12:25:22.338311 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | SSH cmd err, output: <nil>:
I0120 12:25:22.338558 989425 main.go:141] libmachine: (old-k8s-version-134433) KVM machine creation complete
I0120 12:25:22.338935 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetConfigRaw
I0120 12:25:22.339619 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .DriverName
I0120 12:25:22.339885 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .DriverName
I0120 12:25:22.340055 989425 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0120 12:25:22.340071 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetState
I0120 12:25:22.341512 989425 main.go:141] libmachine: Detecting operating system of created instance...
I0120 12:25:22.341526 989425 main.go:141] libmachine: Waiting for SSH to be available...
I0120 12:25:22.341531 989425 main.go:141] libmachine: Getting to WaitForSSH function...
I0120 12:25:22.341536 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetSSHHostname
I0120 12:25:22.343991 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | domain old-k8s-version-134433 has defined MAC address 52:54:00:4a:b6:e2 in network mk-old-k8s-version-134433
I0120 12:25:22.344346 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:4a:b6:e2", ip: ""} in network mk-old-k8s-version-134433: {Iface:virbr2 ExpiryTime:2025-01-20 13:25:12 +0000 UTC Type:0 Mac:52:54:00:4a:b6:e2 Iaid: IPaddr:192.168.50.250 Prefix:24 Hostname:old-k8s-version-134433 Clientid:01:52:54:00:4a:b6:e2}
I0120 12:25:22.344382 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | domain old-k8s-version-134433 has defined IP address 192.168.50.250 and MAC address 52:54:00:4a:b6:e2 in network mk-old-k8s-version-134433
I0120 12:25:22.344533 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetSSHPort
I0120 12:25:22.344775 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetSSHKeyPath
I0120 12:25:22.344965 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetSSHKeyPath
I0120 12:25:22.345165 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetSSHUsername
I0120 12:25:22.345342 989425 main.go:141] libmachine: Using SSH client type: native
I0120 12:25:22.345575 989425 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.50.250 22 <nil> <nil>}
I0120 12:25:22.345588 989425 main.go:141] libmachine: About to run SSH command:
exit 0
I0120 12:25:22.453472 989425 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0120 12:25:22.453498 989425 main.go:141] libmachine: Detecting the provisioner...
I0120 12:25:22.453509 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetSSHHostname
I0120 12:25:22.456468 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | domain old-k8s-version-134433 has defined MAC address 52:54:00:4a:b6:e2 in network mk-old-k8s-version-134433
I0120 12:25:22.456832 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:4a:b6:e2", ip: ""} in network mk-old-k8s-version-134433: {Iface:virbr2 ExpiryTime:2025-01-20 13:25:12 +0000 UTC Type:0 Mac:52:54:00:4a:b6:e2 Iaid: IPaddr:192.168.50.250 Prefix:24 Hostname:old-k8s-version-134433 Clientid:01:52:54:00:4a:b6:e2}
I0120 12:25:22.456859 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | domain old-k8s-version-134433 has defined IP address 192.168.50.250 and MAC address 52:54:00:4a:b6:e2 in network mk-old-k8s-version-134433
I0120 12:25:22.456982 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetSSHPort
I0120 12:25:22.457183 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetSSHKeyPath
I0120 12:25:22.457341 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetSSHKeyPath
I0120 12:25:22.457524 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetSSHUsername
I0120 12:25:22.457692 989425 main.go:141] libmachine: Using SSH client type: native
I0120 12:25:22.457908 989425 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.50.250 22 <nil> <nil>}
I0120 12:25:22.457925 989425 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0120 12:25:22.562611 989425 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0120 12:25:22.562681 989425 main.go:141] libmachine: found compatible host: buildroot
I0120 12:25:22.562689 989425 main.go:141] libmachine: Provisioning with buildroot...
I0120 12:25:22.562697 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetMachineName
I0120 12:25:22.562972 989425 buildroot.go:166] provisioning hostname "old-k8s-version-134433"
I0120 12:25:22.563002 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetMachineName
I0120 12:25:22.563201 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetSSHHostname
I0120 12:25:22.565851 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | domain old-k8s-version-134433 has defined MAC address 52:54:00:4a:b6:e2 in network mk-old-k8s-version-134433
I0120 12:25:22.566229 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:4a:b6:e2", ip: ""} in network mk-old-k8s-version-134433: {Iface:virbr2 ExpiryTime:2025-01-20 13:25:12 +0000 UTC Type:0 Mac:52:54:00:4a:b6:e2 Iaid: IPaddr:192.168.50.250 Prefix:24 Hostname:old-k8s-version-134433 Clientid:01:52:54:00:4a:b6:e2}
I0120 12:25:22.566257 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | domain old-k8s-version-134433 has defined IP address 192.168.50.250 and MAC address 52:54:00:4a:b6:e2 in network mk-old-k8s-version-134433
I0120 12:25:22.566415 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetSSHPort
I0120 12:25:22.566607 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetSSHKeyPath
I0120 12:25:22.566766 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetSSHKeyPath
I0120 12:25:22.566900 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetSSHUsername
I0120 12:25:22.567097 989425 main.go:141] libmachine: Using SSH client type: native
I0120 12:25:22.567264 989425 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.50.250 22 <nil> <nil>}
I0120 12:25:22.567276 989425 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-134433 && echo "old-k8s-version-134433" | sudo tee /etc/hostname
I0120 12:25:22.686794 989425 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-134433
I0120 12:25:22.686832 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetSSHHostname
I0120 12:25:22.689267 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | domain old-k8s-version-134433 has defined MAC address 52:54:00:4a:b6:e2 in network mk-old-k8s-version-134433
I0120 12:25:22.689629 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:4a:b6:e2", ip: ""} in network mk-old-k8s-version-134433: {Iface:virbr2 ExpiryTime:2025-01-20 13:25:12 +0000 UTC Type:0 Mac:52:54:00:4a:b6:e2 Iaid: IPaddr:192.168.50.250 Prefix:24 Hostname:old-k8s-version-134433 Clientid:01:52:54:00:4a:b6:e2}
I0120 12:25:22.689657 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | domain old-k8s-version-134433 has defined IP address 192.168.50.250 and MAC address 52:54:00:4a:b6:e2 in network mk-old-k8s-version-134433
I0120 12:25:22.689818 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetSSHPort
I0120 12:25:22.689982 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetSSHKeyPath
I0120 12:25:22.690123 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetSSHKeyPath
I0120 12:25:22.690241 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetSSHUsername
I0120 12:25:22.690427 989425 main.go:141] libmachine: Using SSH client type: native
I0120 12:25:22.690599 989425 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.50.250 22 <nil> <nil>}
I0120 12:25:22.690614 989425 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-134433' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-134433/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-134433' | sudo tee -a /etc/hosts;
fi
fi
I0120 12:25:22.801613 989425 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0120 12:25:22.801638 989425 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/20151-942401/.minikube CaCertPath:/home/jenkins/minikube-integration/20151-942401/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20151-942401/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20151-942401/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20151-942401/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20151-942401/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20151-942401/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20151-942401/.minikube}
I0120 12:25:22.801674 989425 buildroot.go:174] setting up certificates
I0120 12:25:22.801683 989425 provision.go:84] configureAuth start
I0120 12:25:22.801695 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetMachineName
I0120 12:25:22.801970 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetIP
I0120 12:25:22.804510 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | domain old-k8s-version-134433 has defined MAC address 52:54:00:4a:b6:e2 in network mk-old-k8s-version-134433
I0120 12:25:22.804802 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:4a:b6:e2", ip: ""} in network mk-old-k8s-version-134433: {Iface:virbr2 ExpiryTime:2025-01-20 13:25:12 +0000 UTC Type:0 Mac:52:54:00:4a:b6:e2 Iaid: IPaddr:192.168.50.250 Prefix:24 Hostname:old-k8s-version-134433 Clientid:01:52:54:00:4a:b6:e2}
I0120 12:25:22.804827 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | domain old-k8s-version-134433 has defined IP address 192.168.50.250 and MAC address 52:54:00:4a:b6:e2 in network mk-old-k8s-version-134433
I0120 12:25:22.805014 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetSSHHostname
I0120 12:25:22.807051 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | domain old-k8s-version-134433 has defined MAC address 52:54:00:4a:b6:e2 in network mk-old-k8s-version-134433
I0120 12:25:22.807399 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:4a:b6:e2", ip: ""} in network mk-old-k8s-version-134433: {Iface:virbr2 ExpiryTime:2025-01-20 13:25:12 +0000 UTC Type:0 Mac:52:54:00:4a:b6:e2 Iaid: IPaddr:192.168.50.250 Prefix:24 Hostname:old-k8s-version-134433 Clientid:01:52:54:00:4a:b6:e2}
I0120 12:25:22.807434 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | domain old-k8s-version-134433 has defined IP address 192.168.50.250 and MAC address 52:54:00:4a:b6:e2 in network mk-old-k8s-version-134433
I0120 12:25:22.807568 989425 provision.go:143] copyHostCerts
I0120 12:25:22.807621 989425 exec_runner.go:144] found /home/jenkins/minikube-integration/20151-942401/.minikube/ca.pem, removing ...
I0120 12:25:22.807643 989425 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20151-942401/.minikube/ca.pem
I0120 12:25:22.807704 989425 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20151-942401/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20151-942401/.minikube/ca.pem (1078 bytes)
I0120 12:25:22.807816 989425 exec_runner.go:144] found /home/jenkins/minikube-integration/20151-942401/.minikube/cert.pem, removing ...
I0120 12:25:22.807828 989425 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20151-942401/.minikube/cert.pem
I0120 12:25:22.807851 989425 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20151-942401/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20151-942401/.minikube/cert.pem (1123 bytes)
I0120 12:25:22.807911 989425 exec_runner.go:144] found /home/jenkins/minikube-integration/20151-942401/.minikube/key.pem, removing ...
I0120 12:25:22.807919 989425 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20151-942401/.minikube/key.pem
I0120 12:25:22.807938 989425 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20151-942401/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20151-942401/.minikube/key.pem (1675 bytes)
I0120 12:25:22.807993 989425 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20151-942401/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20151-942401/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20151-942401/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-134433 san=[127.0.0.1 192.168.50.250 localhost minikube old-k8s-version-134433]
I0120 12:25:23.051399 989425 provision.go:177] copyRemoteCerts
I0120 12:25:23.051454 989425 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0120 12:25:23.051478 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetSSHHostname
I0120 12:25:23.054376 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | domain old-k8s-version-134433 has defined MAC address 52:54:00:4a:b6:e2 in network mk-old-k8s-version-134433
I0120 12:25:23.054742 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:4a:b6:e2", ip: ""} in network mk-old-k8s-version-134433: {Iface:virbr2 ExpiryTime:2025-01-20 13:25:12 +0000 UTC Type:0 Mac:52:54:00:4a:b6:e2 Iaid: IPaddr:192.168.50.250 Prefix:24 Hostname:old-k8s-version-134433 Clientid:01:52:54:00:4a:b6:e2}
I0120 12:25:23.054766 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | domain old-k8s-version-134433 has defined IP address 192.168.50.250 and MAC address 52:54:00:4a:b6:e2 in network mk-old-k8s-version-134433
I0120 12:25:23.055006 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetSSHPort
I0120 12:25:23.055247 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetSSHKeyPath
I0120 12:25:23.055424 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetSSHUsername
I0120 12:25:23.055658 989425 sshutil.go:53] new ssh client: &{IP:192.168.50.250 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20151-942401/.minikube/machines/old-k8s-version-134433/id_rsa Username:docker}
I0120 12:25:23.140140 989425 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20151-942401/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0120 12:25:23.161505 989425 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20151-942401/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0120 12:25:23.182315 989425 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20151-942401/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0120 12:25:23.202948 989425 provision.go:87] duration metric: took 401.251207ms to configureAuth
I0120 12:25:23.202973 989425 buildroot.go:189] setting minikube options for container-runtime
I0120 12:25:23.203138 989425 config.go:182] Loaded profile config "old-k8s-version-134433": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0120 12:25:23.203219 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetSSHHostname
I0120 12:25:23.206178 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | domain old-k8s-version-134433 has defined MAC address 52:54:00:4a:b6:e2 in network mk-old-k8s-version-134433
I0120 12:25:23.206547 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:4a:b6:e2", ip: ""} in network mk-old-k8s-version-134433: {Iface:virbr2 ExpiryTime:2025-01-20 13:25:12 +0000 UTC Type:0 Mac:52:54:00:4a:b6:e2 Iaid: IPaddr:192.168.50.250 Prefix:24 Hostname:old-k8s-version-134433 Clientid:01:52:54:00:4a:b6:e2}
I0120 12:25:23.206581 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | domain old-k8s-version-134433 has defined IP address 192.168.50.250 and MAC address 52:54:00:4a:b6:e2 in network mk-old-k8s-version-134433
I0120 12:25:23.206839 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetSSHPort
I0120 12:25:23.207079 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetSSHKeyPath
I0120 12:25:23.207269 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetSSHKeyPath
I0120 12:25:23.207489 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetSSHUsername
I0120 12:25:23.207678 989425 main.go:141] libmachine: Using SSH client type: native
I0120 12:25:23.207886 989425 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.50.250 22 <nil> <nil>}
I0120 12:25:23.207910 989425 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0120 12:25:23.425860 989425 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0120 12:25:23.425905 989425 main.go:141] libmachine: Checking connection to Docker...
I0120 12:25:23.425920 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetURL
I0120 12:25:23.427275 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | using libvirt version 6000000
I0120 12:25:23.429272 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | domain old-k8s-version-134433 has defined MAC address 52:54:00:4a:b6:e2 in network mk-old-k8s-version-134433
I0120 12:25:23.429586 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:4a:b6:e2", ip: ""} in network mk-old-k8s-version-134433: {Iface:virbr2 ExpiryTime:2025-01-20 13:25:12 +0000 UTC Type:0 Mac:52:54:00:4a:b6:e2 Iaid: IPaddr:192.168.50.250 Prefix:24 Hostname:old-k8s-version-134433 Clientid:01:52:54:00:4a:b6:e2}
I0120 12:25:23.429619 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | domain old-k8s-version-134433 has defined IP address 192.168.50.250 and MAC address 52:54:00:4a:b6:e2 in network mk-old-k8s-version-134433
I0120 12:25:23.429774 989425 main.go:141] libmachine: Docker is up and running!
I0120 12:25:23.429796 989425 main.go:141] libmachine: Reticulating splines...
I0120 12:25:23.429803 989425 client.go:171] duration metric: took 26.301461876s to LocalClient.Create
I0120 12:25:23.429826 989425 start.go:167] duration metric: took 26.301528725s to libmachine.API.Create "old-k8s-version-134433"
I0120 12:25:23.429838 989425 start.go:293] postStartSetup for "old-k8s-version-134433" (driver="kvm2")
I0120 12:25:23.429848 989425 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0120 12:25:23.429867 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .DriverName
I0120 12:25:23.430141 989425 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0120 12:25:23.430178 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetSSHHostname
I0120 12:25:23.432453 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | domain old-k8s-version-134433 has defined MAC address 52:54:00:4a:b6:e2 in network mk-old-k8s-version-134433
I0120 12:25:23.432755 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:4a:b6:e2", ip: ""} in network mk-old-k8s-version-134433: {Iface:virbr2 ExpiryTime:2025-01-20 13:25:12 +0000 UTC Type:0 Mac:52:54:00:4a:b6:e2 Iaid: IPaddr:192.168.50.250 Prefix:24 Hostname:old-k8s-version-134433 Clientid:01:52:54:00:4a:b6:e2}
I0120 12:25:23.432787 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | domain old-k8s-version-134433 has defined IP address 192.168.50.250 and MAC address 52:54:00:4a:b6:e2 in network mk-old-k8s-version-134433
I0120 12:25:23.432920 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetSSHPort
I0120 12:25:23.433069 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetSSHKeyPath
I0120 12:25:23.433226 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetSSHUsername
I0120 12:25:23.433371 989425 sshutil.go:53] new ssh client: &{IP:192.168.50.250 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20151-942401/.minikube/machines/old-k8s-version-134433/id_rsa Username:docker}
I0120 12:25:23.516273 989425 ssh_runner.go:195] Run: cat /etc/os-release
I0120 12:25:23.520244 989425 info.go:137] Remote host: Buildroot 2023.02.9
I0120 12:25:23.520265 989425 filesync.go:126] Scanning /home/jenkins/minikube-integration/20151-942401/.minikube/addons for local assets ...
I0120 12:25:23.520323 989425 filesync.go:126] Scanning /home/jenkins/minikube-integration/20151-942401/.minikube/files for local assets ...
I0120 12:25:23.520400 989425 filesync.go:149] local asset: /home/jenkins/minikube-integration/20151-942401/.minikube/files/etc/ssl/certs/9496562.pem -> 9496562.pem in /etc/ssl/certs
I0120 12:25:23.520482 989425 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0120 12:25:23.528957 989425 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20151-942401/.minikube/files/etc/ssl/certs/9496562.pem --> /etc/ssl/certs/9496562.pem (1708 bytes)
I0120 12:25:23.551611 989425 start.go:296] duration metric: took 121.762942ms for postStartSetup
I0120 12:25:23.551663 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetConfigRaw
I0120 12:25:23.552228 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetIP
I0120 12:25:23.554800 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | domain old-k8s-version-134433 has defined MAC address 52:54:00:4a:b6:e2 in network mk-old-k8s-version-134433
I0120 12:25:23.555249 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:4a:b6:e2", ip: ""} in network mk-old-k8s-version-134433: {Iface:virbr2 ExpiryTime:2025-01-20 13:25:12 +0000 UTC Type:0 Mac:52:54:00:4a:b6:e2 Iaid: IPaddr:192.168.50.250 Prefix:24 Hostname:old-k8s-version-134433 Clientid:01:52:54:00:4a:b6:e2}
I0120 12:25:23.555281 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | domain old-k8s-version-134433 has defined IP address 192.168.50.250 and MAC address 52:54:00:4a:b6:e2 in network mk-old-k8s-version-134433
I0120 12:25:23.555581 989425 profile.go:143] Saving config to /home/jenkins/minikube-integration/20151-942401/.minikube/profiles/old-k8s-version-134433/config.json ...
I0120 12:25:23.555783 989425 start.go:128] duration metric: took 26.451726976s to createHost
I0120 12:25:23.555813 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetSSHHostname
I0120 12:25:23.557853 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | domain old-k8s-version-134433 has defined MAC address 52:54:00:4a:b6:e2 in network mk-old-k8s-version-134433
I0120 12:25:23.558133 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:4a:b6:e2", ip: ""} in network mk-old-k8s-version-134433: {Iface:virbr2 ExpiryTime:2025-01-20 13:25:12 +0000 UTC Type:0 Mac:52:54:00:4a:b6:e2 Iaid: IPaddr:192.168.50.250 Prefix:24 Hostname:old-k8s-version-134433 Clientid:01:52:54:00:4a:b6:e2}
I0120 12:25:23.558164 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | domain old-k8s-version-134433 has defined IP address 192.168.50.250 and MAC address 52:54:00:4a:b6:e2 in network mk-old-k8s-version-134433
I0120 12:25:23.558280 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetSSHPort
I0120 12:25:23.558451 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetSSHKeyPath
I0120 12:25:23.558633 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetSSHKeyPath
I0120 12:25:23.558769 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetSSHUsername
I0120 12:25:23.558915 989425 main.go:141] libmachine: Using SSH client type: native
I0120 12:25:23.559079 989425 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.50.250 22 <nil> <nil>}
I0120 12:25:23.559089 989425 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0120 12:25:23.667851 989425 main.go:141] libmachine: SSH cmd err, output: <nil>: 1737375923.637399880
I0120 12:25:23.667875 989425 fix.go:216] guest clock: 1737375923.637399880
I0120 12:25:23.667885 989425 fix.go:229] Guest: 2025-01-20 12:25:23.63739988 +0000 UTC Remote: 2025-01-20 12:25:23.55579891 +0000 UTC m=+26.591600371 (delta=81.60097ms)
I0120 12:25:23.667922 989425 fix.go:200] guest clock delta is within tolerance: 81.60097ms
I0120 12:25:23.667929 989425 start.go:83] releasing machines lock for "old-k8s-version-134433", held for 26.563998178s
I0120 12:25:23.667957 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .DriverName
I0120 12:25:23.668274 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetIP
I0120 12:25:23.671670 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | domain old-k8s-version-134433 has defined MAC address 52:54:00:4a:b6:e2 in network mk-old-k8s-version-134433
I0120 12:25:23.671993 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:4a:b6:e2", ip: ""} in network mk-old-k8s-version-134433: {Iface:virbr2 ExpiryTime:2025-01-20 13:25:12 +0000 UTC Type:0 Mac:52:54:00:4a:b6:e2 Iaid: IPaddr:192.168.50.250 Prefix:24 Hostname:old-k8s-version-134433 Clientid:01:52:54:00:4a:b6:e2}
I0120 12:25:23.672015 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | domain old-k8s-version-134433 has defined IP address 192.168.50.250 and MAC address 52:54:00:4a:b6:e2 in network mk-old-k8s-version-134433
I0120 12:25:23.672177 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .DriverName
I0120 12:25:23.672668 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .DriverName
I0120 12:25:23.672876 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .DriverName
I0120 12:25:23.672959 989425 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0120 12:25:23.673009 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetSSHHostname
I0120 12:25:23.673104 989425 ssh_runner.go:195] Run: cat /version.json
I0120 12:25:23.673137 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetSSHHostname
I0120 12:25:23.675740 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | domain old-k8s-version-134433 has defined MAC address 52:54:00:4a:b6:e2 in network mk-old-k8s-version-134433
I0120 12:25:23.676099 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:4a:b6:e2", ip: ""} in network mk-old-k8s-version-134433: {Iface:virbr2 ExpiryTime:2025-01-20 13:25:12 +0000 UTC Type:0 Mac:52:54:00:4a:b6:e2 Iaid: IPaddr:192.168.50.250 Prefix:24 Hostname:old-k8s-version-134433 Clientid:01:52:54:00:4a:b6:e2}
I0120 12:25:23.676140 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | domain old-k8s-version-134433 has defined MAC address 52:54:00:4a:b6:e2 in network mk-old-k8s-version-134433
I0120 12:25:23.676164 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | domain old-k8s-version-134433 has defined IP address 192.168.50.250 and MAC address 52:54:00:4a:b6:e2 in network mk-old-k8s-version-134433
I0120 12:25:23.676387 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetSSHPort
I0120 12:25:23.676593 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:4a:b6:e2", ip: ""} in network mk-old-k8s-version-134433: {Iface:virbr2 ExpiryTime:2025-01-20 13:25:12 +0000 UTC Type:0 Mac:52:54:00:4a:b6:e2 Iaid: IPaddr:192.168.50.250 Prefix:24 Hostname:old-k8s-version-134433 Clientid:01:52:54:00:4a:b6:e2}
I0120 12:25:23.676606 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetSSHKeyPath
I0120 12:25:23.676623 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | domain old-k8s-version-134433 has defined IP address 192.168.50.250 and MAC address 52:54:00:4a:b6:e2 in network mk-old-k8s-version-134433
I0120 12:25:23.676814 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetSSHUsername
I0120 12:25:23.676815 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetSSHPort
I0120 12:25:23.677026 989425 sshutil.go:53] new ssh client: &{IP:192.168.50.250 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20151-942401/.minikube/machines/old-k8s-version-134433/id_rsa Username:docker}
I0120 12:25:23.677051 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetSSHKeyPath
I0120 12:25:23.677198 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetSSHUsername
I0120 12:25:23.677366 989425 sshutil.go:53] new ssh client: &{IP:192.168.50.250 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20151-942401/.minikube/machines/old-k8s-version-134433/id_rsa Username:docker}
I0120 12:25:23.763734 989425 ssh_runner.go:195] Run: systemctl --version
I0120 12:25:23.793612 989425 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0120 12:25:23.953200 989425 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0120 12:25:23.959021 989425 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0120 12:25:23.959095 989425 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0120 12:25:23.973584 989425 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0120 12:25:23.973604 989425 start.go:495] detecting cgroup driver to use...
I0120 12:25:23.973668 989425 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0120 12:25:23.991439 989425 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0120 12:25:24.004055 989425 docker.go:217] disabling cri-docker service (if available) ...
I0120 12:25:24.004121 989425 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0120 12:25:24.018540 989425 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0120 12:25:24.031295 989425 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0120 12:25:24.150758 989425 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0120 12:25:24.307851 989425 docker.go:233] disabling docker service ...
I0120 12:25:24.307934 989425 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0120 12:25:24.320907 989425 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0120 12:25:24.332351 989425 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0120 12:25:24.440897 989425 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0120 12:25:24.550485 989425 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0120 12:25:24.564766 989425 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0120 12:25:24.584663 989425 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0120 12:25:24.584726 989425 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0120 12:25:24.596509 989425 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0120 12:25:24.596573 989425 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0120 12:25:24.608176 989425 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0120 12:25:24.619502 989425 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0120 12:25:24.630953 989425 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0120 12:25:24.642766 989425 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0120 12:25:24.653833 989425 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0120 12:25:24.653872 989425 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0120 12:25:24.667170 989425 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0120 12:25:24.676072 989425 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0120 12:25:24.791117 989425 ssh_runner.go:195] Run: sudo systemctl restart crio
I0120 12:25:24.895728 989425 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0120 12:25:24.895793 989425 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0120 12:25:24.900789 989425 start.go:563] Will wait 60s for crictl version
I0120 12:25:24.900838 989425 ssh_runner.go:195] Run: which crictl
I0120 12:25:24.904431 989425 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0120 12:25:24.946045 989425 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0120 12:25:24.946138 989425 ssh_runner.go:195] Run: crio --version
I0120 12:25:24.972285 989425 ssh_runner.go:195] Run: crio --version
I0120 12:25:24.998476 989425 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0120 12:25:24.999716 989425 main.go:141] libmachine: (old-k8s-version-134433) Calling .GetIP
I0120 12:25:25.002983 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | domain old-k8s-version-134433 has defined MAC address 52:54:00:4a:b6:e2 in network mk-old-k8s-version-134433
I0120 12:25:25.003501 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:4a:b6:e2", ip: ""} in network mk-old-k8s-version-134433: {Iface:virbr2 ExpiryTime:2025-01-20 13:25:12 +0000 UTC Type:0 Mac:52:54:00:4a:b6:e2 Iaid: IPaddr:192.168.50.250 Prefix:24 Hostname:old-k8s-version-134433 Clientid:01:52:54:00:4a:b6:e2}
I0120 12:25:25.003540 989425 main.go:141] libmachine: (old-k8s-version-134433) DBG | domain old-k8s-version-134433 has defined IP address 192.168.50.250 and MAC address 52:54:00:4a:b6:e2 in network mk-old-k8s-version-134433
I0120 12:25:25.003760 989425 ssh_runner.go:195] Run: grep 192.168.50.1 host.minikube.internal$ /etc/hosts
I0120 12:25:25.007680 989425 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.50.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0120 12:25:25.019820 989425 kubeadm.go:883] updating cluster {Name:old-k8s-version-134433 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-134433 Namespace
:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.50.250 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror:
DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0120 12:25:25.019940 989425 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0120 12:25:25.019984 989425 ssh_runner.go:195] Run: sudo crictl images --output json
I0120 12:25:25.052588 989425 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0120 12:25:25.052645 989425 ssh_runner.go:195] Run: which lz4
I0120 12:25:25.056523 989425 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0120 12:25:25.060973 989425 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0120 12:25:25.061006 989425 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20151-942401/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0120 12:25:26.528531 989425 crio.go:462] duration metric: took 1.47203598s to copy over tarball
I0120 12:25:26.528609 989425 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0120 12:25:28.999385 989425 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.470733651s)
I0120 12:25:28.999419 989425 crio.go:469] duration metric: took 2.470853982s to extract the tarball
I0120 12:25:28.999429 989425 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0120 12:25:29.042912 989425 ssh_runner.go:195] Run: sudo crictl images --output json
I0120 12:25:29.084820 989425 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0120 12:25:29.084849 989425 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0120 12:25:29.084909 989425 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0120 12:25:29.084934 989425 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0120 12:25:29.084959 989425 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0120 12:25:29.084947 989425 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0120 12:25:29.084999 989425 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0120 12:25:29.085014 989425 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0120 12:25:29.085047 989425 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I0120 12:25:29.085092 989425 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I0120 12:25:29.086420 989425 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0120 12:25:29.086627 989425 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0120 12:25:29.086688 989425 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0120 12:25:29.086716 989425 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0120 12:25:29.086753 989425 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0120 12:25:29.086693 989425 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0120 12:25:29.086696 989425 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0120 12:25:29.086755 989425 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0120 12:25:29.303407 989425 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0120 12:25:29.307859 989425 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0120 12:25:29.313389 989425 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0120 12:25:29.314591 989425 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0120 12:25:29.319794 989425 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0120 12:25:29.331925 989425 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0120 12:25:29.353611 989425 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0120 12:25:29.397745 989425 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0120 12:25:29.397812 989425 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0120 12:25:29.397859 989425 ssh_runner.go:195] Run: which crictl
I0120 12:25:29.451685 989425 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0120 12:25:29.451746 989425 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0120 12:25:29.451808 989425 ssh_runner.go:195] Run: which crictl
I0120 12:25:29.475375 989425 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0120 12:25:29.475443 989425 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0120 12:25:29.475505 989425 ssh_runner.go:195] Run: which crictl
I0120 12:25:29.486774 989425 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0120 12:25:29.486827 989425 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0120 12:25:29.486862 989425 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0120 12:25:29.486876 989425 ssh_runner.go:195] Run: which crictl
I0120 12:25:29.486900 989425 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0120 12:25:29.486776 989425 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0120 12:25:29.486947 989425 ssh_runner.go:195] Run: which crictl
I0120 12:25:29.486954 989425 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0120 12:25:29.486955 989425 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0120 12:25:29.487000 989425 ssh_runner.go:195] Run: which crictl
I0120 12:25:29.486780 989425 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0120 12:25:29.487045 989425 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0120 12:25:29.487054 989425 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0120 12:25:29.487070 989425 ssh_runner.go:195] Run: which crictl
I0120 12:25:29.489682 989425 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0120 12:25:29.550515 989425 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0120 12:25:29.550611 989425 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0120 12:25:29.550632 989425 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0120 12:25:29.550661 989425 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0120 12:25:29.550713 989425 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0120 12:25:29.550770 989425 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0120 12:25:29.567106 989425 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0120 12:25:29.676340 989425 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0120 12:25:29.724817 989425 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0120 12:25:29.724873 989425 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0120 12:25:29.724988 989425 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0120 12:25:29.724994 989425 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0120 12:25:29.725057 989425 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0120 12:25:29.728153 989425 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0120 12:25:29.731763 989425 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0120 12:25:29.867661 989425 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0120 12:25:29.867662 989425 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0120 12:25:29.872126 989425 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20151-942401/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0120 12:25:29.872203 989425 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20151-942401/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0120 12:25:29.872258 989425 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0120 12:25:29.872304 989425 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20151-942401/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0120 12:25:29.872358 989425 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20151-942401/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0120 12:25:29.943040 989425 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20151-942401/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0120 12:25:29.943087 989425 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20151-942401/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0120 12:25:29.943091 989425 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20151-942401/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0120 12:25:30.264311 989425 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0120 12:25:30.402469 989425 cache_images.go:92] duration metric: took 1.317599075s to LoadCachedImages
W0120 12:25:30.402593 989425 out.go:270] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20151-942401/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20151-942401/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0: no such file or directory
I0120 12:25:30.402613 989425 kubeadm.go:934] updating node { 192.168.50.250 8443 v1.20.0 crio true true} ...
I0120 12:25:30.402746 989425 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-134433 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.50.250
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-134433 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0120 12:25:30.402835 989425 ssh_runner.go:195] Run: crio config
I0120 12:25:30.451559 989425 cni.go:84] Creating CNI manager for ""
I0120 12:25:30.451582 989425 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0120 12:25:30.451594 989425 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0120 12:25:30.451620 989425 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.50.250 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-134433 NodeName:old-k8s-version-134433 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.50.250"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.50.250 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0120 12:25:30.451766 989425 kubeadm.go:195] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.50.250
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-134433"
kubeletExtraArgs:
node-ip: 192.168.50.250
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.50.250"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0120 12:25:30.451865 989425 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0120 12:25:30.461678 989425 binaries.go:44] Found k8s binaries, skipping transfer
I0120 12:25:30.461758 989425 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0120 12:25:30.471627 989425 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0120 12:25:30.487227 989425 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0120 12:25:30.503247 989425 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2123 bytes)
I0120 12:25:30.518623 989425 ssh_runner.go:195] Run: grep 192.168.50.250 control-plane.minikube.internal$ /etc/hosts
I0120 12:25:30.522304 989425 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.50.250 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0120 12:25:30.534332 989425 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0120 12:25:30.657947 989425 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0120 12:25:30.674996 989425 certs.go:68] Setting up /home/jenkins/minikube-integration/20151-942401/.minikube/profiles/old-k8s-version-134433 for IP: 192.168.50.250
I0120 12:25:30.675024 989425 certs.go:194] generating shared ca certs ...
I0120 12:25:30.675049 989425 certs.go:226] acquiring lock for ca certs: {Name:mk7d6f61e0c358ebc451db1b73619131ab80bd63 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0120 12:25:30.675266 989425 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20151-942401/.minikube/ca.key
I0120 12:25:30.675332 989425 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20151-942401/.minikube/proxy-client-ca.key
I0120 12:25:30.675346 989425 certs.go:256] generating profile certs ...
I0120 12:25:30.675424 989425 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/20151-942401/.minikube/profiles/old-k8s-version-134433/client.key
I0120 12:25:30.675457 989425 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20151-942401/.minikube/profiles/old-k8s-version-134433/client.crt with IP's: []
I0120 12:25:31.094629 989425 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20151-942401/.minikube/profiles/old-k8s-version-134433/client.crt ...
I0120 12:25:31.094664 989425 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20151-942401/.minikube/profiles/old-k8s-version-134433/client.crt: {Name:mkf80c28b98931ac93f9fa1ac55653146433ed40 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0120 12:25:31.094863 989425 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20151-942401/.minikube/profiles/old-k8s-version-134433/client.key ...
I0120 12:25:31.094885 989425 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20151-942401/.minikube/profiles/old-k8s-version-134433/client.key: {Name:mk3167171cda17b253ef75e32e7333563dfc097a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0120 12:25:31.095007 989425 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/20151-942401/.minikube/profiles/old-k8s-version-134433/apiserver.key.6d656c93
I0120 12:25:31.095029 989425 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20151-942401/.minikube/profiles/old-k8s-version-134433/apiserver.crt.6d656c93 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.50.250]
I0120 12:25:31.258824 989425 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20151-942401/.minikube/profiles/old-k8s-version-134433/apiserver.crt.6d656c93 ...
I0120 12:25:31.258853 989425 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20151-942401/.minikube/profiles/old-k8s-version-134433/apiserver.crt.6d656c93: {Name:mk34553942ac2293e300722f44928e7ed4448abe Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0120 12:25:31.259032 989425 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20151-942401/.minikube/profiles/old-k8s-version-134433/apiserver.key.6d656c93 ...
I0120 12:25:31.259051 989425 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20151-942401/.minikube/profiles/old-k8s-version-134433/apiserver.key.6d656c93: {Name:mk7d809a9161f49c2563940dcb7b85fe616c3ea3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0120 12:25:31.259153 989425 certs.go:381] copying /home/jenkins/minikube-integration/20151-942401/.minikube/profiles/old-k8s-version-134433/apiserver.crt.6d656c93 -> /home/jenkins/minikube-integration/20151-942401/.minikube/profiles/old-k8s-version-134433/apiserver.crt
I0120 12:25:31.259230 989425 certs.go:385] copying /home/jenkins/minikube-integration/20151-942401/.minikube/profiles/old-k8s-version-134433/apiserver.key.6d656c93 -> /home/jenkins/minikube-integration/20151-942401/.minikube/profiles/old-k8s-version-134433/apiserver.key
I0120 12:25:31.259282 989425 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/20151-942401/.minikube/profiles/old-k8s-version-134433/proxy-client.key
I0120 12:25:31.259298 989425 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20151-942401/.minikube/profiles/old-k8s-version-134433/proxy-client.crt with IP's: []
I0120 12:25:31.399130 989425 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20151-942401/.minikube/profiles/old-k8s-version-134433/proxy-client.crt ...
I0120 12:25:31.399162 989425 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20151-942401/.minikube/profiles/old-k8s-version-134433/proxy-client.crt: {Name:mkaeb6f4a25baf8144019273f88f78656fa0b628 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0120 12:25:31.399348 989425 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20151-942401/.minikube/profiles/old-k8s-version-134433/proxy-client.key ...
I0120 12:25:31.399367 989425 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20151-942401/.minikube/profiles/old-k8s-version-134433/proxy-client.key: {Name:mk54ae09ec6b743b281fd01a58d0bf264a595e49 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0120 12:25:31.399573 989425 certs.go:484] found cert: /home/jenkins/minikube-integration/20151-942401/.minikube/certs/949656.pem (1338 bytes)
W0120 12:25:31.399615 989425 certs.go:480] ignoring /home/jenkins/minikube-integration/20151-942401/.minikube/certs/949656_empty.pem, impossibly tiny 0 bytes
I0120 12:25:31.399625 989425 certs.go:484] found cert: /home/jenkins/minikube-integration/20151-942401/.minikube/certs/ca-key.pem (1679 bytes)
I0120 12:25:31.399648 989425 certs.go:484] found cert: /home/jenkins/minikube-integration/20151-942401/.minikube/certs/ca.pem (1078 bytes)
I0120 12:25:31.399669 989425 certs.go:484] found cert: /home/jenkins/minikube-integration/20151-942401/.minikube/certs/cert.pem (1123 bytes)
I0120 12:25:31.399690 989425 certs.go:484] found cert: /home/jenkins/minikube-integration/20151-942401/.minikube/certs/key.pem (1675 bytes)
I0120 12:25:31.399732 989425 certs.go:484] found cert: /home/jenkins/minikube-integration/20151-942401/.minikube/files/etc/ssl/certs/9496562.pem (1708 bytes)
I0120 12:25:31.400297 989425 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20151-942401/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0120 12:25:31.431955 989425 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20151-942401/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0120 12:25:31.454724 989425 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20151-942401/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0120 12:25:31.479233 989425 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20151-942401/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0120 12:25:31.514558 989425 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20151-942401/.minikube/profiles/old-k8s-version-134433/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0120 12:25:31.549166 989425 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20151-942401/.minikube/profiles/old-k8s-version-134433/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0120 12:25:31.593875 989425 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20151-942401/.minikube/profiles/old-k8s-version-134433/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0120 12:25:31.620401 989425 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20151-942401/.minikube/profiles/old-k8s-version-134433/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0120 12:25:31.645241 989425 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20151-942401/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0120 12:25:31.667476 989425 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20151-942401/.minikube/certs/949656.pem --> /usr/share/ca-certificates/949656.pem (1338 bytes)
I0120 12:25:31.690503 989425 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20151-942401/.minikube/files/etc/ssl/certs/9496562.pem --> /usr/share/ca-certificates/9496562.pem (1708 bytes)
I0120 12:25:31.714182 989425 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0120 12:25:31.732442 989425 ssh_runner.go:195] Run: openssl version
I0120 12:25:31.739674 989425 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0120 12:25:31.752455 989425 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0120 12:25:31.757118 989425 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jan 20 11:22 /usr/share/ca-certificates/minikubeCA.pem
I0120 12:25:31.757182 989425 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0120 12:25:31.762976 989425 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0120 12:25:31.773229 989425 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/949656.pem && ln -fs /usr/share/ca-certificates/949656.pem /etc/ssl/certs/949656.pem"
I0120 12:25:31.783705 989425 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/949656.pem
I0120 12:25:31.787945 989425 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jan 20 11:30 /usr/share/ca-certificates/949656.pem
I0120 12:25:31.787993 989425 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/949656.pem
I0120 12:25:31.793705 989425 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/949656.pem /etc/ssl/certs/51391683.0"
I0120 12:25:31.803820 989425 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/9496562.pem && ln -fs /usr/share/ca-certificates/9496562.pem /etc/ssl/certs/9496562.pem"
I0120 12:25:31.814595 989425 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/9496562.pem
I0120 12:25:31.819359 989425 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jan 20 11:30 /usr/share/ca-certificates/9496562.pem
I0120 12:25:31.819415 989425 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/9496562.pem
I0120 12:25:31.825603 989425 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/9496562.pem /etc/ssl/certs/3ec20f2e.0"
I0120 12:25:31.836673 989425 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0120 12:25:31.841372 989425 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0120 12:25:31.841459 989425 kubeadm.go:392] StartCluster: {Name:old-k8s-version-134433 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-134433 Namespace:de
fault APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.50.250 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Dis
ableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0120 12:25:31.841556 989425 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0120 12:25:31.841607 989425 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0120 12:25:31.886587 989425 cri.go:89] found id: ""
I0120 12:25:31.886666 989425 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0120 12:25:31.897849 989425 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0120 12:25:31.908287 989425 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0120 12:25:31.918432 989425 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0120 12:25:31.918449 989425 kubeadm.go:157] found existing configuration files:
I0120 12:25:31.918492 989425 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0120 12:25:31.928101 989425 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0120 12:25:31.928148 989425 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0120 12:25:31.938238 989425 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0120 12:25:31.948052 989425 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0120 12:25:31.948130 989425 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0120 12:25:31.958212 989425 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0120 12:25:31.967885 989425 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0120 12:25:31.967937 989425 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0120 12:25:31.977110 989425 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0120 12:25:31.985742 989425 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0120 12:25:31.985793 989425 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0120 12:25:31.995228 989425 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0120 12:25:32.105886 989425 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0120 12:25:32.105970 989425 kubeadm.go:310] [preflight] Running pre-flight checks
I0120 12:25:32.252581 989425 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0120 12:25:32.252766 989425 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0120 12:25:32.252944 989425 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0120 12:25:32.484481 989425 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0120 12:25:32.585750 989425 out.go:235] - Generating certificates and keys ...
I0120 12:25:32.585892 989425 kubeadm.go:310] [certs] Using existing ca certificate authority
I0120 12:25:32.586038 989425 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0120 12:25:32.651778 989425 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0120 12:25:32.964982 989425 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0120 12:25:33.121114 989425 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0120 12:25:33.271260 989425 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0120 12:25:33.328325 989425 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0120 12:25:33.328501 989425 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-134433] and IPs [192.168.50.250 127.0.0.1 ::1]
I0120 12:25:33.506051 989425 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0120 12:25:33.506306 989425 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-134433] and IPs [192.168.50.250 127.0.0.1 ::1]
I0120 12:25:33.721695 989425 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0120 12:25:33.827671 989425 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0120 12:25:34.086992 989425 kubeadm.go:310] [certs] Generating "sa" key and public key
I0120 12:25:34.090455 989425 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0120 12:25:34.216737 989425 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0120 12:25:34.448898 989425 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0120 12:25:34.510125 989425 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0120 12:25:34.670325 989425 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0120 12:25:34.688581 989425 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0120 12:25:34.689834 989425 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0120 12:25:34.689907 989425 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0120 12:25:34.799443 989425 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0120 12:25:34.802293 989425 out.go:235] - Booting up control plane ...
I0120 12:25:34.802441 989425 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0120 12:25:34.813632 989425 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0120 12:25:34.814670 989425 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0120 12:25:34.815570 989425 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0120 12:25:34.819560 989425 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0120 12:26:14.809365 989425 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0120 12:26:14.810588 989425 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0120 12:26:14.810870 989425 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0120 12:26:19.810922 989425 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0120 12:26:19.811242 989425 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0120 12:26:29.810810 989425 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0120 12:26:29.811165 989425 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0120 12:26:49.811626 989425 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0120 12:26:49.811941 989425 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0120 12:27:29.812560 989425 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0120 12:27:29.812837 989425 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0120 12:27:29.812856 989425 kubeadm.go:310]
I0120 12:27:29.812916 989425 kubeadm.go:310] Unfortunately, an error has occurred:
I0120 12:27:29.812952 989425 kubeadm.go:310] timed out waiting for the condition
I0120 12:27:29.812963 989425 kubeadm.go:310]
I0120 12:27:29.813039 989425 kubeadm.go:310] This error is likely caused by:
I0120 12:27:29.813087 989425 kubeadm.go:310] - The kubelet is not running
I0120 12:27:29.813197 989425 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0120 12:27:29.813212 989425 kubeadm.go:310]
I0120 12:27:29.813346 989425 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0120 12:27:29.813395 989425 kubeadm.go:310] - 'systemctl status kubelet'
I0120 12:27:29.813430 989425 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0120 12:27:29.813440 989425 kubeadm.go:310]
I0120 12:27:29.813575 989425 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0120 12:27:29.813701 989425 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0120 12:27:29.813717 989425 kubeadm.go:310]
I0120 12:27:29.813868 989425 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0120 12:27:29.813994 989425 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0120 12:27:29.814108 989425 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0120 12:27:29.814173 989425 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0120 12:27:29.814191 989425 kubeadm.go:310]
I0120 12:27:29.814838 989425 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0120 12:27:29.814964 989425 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0120 12:27:29.815022 989425 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
W0120 12:27:29.815151 989425 out.go:270] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-134433] and IPs [192.168.50.250 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-134433] and IPs [192.168.50.250 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-134433] and IPs [192.168.50.250 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-134433] and IPs [192.168.50.250 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0120 12:27:29.815193 989425 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0120 12:27:30.265890 989425 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0120 12:27:30.281740 989425 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0120 12:27:30.291250 989425 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0120 12:27:30.291276 989425 kubeadm.go:157] found existing configuration files:
I0120 12:27:30.291326 989425 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0120 12:27:30.300223 989425 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0120 12:27:30.300281 989425 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0120 12:27:30.309346 989425 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0120 12:27:30.318977 989425 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0120 12:27:30.319037 989425 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0120 12:27:30.328354 989425 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0120 12:27:30.337202 989425 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0120 12:27:30.337237 989425 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0120 12:27:30.346297 989425 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0120 12:27:30.356017 989425 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0120 12:27:30.356074 989425 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0120 12:27:30.365115 989425 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0120 12:27:30.608597 989425 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0120 12:29:26.833573 989425 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0120 12:29:26.833743 989425 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0120 12:29:26.835308 989425 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0120 12:29:26.835407 989425 kubeadm.go:310] [preflight] Running pre-flight checks
I0120 12:29:26.835527 989425 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0120 12:29:26.835659 989425 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0120 12:29:26.835762 989425 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0120 12:29:26.835845 989425 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0120 12:29:26.837716 989425 out.go:235] - Generating certificates and keys ...
I0120 12:29:26.837817 989425 kubeadm.go:310] [certs] Using existing ca certificate authority
I0120 12:29:26.837899 989425 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0120 12:29:26.838016 989425 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0120 12:29:26.838112 989425 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0120 12:29:26.838191 989425 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0120 12:29:26.838265 989425 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0120 12:29:26.838323 989425 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0120 12:29:26.838382 989425 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0120 12:29:26.838447 989425 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0120 12:29:26.838513 989425 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0120 12:29:26.838574 989425 kubeadm.go:310] [certs] Using the existing "sa" key
I0120 12:29:26.838662 989425 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0120 12:29:26.838752 989425 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0120 12:29:26.838851 989425 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0120 12:29:26.838951 989425 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0120 12:29:26.839036 989425 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0120 12:29:26.839158 989425 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0120 12:29:26.839278 989425 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0120 12:29:26.839375 989425 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0120 12:29:26.839471 989425 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0120 12:29:26.841642 989425 out.go:235] - Booting up control plane ...
I0120 12:29:26.841727 989425 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0120 12:29:26.841810 989425 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0120 12:29:26.841885 989425 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0120 12:29:26.841967 989425 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0120 12:29:26.842115 989425 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0120 12:29:26.842163 989425 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0120 12:29:26.842255 989425 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0120 12:29:26.842515 989425 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0120 12:29:26.842635 989425 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0120 12:29:26.842891 989425 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0120 12:29:26.842993 989425 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0120 12:29:26.843228 989425 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0120 12:29:26.843320 989425 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0120 12:29:26.843518 989425 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0120 12:29:26.843576 989425 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0120 12:29:26.843725 989425 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0120 12:29:26.843740 989425 kubeadm.go:310]
I0120 12:29:26.843790 989425 kubeadm.go:310] Unfortunately, an error has occurred:
I0120 12:29:26.843850 989425 kubeadm.go:310] timed out waiting for the condition
I0120 12:29:26.843863 989425 kubeadm.go:310]
I0120 12:29:26.843911 989425 kubeadm.go:310] This error is likely caused by:
I0120 12:29:26.843976 989425 kubeadm.go:310] - The kubelet is not running
I0120 12:29:26.844115 989425 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0120 12:29:26.844125 989425 kubeadm.go:310]
I0120 12:29:26.844252 989425 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0120 12:29:26.844306 989425 kubeadm.go:310] - 'systemctl status kubelet'
I0120 12:29:26.844345 989425 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0120 12:29:26.844355 989425 kubeadm.go:310]
I0120 12:29:26.844508 989425 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0120 12:29:26.844611 989425 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0120 12:29:26.844621 989425 kubeadm.go:310]
I0120 12:29:26.844779 989425 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0120 12:29:26.844885 989425 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0120 12:29:26.844988 989425 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0120 12:29:26.845088 989425 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0120 12:29:26.845124 989425 kubeadm.go:310]
I0120 12:29:26.845188 989425 kubeadm.go:394] duration metric: took 3m55.003736536s to StartCluster
I0120 12:29:26.845250 989425 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0120 12:29:26.845327 989425 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0120 12:29:26.887064 989425 cri.go:89] found id: ""
I0120 12:29:26.887107 989425 logs.go:282] 0 containers: []
W0120 12:29:26.887121 989425 logs.go:284] No container was found matching "kube-apiserver"
I0120 12:29:26.887135 989425 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0120 12:29:26.887223 989425 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0120 12:29:26.927300 989425 cri.go:89] found id: ""
I0120 12:29:26.927334 989425 logs.go:282] 0 containers: []
W0120 12:29:26.927353 989425 logs.go:284] No container was found matching "etcd"
I0120 12:29:26.927363 989425 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0120 12:29:26.927437 989425 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0120 12:29:26.959893 989425 cri.go:89] found id: ""
I0120 12:29:26.959924 989425 logs.go:282] 0 containers: []
W0120 12:29:26.959934 989425 logs.go:284] No container was found matching "coredns"
I0120 12:29:26.959941 989425 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0120 12:29:26.960004 989425 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0120 12:29:26.995151 989425 cri.go:89] found id: ""
I0120 12:29:26.995185 989425 logs.go:282] 0 containers: []
W0120 12:29:26.995196 989425 logs.go:284] No container was found matching "kube-scheduler"
I0120 12:29:26.995205 989425 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0120 12:29:26.995277 989425 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0120 12:29:27.051881 989425 cri.go:89] found id: ""
I0120 12:29:27.051920 989425 logs.go:282] 0 containers: []
W0120 12:29:27.051932 989425 logs.go:284] No container was found matching "kube-proxy"
I0120 12:29:27.051940 989425 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0120 12:29:27.052018 989425 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0120 12:29:27.089793 989425 cri.go:89] found id: ""
I0120 12:29:27.089828 989425 logs.go:282] 0 containers: []
W0120 12:29:27.089838 989425 logs.go:284] No container was found matching "kube-controller-manager"
I0120 12:29:27.089846 989425 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0120 12:29:27.089914 989425 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0120 12:29:27.123338 989425 cri.go:89] found id: ""
I0120 12:29:27.123371 989425 logs.go:282] 0 containers: []
W0120 12:29:27.123383 989425 logs.go:284] No container was found matching "kindnet"
I0120 12:29:27.123398 989425 logs.go:123] Gathering logs for kubelet ...
I0120 12:29:27.123418 989425 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0120 12:29:27.171032 989425 logs.go:123] Gathering logs for dmesg ...
I0120 12:29:27.171065 989425 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0120 12:29:27.183618 989425 logs.go:123] Gathering logs for describe nodes ...
I0120 12:29:27.183649 989425 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0120 12:29:27.306453 989425 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0120 12:29:27.306485 989425 logs.go:123] Gathering logs for CRI-O ...
I0120 12:29:27.306504 989425 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0120 12:29:27.407062 989425 logs.go:123] Gathering logs for container status ...
I0120 12:29:27.407104 989425 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0120 12:29:27.455571 989425 out.go:418] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0120 12:29:27.455650 989425 out.go:270] *
*
W0120 12:29:27.455737 989425 out.go:270] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0120 12:29:27.455761 989425 out.go:270] *
*
W0120 12:29:27.457088 989425 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0120 12:29:27.460700 989425 out.go:201]
W0120 12:29:27.461752 989425 out.go:270] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0120 12:29:27.461809 989425 out.go:270] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0120 12:29:27.461841 989425 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0120 12:29:27.463902 989425 out.go:201]
** /stderr **
start_stop_delete_test.go:186: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-134433 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-134433 -n old-k8s-version-134433
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-134433 -n old-k8s-version-134433: exit status 6 (249.038377ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0120 12:29:27.763679 992762 status.go:458] kubeconfig endpoint: get endpoint: "old-k8s-version-134433" does not appear in /home/jenkins/minikube-integration/20151-942401/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-134433" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (270.82s)