=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-390782 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-390782 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m25.119264672s)
-- stdout --
* [old-k8s-version-390782] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=19443
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19443-13088/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19443-13088/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-390782" primary control-plane node in "old-k8s-version-390782" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0815 01:18:15.261046 62901 out.go:291] Setting OutFile to fd 1 ...
I0815 01:18:15.261270 62901 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0815 01:18:15.261278 62901 out.go:304] Setting ErrFile to fd 2...
I0815 01:18:15.261283 62901 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0815 01:18:15.261453 62901 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19443-13088/.minikube/bin
I0815 01:18:15.261994 62901 out.go:298] Setting JSON to false
I0815 01:18:15.262914 62901 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-8","uptime":7240,"bootTime":1723677455,"procs":217,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1066-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0815 01:18:15.262972 62901 start.go:139] virtualization: kvm guest
I0815 01:18:15.265137 62901 out.go:177] * [old-k8s-version-390782] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
I0815 01:18:15.266305 62901 out.go:177] - MINIKUBE_LOCATION=19443
I0815 01:18:15.266302 62901 notify.go:220] Checking for updates...
I0815 01:18:15.267704 62901 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0815 01:18:15.269044 62901 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19443-13088/kubeconfig
I0815 01:18:15.270391 62901 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19443-13088/.minikube
I0815 01:18:15.271656 62901 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0815 01:18:15.273019 62901 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0815 01:18:15.274956 62901 config.go:182] Loaded profile config "cert-expiration-131152": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.0
I0815 01:18:15.275083 62901 config.go:182] Loaded profile config "kubernetes-upgrade-146394": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0815 01:18:15.275210 62901 config.go:182] Loaded profile config "pause-064537": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.0
I0815 01:18:15.275308 62901 driver.go:392] Setting default libvirt URI to qemu:///system
I0815 01:18:15.311461 62901 out.go:177] * Using the kvm2 driver based on user configuration
I0815 01:18:15.312881 62901 start.go:297] selected driver: kvm2
I0815 01:18:15.312912 62901 start.go:901] validating driver "kvm2" against <nil>
I0815 01:18:15.312925 62901 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0815 01:18:15.313631 62901 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0815 01:18:15.313710 62901 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19443-13088/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0815 01:18:15.328565 62901 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.1
I0815 01:18:15.328646 62901 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0815 01:18:15.328888 62901 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0815 01:18:15.328922 62901 cni.go:84] Creating CNI manager for ""
I0815 01:18:15.328929 62901 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0815 01:18:15.328938 62901 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0815 01:18:15.328985 62901 start.go:340] cluster config:
{Name:old-k8s-version-390782 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-390782 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0815 01:18:15.329107 62901 iso.go:125] acquiring lock: {Name:mk32aeaa0100c55740e9f02cdcbc99755de867ed Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0815 01:18:15.330892 62901 out.go:177] * Starting "old-k8s-version-390782" primary control-plane node in "old-k8s-version-390782" cluster
I0815 01:18:15.331965 62901 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0815 01:18:15.331999 62901 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19443-13088/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0815 01:18:15.332008 62901 cache.go:56] Caching tarball of preloaded images
I0815 01:18:15.332074 62901 preload.go:172] Found /home/jenkins/minikube-integration/19443-13088/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0815 01:18:15.332084 62901 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0815 01:18:15.332171 62901 profile.go:143] Saving config to /home/jenkins/minikube-integration/19443-13088/.minikube/profiles/old-k8s-version-390782/config.json ...
I0815 01:18:15.332187 62901 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19443-13088/.minikube/profiles/old-k8s-version-390782/config.json: {Name:mkf0346f19b6e6d7119ca76efe114063f5674cee Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0815 01:18:15.332312 62901 start.go:360] acquireMachinesLock for old-k8s-version-390782: {Name:mk1d1abebd831c3c928fd30ac0d08e20b6c0be1f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0815 01:18:15.332344 62901 start.go:364] duration metric: took 17.007µs to acquireMachinesLock for "old-k8s-version-390782"
I0815 01:18:15.332358 62901 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-390782 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-390782 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0815 01:18:15.332413 62901 start.go:125] createHost starting for "" (driver="kvm2")
I0815 01:18:15.333754 62901 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0815 01:18:15.333887 62901 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0815 01:18:15.333924 62901 main.go:141] libmachine: Launching plugin server for driver kvm2
I0815 01:18:15.348472 62901 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45583
I0815 01:18:15.348937 62901 main.go:141] libmachine: () Calling .GetVersion
I0815 01:18:15.349509 62901 main.go:141] libmachine: Using API Version 1
I0815 01:18:15.349538 62901 main.go:141] libmachine: () Calling .SetConfigRaw
I0815 01:18:15.349884 62901 main.go:141] libmachine: () Calling .GetMachineName
I0815 01:18:15.350094 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetMachineName
I0815 01:18:15.350295 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .DriverName
I0815 01:18:15.350507 62901 start.go:159] libmachine.API.Create for "old-k8s-version-390782" (driver="kvm2")
I0815 01:18:15.350535 62901 client.go:168] LocalClient.Create starting
I0815 01:18:15.350581 62901 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19443-13088/.minikube/certs/ca.pem
I0815 01:18:15.350617 62901 main.go:141] libmachine: Decoding PEM data...
I0815 01:18:15.350642 62901 main.go:141] libmachine: Parsing certificate...
I0815 01:18:15.350710 62901 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19443-13088/.minikube/certs/cert.pem
I0815 01:18:15.350738 62901 main.go:141] libmachine: Decoding PEM data...
I0815 01:18:15.350765 62901 main.go:141] libmachine: Parsing certificate...
I0815 01:18:15.350788 62901 main.go:141] libmachine: Running pre-create checks...
I0815 01:18:15.350798 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .PreCreateCheck
I0815 01:18:15.351144 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetConfigRaw
I0815 01:18:15.351519 62901 main.go:141] libmachine: Creating machine...
I0815 01:18:15.351532 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .Create
I0815 01:18:15.351686 62901 main.go:141] libmachine: (old-k8s-version-390782) Creating KVM machine...
I0815 01:18:15.352916 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | found existing default KVM network
I0815 01:18:15.354153 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | I0815 01:18:15.354012 62925 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr2 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:73:88:a8} reservation:<nil>}
I0815 01:18:15.355219 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | I0815 01:18:15.355146 62925 network.go:206] using free private subnet 192.168.50.0/24: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000288990}
I0815 01:18:15.355236 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | created network xml:
I0815 01:18:15.355244 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | <network>
I0815 01:18:15.355250 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | <name>mk-old-k8s-version-390782</name>
I0815 01:18:15.355272 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | <dns enable='no'/>
I0815 01:18:15.355279 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG |
I0815 01:18:15.355289 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | <ip address='192.168.50.1' netmask='255.255.255.0'>
I0815 01:18:15.355299 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | <dhcp>
I0815 01:18:15.355309 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | <range start='192.168.50.2' end='192.168.50.253'/>
I0815 01:18:15.355323 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | </dhcp>
I0815 01:18:15.355334 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | </ip>
I0815 01:18:15.355346 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG |
I0815 01:18:15.355358 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | </network>
I0815 01:18:15.355368 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG |
I0815 01:18:15.360118 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | trying to create private KVM network mk-old-k8s-version-390782 192.168.50.0/24...
I0815 01:18:15.428315 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | private KVM network mk-old-k8s-version-390782 192.168.50.0/24 created
I0815 01:18:15.428363 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | I0815 01:18:15.428284 62925 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19443-13088/.minikube
I0815 01:18:15.428384 62901 main.go:141] libmachine: (old-k8s-version-390782) Setting up store path in /home/jenkins/minikube-integration/19443-13088/.minikube/machines/old-k8s-version-390782 ...
I0815 01:18:15.428407 62901 main.go:141] libmachine: (old-k8s-version-390782) Building disk image from file:///home/jenkins/minikube-integration/19443-13088/.minikube/cache/iso/amd64/minikube-v1.33.1-1723650137-19443-amd64.iso
I0815 01:18:15.428492 62901 main.go:141] libmachine: (old-k8s-version-390782) Downloading /home/jenkins/minikube-integration/19443-13088/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19443-13088/.minikube/cache/iso/amd64/minikube-v1.33.1-1723650137-19443-amd64.iso...
I0815 01:18:15.676415 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | I0815 01:18:15.676256 62925 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19443-13088/.minikube/machines/old-k8s-version-390782/id_rsa...
I0815 01:18:15.913507 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | I0815 01:18:15.913356 62925 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19443-13088/.minikube/machines/old-k8s-version-390782/old-k8s-version-390782.rawdisk...
I0815 01:18:15.913558 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | Writing magic tar header
I0815 01:18:15.913595 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | Writing SSH key tar header
I0815 01:18:15.913613 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | I0815 01:18:15.913528 62925 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19443-13088/.minikube/machines/old-k8s-version-390782 ...
I0815 01:18:15.913761 62901 main.go:141] libmachine: (old-k8s-version-390782) Setting executable bit set on /home/jenkins/minikube-integration/19443-13088/.minikube/machines/old-k8s-version-390782 (perms=drwx------)
I0815 01:18:15.913786 62901 main.go:141] libmachine: (old-k8s-version-390782) Setting executable bit set on /home/jenkins/minikube-integration/19443-13088/.minikube/machines (perms=drwxr-xr-x)
I0815 01:18:15.913799 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19443-13088/.minikube/machines/old-k8s-version-390782
I0815 01:18:15.913815 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19443-13088/.minikube/machines
I0815 01:18:15.913830 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19443-13088/.minikube
I0815 01:18:15.913845 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19443-13088
I0815 01:18:15.913858 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0815 01:18:15.913872 62901 main.go:141] libmachine: (old-k8s-version-390782) Setting executable bit set on /home/jenkins/minikube-integration/19443-13088/.minikube (perms=drwxr-xr-x)
I0815 01:18:15.913898 62901 main.go:141] libmachine: (old-k8s-version-390782) Setting executable bit set on /home/jenkins/minikube-integration/19443-13088 (perms=drwxrwxr-x)
I0815 01:18:15.913917 62901 main.go:141] libmachine: (old-k8s-version-390782) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0815 01:18:15.913926 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | Checking permissions on dir: /home/jenkins
I0815 01:18:15.913941 62901 main.go:141] libmachine: (old-k8s-version-390782) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0815 01:18:15.913955 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | Checking permissions on dir: /home
I0815 01:18:15.913972 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | Skipping /home - not owner
I0815 01:18:15.913987 62901 main.go:141] libmachine: (old-k8s-version-390782) Creating domain...
I0815 01:18:15.915132 62901 main.go:141] libmachine: (old-k8s-version-390782) define libvirt domain using xml:
I0815 01:18:15.915165 62901 main.go:141] libmachine: (old-k8s-version-390782) <domain type='kvm'>
I0815 01:18:15.915178 62901 main.go:141] libmachine: (old-k8s-version-390782) <name>old-k8s-version-390782</name>
I0815 01:18:15.915189 62901 main.go:141] libmachine: (old-k8s-version-390782) <memory unit='MiB'>2200</memory>
I0815 01:18:15.915202 62901 main.go:141] libmachine: (old-k8s-version-390782) <vcpu>2</vcpu>
I0815 01:18:15.915208 62901 main.go:141] libmachine: (old-k8s-version-390782) <features>
I0815 01:18:15.915216 62901 main.go:141] libmachine: (old-k8s-version-390782) <acpi/>
I0815 01:18:15.915221 62901 main.go:141] libmachine: (old-k8s-version-390782) <apic/>
I0815 01:18:15.915236 62901 main.go:141] libmachine: (old-k8s-version-390782) <pae/>
I0815 01:18:15.915243 62901 main.go:141] libmachine: (old-k8s-version-390782)
I0815 01:18:15.915249 62901 main.go:141] libmachine: (old-k8s-version-390782) </features>
I0815 01:18:15.915256 62901 main.go:141] libmachine: (old-k8s-version-390782) <cpu mode='host-passthrough'>
I0815 01:18:15.915261 62901 main.go:141] libmachine: (old-k8s-version-390782)
I0815 01:18:15.915268 62901 main.go:141] libmachine: (old-k8s-version-390782) </cpu>
I0815 01:18:15.915273 62901 main.go:141] libmachine: (old-k8s-version-390782) <os>
I0815 01:18:15.915277 62901 main.go:141] libmachine: (old-k8s-version-390782) <type>hvm</type>
I0815 01:18:15.915285 62901 main.go:141] libmachine: (old-k8s-version-390782) <boot dev='cdrom'/>
I0815 01:18:15.915290 62901 main.go:141] libmachine: (old-k8s-version-390782) <boot dev='hd'/>
I0815 01:18:15.915298 62901 main.go:141] libmachine: (old-k8s-version-390782) <bootmenu enable='no'/>
I0815 01:18:15.915302 62901 main.go:141] libmachine: (old-k8s-version-390782) </os>
I0815 01:18:15.915318 62901 main.go:141] libmachine: (old-k8s-version-390782) <devices>
I0815 01:18:15.915326 62901 main.go:141] libmachine: (old-k8s-version-390782) <disk type='file' device='cdrom'>
I0815 01:18:15.915336 62901 main.go:141] libmachine: (old-k8s-version-390782) <source file='/home/jenkins/minikube-integration/19443-13088/.minikube/machines/old-k8s-version-390782/boot2docker.iso'/>
I0815 01:18:15.915343 62901 main.go:141] libmachine: (old-k8s-version-390782) <target dev='hdc' bus='scsi'/>
I0815 01:18:15.915349 62901 main.go:141] libmachine: (old-k8s-version-390782) <readonly/>
I0815 01:18:15.915354 62901 main.go:141] libmachine: (old-k8s-version-390782) </disk>
I0815 01:18:15.915360 62901 main.go:141] libmachine: (old-k8s-version-390782) <disk type='file' device='disk'>
I0815 01:18:15.915377 62901 main.go:141] libmachine: (old-k8s-version-390782) <driver name='qemu' type='raw' cache='default' io='threads' />
I0815 01:18:15.915389 62901 main.go:141] libmachine: (old-k8s-version-390782) <source file='/home/jenkins/minikube-integration/19443-13088/.minikube/machines/old-k8s-version-390782/old-k8s-version-390782.rawdisk'/>
I0815 01:18:15.915397 62901 main.go:141] libmachine: (old-k8s-version-390782) <target dev='hda' bus='virtio'/>
I0815 01:18:15.915402 62901 main.go:141] libmachine: (old-k8s-version-390782) </disk>
I0815 01:18:15.915409 62901 main.go:141] libmachine: (old-k8s-version-390782) <interface type='network'>
I0815 01:18:15.915417 62901 main.go:141] libmachine: (old-k8s-version-390782) <source network='mk-old-k8s-version-390782'/>
I0815 01:18:15.915428 62901 main.go:141] libmachine: (old-k8s-version-390782) <model type='virtio'/>
I0815 01:18:15.915433 62901 main.go:141] libmachine: (old-k8s-version-390782) </interface>
I0815 01:18:15.915442 62901 main.go:141] libmachine: (old-k8s-version-390782) <interface type='network'>
I0815 01:18:15.915448 62901 main.go:141] libmachine: (old-k8s-version-390782) <source network='default'/>
I0815 01:18:15.915455 62901 main.go:141] libmachine: (old-k8s-version-390782) <model type='virtio'/>
I0815 01:18:15.915461 62901 main.go:141] libmachine: (old-k8s-version-390782) </interface>
I0815 01:18:15.915466 62901 main.go:141] libmachine: (old-k8s-version-390782) <serial type='pty'>
I0815 01:18:15.915472 62901 main.go:141] libmachine: (old-k8s-version-390782) <target port='0'/>
I0815 01:18:15.915478 62901 main.go:141] libmachine: (old-k8s-version-390782) </serial>
I0815 01:18:15.915484 62901 main.go:141] libmachine: (old-k8s-version-390782) <console type='pty'>
I0815 01:18:15.915491 62901 main.go:141] libmachine: (old-k8s-version-390782) <target type='serial' port='0'/>
I0815 01:18:15.915496 62901 main.go:141] libmachine: (old-k8s-version-390782) </console>
I0815 01:18:15.915503 62901 main.go:141] libmachine: (old-k8s-version-390782) <rng model='virtio'>
I0815 01:18:15.915510 62901 main.go:141] libmachine: (old-k8s-version-390782) <backend model='random'>/dev/random</backend>
I0815 01:18:15.915517 62901 main.go:141] libmachine: (old-k8s-version-390782) </rng>
I0815 01:18:15.915525 62901 main.go:141] libmachine: (old-k8s-version-390782)
I0815 01:18:15.915534 62901 main.go:141] libmachine: (old-k8s-version-390782)
I0815 01:18:15.915541 62901 main.go:141] libmachine: (old-k8s-version-390782) </devices>
I0815 01:18:15.915550 62901 main.go:141] libmachine: (old-k8s-version-390782) </domain>
I0815 01:18:15.915560 62901 main.go:141] libmachine: (old-k8s-version-390782)
I0815 01:18:15.919941 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | domain old-k8s-version-390782 has defined MAC address 52:54:00:df:3d:81 in network default
I0815 01:18:15.920701 62901 main.go:141] libmachine: (old-k8s-version-390782) Ensuring networks are active...
I0815 01:18:15.920726 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | domain old-k8s-version-390782 has defined MAC address 52:54:00:5c:70:6d in network mk-old-k8s-version-390782
I0815 01:18:15.921463 62901 main.go:141] libmachine: (old-k8s-version-390782) Ensuring network default is active
I0815 01:18:15.921779 62901 main.go:141] libmachine: (old-k8s-version-390782) Ensuring network mk-old-k8s-version-390782 is active
I0815 01:18:15.922248 62901 main.go:141] libmachine: (old-k8s-version-390782) Getting domain xml...
I0815 01:18:15.922882 62901 main.go:141] libmachine: (old-k8s-version-390782) Creating domain...
I0815 01:18:17.168776 62901 main.go:141] libmachine: (old-k8s-version-390782) Waiting to get IP...
I0815 01:18:17.169581 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | domain old-k8s-version-390782 has defined MAC address 52:54:00:5c:70:6d in network mk-old-k8s-version-390782
I0815 01:18:17.170038 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | unable to find current IP address of domain old-k8s-version-390782 in network mk-old-k8s-version-390782
I0815 01:18:17.170058 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | I0815 01:18:17.170016 62925 retry.go:31] will retry after 311.149741ms: waiting for machine to come up
I0815 01:18:17.482677 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | domain old-k8s-version-390782 has defined MAC address 52:54:00:5c:70:6d in network mk-old-k8s-version-390782
I0815 01:18:17.483252 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | unable to find current IP address of domain old-k8s-version-390782 in network mk-old-k8s-version-390782
I0815 01:18:17.483279 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | I0815 01:18:17.483204 62925 retry.go:31] will retry after 276.633139ms: waiting for machine to come up
I0815 01:18:17.761773 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | domain old-k8s-version-390782 has defined MAC address 52:54:00:5c:70:6d in network mk-old-k8s-version-390782
I0815 01:18:17.762240 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | unable to find current IP address of domain old-k8s-version-390782 in network mk-old-k8s-version-390782
I0815 01:18:17.762265 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | I0815 01:18:17.762199 62925 retry.go:31] will retry after 356.697583ms: waiting for machine to come up
I0815 01:18:18.120675 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | domain old-k8s-version-390782 has defined MAC address 52:54:00:5c:70:6d in network mk-old-k8s-version-390782
I0815 01:18:18.121283 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | unable to find current IP address of domain old-k8s-version-390782 in network mk-old-k8s-version-390782
I0815 01:18:18.121320 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | I0815 01:18:18.121234 62925 retry.go:31] will retry after 585.242983ms: waiting for machine to come up
I0815 01:18:18.707730 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | domain old-k8s-version-390782 has defined MAC address 52:54:00:5c:70:6d in network mk-old-k8s-version-390782
I0815 01:18:18.708228 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | unable to find current IP address of domain old-k8s-version-390782 in network mk-old-k8s-version-390782
I0815 01:18:18.708280 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | I0815 01:18:18.708163 62925 retry.go:31] will retry after 689.67481ms: waiting for machine to come up
I0815 01:18:19.398920 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | domain old-k8s-version-390782 has defined MAC address 52:54:00:5c:70:6d in network mk-old-k8s-version-390782
I0815 01:18:19.399454 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | unable to find current IP address of domain old-k8s-version-390782 in network mk-old-k8s-version-390782
I0815 01:18:19.399480 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | I0815 01:18:19.399409 62925 retry.go:31] will retry after 825.287626ms: waiting for machine to come up
I0815 01:18:20.225656 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | domain old-k8s-version-390782 has defined MAC address 52:54:00:5c:70:6d in network mk-old-k8s-version-390782
I0815 01:18:20.226134 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | unable to find current IP address of domain old-k8s-version-390782 in network mk-old-k8s-version-390782
I0815 01:18:20.226162 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | I0815 01:18:20.226066 62925 retry.go:31] will retry after 737.299892ms: waiting for machine to come up
I0815 01:18:20.964587 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | domain old-k8s-version-390782 has defined MAC address 52:54:00:5c:70:6d in network mk-old-k8s-version-390782
I0815 01:18:20.965182 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | unable to find current IP address of domain old-k8s-version-390782 in network mk-old-k8s-version-390782
I0815 01:18:20.965207 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | I0815 01:18:20.965130 62925 retry.go:31] will retry after 1.430015488s: waiting for machine to come up
I0815 01:18:22.396726 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | domain old-k8s-version-390782 has defined MAC address 52:54:00:5c:70:6d in network mk-old-k8s-version-390782
I0815 01:18:22.397262 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | unable to find current IP address of domain old-k8s-version-390782 in network mk-old-k8s-version-390782
I0815 01:18:22.397288 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | I0815 01:18:22.397215 62925 retry.go:31] will retry after 1.383910462s: waiting for machine to come up
I0815 01:18:23.782390 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | domain old-k8s-version-390782 has defined MAC address 52:54:00:5c:70:6d in network mk-old-k8s-version-390782
I0815 01:18:23.782843 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | unable to find current IP address of domain old-k8s-version-390782 in network mk-old-k8s-version-390782
I0815 01:18:23.782864 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | I0815 01:18:23.782797 62925 retry.go:31] will retry after 2.264972596s: waiting for machine to come up
I0815 01:18:26.049330 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | domain old-k8s-version-390782 has defined MAC address 52:54:00:5c:70:6d in network mk-old-k8s-version-390782
I0815 01:18:26.049825 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | unable to find current IP address of domain old-k8s-version-390782 in network mk-old-k8s-version-390782
I0815 01:18:26.049854 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | I0815 01:18:26.049780 62925 retry.go:31] will retry after 2.624299371s: waiting for machine to come up
I0815 01:18:28.677599 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | domain old-k8s-version-390782 has defined MAC address 52:54:00:5c:70:6d in network mk-old-k8s-version-390782
I0815 01:18:28.678123 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | unable to find current IP address of domain old-k8s-version-390782 in network mk-old-k8s-version-390782
I0815 01:18:28.678145 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | I0815 01:18:28.678082 62925 retry.go:31] will retry after 3.117191657s: waiting for machine to come up
I0815 01:18:31.798051 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | domain old-k8s-version-390782 has defined MAC address 52:54:00:5c:70:6d in network mk-old-k8s-version-390782
I0815 01:18:31.798633 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | unable to find current IP address of domain old-k8s-version-390782 in network mk-old-k8s-version-390782
I0815 01:18:31.798657 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | I0815 01:18:31.798584 62925 retry.go:31] will retry after 3.580140298s: waiting for machine to come up
I0815 01:18:35.380019 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | domain old-k8s-version-390782 has defined MAC address 52:54:00:5c:70:6d in network mk-old-k8s-version-390782
I0815 01:18:35.380569 62901 main.go:141] libmachine: (old-k8s-version-390782) Found IP for machine: 192.168.50.21
I0815 01:18:35.380591 62901 main.go:141] libmachine: (old-k8s-version-390782) Reserving static IP address...
I0815 01:18:35.380606 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | domain old-k8s-version-390782 has current primary IP address 192.168.50.21 and MAC address 52:54:00:5c:70:6d in network mk-old-k8s-version-390782
I0815 01:18:35.380988 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-390782", mac: "52:54:00:5c:70:6d", ip: "192.168.50.21"} in network mk-old-k8s-version-390782
I0815 01:18:35.458829 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | Getting to WaitForSSH function...
I0815 01:18:35.458860 62901 main.go:141] libmachine: (old-k8s-version-390782) Reserved static IP address: 192.168.50.21
I0815 01:18:35.458879 62901 main.go:141] libmachine: (old-k8s-version-390782) Waiting for SSH to be available...
I0815 01:18:35.461598 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | domain old-k8s-version-390782 has defined MAC address 52:54:00:5c:70:6d in network mk-old-k8s-version-390782
I0815 01:18:35.462086 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5c:70:6d", ip: ""} in network mk-old-k8s-version-390782: {Iface:virbr1 ExpiryTime:2024-08-15 02:18:29 +0000 UTC Type:0 Mac:52:54:00:5c:70:6d Iaid: IPaddr:192.168.50.21 Prefix:24 Hostname:minikube Clientid:01:52:54:00:5c:70:6d}
I0815 01:18:35.462116 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | domain old-k8s-version-390782 has defined IP address 192.168.50.21 and MAC address 52:54:00:5c:70:6d in network mk-old-k8s-version-390782
I0815 01:18:35.462256 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | Using SSH client type: external
I0815 01:18:35.462285 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | Using SSH private key: /home/jenkins/minikube-integration/19443-13088/.minikube/machines/old-k8s-version-390782/id_rsa (-rw-------)
I0815 01:18:35.462328 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.50.21 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19443-13088/.minikube/machines/old-k8s-version-390782/id_rsa -p 22] /usr/bin/ssh <nil>}
I0815 01:18:35.462349 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | About to run SSH command:
I0815 01:18:35.462362 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | exit 0
I0815 01:18:35.584924 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | SSH cmd err, output: <nil>:
I0815 01:18:35.585133 62901 main.go:141] libmachine: (old-k8s-version-390782) KVM machine creation complete!
I0815 01:18:35.585552 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetConfigRaw
I0815 01:18:35.586131 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .DriverName
I0815 01:18:35.586345 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .DriverName
I0815 01:18:35.586523 62901 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0815 01:18:35.586557 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetState
I0815 01:18:35.588011 62901 main.go:141] libmachine: Detecting operating system of created instance...
I0815 01:18:35.588029 62901 main.go:141] libmachine: Waiting for SSH to be available...
I0815 01:18:35.588036 62901 main.go:141] libmachine: Getting to WaitForSSH function...
I0815 01:18:35.588044 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetSSHHostname
I0815 01:18:35.590687 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | domain old-k8s-version-390782 has defined MAC address 52:54:00:5c:70:6d in network mk-old-k8s-version-390782
I0815 01:18:35.591185 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5c:70:6d", ip: ""} in network mk-old-k8s-version-390782: {Iface:virbr1 ExpiryTime:2024-08-15 02:18:29 +0000 UTC Type:0 Mac:52:54:00:5c:70:6d Iaid: IPaddr:192.168.50.21 Prefix:24 Hostname:old-k8s-version-390782 Clientid:01:52:54:00:5c:70:6d}
I0815 01:18:35.591223 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | domain old-k8s-version-390782 has defined IP address 192.168.50.21 and MAC address 52:54:00:5c:70:6d in network mk-old-k8s-version-390782
I0815 01:18:35.591314 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetSSHPort
I0815 01:18:35.591482 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetSSHKeyPath
I0815 01:18:35.591589 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetSSHKeyPath
I0815 01:18:35.591723 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetSSHUsername
I0815 01:18:35.591903 62901 main.go:141] libmachine: Using SSH client type: native
I0815 01:18:35.592088 62901 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.50.21 22 <nil> <nil>}
I0815 01:18:35.592103 62901 main.go:141] libmachine: About to run SSH command:
exit 0
I0815 01:18:35.688105 62901 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0815 01:18:35.688133 62901 main.go:141] libmachine: Detecting the provisioner...
I0815 01:18:35.688145 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetSSHHostname
I0815 01:18:35.690847 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | domain old-k8s-version-390782 has defined MAC address 52:54:00:5c:70:6d in network mk-old-k8s-version-390782
I0815 01:18:35.691226 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5c:70:6d", ip: ""} in network mk-old-k8s-version-390782: {Iface:virbr1 ExpiryTime:2024-08-15 02:18:29 +0000 UTC Type:0 Mac:52:54:00:5c:70:6d Iaid: IPaddr:192.168.50.21 Prefix:24 Hostname:old-k8s-version-390782 Clientid:01:52:54:00:5c:70:6d}
I0815 01:18:35.691254 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | domain old-k8s-version-390782 has defined IP address 192.168.50.21 and MAC address 52:54:00:5c:70:6d in network mk-old-k8s-version-390782
I0815 01:18:35.691397 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetSSHPort
I0815 01:18:35.691587 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetSSHKeyPath
I0815 01:18:35.691769 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetSSHKeyPath
I0815 01:18:35.691912 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetSSHUsername
I0815 01:18:35.692088 62901 main.go:141] libmachine: Using SSH client type: native
I0815 01:18:35.692285 62901 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.50.21 22 <nil> <nil>}
I0815 01:18:35.692298 62901 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0815 01:18:35.789590 62901 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0815 01:18:35.789678 62901 main.go:141] libmachine: found compatible host: buildroot
I0815 01:18:35.789691 62901 main.go:141] libmachine: Provisioning with buildroot...
I0815 01:18:35.789704 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetMachineName
I0815 01:18:35.789958 62901 buildroot.go:166] provisioning hostname "old-k8s-version-390782"
I0815 01:18:35.789988 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetMachineName
I0815 01:18:35.790196 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetSSHHostname
I0815 01:18:35.793502 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | domain old-k8s-version-390782 has defined MAC address 52:54:00:5c:70:6d in network mk-old-k8s-version-390782
I0815 01:18:35.793998 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5c:70:6d", ip: ""} in network mk-old-k8s-version-390782: {Iface:virbr1 ExpiryTime:2024-08-15 02:18:29 +0000 UTC Type:0 Mac:52:54:00:5c:70:6d Iaid: IPaddr:192.168.50.21 Prefix:24 Hostname:old-k8s-version-390782 Clientid:01:52:54:00:5c:70:6d}
I0815 01:18:35.794032 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | domain old-k8s-version-390782 has defined IP address 192.168.50.21 and MAC address 52:54:00:5c:70:6d in network mk-old-k8s-version-390782
I0815 01:18:35.794160 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetSSHPort
I0815 01:18:35.794372 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetSSHKeyPath
I0815 01:18:35.794627 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetSSHKeyPath
I0815 01:18:35.794834 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetSSHUsername
I0815 01:18:35.795022 62901 main.go:141] libmachine: Using SSH client type: native
I0815 01:18:35.795236 62901 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.50.21 22 <nil> <nil>}
I0815 01:18:35.795249 62901 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-390782 && echo "old-k8s-version-390782" | sudo tee /etc/hostname
I0815 01:18:35.911921 62901 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-390782
I0815 01:18:35.911944 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetSSHHostname
I0815 01:18:35.915479 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | domain old-k8s-version-390782 has defined MAC address 52:54:00:5c:70:6d in network mk-old-k8s-version-390782
I0815 01:18:35.915959 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5c:70:6d", ip: ""} in network mk-old-k8s-version-390782: {Iface:virbr1 ExpiryTime:2024-08-15 02:18:29 +0000 UTC Type:0 Mac:52:54:00:5c:70:6d Iaid: IPaddr:192.168.50.21 Prefix:24 Hostname:old-k8s-version-390782 Clientid:01:52:54:00:5c:70:6d}
I0815 01:18:35.916005 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | domain old-k8s-version-390782 has defined IP address 192.168.50.21 and MAC address 52:54:00:5c:70:6d in network mk-old-k8s-version-390782
I0815 01:18:35.916193 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetSSHPort
I0815 01:18:35.916397 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetSSHKeyPath
I0815 01:18:35.916559 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetSSHKeyPath
I0815 01:18:35.916740 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetSSHUsername
I0815 01:18:35.916901 62901 main.go:141] libmachine: Using SSH client type: native
I0815 01:18:35.917074 62901 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.50.21 22 <nil> <nil>}
I0815 01:18:35.917097 62901 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-390782' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-390782/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-390782' | sudo tee -a /etc/hosts;
fi
fi
I0815 01:18:36.025041 62901 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0815 01:18:36.025087 62901 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19443-13088/.minikube CaCertPath:/home/jenkins/minikube-integration/19443-13088/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19443-13088/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19443-13088/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19443-13088/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19443-13088/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19443-13088/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19443-13088/.minikube}
I0815 01:18:36.025123 62901 buildroot.go:174] setting up certificates
I0815 01:18:36.025133 62901 provision.go:84] configureAuth start
I0815 01:18:36.025145 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetMachineName
I0815 01:18:36.025414 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetIP
I0815 01:18:36.028031 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | domain old-k8s-version-390782 has defined MAC address 52:54:00:5c:70:6d in network mk-old-k8s-version-390782
I0815 01:18:36.028316 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5c:70:6d", ip: ""} in network mk-old-k8s-version-390782: {Iface:virbr1 ExpiryTime:2024-08-15 02:18:29 +0000 UTC Type:0 Mac:52:54:00:5c:70:6d Iaid: IPaddr:192.168.50.21 Prefix:24 Hostname:old-k8s-version-390782 Clientid:01:52:54:00:5c:70:6d}
I0815 01:18:36.028353 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | domain old-k8s-version-390782 has defined IP address 192.168.50.21 and MAC address 52:54:00:5c:70:6d in network mk-old-k8s-version-390782
I0815 01:18:36.028515 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetSSHHostname
I0815 01:18:36.030741 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | domain old-k8s-version-390782 has defined MAC address 52:54:00:5c:70:6d in network mk-old-k8s-version-390782
I0815 01:18:36.031098 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5c:70:6d", ip: ""} in network mk-old-k8s-version-390782: {Iface:virbr1 ExpiryTime:2024-08-15 02:18:29 +0000 UTC Type:0 Mac:52:54:00:5c:70:6d Iaid: IPaddr:192.168.50.21 Prefix:24 Hostname:old-k8s-version-390782 Clientid:01:52:54:00:5c:70:6d}
I0815 01:18:36.031124 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | domain old-k8s-version-390782 has defined IP address 192.168.50.21 and MAC address 52:54:00:5c:70:6d in network mk-old-k8s-version-390782
I0815 01:18:36.031265 62901 provision.go:143] copyHostCerts
I0815 01:18:36.031320 62901 exec_runner.go:144] found /home/jenkins/minikube-integration/19443-13088/.minikube/key.pem, removing ...
I0815 01:18:36.031337 62901 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19443-13088/.minikube/key.pem
I0815 01:18:36.031409 62901 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19443-13088/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19443-13088/.minikube/key.pem (1679 bytes)
I0815 01:18:36.031504 62901 exec_runner.go:144] found /home/jenkins/minikube-integration/19443-13088/.minikube/ca.pem, removing ...
I0815 01:18:36.031513 62901 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19443-13088/.minikube/ca.pem
I0815 01:18:36.031539 62901 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19443-13088/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19443-13088/.minikube/ca.pem (1078 bytes)
I0815 01:18:36.031593 62901 exec_runner.go:144] found /home/jenkins/minikube-integration/19443-13088/.minikube/cert.pem, removing ...
I0815 01:18:36.031600 62901 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19443-13088/.minikube/cert.pem
I0815 01:18:36.031620 62901 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19443-13088/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19443-13088/.minikube/cert.pem (1123 bytes)
I0815 01:18:36.031662 62901 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19443-13088/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19443-13088/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19443-13088/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-390782 san=[127.0.0.1 192.168.50.21 localhost minikube old-k8s-version-390782]
I0815 01:18:36.102875 62901 provision.go:177] copyRemoteCerts
I0815 01:18:36.102929 62901 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0815 01:18:36.102950 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetSSHHostname
I0815 01:18:36.105686 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | domain old-k8s-version-390782 has defined MAC address 52:54:00:5c:70:6d in network mk-old-k8s-version-390782
I0815 01:18:36.106074 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5c:70:6d", ip: ""} in network mk-old-k8s-version-390782: {Iface:virbr1 ExpiryTime:2024-08-15 02:18:29 +0000 UTC Type:0 Mac:52:54:00:5c:70:6d Iaid: IPaddr:192.168.50.21 Prefix:24 Hostname:old-k8s-version-390782 Clientid:01:52:54:00:5c:70:6d}
I0815 01:18:36.106102 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | domain old-k8s-version-390782 has defined IP address 192.168.50.21 and MAC address 52:54:00:5c:70:6d in network mk-old-k8s-version-390782
I0815 01:18:36.106300 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetSSHPort
I0815 01:18:36.106476 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetSSHKeyPath
I0815 01:18:36.106629 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetSSHUsername
I0815 01:18:36.106756 62901 sshutil.go:53] new ssh client: &{IP:192.168.50.21 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19443-13088/.minikube/machines/old-k8s-version-390782/id_rsa Username:docker}
I0815 01:18:36.186785 62901 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19443-13088/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0815 01:18:36.209964 62901 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19443-13088/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0815 01:18:36.232470 62901 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19443-13088/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0815 01:18:36.255656 62901 provision.go:87] duration metric: took 230.51002ms to configureAuth
I0815 01:18:36.255685 62901 buildroot.go:189] setting minikube options for container-runtime
I0815 01:18:36.255891 62901 config.go:182] Loaded profile config "old-k8s-version-390782": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0815 01:18:36.255956 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetSSHHostname
I0815 01:18:36.258764 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | domain old-k8s-version-390782 has defined MAC address 52:54:00:5c:70:6d in network mk-old-k8s-version-390782
I0815 01:18:36.259167 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5c:70:6d", ip: ""} in network mk-old-k8s-version-390782: {Iface:virbr1 ExpiryTime:2024-08-15 02:18:29 +0000 UTC Type:0 Mac:52:54:00:5c:70:6d Iaid: IPaddr:192.168.50.21 Prefix:24 Hostname:old-k8s-version-390782 Clientid:01:52:54:00:5c:70:6d}
I0815 01:18:36.259199 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | domain old-k8s-version-390782 has defined IP address 192.168.50.21 and MAC address 52:54:00:5c:70:6d in network mk-old-k8s-version-390782
I0815 01:18:36.259344 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetSSHPort
I0815 01:18:36.259570 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetSSHKeyPath
I0815 01:18:36.259736 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetSSHKeyPath
I0815 01:18:36.259925 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetSSHUsername
I0815 01:18:36.260089 62901 main.go:141] libmachine: Using SSH client type: native
I0815 01:18:36.260261 62901 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.50.21 22 <nil> <nil>}
I0815 01:18:36.260277 62901 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0815 01:18:36.507967 62901 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0815 01:18:36.507993 62901 main.go:141] libmachine: Checking connection to Docker...
I0815 01:18:36.508003 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetURL
I0815 01:18:36.509356 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | Using libvirt version 6000000
I0815 01:18:36.511794 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | domain old-k8s-version-390782 has defined MAC address 52:54:00:5c:70:6d in network mk-old-k8s-version-390782
I0815 01:18:36.512191 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5c:70:6d", ip: ""} in network mk-old-k8s-version-390782: {Iface:virbr1 ExpiryTime:2024-08-15 02:18:29 +0000 UTC Type:0 Mac:52:54:00:5c:70:6d Iaid: IPaddr:192.168.50.21 Prefix:24 Hostname:old-k8s-version-390782 Clientid:01:52:54:00:5c:70:6d}
I0815 01:18:36.512220 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | domain old-k8s-version-390782 has defined IP address 192.168.50.21 and MAC address 52:54:00:5c:70:6d in network mk-old-k8s-version-390782
I0815 01:18:36.512395 62901 main.go:141] libmachine: Docker is up and running!
I0815 01:18:36.512409 62901 main.go:141] libmachine: Reticulating splines...
I0815 01:18:36.512417 62901 client.go:171] duration metric: took 21.161871181s to LocalClient.Create
I0815 01:18:36.512441 62901 start.go:167] duration metric: took 21.161936031s to libmachine.API.Create "old-k8s-version-390782"
I0815 01:18:36.512454 62901 start.go:293] postStartSetup for "old-k8s-version-390782" (driver="kvm2")
I0815 01:18:36.512467 62901 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0815 01:18:36.512486 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .DriverName
I0815 01:18:36.512776 62901 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0815 01:18:36.512801 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetSSHHostname
I0815 01:18:36.514839 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | domain old-k8s-version-390782 has defined MAC address 52:54:00:5c:70:6d in network mk-old-k8s-version-390782
I0815 01:18:36.515154 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5c:70:6d", ip: ""} in network mk-old-k8s-version-390782: {Iface:virbr1 ExpiryTime:2024-08-15 02:18:29 +0000 UTC Type:0 Mac:52:54:00:5c:70:6d Iaid: IPaddr:192.168.50.21 Prefix:24 Hostname:old-k8s-version-390782 Clientid:01:52:54:00:5c:70:6d}
I0815 01:18:36.515189 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | domain old-k8s-version-390782 has defined IP address 192.168.50.21 and MAC address 52:54:00:5c:70:6d in network mk-old-k8s-version-390782
I0815 01:18:36.515355 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetSSHPort
I0815 01:18:36.515592 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetSSHKeyPath
I0815 01:18:36.515733 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetSSHUsername
I0815 01:18:36.515870 62901 sshutil.go:53] new ssh client: &{IP:192.168.50.21 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19443-13088/.minikube/machines/old-k8s-version-390782/id_rsa Username:docker}
I0815 01:18:36.599234 62901 ssh_runner.go:195] Run: cat /etc/os-release
I0815 01:18:36.603175 62901 info.go:137] Remote host: Buildroot 2023.02.9
I0815 01:18:36.603195 62901 filesync.go:126] Scanning /home/jenkins/minikube-integration/19443-13088/.minikube/addons for local assets ...
I0815 01:18:36.603251 62901 filesync.go:126] Scanning /home/jenkins/minikube-integration/19443-13088/.minikube/files for local assets ...
I0815 01:18:36.603347 62901 filesync.go:149] local asset: /home/jenkins/minikube-integration/19443-13088/.minikube/files/etc/ssl/certs/202792.pem -> 202792.pem in /etc/ssl/certs
I0815 01:18:36.603461 62901 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0815 01:18:36.613138 62901 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19443-13088/.minikube/files/etc/ssl/certs/202792.pem --> /etc/ssl/certs/202792.pem (1708 bytes)
I0815 01:18:36.635882 62901 start.go:296] duration metric: took 123.410932ms for postStartSetup
I0815 01:18:36.635928 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetConfigRaw
I0815 01:18:36.636541 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetIP
I0815 01:18:36.639425 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | domain old-k8s-version-390782 has defined MAC address 52:54:00:5c:70:6d in network mk-old-k8s-version-390782
I0815 01:18:36.639830 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5c:70:6d", ip: ""} in network mk-old-k8s-version-390782: {Iface:virbr1 ExpiryTime:2024-08-15 02:18:29 +0000 UTC Type:0 Mac:52:54:00:5c:70:6d Iaid: IPaddr:192.168.50.21 Prefix:24 Hostname:old-k8s-version-390782 Clientid:01:52:54:00:5c:70:6d}
I0815 01:18:36.639868 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | domain old-k8s-version-390782 has defined IP address 192.168.50.21 and MAC address 52:54:00:5c:70:6d in network mk-old-k8s-version-390782
I0815 01:18:36.640080 62901 profile.go:143] Saving config to /home/jenkins/minikube-integration/19443-13088/.minikube/profiles/old-k8s-version-390782/config.json ...
I0815 01:18:36.640250 62901 start.go:128] duration metric: took 21.307828503s to createHost
I0815 01:18:36.640276 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetSSHHostname
I0815 01:18:36.642954 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | domain old-k8s-version-390782 has defined MAC address 52:54:00:5c:70:6d in network mk-old-k8s-version-390782
I0815 01:18:36.643324 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5c:70:6d", ip: ""} in network mk-old-k8s-version-390782: {Iface:virbr1 ExpiryTime:2024-08-15 02:18:29 +0000 UTC Type:0 Mac:52:54:00:5c:70:6d Iaid: IPaddr:192.168.50.21 Prefix:24 Hostname:old-k8s-version-390782 Clientid:01:52:54:00:5c:70:6d}
I0815 01:18:36.643347 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | domain old-k8s-version-390782 has defined IP address 192.168.50.21 and MAC address 52:54:00:5c:70:6d in network mk-old-k8s-version-390782
I0815 01:18:36.643548 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetSSHPort
I0815 01:18:36.643760 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetSSHKeyPath
I0815 01:18:36.643948 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetSSHKeyPath
I0815 01:18:36.644096 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetSSHUsername
I0815 01:18:36.644285 62901 main.go:141] libmachine: Using SSH client type: native
I0815 01:18:36.644446 62901 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.50.21 22 <nil> <nil>}
I0815 01:18:36.644468 62901 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0815 01:18:36.741069 62901 main.go:141] libmachine: SSH cmd err, output: <nil>: 1723684716.708936236
I0815 01:18:36.741090 62901 fix.go:216] guest clock: 1723684716.708936236
I0815 01:18:36.741097 62901 fix.go:229] Guest: 2024-08-15 01:18:36.708936236 +0000 UTC Remote: 2024-08-15 01:18:36.640259084 +0000 UTC m=+21.412530548 (delta=68.677152ms)
I0815 01:18:36.741115 62901 fix.go:200] guest clock delta is within tolerance: 68.677152ms
I0815 01:18:36.741119 62901 start.go:83] releasing machines lock for "old-k8s-version-390782", held for 21.408769434s
I0815 01:18:36.741170 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .DriverName
I0815 01:18:36.741448 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetIP
I0815 01:18:36.743920 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | domain old-k8s-version-390782 has defined MAC address 52:54:00:5c:70:6d in network mk-old-k8s-version-390782
I0815 01:18:36.744266 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5c:70:6d", ip: ""} in network mk-old-k8s-version-390782: {Iface:virbr1 ExpiryTime:2024-08-15 02:18:29 +0000 UTC Type:0 Mac:52:54:00:5c:70:6d Iaid: IPaddr:192.168.50.21 Prefix:24 Hostname:old-k8s-version-390782 Clientid:01:52:54:00:5c:70:6d}
I0815 01:18:36.744297 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | domain old-k8s-version-390782 has defined IP address 192.168.50.21 and MAC address 52:54:00:5c:70:6d in network mk-old-k8s-version-390782
I0815 01:18:36.744446 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .DriverName
I0815 01:18:36.744893 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .DriverName
I0815 01:18:36.745074 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .DriverName
I0815 01:18:36.745161 62901 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0815 01:18:36.745195 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetSSHHostname
I0815 01:18:36.745267 62901 ssh_runner.go:195] Run: cat /version.json
I0815 01:18:36.745284 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetSSHHostname
I0815 01:18:36.747884 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | domain old-k8s-version-390782 has defined MAC address 52:54:00:5c:70:6d in network mk-old-k8s-version-390782
I0815 01:18:36.748163 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | domain old-k8s-version-390782 has defined MAC address 52:54:00:5c:70:6d in network mk-old-k8s-version-390782
I0815 01:18:36.748406 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5c:70:6d", ip: ""} in network mk-old-k8s-version-390782: {Iface:virbr1 ExpiryTime:2024-08-15 02:18:29 +0000 UTC Type:0 Mac:52:54:00:5c:70:6d Iaid: IPaddr:192.168.50.21 Prefix:24 Hostname:old-k8s-version-390782 Clientid:01:52:54:00:5c:70:6d}
I0815 01:18:36.748440 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | domain old-k8s-version-390782 has defined IP address 192.168.50.21 and MAC address 52:54:00:5c:70:6d in network mk-old-k8s-version-390782
I0815 01:18:36.748522 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5c:70:6d", ip: ""} in network mk-old-k8s-version-390782: {Iface:virbr1 ExpiryTime:2024-08-15 02:18:29 +0000 UTC Type:0 Mac:52:54:00:5c:70:6d Iaid: IPaddr:192.168.50.21 Prefix:24 Hostname:old-k8s-version-390782 Clientid:01:52:54:00:5c:70:6d}
I0815 01:18:36.748553 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetSSHPort
I0815 01:18:36.748554 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | domain old-k8s-version-390782 has defined IP address 192.168.50.21 and MAC address 52:54:00:5c:70:6d in network mk-old-k8s-version-390782
I0815 01:18:36.748822 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetSSHPort
I0815 01:18:36.748822 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetSSHKeyPath
I0815 01:18:36.749034 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetSSHUsername
I0815 01:18:36.749072 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetSSHKeyPath
I0815 01:18:36.749236 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetSSHUsername
I0815 01:18:36.749285 62901 sshutil.go:53] new ssh client: &{IP:192.168.50.21 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19443-13088/.minikube/machines/old-k8s-version-390782/id_rsa Username:docker}
I0815 01:18:36.749409 62901 sshutil.go:53] new ssh client: &{IP:192.168.50.21 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19443-13088/.minikube/machines/old-k8s-version-390782/id_rsa Username:docker}
I0815 01:18:36.825216 62901 ssh_runner.go:195] Run: systemctl --version
I0815 01:18:36.855603 62901 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0815 01:18:37.020573 62901 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0815 01:18:37.028648 62901 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0815 01:18:37.028729 62901 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0815 01:18:37.045556 62901 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0815 01:18:37.045588 62901 start.go:495] detecting cgroup driver to use...
I0815 01:18:37.045647 62901 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0815 01:18:37.063227 62901 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0815 01:18:37.078785 62901 docker.go:217] disabling cri-docker service (if available) ...
I0815 01:18:37.078843 62901 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0815 01:18:37.093746 62901 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0815 01:18:37.108703 62901 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0815 01:18:37.235966 62901 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0815 01:18:37.409726 62901 docker.go:233] disabling docker service ...
I0815 01:18:37.409800 62901 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0815 01:18:37.423173 62901 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0815 01:18:37.435573 62901 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0815 01:18:37.542629 62901 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0815 01:18:37.647079 62901 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0815 01:18:37.659692 62901 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0815 01:18:37.677559 62901 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0815 01:18:37.677647 62901 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0815 01:18:37.686788 62901 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0815 01:18:37.686849 62901 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0815 01:18:37.696197 62901 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0815 01:18:37.705195 62901 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0815 01:18:37.714113 62901 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0815 01:18:37.723448 62901 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0815 01:18:37.731778 62901 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0815 01:18:37.731828 62901 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0815 01:18:37.742733 62901 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0815 01:18:37.751643 62901 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0815 01:18:37.850633 62901 ssh_runner.go:195] Run: sudo systemctl restart crio
I0815 01:18:37.980286 62901 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0815 01:18:37.980365 62901 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0815 01:18:37.985603 62901 start.go:563] Will wait 60s for crictl version
I0815 01:18:37.985653 62901 ssh_runner.go:195] Run: which crictl
I0815 01:18:37.989325 62901 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0815 01:18:38.025446 62901 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0815 01:18:38.025526 62901 ssh_runner.go:195] Run: crio --version
I0815 01:18:38.052335 62901 ssh_runner.go:195] Run: crio --version
I0815 01:18:38.079325 62901 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0815 01:18:38.080350 62901 main.go:141] libmachine: (old-k8s-version-390782) Calling .GetIP
I0815 01:18:38.082844 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | domain old-k8s-version-390782 has defined MAC address 52:54:00:5c:70:6d in network mk-old-k8s-version-390782
I0815 01:18:38.083283 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5c:70:6d", ip: ""} in network mk-old-k8s-version-390782: {Iface:virbr1 ExpiryTime:2024-08-15 02:18:29 +0000 UTC Type:0 Mac:52:54:00:5c:70:6d Iaid: IPaddr:192.168.50.21 Prefix:24 Hostname:old-k8s-version-390782 Clientid:01:52:54:00:5c:70:6d}
I0815 01:18:38.083311 62901 main.go:141] libmachine: (old-k8s-version-390782) DBG | domain old-k8s-version-390782 has defined IP address 192.168.50.21 and MAC address 52:54:00:5c:70:6d in network mk-old-k8s-version-390782
I0815 01:18:38.083549 62901 ssh_runner.go:195] Run: grep 192.168.50.1 host.minikube.internal$ /etc/hosts
I0815 01:18:38.087341 62901 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.50.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0815 01:18:38.098986 62901 kubeadm.go:883] updating cluster {Name:old-k8s-version-390782 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-390782 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.50.21 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mo
untPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0815 01:18:38.099109 62901 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0815 01:18:38.099169 62901 ssh_runner.go:195] Run: sudo crictl images --output json
I0815 01:18:38.129986 62901 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0815 01:18:38.130045 62901 ssh_runner.go:195] Run: which lz4
I0815 01:18:38.133747 62901 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0815 01:18:38.137445 62901 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0815 01:18:38.137476 62901 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19443-13088/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0815 01:18:39.499103 62901 crio.go:462] duration metric: took 1.365389682s to copy over tarball
I0815 01:18:39.499174 62901 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0815 01:18:42.032527 62901 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.533306372s)
I0815 01:18:42.032570 62901 crio.go:469] duration metric: took 2.533442037s to extract the tarball
I0815 01:18:42.032578 62901 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0815 01:18:42.076717 62901 ssh_runner.go:195] Run: sudo crictl images --output json
I0815 01:18:42.124324 62901 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0815 01:18:42.124349 62901 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0815 01:18:42.124422 62901 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0815 01:18:42.124448 62901 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I0815 01:18:42.124465 62901 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0815 01:18:42.124469 62901 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I0815 01:18:42.124469 62901 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0815 01:18:42.124417 62901 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0815 01:18:42.124675 62901 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0815 01:18:42.124422 62901 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0815 01:18:42.126393 62901 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0815 01:18:42.126446 62901 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0815 01:18:42.126504 62901 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0815 01:18:42.126537 62901 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0815 01:18:42.126677 62901 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0815 01:18:42.126683 62901 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0815 01:18:42.126702 62901 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0815 01:18:42.126740 62901 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0815 01:18:42.334588 62901 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0815 01:18:42.373124 62901 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0815 01:18:42.373162 62901 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0815 01:18:42.373200 62901 ssh_runner.go:195] Run: which crictl
I0815 01:18:42.376945 62901 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0815 01:18:42.384186 62901 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0815 01:18:42.391317 62901 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0815 01:18:42.396156 62901 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0815 01:18:42.416184 62901 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0815 01:18:42.417853 62901 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0815 01:18:42.420925 62901 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0815 01:18:42.457174 62901 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0815 01:18:42.499333 62901 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0815 01:18:42.499399 62901 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0815 01:18:42.499446 62901 ssh_runner.go:195] Run: which crictl
I0815 01:18:42.515004 62901 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0815 01:18:42.515026 62901 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0815 01:18:42.515046 62901 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0815 01:18:42.515046 62901 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0815 01:18:42.515088 62901 ssh_runner.go:195] Run: which crictl
I0815 01:18:42.515088 62901 ssh_runner.go:195] Run: which crictl
I0815 01:18:42.518962 62901 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0815 01:18:42.590012 62901 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0815 01:18:42.590056 62901 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0815 01:18:42.590082 62901 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0815 01:18:42.590112 62901 ssh_runner.go:195] Run: which crictl
I0815 01:18:42.590112 62901 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0815 01:18:42.590198 62901 ssh_runner.go:195] Run: which crictl
I0815 01:18:42.604756 62901 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0815 01:18:42.604806 62901 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0815 01:18:42.604809 62901 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0815 01:18:42.604849 62901 ssh_runner.go:195] Run: which crictl
I0815 01:18:42.604853 62901 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0815 01:18:42.604890 62901 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0815 01:18:42.604927 62901 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19443-13088/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0815 01:18:42.604959 62901 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0815 01:18:42.604975 62901 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0815 01:18:42.690129 62901 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0815 01:18:42.724791 62901 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0815 01:18:42.754797 62901 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0815 01:18:42.754799 62901 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0815 01:18:42.754799 62901 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0815 01:18:42.754809 62901 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0815 01:18:42.796884 62901 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0815 01:18:42.807108 62901 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0815 01:18:42.864050 62901 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0815 01:18:42.884593 62901 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0815 01:18:42.884637 62901 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0815 01:18:42.884713 62901 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0815 01:18:42.967087 62901 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19443-13088/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0815 01:18:42.967095 62901 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19443-13088/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0815 01:18:42.970564 62901 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0815 01:18:43.012605 62901 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19443-13088/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0815 01:18:43.012642 62901 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19443-13088/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0815 01:18:43.012732 62901 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19443-13088/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0815 01:18:43.012786 62901 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0815 01:18:43.145628 62901 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19443-13088/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0815 01:18:43.145691 62901 cache_images.go:92] duration metric: took 1.021327666s to LoadCachedImages
W0815 01:18:43.145751 62901 out.go:239] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19443-13088/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19443-13088/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2: no such file or directory
I0815 01:18:43.145776 62901 kubeadm.go:934] updating node { 192.168.50.21 8443 v1.20.0 crio true true} ...
I0815 01:18:43.145896 62901 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-390782 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.50.21
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-390782 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0815 01:18:43.145977 62901 ssh_runner.go:195] Run: crio config
I0815 01:18:43.196228 62901 cni.go:84] Creating CNI manager for ""
I0815 01:18:43.196247 62901 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0815 01:18:43.196256 62901 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0815 01:18:43.196275 62901 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.50.21 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-390782 NodeName:old-k8s-version-390782 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.50.21"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.50.21 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt Stati
cPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0815 01:18:43.196390 62901 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.50.21
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-390782"
kubeletExtraArgs:
node-ip: 192.168.50.21
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.50.21"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0815 01:18:43.196446 62901 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0815 01:18:43.206350 62901 binaries.go:44] Found k8s binaries, skipping transfer
I0815 01:18:43.206423 62901 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0815 01:18:43.215657 62901 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (429 bytes)
I0815 01:18:43.230982 62901 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0815 01:18:43.249230 62901 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2120 bytes)
I0815 01:18:43.267757 62901 ssh_runner.go:195] Run: grep 192.168.50.21 control-plane.minikube.internal$ /etc/hosts
I0815 01:18:43.272402 62901 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.50.21 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0815 01:18:43.287670 62901 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0815 01:18:43.419547 62901 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0815 01:18:43.438464 62901 certs.go:68] Setting up /home/jenkins/minikube-integration/19443-13088/.minikube/profiles/old-k8s-version-390782 for IP: 192.168.50.21
I0815 01:18:43.438492 62901 certs.go:194] generating shared ca certs ...
I0815 01:18:43.438512 62901 certs.go:226] acquiring lock for ca certs: {Name:mka993f83e51f4a6c691ce83d5a0e61f1c8a954d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0815 01:18:43.438694 62901 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19443-13088/.minikube/ca.key
I0815 01:18:43.438756 62901 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19443-13088/.minikube/proxy-client-ca.key
I0815 01:18:43.438770 62901 certs.go:256] generating profile certs ...
I0815 01:18:43.438848 62901 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19443-13088/.minikube/profiles/old-k8s-version-390782/client.key
I0815 01:18:43.438875 62901 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19443-13088/.minikube/profiles/old-k8s-version-390782/client.crt with IP's: []
I0815 01:18:43.583816 62901 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19443-13088/.minikube/profiles/old-k8s-version-390782/client.crt ...
I0815 01:18:43.583845 62901 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19443-13088/.minikube/profiles/old-k8s-version-390782/client.crt: {Name:mk3704cec091c432f9995f39282f09da868b376f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0815 01:18:43.584029 62901 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19443-13088/.minikube/profiles/old-k8s-version-390782/client.key ...
I0815 01:18:43.584049 62901 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19443-13088/.minikube/profiles/old-k8s-version-390782/client.key: {Name:mkc3166e5c07337fd4a57baf7a3b62c154e12547 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0815 01:18:43.584164 62901 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19443-13088/.minikube/profiles/old-k8s-version-390782/apiserver.key.d79afed6
I0815 01:18:43.584187 62901 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19443-13088/.minikube/profiles/old-k8s-version-390782/apiserver.crt.d79afed6 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.50.21]
I0815 01:18:43.921387 62901 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19443-13088/.minikube/profiles/old-k8s-version-390782/apiserver.crt.d79afed6 ...
I0815 01:18:43.921416 62901 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19443-13088/.minikube/profiles/old-k8s-version-390782/apiserver.crt.d79afed6: {Name:mk7d4094a83796263013154c0cb821537c264b95 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0815 01:18:43.921609 62901 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19443-13088/.minikube/profiles/old-k8s-version-390782/apiserver.key.d79afed6 ...
I0815 01:18:43.921631 62901 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19443-13088/.minikube/profiles/old-k8s-version-390782/apiserver.key.d79afed6: {Name:mk4b03b753cd11d09dc2d3d4898fd75cb5e6dbb2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0815 01:18:43.921733 62901 certs.go:381] copying /home/jenkins/minikube-integration/19443-13088/.minikube/profiles/old-k8s-version-390782/apiserver.crt.d79afed6 -> /home/jenkins/minikube-integration/19443-13088/.minikube/profiles/old-k8s-version-390782/apiserver.crt
I0815 01:18:43.921808 62901 certs.go:385] copying /home/jenkins/minikube-integration/19443-13088/.minikube/profiles/old-k8s-version-390782/apiserver.key.d79afed6 -> /home/jenkins/minikube-integration/19443-13088/.minikube/profiles/old-k8s-version-390782/apiserver.key
I0815 01:18:43.921859 62901 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19443-13088/.minikube/profiles/old-k8s-version-390782/proxy-client.key
I0815 01:18:43.921875 62901 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19443-13088/.minikube/profiles/old-k8s-version-390782/proxy-client.crt with IP's: []
I0815 01:18:44.170034 62901 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19443-13088/.minikube/profiles/old-k8s-version-390782/proxy-client.crt ...
I0815 01:18:44.170059 62901 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19443-13088/.minikube/profiles/old-k8s-version-390782/proxy-client.crt: {Name:mk4c373fce31688a292a12dc39a7fd0454748c01 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0815 01:18:44.170216 62901 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19443-13088/.minikube/profiles/old-k8s-version-390782/proxy-client.key ...
I0815 01:18:44.170229 62901 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19443-13088/.minikube/profiles/old-k8s-version-390782/proxy-client.key: {Name:mk5170e2a41af876693ef52ec4446c63b6968e19 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0815 01:18:44.170405 62901 certs.go:484] found cert: /home/jenkins/minikube-integration/19443-13088/.minikube/certs/20279.pem (1338 bytes)
W0815 01:18:44.170441 62901 certs.go:480] ignoring /home/jenkins/minikube-integration/19443-13088/.minikube/certs/20279_empty.pem, impossibly tiny 0 bytes
I0815 01:18:44.170448 62901 certs.go:484] found cert: /home/jenkins/minikube-integration/19443-13088/.minikube/certs/ca-key.pem (1679 bytes)
I0815 01:18:44.170469 62901 certs.go:484] found cert: /home/jenkins/minikube-integration/19443-13088/.minikube/certs/ca.pem (1078 bytes)
I0815 01:18:44.170493 62901 certs.go:484] found cert: /home/jenkins/minikube-integration/19443-13088/.minikube/certs/cert.pem (1123 bytes)
I0815 01:18:44.170514 62901 certs.go:484] found cert: /home/jenkins/minikube-integration/19443-13088/.minikube/certs/key.pem (1679 bytes)
I0815 01:18:44.170551 62901 certs.go:484] found cert: /home/jenkins/minikube-integration/19443-13088/.minikube/files/etc/ssl/certs/202792.pem (1708 bytes)
I0815 01:18:44.171103 62901 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19443-13088/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0815 01:18:44.198245 62901 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19443-13088/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0815 01:18:44.224553 62901 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19443-13088/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0815 01:18:44.257043 62901 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19443-13088/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0815 01:18:44.292022 62901 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19443-13088/.minikube/profiles/old-k8s-version-390782/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0815 01:18:44.318974 62901 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19443-13088/.minikube/profiles/old-k8s-version-390782/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0815 01:18:44.350461 62901 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19443-13088/.minikube/profiles/old-k8s-version-390782/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0815 01:18:44.382990 62901 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19443-13088/.minikube/profiles/old-k8s-version-390782/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0815 01:18:44.405719 62901 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19443-13088/.minikube/files/etc/ssl/certs/202792.pem --> /usr/share/ca-certificates/202792.pem (1708 bytes)
I0815 01:18:44.429283 62901 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19443-13088/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0815 01:18:44.452552 62901 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19443-13088/.minikube/certs/20279.pem --> /usr/share/ca-certificates/20279.pem (1338 bytes)
I0815 01:18:44.475027 62901 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0815 01:18:44.490851 62901 ssh_runner.go:195] Run: openssl version
I0815 01:18:44.496900 62901 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/202792.pem && ln -fs /usr/share/ca-certificates/202792.pem /etc/ssl/certs/202792.pem"
I0815 01:18:44.507739 62901 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/202792.pem
I0815 01:18:44.512174 62901 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Aug 15 00:17 /usr/share/ca-certificates/202792.pem
I0815 01:18:44.512228 62901 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/202792.pem
I0815 01:18:44.518864 62901 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/202792.pem /etc/ssl/certs/3ec20f2e.0"
I0815 01:18:44.529056 62901 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0815 01:18:44.538684 62901 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0815 01:18:44.542941 62901 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug 15 00:06 /usr/share/ca-certificates/minikubeCA.pem
I0815 01:18:44.543002 62901 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0815 01:18:44.548393 62901 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0815 01:18:44.558468 62901 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/20279.pem && ln -fs /usr/share/ca-certificates/20279.pem /etc/ssl/certs/20279.pem"
I0815 01:18:44.568385 62901 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/20279.pem
I0815 01:18:44.572941 62901 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Aug 15 00:17 /usr/share/ca-certificates/20279.pem
I0815 01:18:44.573000 62901 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/20279.pem
I0815 01:18:44.579115 62901 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/20279.pem /etc/ssl/certs/51391683.0"
I0815 01:18:44.589228 62901 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0815 01:18:44.592911 62901 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0815 01:18:44.592960 62901 kubeadm.go:392] StartCluster: {Name:old-k8s-version-390782 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-390782 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.50.21 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0815 01:18:44.593023 62901 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0815 01:18:44.593087 62901 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0815 01:18:44.633019 62901 cri.go:89] found id: ""
I0815 01:18:44.633105 62901 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0815 01:18:44.643911 62901 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0815 01:18:44.653552 62901 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0815 01:18:44.663792 62901 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0815 01:18:44.663809 62901 kubeadm.go:157] found existing configuration files:
I0815 01:18:44.663852 62901 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0815 01:18:44.672407 62901 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0815 01:18:44.672467 62901 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0815 01:18:44.681471 62901 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0815 01:18:44.690216 62901 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0815 01:18:44.690270 62901 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0815 01:18:44.698929 62901 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0815 01:18:44.707217 62901 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0815 01:18:44.707269 62901 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0815 01:18:44.716108 62901 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0815 01:18:44.724552 62901 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0815 01:18:44.724604 62901 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0815 01:18:44.733134 62901 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0815 01:18:45.008366 62901 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0815 01:20:42.831644 62901 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0815 01:20:42.831740 62901 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0815 01:20:42.833205 62901 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0815 01:20:42.833285 62901 kubeadm.go:310] [preflight] Running pre-flight checks
I0815 01:20:42.833397 62901 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0815 01:20:42.833508 62901 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0815 01:20:42.833647 62901 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0815 01:20:42.833750 62901 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0815 01:20:42.835471 62901 out.go:204] - Generating certificates and keys ...
I0815 01:20:42.835544 62901 kubeadm.go:310] [certs] Using existing ca certificate authority
I0815 01:20:42.835602 62901 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0815 01:20:42.835682 62901 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0815 01:20:42.835764 62901 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0815 01:20:42.835839 62901 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0815 01:20:42.835903 62901 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0815 01:20:42.835970 62901 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0815 01:20:42.836085 62901 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-390782] and IPs [192.168.50.21 127.0.0.1 ::1]
I0815 01:20:42.836161 62901 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0815 01:20:42.836327 62901 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-390782] and IPs [192.168.50.21 127.0.0.1 ::1]
I0815 01:20:42.836428 62901 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0815 01:20:42.836513 62901 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0815 01:20:42.836584 62901 kubeadm.go:310] [certs] Generating "sa" key and public key
I0815 01:20:42.836668 62901 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0815 01:20:42.836748 62901 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0815 01:20:42.836826 62901 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0815 01:20:42.836921 62901 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0815 01:20:42.836987 62901 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0815 01:20:42.837070 62901 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0815 01:20:42.837139 62901 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0815 01:20:42.837186 62901 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0815 01:20:42.837249 62901 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0815 01:20:42.839455 62901 out.go:204] - Booting up control plane ...
I0815 01:20:42.839541 62901 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0815 01:20:42.839624 62901 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0815 01:20:42.839683 62901 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0815 01:20:42.839758 62901 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0815 01:20:42.839960 62901 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0815 01:20:42.840029 62901 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0815 01:20:42.840110 62901 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0815 01:20:42.840320 62901 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0815 01:20:42.840428 62901 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0815 01:20:42.840630 62901 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0815 01:20:42.840740 62901 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0815 01:20:42.840933 62901 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0815 01:20:42.841024 62901 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0815 01:20:42.841210 62901 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0815 01:20:42.841304 62901 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0815 01:20:42.841494 62901 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0815 01:20:42.841506 62901 kubeadm.go:310]
I0815 01:20:42.841537 62901 kubeadm.go:310] Unfortunately, an error has occurred:
I0815 01:20:42.841587 62901 kubeadm.go:310] timed out waiting for the condition
I0815 01:20:42.841594 62901 kubeadm.go:310]
I0815 01:20:42.841630 62901 kubeadm.go:310] This error is likely caused by:
I0815 01:20:42.841687 62901 kubeadm.go:310] - The kubelet is not running
I0815 01:20:42.841831 62901 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0815 01:20:42.841843 62901 kubeadm.go:310]
I0815 01:20:42.841993 62901 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0815 01:20:42.842043 62901 kubeadm.go:310] - 'systemctl status kubelet'
I0815 01:20:42.842076 62901 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0815 01:20:42.842083 62901 kubeadm.go:310]
I0815 01:20:42.842187 62901 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0815 01:20:42.842291 62901 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0815 01:20:42.842303 62901 kubeadm.go:310]
I0815 01:20:42.842435 62901 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0815 01:20:42.842547 62901 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0815 01:20:42.842630 62901 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0815 01:20:42.842703 62901 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0815 01:20:42.842743 62901 kubeadm.go:310]
W0815 01:20:42.842839 62901 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-390782] and IPs [192.168.50.21 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-390782] and IPs [192.168.50.21 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-390782] and IPs [192.168.50.21 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-390782] and IPs [192.168.50.21 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0815 01:20:42.842877 62901 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0815 01:20:43.511675 62901 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0815 01:20:43.525004 62901 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0815 01:20:43.534682 62901 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0815 01:20:43.534712 62901 kubeadm.go:157] found existing configuration files:
I0815 01:20:43.534765 62901 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0815 01:20:43.543599 62901 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0815 01:20:43.543658 62901 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0815 01:20:43.552598 62901 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0815 01:20:43.561162 62901 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0815 01:20:43.561215 62901 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0815 01:20:43.570098 62901 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0815 01:20:43.578490 62901 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0815 01:20:43.578554 62901 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0815 01:20:43.587163 62901 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0815 01:20:43.595686 62901 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0815 01:20:43.595740 62901 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0815 01:20:43.604408 62901 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0815 01:20:43.672454 62901 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0815 01:20:43.672646 62901 kubeadm.go:310] [preflight] Running pre-flight checks
I0815 01:20:43.810398 62901 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0815 01:20:43.810505 62901 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0815 01:20:43.810607 62901 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0815 01:20:43.977623 62901 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0815 01:20:43.979610 62901 out.go:204] - Generating certificates and keys ...
I0815 01:20:43.979708 62901 kubeadm.go:310] [certs] Using existing ca certificate authority
I0815 01:20:43.979799 62901 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0815 01:20:43.979872 62901 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0815 01:20:43.979935 62901 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0815 01:20:43.980025 62901 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0815 01:20:43.980131 62901 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0815 01:20:43.980582 62901 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0815 01:20:43.981233 62901 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0815 01:20:43.981910 62901 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0815 01:20:43.982604 62901 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0815 01:20:43.982860 62901 kubeadm.go:310] [certs] Using the existing "sa" key
I0815 01:20:43.982922 62901 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0815 01:20:44.115044 62901 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0815 01:20:44.261201 62901 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0815 01:20:44.378138 62901 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0815 01:20:44.531909 62901 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0815 01:20:44.545789 62901 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0815 01:20:44.547652 62901 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0815 01:20:44.547785 62901 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0815 01:20:44.670260 62901 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0815 01:20:44.672012 62901 out.go:204] - Booting up control plane ...
I0815 01:20:44.672110 62901 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0815 01:20:44.676684 62901 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0815 01:20:44.677932 62901 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0815 01:20:44.678789 62901 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0815 01:20:44.680952 62901 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0815 01:21:24.678853 62901 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0815 01:21:24.679210 62901 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0815 01:21:24.679436 62901 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0815 01:21:29.679634 62901 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0815 01:21:29.679864 62901 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0815 01:21:39.679775 62901 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0815 01:21:39.679946 62901 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0815 01:21:59.680872 62901 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0815 01:21:59.681136 62901 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0815 01:22:39.683053 62901 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0815 01:22:39.683364 62901 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0815 01:22:39.683390 62901 kubeadm.go:310]
I0815 01:22:39.683446 62901 kubeadm.go:310] Unfortunately, an error has occurred:
I0815 01:22:39.683529 62901 kubeadm.go:310] timed out waiting for the condition
I0815 01:22:39.683550 62901 kubeadm.go:310]
I0815 01:22:39.683593 62901 kubeadm.go:310] This error is likely caused by:
I0815 01:22:39.683643 62901 kubeadm.go:310] - The kubelet is not running
I0815 01:22:39.683774 62901 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0815 01:22:39.683799 62901 kubeadm.go:310]
I0815 01:22:39.683936 62901 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0815 01:22:39.683994 62901 kubeadm.go:310] - 'systemctl status kubelet'
I0815 01:22:39.684036 62901 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0815 01:22:39.684047 62901 kubeadm.go:310]
I0815 01:22:39.684178 62901 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0815 01:22:39.684328 62901 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0815 01:22:39.684345 62901 kubeadm.go:310]
I0815 01:22:39.684489 62901 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0815 01:22:39.684605 62901 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0815 01:22:39.684733 62901 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0815 01:22:39.684837 62901 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0815 01:22:39.684848 62901 kubeadm.go:310]
I0815 01:22:39.685395 62901 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0815 01:22:39.685507 62901 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0815 01:22:39.685618 62901 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0815 01:22:39.685715 62901 kubeadm.go:394] duration metric: took 3m55.092757137s to StartCluster
I0815 01:22:39.685775 62901 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0815 01:22:39.685847 62901 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0815 01:22:39.729020 62901 cri.go:89] found id: ""
I0815 01:22:39.729050 62901 logs.go:276] 0 containers: []
W0815 01:22:39.729061 62901 logs.go:278] No container was found matching "kube-apiserver"
I0815 01:22:39.729069 62901 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0815 01:22:39.729139 62901 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0815 01:22:39.765245 62901 cri.go:89] found id: ""
I0815 01:22:39.765273 62901 logs.go:276] 0 containers: []
W0815 01:22:39.765284 62901 logs.go:278] No container was found matching "etcd"
I0815 01:22:39.765291 62901 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0815 01:22:39.765359 62901 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0815 01:22:39.799416 62901 cri.go:89] found id: ""
I0815 01:22:39.799445 62901 logs.go:276] 0 containers: []
W0815 01:22:39.799455 62901 logs.go:278] No container was found matching "coredns"
I0815 01:22:39.799462 62901 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0815 01:22:39.799522 62901 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0815 01:22:39.836454 62901 cri.go:89] found id: ""
I0815 01:22:39.836488 62901 logs.go:276] 0 containers: []
W0815 01:22:39.836497 62901 logs.go:278] No container was found matching "kube-scheduler"
I0815 01:22:39.836504 62901 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0815 01:22:39.836555 62901 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0815 01:22:39.891014 62901 cri.go:89] found id: ""
I0815 01:22:39.891041 62901 logs.go:276] 0 containers: []
W0815 01:22:39.891051 62901 logs.go:278] No container was found matching "kube-proxy"
I0815 01:22:39.891059 62901 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0815 01:22:39.891111 62901 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0815 01:22:39.939689 62901 cri.go:89] found id: ""
I0815 01:22:39.939711 62901 logs.go:276] 0 containers: []
W0815 01:22:39.939721 62901 logs.go:278] No container was found matching "kube-controller-manager"
I0815 01:22:39.939729 62901 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0815 01:22:39.939789 62901 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0815 01:22:39.980710 62901 cri.go:89] found id: ""
I0815 01:22:39.980742 62901 logs.go:276] 0 containers: []
W0815 01:22:39.980753 62901 logs.go:278] No container was found matching "kindnet"
I0815 01:22:39.980764 62901 logs.go:123] Gathering logs for kubelet ...
I0815 01:22:39.980779 62901 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0815 01:22:40.032558 62901 logs.go:123] Gathering logs for dmesg ...
I0815 01:22:40.032590 62901 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0815 01:22:40.049782 62901 logs.go:123] Gathering logs for describe nodes ...
I0815 01:22:40.049810 62901 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0815 01:22:40.160450 62901 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0815 01:22:40.160470 62901 logs.go:123] Gathering logs for CRI-O ...
I0815 01:22:40.160486 62901 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0815 01:22:40.280277 62901 logs.go:123] Gathering logs for container status ...
I0815 01:22:40.280312 62901 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0815 01:22:40.329871 62901 out.go:364] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0815 01:22:40.329925 62901 out.go:239] *
*
W0815 01:22:40.329986 62901 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0815 01:22:40.330010 62901 out.go:239] *
*
W0815 01:22:40.330906 62901 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0815 01:22:40.333952 62901 out.go:177]
W0815 01:22:40.335240 62901 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0815 01:22:40.335318 62901 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0815 01:22:40.335352 62901 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0815 01:22:40.336818 62901 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-390782 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-390782 -n old-k8s-version-390782
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-390782 -n old-k8s-version-390782: exit status 6 (226.193919ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0815 01:22:40.617173 65912 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-390782" does not appear in /home/jenkins/minikube-integration/19443-13088/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-390782" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (265.41s)