=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-983302 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-983302 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m38.793614446s)
-- stdout --
* [old-k8s-version-983302] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=17779
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/17779-14199/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/17779-14199/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-983302" primary control-plane node in "old-k8s-version-983302" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0612 21:27:35.268613 73322 out.go:291] Setting OutFile to fd 1 ...
I0612 21:27:35.268726 73322 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0612 21:27:35.268737 73322 out.go:304] Setting ErrFile to fd 2...
I0612 21:27:35.268744 73322 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0612 21:27:35.268905 73322 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17779-14199/.minikube/bin
I0612 21:27:35.269480 73322 out.go:298] Setting JSON to false
I0612 21:27:35.270514 73322 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-11","uptime":7800,"bootTime":1718219855,"procs":312,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1062-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0612 21:27:35.270571 73322 start.go:139] virtualization: kvm guest
I0612 21:27:35.272916 73322 out.go:177] * [old-k8s-version-983302] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
I0612 21:27:35.274277 73322 notify.go:220] Checking for updates...
I0612 21:27:35.274305 73322 out.go:177] - MINIKUBE_LOCATION=17779
I0612 21:27:35.275719 73322 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0612 21:27:35.277608 73322 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/17779-14199/kubeconfig
I0612 21:27:35.279454 73322 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/17779-14199/.minikube
I0612 21:27:35.280920 73322 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0612 21:27:35.282232 73322 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0612 21:27:35.283937 73322 config.go:182] Loaded profile config "bridge-701638": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.1
I0612 21:27:35.284087 73322 config.go:182] Loaded profile config "enable-default-cni-701638": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.1
I0612 21:27:35.284184 73322 config.go:182] Loaded profile config "flannel-701638": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.1
I0612 21:27:35.284343 73322 driver.go:392] Setting default libvirt URI to qemu:///system
I0612 21:27:35.328073 73322 out.go:177] * Using the kvm2 driver based on user configuration
I0612 21:27:35.329488 73322 start.go:297] selected driver: kvm2
I0612 21:27:35.329513 73322 start.go:901] validating driver "kvm2" against <nil>
I0612 21:27:35.329524 73322 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0612 21:27:35.330187 73322 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0612 21:27:35.330252 73322 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/17779-14199/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0612 21:27:35.347619 73322 install.go:137] /home/jenkins/minikube-integration/17779-14199/.minikube/bin/docker-machine-driver-kvm2 version is 1.33.1
I0612 21:27:35.347661 73322 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0612 21:27:35.347845 73322 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0612 21:27:35.347903 73322 cni.go:84] Creating CNI manager for ""
I0612 21:27:35.347915 73322 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0612 21:27:35.347926 73322 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0612 21:27:35.347971 73322 start.go:340] cluster config:
{Name:old-k8s-version-983302 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1717668449-19038@sha256:30d191eb345232f513c52f7ac036e7a34a8cc441d88353f92985384bcddf00d6 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-983302 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0612 21:27:35.348070 73322 iso.go:125] acquiring lock: {Name:mka3f0e4342e40c53a8ce19d62c157a63127ccf3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0612 21:27:35.349964 73322 out.go:177] * Starting "old-k8s-version-983302" primary control-plane node in "old-k8s-version-983302" cluster
I0612 21:27:35.351164 73322 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0612 21:27:35.351233 73322 preload.go:147] Found local preload: /home/jenkins/minikube-integration/17779-14199/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0612 21:27:35.351241 73322 cache.go:56] Caching tarball of preloaded images
I0612 21:27:35.351355 73322 preload.go:173] Found /home/jenkins/minikube-integration/17779-14199/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0612 21:27:35.351369 73322 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0612 21:27:35.351477 73322 profile.go:143] Saving config to /home/jenkins/minikube-integration/17779-14199/.minikube/profiles/old-k8s-version-983302/config.json ...
I0612 21:27:35.351500 73322 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17779-14199/.minikube/profiles/old-k8s-version-983302/config.json: {Name:mkdbdeb1ed13f3820805aab6f58d17a7b4e16dc4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0612 21:27:35.351664 73322 start.go:360] acquireMachinesLock for old-k8s-version-983302: {Name:mk2e80cace89023dedef428df19ba26686582917 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0612 21:27:35.351709 73322 start.go:364] duration metric: took 25.623µs to acquireMachinesLock for "old-k8s-version-983302"
I0612 21:27:35.351731 73322 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-983302 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19038/minikube-v1.33.1-1717668912-19038-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1717668449-19038@sha256:30d191eb345232f513c52f7ac036e7a34a8cc441d88353f92985384bcddf00d6 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-983302 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0612 21:27:35.351823 73322 start.go:125] createHost starting for "" (driver="kvm2")
I0612 21:27:35.353478 73322 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0612 21:27:35.353600 73322 main.go:141] libmachine: Found binary path at /home/jenkins/minikube-integration/17779-14199/.minikube/bin/docker-machine-driver-kvm2
I0612 21:27:35.353642 73322 main.go:141] libmachine: Launching plugin server for driver kvm2
I0612 21:27:35.368318 73322 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40025
I0612 21:27:35.368786 73322 main.go:141] libmachine: () Calling .GetVersion
I0612 21:27:35.369374 73322 main.go:141] libmachine: Using API Version 1
I0612 21:27:35.369404 73322 main.go:141] libmachine: () Calling .SetConfigRaw
I0612 21:27:35.369703 73322 main.go:141] libmachine: () Calling .GetMachineName
I0612 21:27:35.369919 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetMachineName
I0612 21:27:35.370081 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .DriverName
I0612 21:27:35.370231 73322 start.go:159] libmachine.API.Create for "old-k8s-version-983302" (driver="kvm2")
I0612 21:27:35.370267 73322 client.go:168] LocalClient.Create starting
I0612 21:27:35.370302 73322 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/17779-14199/.minikube/certs/ca.pem
I0612 21:27:35.370335 73322 main.go:141] libmachine: Decoding PEM data...
I0612 21:27:35.370351 73322 main.go:141] libmachine: Parsing certificate...
I0612 21:27:35.370404 73322 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/17779-14199/.minikube/certs/cert.pem
I0612 21:27:35.370421 73322 main.go:141] libmachine: Decoding PEM data...
I0612 21:27:35.370434 73322 main.go:141] libmachine: Parsing certificate...
I0612 21:27:35.370447 73322 main.go:141] libmachine: Running pre-create checks...
I0612 21:27:35.370461 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .PreCreateCheck
I0612 21:27:35.370768 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetConfigRaw
I0612 21:27:35.371143 73322 main.go:141] libmachine: Creating machine...
I0612 21:27:35.371158 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .Create
I0612 21:27:35.371332 73322 main.go:141] libmachine: (old-k8s-version-983302) Creating KVM machine...
I0612 21:27:35.372571 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | found existing default KVM network
I0612 21:27:35.373811 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | I0612 21:27:35.373641 73345 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:12:4d:86} reservation:<nil>}
I0612 21:27:35.374835 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | I0612 21:27:35.374769 73345 network.go:206] using free private subnet 192.168.50.0/24: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000288990}
I0612 21:27:35.374873 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | created network xml:
I0612 21:27:35.374891 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | <network>
I0612 21:27:35.374905 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | <name>mk-old-k8s-version-983302</name>
I0612 21:27:35.374913 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | <dns enable='no'/>
I0612 21:27:35.374923 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG |
I0612 21:27:35.374936 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | <ip address='192.168.50.1' netmask='255.255.255.0'>
I0612 21:27:35.374955 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | <dhcp>
I0612 21:27:35.374963 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | <range start='192.168.50.2' end='192.168.50.253'/>
I0612 21:27:35.374971 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | </dhcp>
I0612 21:27:35.374980 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | </ip>
I0612 21:27:35.375008 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG |
I0612 21:27:35.375028 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | </network>
I0612 21:27:35.375040 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG |
I0612 21:27:35.380104 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | trying to create private KVM network mk-old-k8s-version-983302 192.168.50.0/24...
I0612 21:27:35.461598 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | private KVM network mk-old-k8s-version-983302 192.168.50.0/24 created
I0612 21:27:35.461629 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | I0612 21:27:35.461573 73345 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/17779-14199/.minikube
I0612 21:27:35.461643 73322 main.go:141] libmachine: (old-k8s-version-983302) Setting up store path in /home/jenkins/minikube-integration/17779-14199/.minikube/machines/old-k8s-version-983302 ...
I0612 21:27:35.461674 73322 main.go:141] libmachine: (old-k8s-version-983302) Building disk image from file:///home/jenkins/minikube-integration/17779-14199/.minikube/cache/iso/amd64/minikube-v1.33.1-1717668912-19038-amd64.iso
I0612 21:27:35.461726 73322 main.go:141] libmachine: (old-k8s-version-983302) Downloading /home/jenkins/minikube-integration/17779-14199/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/17779-14199/.minikube/cache/iso/amd64/minikube-v1.33.1-1717668912-19038-amd64.iso...
I0612 21:27:35.723925 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | I0612 21:27:35.723825 73345 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/17779-14199/.minikube/machines/old-k8s-version-983302/id_rsa...
I0612 21:27:35.807196 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | I0612 21:27:35.807013 73345 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/17779-14199/.minikube/machines/old-k8s-version-983302/old-k8s-version-983302.rawdisk...
I0612 21:27:35.807243 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | Writing magic tar header
I0612 21:27:35.807263 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | Writing SSH key tar header
I0612 21:27:35.807276 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | I0612 21:27:35.807223 73345 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/17779-14199/.minikube/machines/old-k8s-version-983302 ...
I0612 21:27:35.807478 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17779-14199/.minikube/machines/old-k8s-version-983302
I0612 21:27:35.807512 73322 main.go:141] libmachine: (old-k8s-version-983302) Setting executable bit set on /home/jenkins/minikube-integration/17779-14199/.minikube/machines/old-k8s-version-983302 (perms=drwx------)
I0612 21:27:35.807530 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17779-14199/.minikube/machines
I0612 21:27:35.807545 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17779-14199/.minikube
I0612 21:27:35.807565 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17779-14199
I0612 21:27:35.807580 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0612 21:27:35.807592 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | Checking permissions on dir: /home/jenkins
I0612 21:27:35.807610 73322 main.go:141] libmachine: (old-k8s-version-983302) Setting executable bit set on /home/jenkins/minikube-integration/17779-14199/.minikube/machines (perms=drwxr-xr-x)
I0612 21:27:35.807626 73322 main.go:141] libmachine: (old-k8s-version-983302) Setting executable bit set on /home/jenkins/minikube-integration/17779-14199/.minikube (perms=drwxr-xr-x)
I0612 21:27:35.807638 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | Checking permissions on dir: /home
I0612 21:27:35.807652 73322 main.go:141] libmachine: (old-k8s-version-983302) Setting executable bit set on /home/jenkins/minikube-integration/17779-14199 (perms=drwxrwxr-x)
I0612 21:27:35.807666 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | Skipping /home - not owner
I0612 21:27:35.807686 73322 main.go:141] libmachine: (old-k8s-version-983302) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0612 21:27:35.807702 73322 main.go:141] libmachine: (old-k8s-version-983302) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0612 21:27:35.807710 73322 main.go:141] libmachine: (old-k8s-version-983302) Creating domain...
I0612 21:27:35.808822 73322 main.go:141] libmachine: (old-k8s-version-983302) define libvirt domain using xml:
I0612 21:27:35.808844 73322 main.go:141] libmachine: (old-k8s-version-983302) <domain type='kvm'>
I0612 21:27:35.808871 73322 main.go:141] libmachine: (old-k8s-version-983302) <name>old-k8s-version-983302</name>
I0612 21:27:35.808887 73322 main.go:141] libmachine: (old-k8s-version-983302) <memory unit='MiB'>2200</memory>
I0612 21:27:35.808898 73322 main.go:141] libmachine: (old-k8s-version-983302) <vcpu>2</vcpu>
I0612 21:27:35.808906 73322 main.go:141] libmachine: (old-k8s-version-983302) <features>
I0612 21:27:35.808927 73322 main.go:141] libmachine: (old-k8s-version-983302) <acpi/>
I0612 21:27:35.808942 73322 main.go:141] libmachine: (old-k8s-version-983302) <apic/>
I0612 21:27:35.808964 73322 main.go:141] libmachine: (old-k8s-version-983302) <pae/>
I0612 21:27:35.808978 73322 main.go:141] libmachine: (old-k8s-version-983302)
I0612 21:27:35.808996 73322 main.go:141] libmachine: (old-k8s-version-983302) </features>
I0612 21:27:35.809012 73322 main.go:141] libmachine: (old-k8s-version-983302) <cpu mode='host-passthrough'>
I0612 21:27:35.809029 73322 main.go:141] libmachine: (old-k8s-version-983302)
I0612 21:27:35.809037 73322 main.go:141] libmachine: (old-k8s-version-983302) </cpu>
I0612 21:27:35.809053 73322 main.go:141] libmachine: (old-k8s-version-983302) <os>
I0612 21:27:35.809061 73322 main.go:141] libmachine: (old-k8s-version-983302) <type>hvm</type>
I0612 21:27:35.809080 73322 main.go:141] libmachine: (old-k8s-version-983302) <boot dev='cdrom'/>
I0612 21:27:35.809089 73322 main.go:141] libmachine: (old-k8s-version-983302) <boot dev='hd'/>
I0612 21:27:35.809104 73322 main.go:141] libmachine: (old-k8s-version-983302) <bootmenu enable='no'/>
I0612 21:27:35.809118 73322 main.go:141] libmachine: (old-k8s-version-983302) </os>
I0612 21:27:35.809134 73322 main.go:141] libmachine: (old-k8s-version-983302) <devices>
I0612 21:27:35.809148 73322 main.go:141] libmachine: (old-k8s-version-983302) <disk type='file' device='cdrom'>
I0612 21:27:35.809172 73322 main.go:141] libmachine: (old-k8s-version-983302) <source file='/home/jenkins/minikube-integration/17779-14199/.minikube/machines/old-k8s-version-983302/boot2docker.iso'/>
I0612 21:27:35.809188 73322 main.go:141] libmachine: (old-k8s-version-983302) <target dev='hdc' bus='scsi'/>
I0612 21:27:35.809201 73322 main.go:141] libmachine: (old-k8s-version-983302) <readonly/>
I0612 21:27:35.809211 73322 main.go:141] libmachine: (old-k8s-version-983302) </disk>
I0612 21:27:35.809218 73322 main.go:141] libmachine: (old-k8s-version-983302) <disk type='file' device='disk'>
I0612 21:27:35.809237 73322 main.go:141] libmachine: (old-k8s-version-983302) <driver name='qemu' type='raw' cache='default' io='threads' />
I0612 21:27:35.809254 73322 main.go:141] libmachine: (old-k8s-version-983302) <source file='/home/jenkins/minikube-integration/17779-14199/.minikube/machines/old-k8s-version-983302/old-k8s-version-983302.rawdisk'/>
I0612 21:27:35.809260 73322 main.go:141] libmachine: (old-k8s-version-983302) <target dev='hda' bus='virtio'/>
I0612 21:27:35.809271 73322 main.go:141] libmachine: (old-k8s-version-983302) </disk>
I0612 21:27:35.809276 73322 main.go:141] libmachine: (old-k8s-version-983302) <interface type='network'>
I0612 21:27:35.809282 73322 main.go:141] libmachine: (old-k8s-version-983302) <source network='mk-old-k8s-version-983302'/>
I0612 21:27:35.809290 73322 main.go:141] libmachine: (old-k8s-version-983302) <model type='virtio'/>
I0612 21:27:35.809303 73322 main.go:141] libmachine: (old-k8s-version-983302) </interface>
I0612 21:27:35.809311 73322 main.go:141] libmachine: (old-k8s-version-983302) <interface type='network'>
I0612 21:27:35.809321 73322 main.go:141] libmachine: (old-k8s-version-983302) <source network='default'/>
I0612 21:27:35.809333 73322 main.go:141] libmachine: (old-k8s-version-983302) <model type='virtio'/>
I0612 21:27:35.809351 73322 main.go:141] libmachine: (old-k8s-version-983302) </interface>
I0612 21:27:35.809361 73322 main.go:141] libmachine: (old-k8s-version-983302) <serial type='pty'>
I0612 21:27:35.809375 73322 main.go:141] libmachine: (old-k8s-version-983302) <target port='0'/>
I0612 21:27:35.809387 73322 main.go:141] libmachine: (old-k8s-version-983302) </serial>
I0612 21:27:35.809400 73322 main.go:141] libmachine: (old-k8s-version-983302) <console type='pty'>
I0612 21:27:35.809413 73322 main.go:141] libmachine: (old-k8s-version-983302) <target type='serial' port='0'/>
I0612 21:27:35.809427 73322 main.go:141] libmachine: (old-k8s-version-983302) </console>
I0612 21:27:35.809438 73322 main.go:141] libmachine: (old-k8s-version-983302) <rng model='virtio'>
I0612 21:27:35.809459 73322 main.go:141] libmachine: (old-k8s-version-983302) <backend model='random'>/dev/random</backend>
I0612 21:27:35.809474 73322 main.go:141] libmachine: (old-k8s-version-983302) </rng>
I0612 21:27:35.809487 73322 main.go:141] libmachine: (old-k8s-version-983302)
I0612 21:27:35.809499 73322 main.go:141] libmachine: (old-k8s-version-983302)
I0612 21:27:35.809507 73322 main.go:141] libmachine: (old-k8s-version-983302) </devices>
I0612 21:27:35.809518 73322 main.go:141] libmachine: (old-k8s-version-983302) </domain>
I0612 21:27:35.809536 73322 main.go:141] libmachine: (old-k8s-version-983302)
I0612 21:27:35.814573 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | domain old-k8s-version-983302 has defined MAC address 52:54:00:de:84:26 in network default
I0612 21:27:35.815102 73322 main.go:141] libmachine: (old-k8s-version-983302) Ensuring networks are active...
I0612 21:27:35.815126 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | domain old-k8s-version-983302 has defined MAC address 52:54:00:7b:c8:d2 in network mk-old-k8s-version-983302
I0612 21:27:35.816003 73322 main.go:141] libmachine: (old-k8s-version-983302) Ensuring network default is active
I0612 21:27:35.816179 73322 main.go:141] libmachine: (old-k8s-version-983302) Ensuring network mk-old-k8s-version-983302 is active
I0612 21:27:35.816940 73322 main.go:141] libmachine: (old-k8s-version-983302) Getting domain xml...
I0612 21:27:35.819258 73322 main.go:141] libmachine: (old-k8s-version-983302) Creating domain...
I0612 21:27:37.401649 73322 main.go:141] libmachine: (old-k8s-version-983302) Waiting to get IP...
I0612 21:27:37.402873 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | domain old-k8s-version-983302 has defined MAC address 52:54:00:7b:c8:d2 in network mk-old-k8s-version-983302
I0612 21:27:37.403558 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | unable to find current IP address of domain old-k8s-version-983302 in network mk-old-k8s-version-983302
I0612 21:27:37.403590 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | I0612 21:27:37.403542 73345 retry.go:31] will retry after 259.963135ms: waiting for machine to come up
I0612 21:27:37.665268 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | domain old-k8s-version-983302 has defined MAC address 52:54:00:7b:c8:d2 in network mk-old-k8s-version-983302
I0612 21:27:37.666108 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | unable to find current IP address of domain old-k8s-version-983302 in network mk-old-k8s-version-983302
I0612 21:27:37.666136 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | I0612 21:27:37.666073 73345 retry.go:31] will retry after 251.214989ms: waiting for machine to come up
I0612 21:27:37.918621 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | domain old-k8s-version-983302 has defined MAC address 52:54:00:7b:c8:d2 in network mk-old-k8s-version-983302
I0612 21:27:37.919650 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | unable to find current IP address of domain old-k8s-version-983302 in network mk-old-k8s-version-983302
I0612 21:27:37.919681 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | I0612 21:27:37.919605 73345 retry.go:31] will retry after 343.720017ms: waiting for machine to come up
I0612 21:27:38.265394 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | domain old-k8s-version-983302 has defined MAC address 52:54:00:7b:c8:d2 in network mk-old-k8s-version-983302
I0612 21:27:38.266049 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | unable to find current IP address of domain old-k8s-version-983302 in network mk-old-k8s-version-983302
I0612 21:27:38.266084 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | I0612 21:27:38.265966 73345 retry.go:31] will retry after 577.194639ms: waiting for machine to come up
I0612 21:27:38.844458 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | domain old-k8s-version-983302 has defined MAC address 52:54:00:7b:c8:d2 in network mk-old-k8s-version-983302
I0612 21:27:38.845033 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | unable to find current IP address of domain old-k8s-version-983302 in network mk-old-k8s-version-983302
I0612 21:27:38.845066 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | I0612 21:27:38.845001 73345 retry.go:31] will retry after 612.964115ms: waiting for machine to come up
I0612 21:27:39.460053 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | domain old-k8s-version-983302 has defined MAC address 52:54:00:7b:c8:d2 in network mk-old-k8s-version-983302
I0612 21:27:39.460648 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | unable to find current IP address of domain old-k8s-version-983302 in network mk-old-k8s-version-983302
I0612 21:27:39.460680 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | I0612 21:27:39.460599 73345 retry.go:31] will retry after 638.863541ms: waiting for machine to come up
I0612 21:27:40.102977 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | domain old-k8s-version-983302 has defined MAC address 52:54:00:7b:c8:d2 in network mk-old-k8s-version-983302
I0612 21:27:40.103749 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | unable to find current IP address of domain old-k8s-version-983302 in network mk-old-k8s-version-983302
I0612 21:27:40.103774 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | I0612 21:27:40.103676 73345 retry.go:31] will retry after 1.025169961s: waiting for machine to come up
I0612 21:27:41.130668 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | domain old-k8s-version-983302 has defined MAC address 52:54:00:7b:c8:d2 in network mk-old-k8s-version-983302
I0612 21:27:41.131357 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | unable to find current IP address of domain old-k8s-version-983302 in network mk-old-k8s-version-983302
I0612 21:27:41.131387 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | I0612 21:27:41.131320 73345 retry.go:31] will retry after 1.301108705s: waiting for machine to come up
I0612 21:27:42.434829 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | domain old-k8s-version-983302 has defined MAC address 52:54:00:7b:c8:d2 in network mk-old-k8s-version-983302
I0612 21:27:42.435457 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | unable to find current IP address of domain old-k8s-version-983302 in network mk-old-k8s-version-983302
I0612 21:27:42.435482 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | I0612 21:27:42.435407 73345 retry.go:31] will retry after 1.643444564s: waiting for machine to come up
I0612 21:27:44.081027 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | domain old-k8s-version-983302 has defined MAC address 52:54:00:7b:c8:d2 in network mk-old-k8s-version-983302
I0612 21:27:44.081661 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | unable to find current IP address of domain old-k8s-version-983302 in network mk-old-k8s-version-983302
I0612 21:27:44.081682 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | I0612 21:27:44.081594 73345 retry.go:31] will retry after 1.900424919s: waiting for machine to come up
I0612 21:27:45.983580 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | domain old-k8s-version-983302 has defined MAC address 52:54:00:7b:c8:d2 in network mk-old-k8s-version-983302
I0612 21:27:45.984126 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | unable to find current IP address of domain old-k8s-version-983302 in network mk-old-k8s-version-983302
I0612 21:27:45.984155 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | I0612 21:27:45.984080 73345 retry.go:31] will retry after 2.83740215s: waiting for machine to come up
I0612 21:27:48.824333 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | domain old-k8s-version-983302 has defined MAC address 52:54:00:7b:c8:d2 in network mk-old-k8s-version-983302
I0612 21:27:48.824994 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | unable to find current IP address of domain old-k8s-version-983302 in network mk-old-k8s-version-983302
I0612 21:27:48.825017 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | I0612 21:27:48.824927 73345 retry.go:31] will retry after 2.248588361s: waiting for machine to come up
I0612 21:27:51.074715 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | domain old-k8s-version-983302 has defined MAC address 52:54:00:7b:c8:d2 in network mk-old-k8s-version-983302
I0612 21:27:51.075285 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | unable to find current IP address of domain old-k8s-version-983302 in network mk-old-k8s-version-983302
I0612 21:27:51.075323 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | I0612 21:27:51.075246 73345 retry.go:31] will retry after 3.265949842s: waiting for machine to come up
I0612 21:27:54.344429 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | domain old-k8s-version-983302 has defined MAC address 52:54:00:7b:c8:d2 in network mk-old-k8s-version-983302
I0612 21:27:54.344935 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | unable to find current IP address of domain old-k8s-version-983302 in network mk-old-k8s-version-983302
I0612 21:27:54.344965 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | I0612 21:27:54.344869 73345 retry.go:31] will retry after 4.892162732s: waiting for machine to come up
I0612 21:27:59.240028 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | domain old-k8s-version-983302 has defined MAC address 52:54:00:7b:c8:d2 in network mk-old-k8s-version-983302
I0612 21:27:59.240549 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | domain old-k8s-version-983302 has current primary IP address 192.168.50.81 and MAC address 52:54:00:7b:c8:d2 in network mk-old-k8s-version-983302
I0612 21:27:59.240591 73322 main.go:141] libmachine: (old-k8s-version-983302) Found IP for machine: 192.168.50.81
I0612 21:27:59.240618 73322 main.go:141] libmachine: (old-k8s-version-983302) Reserving static IP address...
I0612 21:27:59.240994 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-983302", mac: "52:54:00:7b:c8:d2", ip: "192.168.50.81"} in network mk-old-k8s-version-983302
I0612 21:27:59.318688 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | Getting to WaitForSSH function...
I0612 21:27:59.318714 73322 main.go:141] libmachine: (old-k8s-version-983302) Reserved static IP address: 192.168.50.81
I0612 21:27:59.318724 73322 main.go:141] libmachine: (old-k8s-version-983302) Waiting for SSH to be available...
I0612 21:27:59.322277 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | domain old-k8s-version-983302 has defined MAC address 52:54:00:7b:c8:d2 in network mk-old-k8s-version-983302
I0612 21:27:59.322703 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | unable to find host DHCP lease matching {name: "", mac: "52:54:00:7b:c8:d2", ip: ""} in network mk-old-k8s-version-983302
I0612 21:27:59.322731 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | unable to find defined IP address of network mk-old-k8s-version-983302 interface with MAC address 52:54:00:7b:c8:d2
I0612 21:27:59.322880 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | Using SSH client type: external
I0612 21:27:59.322909 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | Using SSH private key: /home/jenkins/minikube-integration/17779-14199/.minikube/machines/old-k8s-version-983302/id_rsa (-rw-------)
I0612 21:27:59.322953 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@ -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/17779-14199/.minikube/machines/old-k8s-version-983302/id_rsa -p 22] /usr/bin/ssh <nil>}
I0612 21:27:59.322969 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | About to run SSH command:
I0612 21:27:59.323007 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | exit 0
I0612 21:27:59.327139 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | SSH cmd err, output: exit status 255:
I0612 21:27:59.327164 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | Error getting ssh command 'exit 0' : ssh command error:
I0612 21:27:59.327192 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | command : exit 0
I0612 21:27:59.327205 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | err : exit status 255
I0612 21:27:59.327220 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | output :
I0612 21:28:02.327463 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | Getting to WaitForSSH function...
I0612 21:28:02.330187 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | domain old-k8s-version-983302 has defined MAC address 52:54:00:7b:c8:d2 in network mk-old-k8s-version-983302
I0612 21:28:02.330622 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7b:c8:d2", ip: ""} in network mk-old-k8s-version-983302: {Iface:virbr2 ExpiryTime:2024-06-12 22:27:51 +0000 UTC Type:0 Mac:52:54:00:7b:c8:d2 Iaid: IPaddr:192.168.50.81 Prefix:24 Hostname:old-k8s-version-983302 Clientid:01:52:54:00:7b:c8:d2}
I0612 21:28:02.330650 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | domain old-k8s-version-983302 has defined IP address 192.168.50.81 and MAC address 52:54:00:7b:c8:d2 in network mk-old-k8s-version-983302
I0612 21:28:02.330780 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | Using SSH client type: external
I0612 21:28:02.330807 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | Using SSH private key: /home/jenkins/minikube-integration/17779-14199/.minikube/machines/old-k8s-version-983302/id_rsa (-rw-------)
I0612 21:28:02.330839 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.50.81 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/17779-14199/.minikube/machines/old-k8s-version-983302/id_rsa -p 22] /usr/bin/ssh <nil>}
I0612 21:28:02.330862 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | About to run SSH command:
I0612 21:28:02.330874 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | exit 0
I0612 21:28:02.455940 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | SSH cmd err, output: <nil>:
I0612 21:28:02.456263 73322 main.go:141] libmachine: (old-k8s-version-983302) KVM machine creation complete!
I0612 21:28:02.456672 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetConfigRaw
I0612 21:28:02.457393 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .DriverName
I0612 21:28:02.457622 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .DriverName
I0612 21:28:02.457793 73322 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0612 21:28:02.457812 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetState
I0612 21:28:02.459258 73322 main.go:141] libmachine: Detecting operating system of created instance...
I0612 21:28:02.459280 73322 main.go:141] libmachine: Waiting for SSH to be available...
I0612 21:28:02.459288 73322 main.go:141] libmachine: Getting to WaitForSSH function...
I0612 21:28:02.459297 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetSSHHostname
I0612 21:28:02.462239 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | domain old-k8s-version-983302 has defined MAC address 52:54:00:7b:c8:d2 in network mk-old-k8s-version-983302
I0612 21:28:02.462687 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7b:c8:d2", ip: ""} in network mk-old-k8s-version-983302: {Iface:virbr2 ExpiryTime:2024-06-12 22:27:51 +0000 UTC Type:0 Mac:52:54:00:7b:c8:d2 Iaid: IPaddr:192.168.50.81 Prefix:24 Hostname:old-k8s-version-983302 Clientid:01:52:54:00:7b:c8:d2}
I0612 21:28:02.462728 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | domain old-k8s-version-983302 has defined IP address 192.168.50.81 and MAC address 52:54:00:7b:c8:d2 in network mk-old-k8s-version-983302
I0612 21:28:02.462850 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetSSHPort
I0612 21:28:02.463021 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetSSHKeyPath
I0612 21:28:02.463232 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetSSHKeyPath
I0612 21:28:02.463399 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetSSHUsername
I0612 21:28:02.463590 73322 main.go:141] libmachine: Using SSH client type: native
I0612 21:28:02.463852 73322 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d880] 0x8305e0 <nil> [] 0s} 192.168.50.81 22 <nil> <nil>}
I0612 21:28:02.463871 73322 main.go:141] libmachine: About to run SSH command:
exit 0
I0612 21:28:02.578969 73322 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0612 21:28:02.578997 73322 main.go:141] libmachine: Detecting the provisioner...
I0612 21:28:02.579009 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetSSHHostname
I0612 21:28:02.582180 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | domain old-k8s-version-983302 has defined MAC address 52:54:00:7b:c8:d2 in network mk-old-k8s-version-983302
I0612 21:28:02.582569 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7b:c8:d2", ip: ""} in network mk-old-k8s-version-983302: {Iface:virbr2 ExpiryTime:2024-06-12 22:27:51 +0000 UTC Type:0 Mac:52:54:00:7b:c8:d2 Iaid: IPaddr:192.168.50.81 Prefix:24 Hostname:old-k8s-version-983302 Clientid:01:52:54:00:7b:c8:d2}
I0612 21:28:02.582601 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | domain old-k8s-version-983302 has defined IP address 192.168.50.81 and MAC address 52:54:00:7b:c8:d2 in network mk-old-k8s-version-983302
I0612 21:28:02.582785 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetSSHPort
I0612 21:28:02.582954 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetSSHKeyPath
I0612 21:28:02.583119 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetSSHKeyPath
I0612 21:28:02.583323 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetSSHUsername
I0612 21:28:02.583523 73322 main.go:141] libmachine: Using SSH client type: native
I0612 21:28:02.583699 73322 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d880] 0x8305e0 <nil> [] 0s} 192.168.50.81 22 <nil> <nil>}
I0612 21:28:02.583711 73322 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0612 21:28:02.701722 73322 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0612 21:28:02.701801 73322 main.go:141] libmachine: found compatible host: buildroot
I0612 21:28:02.701811 73322 main.go:141] libmachine: Provisioning with buildroot...
I0612 21:28:02.701822 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetMachineName
I0612 21:28:02.702066 73322 buildroot.go:166] provisioning hostname "old-k8s-version-983302"
I0612 21:28:02.702098 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetMachineName
I0612 21:28:02.702308 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetSSHHostname
I0612 21:28:02.705380 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | domain old-k8s-version-983302 has defined MAC address 52:54:00:7b:c8:d2 in network mk-old-k8s-version-983302
I0612 21:28:02.705781 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7b:c8:d2", ip: ""} in network mk-old-k8s-version-983302: {Iface:virbr2 ExpiryTime:2024-06-12 22:27:51 +0000 UTC Type:0 Mac:52:54:00:7b:c8:d2 Iaid: IPaddr:192.168.50.81 Prefix:24 Hostname:old-k8s-version-983302 Clientid:01:52:54:00:7b:c8:d2}
I0612 21:28:02.705831 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | domain old-k8s-version-983302 has defined IP address 192.168.50.81 and MAC address 52:54:00:7b:c8:d2 in network mk-old-k8s-version-983302
I0612 21:28:02.706025 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetSSHPort
I0612 21:28:02.706215 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetSSHKeyPath
I0612 21:28:02.706417 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetSSHKeyPath
I0612 21:28:02.706556 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetSSHUsername
I0612 21:28:02.706730 73322 main.go:141] libmachine: Using SSH client type: native
I0612 21:28:02.706950 73322 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d880] 0x8305e0 <nil> [] 0s} 192.168.50.81 22 <nil> <nil>}
I0612 21:28:02.706968 73322 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-983302 && echo "old-k8s-version-983302" | sudo tee /etc/hostname
I0612 21:28:02.837530 73322 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-983302
I0612 21:28:02.837562 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetSSHHostname
I0612 21:28:02.840762 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | domain old-k8s-version-983302 has defined MAC address 52:54:00:7b:c8:d2 in network mk-old-k8s-version-983302
I0612 21:28:02.841117 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7b:c8:d2", ip: ""} in network mk-old-k8s-version-983302: {Iface:virbr2 ExpiryTime:2024-06-12 22:27:51 +0000 UTC Type:0 Mac:52:54:00:7b:c8:d2 Iaid: IPaddr:192.168.50.81 Prefix:24 Hostname:old-k8s-version-983302 Clientid:01:52:54:00:7b:c8:d2}
I0612 21:28:02.841147 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | domain old-k8s-version-983302 has defined IP address 192.168.50.81 and MAC address 52:54:00:7b:c8:d2 in network mk-old-k8s-version-983302
I0612 21:28:02.841340 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetSSHPort
I0612 21:28:02.841526 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetSSHKeyPath
I0612 21:28:02.841700 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetSSHKeyPath
I0612 21:28:02.841900 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetSSHUsername
I0612 21:28:02.842142 73322 main.go:141] libmachine: Using SSH client type: native
I0612 21:28:02.842388 73322 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d880] 0x8305e0 <nil> [] 0s} 192.168.50.81 22 <nil> <nil>}
I0612 21:28:02.842415 73322 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-983302' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-983302/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-983302' | sudo tee -a /etc/hosts;
fi
fi
I0612 21:28:02.965894 73322 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0612 21:28:02.965937 73322 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17779-14199/.minikube CaCertPath:/home/jenkins/minikube-integration/17779-14199/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17779-14199/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17779-14199/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17779-14199/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17779-14199/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17779-14199/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17779-14199/.minikube}
I0612 21:28:02.965988 73322 buildroot.go:174] setting up certificates
I0612 21:28:02.966006 73322 provision.go:84] configureAuth start
I0612 21:28:02.966024 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetMachineName
I0612 21:28:02.966334 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetIP
I0612 21:28:02.969682 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | domain old-k8s-version-983302 has defined MAC address 52:54:00:7b:c8:d2 in network mk-old-k8s-version-983302
I0612 21:28:02.970063 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7b:c8:d2", ip: ""} in network mk-old-k8s-version-983302: {Iface:virbr2 ExpiryTime:2024-06-12 22:27:51 +0000 UTC Type:0 Mac:52:54:00:7b:c8:d2 Iaid: IPaddr:192.168.50.81 Prefix:24 Hostname:old-k8s-version-983302 Clientid:01:52:54:00:7b:c8:d2}
I0612 21:28:02.970097 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | domain old-k8s-version-983302 has defined IP address 192.168.50.81 and MAC address 52:54:00:7b:c8:d2 in network mk-old-k8s-version-983302
I0612 21:28:02.970250 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetSSHHostname
I0612 21:28:02.972905 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | domain old-k8s-version-983302 has defined MAC address 52:54:00:7b:c8:d2 in network mk-old-k8s-version-983302
I0612 21:28:02.973333 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7b:c8:d2", ip: ""} in network mk-old-k8s-version-983302: {Iface:virbr2 ExpiryTime:2024-06-12 22:27:51 +0000 UTC Type:0 Mac:52:54:00:7b:c8:d2 Iaid: IPaddr:192.168.50.81 Prefix:24 Hostname:old-k8s-version-983302 Clientid:01:52:54:00:7b:c8:d2}
I0612 21:28:02.973381 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | domain old-k8s-version-983302 has defined IP address 192.168.50.81 and MAC address 52:54:00:7b:c8:d2 in network mk-old-k8s-version-983302
I0612 21:28:02.973561 73322 provision.go:143] copyHostCerts
I0612 21:28:02.973647 73322 exec_runner.go:144] found /home/jenkins/minikube-integration/17779-14199/.minikube/ca.pem, removing ...
I0612 21:28:02.973671 73322 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17779-14199/.minikube/ca.pem
I0612 21:28:02.973745 73322 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17779-14199/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17779-14199/.minikube/ca.pem (1078 bytes)
I0612 21:28:02.973884 73322 exec_runner.go:144] found /home/jenkins/minikube-integration/17779-14199/.minikube/cert.pem, removing ...
I0612 21:28:02.973902 73322 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17779-14199/.minikube/cert.pem
I0612 21:28:02.973942 73322 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17779-14199/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17779-14199/.minikube/cert.pem (1123 bytes)
I0612 21:28:02.974099 73322 exec_runner.go:144] found /home/jenkins/minikube-integration/17779-14199/.minikube/key.pem, removing ...
I0612 21:28:02.974115 73322 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17779-14199/.minikube/key.pem
I0612 21:28:02.974152 73322 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17779-14199/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17779-14199/.minikube/key.pem (1679 bytes)
I0612 21:28:02.974253 73322 provision.go:117] generating server cert: /home/jenkins/minikube-integration/17779-14199/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17779-14199/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17779-14199/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-983302 san=[127.0.0.1 192.168.50.81 localhost minikube old-k8s-version-983302]
I0612 21:28:03.060990 73322 provision.go:177] copyRemoteCerts
I0612 21:28:03.061051 73322 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0612 21:28:03.061078 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetSSHHostname
I0612 21:28:03.064109 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | domain old-k8s-version-983302 has defined MAC address 52:54:00:7b:c8:d2 in network mk-old-k8s-version-983302
I0612 21:28:03.064513 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7b:c8:d2", ip: ""} in network mk-old-k8s-version-983302: {Iface:virbr2 ExpiryTime:2024-06-12 22:27:51 +0000 UTC Type:0 Mac:52:54:00:7b:c8:d2 Iaid: IPaddr:192.168.50.81 Prefix:24 Hostname:old-k8s-version-983302 Clientid:01:52:54:00:7b:c8:d2}
I0612 21:28:03.064540 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | domain old-k8s-version-983302 has defined IP address 192.168.50.81 and MAC address 52:54:00:7b:c8:d2 in network mk-old-k8s-version-983302
I0612 21:28:03.064695 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetSSHPort
I0612 21:28:03.064896 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetSSHKeyPath
I0612 21:28:03.065065 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetSSHUsername
I0612 21:28:03.065213 73322 sshutil.go:53] new ssh client: &{IP:192.168.50.81 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17779-14199/.minikube/machines/old-k8s-version-983302/id_rsa Username:docker}
I0612 21:28:03.154236 73322 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17779-14199/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0612 21:28:03.183111 73322 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17779-14199/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0612 21:28:03.215066 73322 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17779-14199/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0612 21:28:03.245380 73322 provision.go:87] duration metric: took 279.360397ms to configureAuth
I0612 21:28:03.245410 73322 buildroot.go:189] setting minikube options for container-runtime
I0612 21:28:03.245605 73322 config.go:182] Loaded profile config "old-k8s-version-983302": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0612 21:28:03.245696 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetSSHHostname
I0612 21:28:03.249300 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | domain old-k8s-version-983302 has defined MAC address 52:54:00:7b:c8:d2 in network mk-old-k8s-version-983302
I0612 21:28:03.249808 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7b:c8:d2", ip: ""} in network mk-old-k8s-version-983302: {Iface:virbr2 ExpiryTime:2024-06-12 22:27:51 +0000 UTC Type:0 Mac:52:54:00:7b:c8:d2 Iaid: IPaddr:192.168.50.81 Prefix:24 Hostname:old-k8s-version-983302 Clientid:01:52:54:00:7b:c8:d2}
I0612 21:28:03.249843 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | domain old-k8s-version-983302 has defined IP address 192.168.50.81 and MAC address 52:54:00:7b:c8:d2 in network mk-old-k8s-version-983302
I0612 21:28:03.250179 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetSSHPort
I0612 21:28:03.250388 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetSSHKeyPath
I0612 21:28:03.250613 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetSSHKeyPath
I0612 21:28:03.250809 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetSSHUsername
I0612 21:28:03.250982 73322 main.go:141] libmachine: Using SSH client type: native
I0612 21:28:03.251232 73322 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d880] 0x8305e0 <nil> [] 0s} 192.168.50.81 22 <nil> <nil>}
I0612 21:28:03.251254 73322 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0612 21:28:03.584773 73322 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0612 21:28:03.584803 73322 main.go:141] libmachine: Checking connection to Docker...
I0612 21:28:03.584814 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetURL
I0612 21:28:03.586219 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | Using libvirt version 6000000
I0612 21:28:03.588972 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | domain old-k8s-version-983302 has defined MAC address 52:54:00:7b:c8:d2 in network mk-old-k8s-version-983302
I0612 21:28:03.589285 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7b:c8:d2", ip: ""} in network mk-old-k8s-version-983302: {Iface:virbr2 ExpiryTime:2024-06-12 22:27:51 +0000 UTC Type:0 Mac:52:54:00:7b:c8:d2 Iaid: IPaddr:192.168.50.81 Prefix:24 Hostname:old-k8s-version-983302 Clientid:01:52:54:00:7b:c8:d2}
I0612 21:28:03.589316 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | domain old-k8s-version-983302 has defined IP address 192.168.50.81 and MAC address 52:54:00:7b:c8:d2 in network mk-old-k8s-version-983302
I0612 21:28:03.589498 73322 main.go:141] libmachine: Docker is up and running!
I0612 21:28:03.589512 73322 main.go:141] libmachine: Reticulating splines...
I0612 21:28:03.589518 73322 client.go:171] duration metric: took 28.219241444s to LocalClient.Create
I0612 21:28:03.589540 73322 start.go:167] duration metric: took 28.219312088s to libmachine.API.Create "old-k8s-version-983302"
I0612 21:28:03.589552 73322 start.go:293] postStartSetup for "old-k8s-version-983302" (driver="kvm2")
I0612 21:28:03.589564 73322 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0612 21:28:03.589579 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .DriverName
I0612 21:28:03.589840 73322 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0612 21:28:03.589878 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetSSHHostname
I0612 21:28:03.592471 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | domain old-k8s-version-983302 has defined MAC address 52:54:00:7b:c8:d2 in network mk-old-k8s-version-983302
I0612 21:28:03.592882 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7b:c8:d2", ip: ""} in network mk-old-k8s-version-983302: {Iface:virbr2 ExpiryTime:2024-06-12 22:27:51 +0000 UTC Type:0 Mac:52:54:00:7b:c8:d2 Iaid: IPaddr:192.168.50.81 Prefix:24 Hostname:old-k8s-version-983302 Clientid:01:52:54:00:7b:c8:d2}
I0612 21:28:03.592918 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | domain old-k8s-version-983302 has defined IP address 192.168.50.81 and MAC address 52:54:00:7b:c8:d2 in network mk-old-k8s-version-983302
I0612 21:28:03.593106 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetSSHPort
I0612 21:28:03.593285 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetSSHKeyPath
I0612 21:28:03.593536 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetSSHUsername
I0612 21:28:03.593700 73322 sshutil.go:53] new ssh client: &{IP:192.168.50.81 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17779-14199/.minikube/machines/old-k8s-version-983302/id_rsa Username:docker}
I0612 21:28:03.681725 73322 ssh_runner.go:195] Run: cat /etc/os-release
I0612 21:28:03.686730 73322 info.go:137] Remote host: Buildroot 2023.02.9
I0612 21:28:03.686766 73322 filesync.go:126] Scanning /home/jenkins/minikube-integration/17779-14199/.minikube/addons for local assets ...
I0612 21:28:03.686830 73322 filesync.go:126] Scanning /home/jenkins/minikube-integration/17779-14199/.minikube/files for local assets ...
I0612 21:28:03.686920 73322 filesync.go:149] local asset: /home/jenkins/minikube-integration/17779-14199/.minikube/files/etc/ssl/certs/214442.pem -> 214442.pem in /etc/ssl/certs
I0612 21:28:03.687053 73322 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0612 21:28:03.697740 73322 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17779-14199/.minikube/files/etc/ssl/certs/214442.pem --> /etc/ssl/certs/214442.pem (1708 bytes)
I0612 21:28:03.726770 73322 start.go:296] duration metric: took 137.200315ms for postStartSetup
I0612 21:28:03.726860 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetConfigRaw
I0612 21:28:03.727538 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetIP
I0612 21:28:03.732252 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | domain old-k8s-version-983302 has defined MAC address 52:54:00:7b:c8:d2 in network mk-old-k8s-version-983302
I0612 21:28:03.733589 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7b:c8:d2", ip: ""} in network mk-old-k8s-version-983302: {Iface:virbr2 ExpiryTime:2024-06-12 22:27:51 +0000 UTC Type:0 Mac:52:54:00:7b:c8:d2 Iaid: IPaddr:192.168.50.81 Prefix:24 Hostname:old-k8s-version-983302 Clientid:01:52:54:00:7b:c8:d2}
I0612 21:28:03.733621 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | domain old-k8s-version-983302 has defined IP address 192.168.50.81 and MAC address 52:54:00:7b:c8:d2 in network mk-old-k8s-version-983302
I0612 21:28:03.734039 73322 profile.go:143] Saving config to /home/jenkins/minikube-integration/17779-14199/.minikube/profiles/old-k8s-version-983302/config.json ...
I0612 21:28:03.734267 73322 start.go:128] duration metric: took 28.382432665s to createHost
I0612 21:28:03.734306 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetSSHHostname
I0612 21:28:03.738962 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | domain old-k8s-version-983302 has defined MAC address 52:54:00:7b:c8:d2 in network mk-old-k8s-version-983302
I0612 21:28:03.740798 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7b:c8:d2", ip: ""} in network mk-old-k8s-version-983302: {Iface:virbr2 ExpiryTime:2024-06-12 22:27:51 +0000 UTC Type:0 Mac:52:54:00:7b:c8:d2 Iaid: IPaddr:192.168.50.81 Prefix:24 Hostname:old-k8s-version-983302 Clientid:01:52:54:00:7b:c8:d2}
I0612 21:28:03.740832 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | domain old-k8s-version-983302 has defined IP address 192.168.50.81 and MAC address 52:54:00:7b:c8:d2 in network mk-old-k8s-version-983302
I0612 21:28:03.741053 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetSSHPort
I0612 21:28:03.741291 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetSSHKeyPath
I0612 21:28:03.741462 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetSSHKeyPath
I0612 21:28:03.741627 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetSSHUsername
I0612 21:28:03.741816 73322 main.go:141] libmachine: Using SSH client type: native
I0612 21:28:03.742025 73322 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d880] 0x8305e0 <nil> [] 0s} 192.168.50.81 22 <nil> <nil>}
I0612 21:28:03.742040 73322 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0612 21:28:03.856385 73322 main.go:141] libmachine: SSH cmd err, output: <nil>: 1718227683.834007750
I0612 21:28:03.856408 73322 fix.go:216] guest clock: 1718227683.834007750
I0612 21:28:03.856416 73322 fix.go:229] Guest: 2024-06-12 21:28:03.83400775 +0000 UTC Remote: 2024-06-12 21:28:03.734289661 +0000 UTC m=+28.501097449 (delta=99.718089ms)
I0612 21:28:03.856450 73322 fix.go:200] guest clock delta is within tolerance: 99.718089ms
I0612 21:28:03.856459 73322 start.go:83] releasing machines lock for "old-k8s-version-983302", held for 28.50473744s
I0612 21:28:03.856489 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .DriverName
I0612 21:28:03.856784 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetIP
I0612 21:28:03.860160 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | domain old-k8s-version-983302 has defined MAC address 52:54:00:7b:c8:d2 in network mk-old-k8s-version-983302
I0612 21:28:03.860638 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7b:c8:d2", ip: ""} in network mk-old-k8s-version-983302: {Iface:virbr2 ExpiryTime:2024-06-12 22:27:51 +0000 UTC Type:0 Mac:52:54:00:7b:c8:d2 Iaid: IPaddr:192.168.50.81 Prefix:24 Hostname:old-k8s-version-983302 Clientid:01:52:54:00:7b:c8:d2}
I0612 21:28:03.860668 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | domain old-k8s-version-983302 has defined IP address 192.168.50.81 and MAC address 52:54:00:7b:c8:d2 in network mk-old-k8s-version-983302
I0612 21:28:03.860903 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .DriverName
I0612 21:28:03.861500 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .DriverName
I0612 21:28:03.861695 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .DriverName
I0612 21:28:03.861814 73322 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0612 21:28:03.861859 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetSSHHostname
I0612 21:28:03.861870 73322 ssh_runner.go:195] Run: cat /version.json
I0612 21:28:03.861884 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetSSHHostname
I0612 21:28:03.864741 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | domain old-k8s-version-983302 has defined MAC address 52:54:00:7b:c8:d2 in network mk-old-k8s-version-983302
I0612 21:28:03.864987 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | domain old-k8s-version-983302 has defined MAC address 52:54:00:7b:c8:d2 in network mk-old-k8s-version-983302
I0612 21:28:03.865110 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7b:c8:d2", ip: ""} in network mk-old-k8s-version-983302: {Iface:virbr2 ExpiryTime:2024-06-12 22:27:51 +0000 UTC Type:0 Mac:52:54:00:7b:c8:d2 Iaid: IPaddr:192.168.50.81 Prefix:24 Hostname:old-k8s-version-983302 Clientid:01:52:54:00:7b:c8:d2}
I0612 21:28:03.865138 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | domain old-k8s-version-983302 has defined IP address 192.168.50.81 and MAC address 52:54:00:7b:c8:d2 in network mk-old-k8s-version-983302
I0612 21:28:03.865310 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetSSHPort
I0612 21:28:03.865447 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7b:c8:d2", ip: ""} in network mk-old-k8s-version-983302: {Iface:virbr2 ExpiryTime:2024-06-12 22:27:51 +0000 UTC Type:0 Mac:52:54:00:7b:c8:d2 Iaid: IPaddr:192.168.50.81 Prefix:24 Hostname:old-k8s-version-983302 Clientid:01:52:54:00:7b:c8:d2}
I0612 21:28:03.865475 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | domain old-k8s-version-983302 has defined IP address 192.168.50.81 and MAC address 52:54:00:7b:c8:d2 in network mk-old-k8s-version-983302
I0612 21:28:03.865481 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetSSHKeyPath
I0612 21:28:03.865652 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetSSHPort
I0612 21:28:03.865660 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetSSHUsername
I0612 21:28:03.865855 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetSSHKeyPath
I0612 21:28:03.865863 73322 sshutil.go:53] new ssh client: &{IP:192.168.50.81 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17779-14199/.minikube/machines/old-k8s-version-983302/id_rsa Username:docker}
I0612 21:28:03.866008 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetSSHUsername
I0612 21:28:03.866202 73322 sshutil.go:53] new ssh client: &{IP:192.168.50.81 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17779-14199/.minikube/machines/old-k8s-version-983302/id_rsa Username:docker}
I0612 21:28:03.946200 73322 ssh_runner.go:195] Run: systemctl --version
I0612 21:28:03.968420 73322 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0612 21:28:04.137599 73322 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0612 21:28:04.143753 73322 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0612 21:28:04.143813 73322 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0612 21:28:04.161060 73322 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0612 21:28:04.161086 73322 start.go:494] detecting cgroup driver to use...
I0612 21:28:04.161151 73322 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0612 21:28:04.179637 73322 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0612 21:28:04.193922 73322 docker.go:217] disabling cri-docker service (if available) ...
I0612 21:28:04.193985 73322 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0612 21:28:04.210160 73322 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0612 21:28:04.223579 73322 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0612 21:28:04.340159 73322 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0612 21:28:04.509721 73322 docker.go:233] disabling docker service ...
I0612 21:28:04.509786 73322 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0612 21:28:04.526042 73322 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0612 21:28:04.540330 73322 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0612 21:28:04.673978 73322 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0612 21:28:04.828951 73322 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0612 21:28:04.846491 73322 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0612 21:28:04.869199 73322 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0612 21:28:04.869273 73322 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0612 21:28:04.882222 73322 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0612 21:28:04.882322 73322 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0612 21:28:04.893341 73322 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0612 21:28:04.904464 73322 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0612 21:28:04.914875 73322 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0612 21:28:04.929228 73322 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0612 21:28:04.946080 73322 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0612 21:28:04.946163 73322 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0612 21:28:04.964049 73322 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0612 21:28:04.976089 73322 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0612 21:28:05.135022 73322 ssh_runner.go:195] Run: sudo systemctl restart crio
I0612 21:28:05.301175 73322 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0612 21:28:05.301245 73322 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0612 21:28:05.306237 73322 start.go:562] Will wait 60s for crictl version
I0612 21:28:05.306303 73322 ssh_runner.go:195] Run: which crictl
I0612 21:28:05.310593 73322 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0612 21:28:05.354808 73322 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0612 21:28:05.354893 73322 ssh_runner.go:195] Run: crio --version
I0612 21:28:05.391745 73322 ssh_runner.go:195] Run: crio --version
I0612 21:28:05.432103 73322 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0612 21:28:05.433452 73322 main.go:141] libmachine: (old-k8s-version-983302) Calling .GetIP
I0612 21:28:05.437073 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | domain old-k8s-version-983302 has defined MAC address 52:54:00:7b:c8:d2 in network mk-old-k8s-version-983302
I0612 21:28:05.437492 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7b:c8:d2", ip: ""} in network mk-old-k8s-version-983302: {Iface:virbr2 ExpiryTime:2024-06-12 22:27:51 +0000 UTC Type:0 Mac:52:54:00:7b:c8:d2 Iaid: IPaddr:192.168.50.81 Prefix:24 Hostname:old-k8s-version-983302 Clientid:01:52:54:00:7b:c8:d2}
I0612 21:28:05.437519 73322 main.go:141] libmachine: (old-k8s-version-983302) DBG | domain old-k8s-version-983302 has defined IP address 192.168.50.81 and MAC address 52:54:00:7b:c8:d2 in network mk-old-k8s-version-983302
I0612 21:28:05.437758 73322 ssh_runner.go:195] Run: grep 192.168.50.1 host.minikube.internal$ /etc/hosts
I0612 21:28:05.442488 73322 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.50.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0612 21:28:05.457320 73322 kubeadm.go:877] updating cluster {Name:old-k8s-version-983302 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19038/minikube-v1.33.1-1717668912-19038-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1717668449-19038@sha256:30d191eb345232f513c52f7ac036e7a34a8cc441d88353f92985384bcddf00d6 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-983302 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.50.81 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mo
untPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0612 21:28:05.457470 73322 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0612 21:28:05.457543 73322 ssh_runner.go:195] Run: sudo crictl images --output json
I0612 21:28:05.499075 73322 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0612 21:28:05.499151 73322 ssh_runner.go:195] Run: which lz4
I0612 21:28:05.504163 73322 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0612 21:28:05.509394 73322 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0612 21:28:05.509425 73322 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17779-14199/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0612 21:28:07.629607 73322 crio.go:462] duration metric: took 2.125472511s to copy over tarball
I0612 21:28:07.629698 73322 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0612 21:28:10.685324 73322 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (3.055578459s)
I0612 21:28:10.685364 73322 crio.go:469] duration metric: took 3.055719813s to extract the tarball
I0612 21:28:10.685373 73322 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0612 21:28:10.731489 73322 ssh_runner.go:195] Run: sudo crictl images --output json
I0612 21:28:10.780408 73322 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0612 21:28:10.780439 73322 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0612 21:28:10.780517 73322 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0612 21:28:10.780525 73322 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0612 21:28:10.780525 73322 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0612 21:28:10.780553 73322 image.go:134] retrieving image: registry.k8s.io/coredns:1.7.0
I0612 21:28:10.780579 73322 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0612 21:28:10.780603 73322 image.go:134] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0612 21:28:10.780631 73322 image.go:134] retrieving image: registry.k8s.io/pause:3.2
I0612 21:28:10.780603 73322 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0612 21:28:10.782188 73322 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0612 21:28:10.782204 73322 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0612 21:28:10.782254 73322 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0612 21:28:10.782283 73322 image.go:177] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0612 21:28:10.782187 73322 image.go:177] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0612 21:28:10.782188 73322 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0612 21:28:10.782188 73322 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0612 21:28:10.782188 73322 image.go:177] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0612 21:28:10.923546 73322 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0612 21:28:10.924365 73322 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0612 21:28:10.930050 73322 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0612 21:28:10.933642 73322 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0612 21:28:10.937170 73322 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0612 21:28:10.938902 73322 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0612 21:28:10.946869 73322 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0612 21:28:11.026736 73322 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0612 21:28:11.026792 73322 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0612 21:28:11.026837 73322 ssh_runner.go:195] Run: which crictl
I0612 21:28:11.074562 73322 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0612 21:28:11.074612 73322 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0612 21:28:11.074667 73322 ssh_runner.go:195] Run: which crictl
I0612 21:28:11.114029 73322 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0612 21:28:11.114158 73322 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0612 21:28:11.114242 73322 ssh_runner.go:195] Run: which crictl
I0612 21:28:11.123150 73322 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0612 21:28:11.123197 73322 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0612 21:28:11.123215 73322 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0612 21:28:11.123229 73322 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0612 21:28:11.123234 73322 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0612 21:28:11.123258 73322 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0612 21:28:11.123265 73322 ssh_runner.go:195] Run: which crictl
I0612 21:28:11.123267 73322 ssh_runner.go:195] Run: which crictl
I0612 21:28:11.123292 73322 ssh_runner.go:195] Run: which crictl
I0612 21:28:11.129167 73322 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0612 21:28:11.129221 73322 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0612 21:28:11.129254 73322 ssh_runner.go:195] Run: which crictl
I0612 21:28:11.129257 73322 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0612 21:28:11.129279 73322 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0612 21:28:11.129203 73322 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0612 21:28:11.131419 73322 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0612 21:28:11.136494 73322 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0612 21:28:11.136578 73322 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0612 21:28:11.275323 73322 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0612 21:28:11.275355 73322 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17779-14199/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0612 21:28:11.275417 73322 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17779-14199/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0612 21:28:11.275479 73322 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17779-14199/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0612 21:28:11.275505 73322 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17779-14199/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0612 21:28:11.279722 73322 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17779-14199/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0612 21:28:11.279775 73322 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17779-14199/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0612 21:28:11.312413 73322 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17779-14199/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0612 21:28:11.594767 73322 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0612 21:28:11.740006 73322 cache_images.go:92] duration metric: took 959.548613ms to LoadCachedImages
W0612 21:28:11.740089 73322 out.go:239] X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/17779-14199/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0: no such file or directory
X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/17779-14199/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0: no such file or directory
I0612 21:28:11.740106 73322 kubeadm.go:928] updating node { 192.168.50.81 8443 v1.20.0 crio true true} ...
I0612 21:28:11.740234 73322 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-983302 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.50.81
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-983302 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0612 21:28:11.740310 73322 ssh_runner.go:195] Run: crio config
I0612 21:28:11.793514 73322 cni.go:84] Creating CNI manager for ""
I0612 21:28:11.793540 73322 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0612 21:28:11.793552 73322 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0612 21:28:11.793575 73322 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.50.81 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-983302 NodeName:old-k8s-version-983302 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.50.81"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.50.81 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt Stati
cPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0612 21:28:11.793742 73322 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.50.81
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-983302"
kubeletExtraArgs:
node-ip: 192.168.50.81
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.50.81"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0612 21:28:11.793816 73322 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0612 21:28:11.806415 73322 binaries.go:44] Found k8s binaries, skipping transfer
I0612 21:28:11.806473 73322 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0612 21:28:11.818167 73322 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (429 bytes)
I0612 21:28:11.836998 73322 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0612 21:28:11.856705 73322 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2120 bytes)
I0612 21:28:11.875557 73322 ssh_runner.go:195] Run: grep 192.168.50.81 control-plane.minikube.internal$ /etc/hosts
I0612 21:28:11.880526 73322 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.50.81 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0612 21:28:11.898447 73322 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0612 21:28:12.046516 73322 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0612 21:28:12.069563 73322 certs.go:68] Setting up /home/jenkins/minikube-integration/17779-14199/.minikube/profiles/old-k8s-version-983302 for IP: 192.168.50.81
I0612 21:28:12.069591 73322 certs.go:194] generating shared ca certs ...
I0612 21:28:12.069610 73322 certs.go:226] acquiring lock for ca certs: {Name:mk0acb420384e68f188900634721a8b628172b46 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0612 21:28:12.069766 73322 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/17779-14199/.minikube/ca.key
I0612 21:28:12.069845 73322 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/17779-14199/.minikube/proxy-client-ca.key
I0612 21:28:12.069861 73322 certs.go:256] generating profile certs ...
I0612 21:28:12.069935 73322 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/17779-14199/.minikube/profiles/old-k8s-version-983302/client.key
I0612 21:28:12.069953 73322 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17779-14199/.minikube/profiles/old-k8s-version-983302/client.crt with IP's: []
I0612 21:28:12.438566 73322 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17779-14199/.minikube/profiles/old-k8s-version-983302/client.crt ...
I0612 21:28:12.438604 73322 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17779-14199/.minikube/profiles/old-k8s-version-983302/client.crt: {Name:mk8b09f8fef3b624d7df85bc30414fbe123bbd7a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0612 21:28:12.438809 73322 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17779-14199/.minikube/profiles/old-k8s-version-983302/client.key ...
I0612 21:28:12.438845 73322 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17779-14199/.minikube/profiles/old-k8s-version-983302/client.key: {Name:mka56f1fdb0d5c78aa3d259142d04fe2f600446a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0612 21:28:12.438967 73322 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/17779-14199/.minikube/profiles/old-k8s-version-983302/apiserver.key.1098c83c
I0612 21:28:12.438995 73322 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17779-14199/.minikube/profiles/old-k8s-version-983302/apiserver.crt.1098c83c with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.50.81]
I0612 21:28:12.702986 73322 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17779-14199/.minikube/profiles/old-k8s-version-983302/apiserver.crt.1098c83c ...
I0612 21:28:12.703012 73322 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17779-14199/.minikube/profiles/old-k8s-version-983302/apiserver.crt.1098c83c: {Name:mkb06499d89c607add489c804a6359f41f95638e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0612 21:28:12.703196 73322 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17779-14199/.minikube/profiles/old-k8s-version-983302/apiserver.key.1098c83c ...
I0612 21:28:12.703219 73322 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17779-14199/.minikube/profiles/old-k8s-version-983302/apiserver.key.1098c83c: {Name:mkee403391f7da0253f58a97c0640fdccf85f21e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0612 21:28:12.703320 73322 certs.go:381] copying /home/jenkins/minikube-integration/17779-14199/.minikube/profiles/old-k8s-version-983302/apiserver.crt.1098c83c -> /home/jenkins/minikube-integration/17779-14199/.minikube/profiles/old-k8s-version-983302/apiserver.crt
I0612 21:28:12.703410 73322 certs.go:385] copying /home/jenkins/minikube-integration/17779-14199/.minikube/profiles/old-k8s-version-983302/apiserver.key.1098c83c -> /home/jenkins/minikube-integration/17779-14199/.minikube/profiles/old-k8s-version-983302/apiserver.key
I0612 21:28:12.703485 73322 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/17779-14199/.minikube/profiles/old-k8s-version-983302/proxy-client.key
I0612 21:28:12.703511 73322 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17779-14199/.minikube/profiles/old-k8s-version-983302/proxy-client.crt with IP's: []
I0612 21:28:12.850479 73322 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17779-14199/.minikube/profiles/old-k8s-version-983302/proxy-client.crt ...
I0612 21:28:12.850511 73322 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17779-14199/.minikube/profiles/old-k8s-version-983302/proxy-client.crt: {Name:mkeea01a8a4f44791762ccc7af9be39473d8387e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0612 21:28:12.850714 73322 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17779-14199/.minikube/profiles/old-k8s-version-983302/proxy-client.key ...
I0612 21:28:12.850737 73322 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17779-14199/.minikube/profiles/old-k8s-version-983302/proxy-client.key: {Name:mke2f35923fafbc462d2fcb19f0c8b0f92594e91 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0612 21:28:12.850991 73322 certs.go:484] found cert: /home/jenkins/minikube-integration/17779-14199/.minikube/certs/21444.pem (1338 bytes)
W0612 21:28:12.851054 73322 certs.go:480] ignoring /home/jenkins/minikube-integration/17779-14199/.minikube/certs/21444_empty.pem, impossibly tiny 0 bytes
I0612 21:28:12.851070 73322 certs.go:484] found cert: /home/jenkins/minikube-integration/17779-14199/.minikube/certs/ca-key.pem (1679 bytes)
I0612 21:28:12.851102 73322 certs.go:484] found cert: /home/jenkins/minikube-integration/17779-14199/.minikube/certs/ca.pem (1078 bytes)
I0612 21:28:12.851133 73322 certs.go:484] found cert: /home/jenkins/minikube-integration/17779-14199/.minikube/certs/cert.pem (1123 bytes)
I0612 21:28:12.851166 73322 certs.go:484] found cert: /home/jenkins/minikube-integration/17779-14199/.minikube/certs/key.pem (1679 bytes)
I0612 21:28:12.851238 73322 certs.go:484] found cert: /home/jenkins/minikube-integration/17779-14199/.minikube/files/etc/ssl/certs/214442.pem (1708 bytes)
I0612 21:28:12.852037 73322 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17779-14199/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0612 21:28:12.883688 73322 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17779-14199/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0612 21:28:12.920825 73322 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17779-14199/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0612 21:28:12.965100 73322 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17779-14199/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0612 21:28:12.988957 73322 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17779-14199/.minikube/profiles/old-k8s-version-983302/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0612 21:28:13.014561 73322 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17779-14199/.minikube/profiles/old-k8s-version-983302/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0612 21:28:13.042604 73322 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17779-14199/.minikube/profiles/old-k8s-version-983302/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0612 21:28:13.070763 73322 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17779-14199/.minikube/profiles/old-k8s-version-983302/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0612 21:28:13.096902 73322 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17779-14199/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0612 21:28:13.121010 73322 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17779-14199/.minikube/certs/21444.pem --> /usr/share/ca-certificates/21444.pem (1338 bytes)
I0612 21:28:13.143799 73322 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17779-14199/.minikube/files/etc/ssl/certs/214442.pem --> /usr/share/ca-certificates/214442.pem (1708 bytes)
I0612 21:28:13.169809 73322 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0612 21:28:13.189660 73322 ssh_runner.go:195] Run: openssl version
I0612 21:28:13.197370 73322 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/214442.pem && ln -fs /usr/share/ca-certificates/214442.pem /etc/ssl/certs/214442.pem"
I0612 21:28:13.212518 73322 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/214442.pem
I0612 21:28:13.218249 73322 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jun 12 20:24 /usr/share/ca-certificates/214442.pem
I0612 21:28:13.218319 73322 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/214442.pem
I0612 21:28:13.226183 73322 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/214442.pem /etc/ssl/certs/3ec20f2e.0"
I0612 21:28:13.240988 73322 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0612 21:28:13.254761 73322 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0612 21:28:13.259864 73322 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jun 12 20:12 /usr/share/ca-certificates/minikubeCA.pem
I0612 21:28:13.259924 73322 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0612 21:28:13.267756 73322 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0612 21:28:13.282527 73322 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/21444.pem && ln -fs /usr/share/ca-certificates/21444.pem /etc/ssl/certs/21444.pem"
I0612 21:28:13.297491 73322 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/21444.pem
I0612 21:28:13.303330 73322 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jun 12 20:24 /usr/share/ca-certificates/21444.pem
I0612 21:28:13.303393 73322 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/21444.pem
I0612 21:28:13.310332 73322 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/21444.pem /etc/ssl/certs/51391683.0"
I0612 21:28:13.323420 73322 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0612 21:28:13.328251 73322 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0612 21:28:13.328297 73322 kubeadm.go:391] StartCluster: {Name:old-k8s-version-983302 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19038/minikube-v1.33.1-1717668912-19038-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1717668449-19038@sha256:30d191eb345232f513c52f7ac036e7a34a8cc441d88353f92985384bcddf00d6 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-983302 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.50.81 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0612 21:28:13.328362 73322 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0612 21:28:13.328397 73322 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0612 21:28:13.385547 73322 cri.go:89] found id: ""
I0612 21:28:13.385618 73322 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0612 21:28:13.396586 73322 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0612 21:28:13.408065 73322 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0612 21:28:13.418854 73322 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0612 21:28:13.418875 73322 kubeadm.go:156] found existing configuration files:
I0612 21:28:13.418921 73322 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0612 21:28:13.429162 73322 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0612 21:28:13.429222 73322 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0612 21:28:13.440913 73322 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0612 21:28:13.451660 73322 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0612 21:28:13.451716 73322 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0612 21:28:13.466599 73322 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0612 21:28:13.476547 73322 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0612 21:28:13.476610 73322 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0612 21:28:13.487416 73322 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0612 21:28:13.498111 73322 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0612 21:28:13.498159 73322 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0612 21:28:13.508656 73322 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0612 21:28:13.637681 73322 kubeadm.go:309] [init] Using Kubernetes version: v1.20.0
I0612 21:28:13.637954 73322 kubeadm.go:309] [preflight] Running pre-flight checks
I0612 21:28:13.846242 73322 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0612 21:28:13.846385 73322 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0612 21:28:13.846504 73322 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0612 21:28:14.102812 73322 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0612 21:28:14.106255 73322 out.go:204] - Generating certificates and keys ...
I0612 21:28:14.106365 73322 kubeadm.go:309] [certs] Using existing ca certificate authority
I0612 21:28:14.106453 73322 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0612 21:28:14.690380 73322 kubeadm.go:309] [certs] Generating "apiserver-kubelet-client" certificate and key
I0612 21:28:14.801796 73322 kubeadm.go:309] [certs] Generating "front-proxy-ca" certificate and key
I0612 21:28:15.196796 73322 kubeadm.go:309] [certs] Generating "front-proxy-client" certificate and key
I0612 21:28:15.407453 73322 kubeadm.go:309] [certs] Generating "etcd/ca" certificate and key
I0612 21:28:15.583907 73322 kubeadm.go:309] [certs] Generating "etcd/server" certificate and key
I0612 21:28:15.584703 73322 kubeadm.go:309] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-983302] and IPs [192.168.50.81 127.0.0.1 ::1]
I0612 21:28:16.226089 73322 kubeadm.go:309] [certs] Generating "etcd/peer" certificate and key
I0612 21:28:16.226724 73322 kubeadm.go:309] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-983302] and IPs [192.168.50.81 127.0.0.1 ::1]
I0612 21:28:16.445847 73322 kubeadm.go:309] [certs] Generating "etcd/healthcheck-client" certificate and key
I0612 21:28:16.769560 73322 kubeadm.go:309] [certs] Generating "apiserver-etcd-client" certificate and key
I0612 21:28:17.382606 73322 kubeadm.go:309] [certs] Generating "sa" key and public key
I0612 21:28:17.382903 73322 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0612 21:28:17.444555 73322 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0612 21:28:17.779056 73322 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0612 21:28:18.559849 73322 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0612 21:28:18.899633 73322 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0612 21:28:18.920601 73322 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0612 21:28:18.921767 73322 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0612 21:28:18.921854 73322 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0612 21:28:19.068132 73322 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0612 21:28:19.239896 73322 out.go:204] - Booting up control plane ...
I0612 21:28:19.240115 73322 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0612 21:28:19.240211 73322 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0612 21:28:19.240309 73322 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0612 21:28:19.240418 73322 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0612 21:28:19.240638 73322 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0612 21:28:59.090475 73322 kubeadm.go:309] [kubelet-check] Initial timeout of 40s passed.
I0612 21:28:59.090623 73322 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0612 21:28:59.090854 73322 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0612 21:29:04.090619 73322 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0612 21:29:04.090874 73322 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0612 21:29:14.090192 73322 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0612 21:29:14.090470 73322 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0612 21:29:34.090466 73322 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0612 21:29:34.090763 73322 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0612 21:30:14.093291 73322 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0612 21:30:14.093777 73322 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0612 21:30:14.093807 73322 kubeadm.go:309]
I0612 21:30:14.093897 73322 kubeadm.go:309] Unfortunately, an error has occurred:
I0612 21:30:14.093984 73322 kubeadm.go:309] timed out waiting for the condition
I0612 21:30:14.093993 73322 kubeadm.go:309]
I0612 21:30:14.094074 73322 kubeadm.go:309] This error is likely caused by:
I0612 21:30:14.094144 73322 kubeadm.go:309] - The kubelet is not running
I0612 21:30:14.094372 73322 kubeadm.go:309] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0612 21:30:14.094394 73322 kubeadm.go:309]
I0612 21:30:14.094626 73322 kubeadm.go:309] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0612 21:30:14.094702 73322 kubeadm.go:309] - 'systemctl status kubelet'
I0612 21:30:14.094776 73322 kubeadm.go:309] - 'journalctl -xeu kubelet'
I0612 21:30:14.094788 73322 kubeadm.go:309]
I0612 21:30:14.095055 73322 kubeadm.go:309] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0612 21:30:14.095257 73322 kubeadm.go:309] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0612 21:30:14.095274 73322 kubeadm.go:309]
I0612 21:30:14.095497 73322 kubeadm.go:309] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0612 21:30:14.095745 73322 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0612 21:30:14.096155 73322 kubeadm.go:309] Once you have found the failing container, you can inspect its logs with:
I0612 21:30:14.096335 73322 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0612 21:30:14.096359 73322 kubeadm.go:309]
I0612 21:30:14.096834 73322 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0612 21:30:14.096945 73322 kubeadm.go:309] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0612 21:30:14.097032 73322 kubeadm.go:309] To see the stack trace of this error execute with --v=5 or higher
W0612 21:30:14.097199 73322 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-983302] and IPs [192.168.50.81 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-983302] and IPs [192.168.50.81 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-983302] and IPs [192.168.50.81 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-983302] and IPs [192.168.50.81 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0612 21:30:14.097253 73322 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0612 21:30:16.220291 73322 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (2.123009757s)
I0612 21:30:16.220371 73322 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0612 21:30:16.239734 73322 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0612 21:30:16.251356 73322 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0612 21:30:16.251380 73322 kubeadm.go:156] found existing configuration files:
I0612 21:30:16.251432 73322 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0612 21:30:16.265647 73322 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0612 21:30:16.265716 73322 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0612 21:30:16.278918 73322 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0612 21:30:16.289824 73322 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0612 21:30:16.289900 73322 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0612 21:30:16.301594 73322 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0612 21:30:16.312179 73322 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0612 21:30:16.312240 73322 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0612 21:30:16.323422 73322 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0612 21:30:16.334771 73322 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0612 21:30:16.334846 73322 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0612 21:30:16.346768 73322 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0612 21:30:16.440798 73322 kubeadm.go:309] [init] Using Kubernetes version: v1.20.0
I0612 21:30:16.440854 73322 kubeadm.go:309] [preflight] Running pre-flight checks
I0612 21:30:16.615524 73322 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0612 21:30:16.615664 73322 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0612 21:30:16.615814 73322 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0612 21:30:16.809680 73322 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0612 21:30:16.812575 73322 out.go:204] - Generating certificates and keys ...
I0612 21:30:16.812690 73322 kubeadm.go:309] [certs] Using existing ca certificate authority
I0612 21:30:16.812770 73322 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0612 21:30:16.812873 73322 kubeadm.go:309] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0612 21:30:16.812989 73322 kubeadm.go:309] [certs] Using existing front-proxy-ca certificate authority
I0612 21:30:16.813104 73322 kubeadm.go:309] [certs] Using existing front-proxy-client certificate and key on disk
I0612 21:30:16.813186 73322 kubeadm.go:309] [certs] Using existing etcd/ca certificate authority
I0612 21:30:16.813283 73322 kubeadm.go:309] [certs] Using existing etcd/server certificate and key on disk
I0612 21:30:16.813374 73322 kubeadm.go:309] [certs] Using existing etcd/peer certificate and key on disk
I0612 21:30:16.813484 73322 kubeadm.go:309] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0612 21:30:16.813595 73322 kubeadm.go:309] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0612 21:30:16.813646 73322 kubeadm.go:309] [certs] Using the existing "sa" key
I0612 21:30:16.813727 73322 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0612 21:30:17.087638 73322 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0612 21:30:17.433470 73322 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0612 21:30:17.683329 73322 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0612 21:30:18.203224 73322 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0612 21:30:18.224065 73322 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0612 21:30:18.225931 73322 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0612 21:30:18.226015 73322 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0612 21:30:18.385552 73322 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0612 21:30:18.387500 73322 out.go:204] - Booting up control plane ...
I0612 21:30:18.387635 73322 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0612 21:30:18.396061 73322 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0612 21:30:18.398703 73322 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0612 21:30:18.398821 73322 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0612 21:30:18.401505 73322 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0612 21:30:58.404136 73322 kubeadm.go:309] [kubelet-check] Initial timeout of 40s passed.
I0612 21:30:58.404275 73322 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0612 21:30:58.404547 73322 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0612 21:31:03.405142 73322 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0612 21:31:03.405358 73322 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0612 21:31:13.404827 73322 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0612 21:31:13.405078 73322 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0612 21:31:33.404471 73322 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0612 21:31:33.404682 73322 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0612 21:32:13.404523 73322 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0612 21:32:13.404722 73322 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0612 21:32:13.404737 73322 kubeadm.go:309]
I0612 21:32:13.404791 73322 kubeadm.go:309] Unfortunately, an error has occurred:
I0612 21:32:13.404828 73322 kubeadm.go:309] timed out waiting for the condition
I0612 21:32:13.404834 73322 kubeadm.go:309]
I0612 21:32:13.404861 73322 kubeadm.go:309] This error is likely caused by:
I0612 21:32:13.404904 73322 kubeadm.go:309] - The kubelet is not running
I0612 21:32:13.405029 73322 kubeadm.go:309] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0612 21:32:13.405038 73322 kubeadm.go:309]
I0612 21:32:13.405129 73322 kubeadm.go:309] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0612 21:32:13.405166 73322 kubeadm.go:309] - 'systemctl status kubelet'
I0612 21:32:13.405197 73322 kubeadm.go:309] - 'journalctl -xeu kubelet'
I0612 21:32:13.405204 73322 kubeadm.go:309]
I0612 21:32:13.405289 73322 kubeadm.go:309] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0612 21:32:13.405371 73322 kubeadm.go:309] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0612 21:32:13.405390 73322 kubeadm.go:309]
I0612 21:32:13.405483 73322 kubeadm.go:309] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0612 21:32:13.405559 73322 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0612 21:32:13.405622 73322 kubeadm.go:309] Once you have found the failing container, you can inspect its logs with:
I0612 21:32:13.405750 73322 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0612 21:32:13.405773 73322 kubeadm.go:309]
I0612 21:32:13.407151 73322 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0612 21:32:13.407281 73322 kubeadm.go:309] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0612 21:32:13.407436 73322 kubeadm.go:393] duration metric: took 4m0.079142763s to StartCluster
I0612 21:32:13.407476 73322 kubeadm.go:309] To see the stack trace of this error execute with --v=5 or higher
I0612 21:32:13.407516 73322 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0612 21:32:13.407586 73322 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0612 21:32:13.452853 73322 cri.go:89] found id: ""
I0612 21:32:13.452881 73322 logs.go:276] 0 containers: []
W0612 21:32:13.452889 73322 logs.go:278] No container was found matching "kube-apiserver"
I0612 21:32:13.452895 73322 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0612 21:32:13.452961 73322 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0612 21:32:13.492503 73322 cri.go:89] found id: ""
I0612 21:32:13.492534 73322 logs.go:276] 0 containers: []
W0612 21:32:13.492543 73322 logs.go:278] No container was found matching "etcd"
I0612 21:32:13.492549 73322 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0612 21:32:13.492606 73322 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0612 21:32:13.526152 73322 cri.go:89] found id: ""
I0612 21:32:13.526176 73322 logs.go:276] 0 containers: []
W0612 21:32:13.526185 73322 logs.go:278] No container was found matching "coredns"
I0612 21:32:13.526191 73322 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0612 21:32:13.526250 73322 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0612 21:32:13.560479 73322 cri.go:89] found id: ""
I0612 21:32:13.560511 73322 logs.go:276] 0 containers: []
W0612 21:32:13.560530 73322 logs.go:278] No container was found matching "kube-scheduler"
I0612 21:32:13.560538 73322 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0612 21:32:13.560599 73322 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0612 21:32:13.598077 73322 cri.go:89] found id: ""
I0612 21:32:13.598104 73322 logs.go:276] 0 containers: []
W0612 21:32:13.598115 73322 logs.go:278] No container was found matching "kube-proxy"
I0612 21:32:13.598122 73322 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0612 21:32:13.598185 73322 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0612 21:32:13.632478 73322 cri.go:89] found id: ""
I0612 21:32:13.632505 73322 logs.go:276] 0 containers: []
W0612 21:32:13.632515 73322 logs.go:278] No container was found matching "kube-controller-manager"
I0612 21:32:13.632523 73322 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0612 21:32:13.632584 73322 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0612 21:32:13.670188 73322 cri.go:89] found id: ""
I0612 21:32:13.670213 73322 logs.go:276] 0 containers: []
W0612 21:32:13.670221 73322 logs.go:278] No container was found matching "kindnet"
I0612 21:32:13.670231 73322 logs.go:123] Gathering logs for kubelet ...
I0612 21:32:13.670243 73322 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0612 21:32:13.720993 73322 logs.go:123] Gathering logs for dmesg ...
I0612 21:32:13.721020 73322 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0612 21:32:13.734139 73322 logs.go:123] Gathering logs for describe nodes ...
I0612 21:32:13.734166 73322 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0612 21:32:13.870400 73322 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0612 21:32:13.870424 73322 logs.go:123] Gathering logs for CRI-O ...
I0612 21:32:13.870436 73322 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0612 21:32:13.965076 73322 logs.go:123] Gathering logs for container status ...
I0612 21:32:13.965111 73322 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0612 21:32:14.008821 73322 out.go:364] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0612 21:32:14.008866 73322 out.go:239] *
*
W0612 21:32:14.008931 73322 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0612 21:32:14.008960 73322 out.go:239] *
*
W0612 21:32:14.010032 73322 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0612 21:32:14.015197 73322 out.go:177]
W0612 21:32:14.016622 73322 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0612 21:32:14.016701 73322 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0612 21:32:14.016729 73322 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0612 21:32:14.018995 73322 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-983302 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-983302 -n old-k8s-version-983302
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-983302 -n old-k8s-version-983302: exit status 6 (221.627543ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0612 21:32:14.285860 79705 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-983302" does not appear in /home/jenkins/minikube-integration/17779-14199/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-983302" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (279.07s)