=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-104669 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-104669 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m54.390002356s)
-- stdout --
* [old-k8s-version-104669] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=19468
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19468-372744/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19468-372744/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-104669" primary control-plane node in "old-k8s-version-104669" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0819 19:01:57.704552 431169 out.go:345] Setting OutFile to fd 1 ...
I0819 19:01:57.704664 431169 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0819 19:01:57.704674 431169 out.go:358] Setting ErrFile to fd 2...
I0819 19:01:57.704678 431169 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0819 19:01:57.704856 431169 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19468-372744/.minikube/bin
I0819 19:01:57.705440 431169 out.go:352] Setting JSON to false
I0819 19:01:57.706656 431169 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-11","uptime":9861,"bootTime":1724084257,"procs":299,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1066-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0819 19:01:57.706723 431169 start.go:139] virtualization: kvm guest
I0819 19:01:57.709157 431169 out.go:177] * [old-k8s-version-104669] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
I0819 19:01:57.710715 431169 notify.go:220] Checking for updates...
I0819 19:01:57.710724 431169 out.go:177] - MINIKUBE_LOCATION=19468
I0819 19:01:57.712255 431169 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0819 19:01:57.713525 431169 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19468-372744/kubeconfig
I0819 19:01:57.714798 431169 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19468-372744/.minikube
I0819 19:01:57.716273 431169 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0819 19:01:57.717540 431169 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0819 19:01:57.719637 431169 config.go:182] Loaded profile config "bridge-571803": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.0
I0819 19:01:57.719802 431169 config.go:182] Loaded profile config "enable-default-cni-571803": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.0
I0819 19:01:57.719923 431169 config.go:182] Loaded profile config "flannel-571803": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.0
I0819 19:01:57.720047 431169 driver.go:392] Setting default libvirt URI to qemu:///system
I0819 19:01:57.763602 431169 out.go:177] * Using the kvm2 driver based on user configuration
I0819 19:01:57.764941 431169 start.go:297] selected driver: kvm2
I0819 19:01:57.764966 431169 start.go:901] validating driver "kvm2" against <nil>
I0819 19:01:57.764983 431169 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0819 19:01:57.765939 431169 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0819 19:01:57.766034 431169 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19468-372744/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0819 19:01:57.783782 431169 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.1
I0819 19:01:57.783869 431169 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0819 19:01:57.784181 431169 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0819 19:01:57.784269 431169 cni.go:84] Creating CNI manager for ""
I0819 19:01:57.784283 431169 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0819 19:01:57.784301 431169 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0819 19:01:57.784383 431169 start.go:340] cluster config:
{Name:old-k8s-version-104669 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-104669 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0819 19:01:57.784555 431169 iso.go:125] acquiring lock: {Name:mk4c0ac1c3202b1a296739df622960e7a0bd8566 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0819 19:01:57.787265 431169 out.go:177] * Starting "old-k8s-version-104669" primary control-plane node in "old-k8s-version-104669" cluster
I0819 19:01:57.788661 431169 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0819 19:01:57.788738 431169 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19468-372744/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0819 19:01:57.788755 431169 cache.go:56] Caching tarball of preloaded images
I0819 19:01:57.788868 431169 preload.go:172] Found /home/jenkins/minikube-integration/19468-372744/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0819 19:01:57.788884 431169 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0819 19:01:57.789038 431169 profile.go:143] Saving config to /home/jenkins/minikube-integration/19468-372744/.minikube/profiles/old-k8s-version-104669/config.json ...
I0819 19:01:57.789075 431169 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19468-372744/.minikube/profiles/old-k8s-version-104669/config.json: {Name:mk4257c3be6ec4e598292e96648655eb43fff941 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0819 19:01:57.789287 431169 start.go:360] acquireMachinesLock for old-k8s-version-104669: {Name:mk24ba67a747357e9ce40f1e460d2bb0bc59cc75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0819 19:02:15.664777 431169 start.go:364] duration metric: took 17.875434385s to acquireMachinesLock for "old-k8s-version-104669"
I0819 19:02:15.664838 431169 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-104669 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19452/minikube-v1.33.1-1723740674-19452-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-104669 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0819 19:02:15.664988 431169 start.go:125] createHost starting for "" (driver="kvm2")
I0819 19:02:15.667278 431169 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0819 19:02:15.667486 431169 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0819 19:02:15.667538 431169 main.go:141] libmachine: Launching plugin server for driver kvm2
I0819 19:02:15.688854 431169 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38655
I0819 19:02:15.689402 431169 main.go:141] libmachine: () Calling .GetVersion
I0819 19:02:15.690000 431169 main.go:141] libmachine: Using API Version 1
I0819 19:02:15.690028 431169 main.go:141] libmachine: () Calling .SetConfigRaw
I0819 19:02:15.690533 431169 main.go:141] libmachine: () Calling .GetMachineName
I0819 19:02:15.690766 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetMachineName
I0819 19:02:15.690941 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .DriverName
I0819 19:02:15.691066 431169 start.go:159] libmachine.API.Create for "old-k8s-version-104669" (driver="kvm2")
I0819 19:02:15.691089 431169 client.go:168] LocalClient.Create starting
I0819 19:02:15.691117 431169 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19468-372744/.minikube/certs/ca.pem
I0819 19:02:15.691152 431169 main.go:141] libmachine: Decoding PEM data...
I0819 19:02:15.691166 431169 main.go:141] libmachine: Parsing certificate...
I0819 19:02:15.691227 431169 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19468-372744/.minikube/certs/cert.pem
I0819 19:02:15.691248 431169 main.go:141] libmachine: Decoding PEM data...
I0819 19:02:15.691260 431169 main.go:141] libmachine: Parsing certificate...
I0819 19:02:15.691279 431169 main.go:141] libmachine: Running pre-create checks...
I0819 19:02:15.691288 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .PreCreateCheck
I0819 19:02:15.691629 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetConfigRaw
I0819 19:02:15.692101 431169 main.go:141] libmachine: Creating machine...
I0819 19:02:15.692120 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .Create
I0819 19:02:15.692262 431169 main.go:141] libmachine: (old-k8s-version-104669) Creating KVM machine...
I0819 19:02:15.693488 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | found existing default KVM network
I0819 19:02:15.694742 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | I0819 19:02:15.694563 431517 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:ca:98:0a} reservation:<nil>}
I0819 19:02:15.696031 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | I0819 19:02:15.695940 431517 network.go:206] using free private subnet 192.168.50.0/24: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc00011dd60}
I0819 19:02:15.696056 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | created network xml:
I0819 19:02:15.696071 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | <network>
I0819 19:02:15.696084 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | <name>mk-old-k8s-version-104669</name>
I0819 19:02:15.696097 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | <dns enable='no'/>
I0819 19:02:15.696107 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG |
I0819 19:02:15.696119 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | <ip address='192.168.50.1' netmask='255.255.255.0'>
I0819 19:02:15.696130 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | <dhcp>
I0819 19:02:15.696145 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | <range start='192.168.50.2' end='192.168.50.253'/>
I0819 19:02:15.696164 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | </dhcp>
I0819 19:02:15.696176 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | </ip>
I0819 19:02:15.696182 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG |
I0819 19:02:15.696190 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | </network>
I0819 19:02:15.696197 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG |
I0819 19:02:15.702113 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | trying to create private KVM network mk-old-k8s-version-104669 192.168.50.0/24...
I0819 19:02:15.789444 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | private KVM network mk-old-k8s-version-104669 192.168.50.0/24 created
I0819 19:02:15.789492 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | I0819 19:02:15.789406 431517 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19468-372744/.minikube
I0819 19:02:15.789512 431169 main.go:141] libmachine: (old-k8s-version-104669) Setting up store path in /home/jenkins/minikube-integration/19468-372744/.minikube/machines/old-k8s-version-104669 ...
I0819 19:02:15.789527 431169 main.go:141] libmachine: (old-k8s-version-104669) Building disk image from file:///home/jenkins/minikube-integration/19468-372744/.minikube/cache/iso/amd64/minikube-v1.33.1-1723740674-19452-amd64.iso
I0819 19:02:15.789547 431169 main.go:141] libmachine: (old-k8s-version-104669) Downloading /home/jenkins/minikube-integration/19468-372744/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19468-372744/.minikube/cache/iso/amd64/minikube-v1.33.1-1723740674-19452-amd64.iso...
I0819 19:02:16.068774 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | I0819 19:02:16.068557 431517 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19468-372744/.minikube/machines/old-k8s-version-104669/id_rsa...
I0819 19:02:16.230593 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | I0819 19:02:16.230448 431517 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19468-372744/.minikube/machines/old-k8s-version-104669/old-k8s-version-104669.rawdisk...
I0819 19:02:16.230641 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | Writing magic tar header
I0819 19:02:16.230676 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | Writing SSH key tar header
I0819 19:02:16.230691 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | I0819 19:02:16.230565 431517 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19468-372744/.minikube/machines/old-k8s-version-104669 ...
I0819 19:02:16.230710 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19468-372744/.minikube/machines/old-k8s-version-104669
I0819 19:02:16.230722 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19468-372744/.minikube/machines
I0819 19:02:16.230737 431169 main.go:141] libmachine: (old-k8s-version-104669) Setting executable bit set on /home/jenkins/minikube-integration/19468-372744/.minikube/machines/old-k8s-version-104669 (perms=drwx------)
I0819 19:02:16.230752 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19468-372744/.minikube
I0819 19:02:16.230764 431169 main.go:141] libmachine: (old-k8s-version-104669) Setting executable bit set on /home/jenkins/minikube-integration/19468-372744/.minikube/machines (perms=drwxr-xr-x)
I0819 19:02:16.230788 431169 main.go:141] libmachine: (old-k8s-version-104669) Setting executable bit set on /home/jenkins/minikube-integration/19468-372744/.minikube (perms=drwxr-xr-x)
I0819 19:02:16.230806 431169 main.go:141] libmachine: (old-k8s-version-104669) Setting executable bit set on /home/jenkins/minikube-integration/19468-372744 (perms=drwxrwxr-x)
I0819 19:02:16.230816 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19468-372744
I0819 19:02:16.230825 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0819 19:02:16.230832 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | Checking permissions on dir: /home/jenkins
I0819 19:02:16.230839 431169 main.go:141] libmachine: (old-k8s-version-104669) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0819 19:02:16.230848 431169 main.go:141] libmachine: (old-k8s-version-104669) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0819 19:02:16.230855 431169 main.go:141] libmachine: (old-k8s-version-104669) Creating domain...
I0819 19:02:16.230865 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | Checking permissions on dir: /home
I0819 19:02:16.230873 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | Skipping /home - not owner
I0819 19:02:16.232101 431169 main.go:141] libmachine: (old-k8s-version-104669) define libvirt domain using xml:
I0819 19:02:16.232128 431169 main.go:141] libmachine: (old-k8s-version-104669) <domain type='kvm'>
I0819 19:02:16.232138 431169 main.go:141] libmachine: (old-k8s-version-104669) <name>old-k8s-version-104669</name>
I0819 19:02:16.232146 431169 main.go:141] libmachine: (old-k8s-version-104669) <memory unit='MiB'>2200</memory>
I0819 19:02:16.232155 431169 main.go:141] libmachine: (old-k8s-version-104669) <vcpu>2</vcpu>
I0819 19:02:16.232163 431169 main.go:141] libmachine: (old-k8s-version-104669) <features>
I0819 19:02:16.232175 431169 main.go:141] libmachine: (old-k8s-version-104669) <acpi/>
I0819 19:02:16.232185 431169 main.go:141] libmachine: (old-k8s-version-104669) <apic/>
I0819 19:02:16.232195 431169 main.go:141] libmachine: (old-k8s-version-104669) <pae/>
I0819 19:02:16.232211 431169 main.go:141] libmachine: (old-k8s-version-104669)
I0819 19:02:16.232225 431169 main.go:141] libmachine: (old-k8s-version-104669) </features>
I0819 19:02:16.232235 431169 main.go:141] libmachine: (old-k8s-version-104669) <cpu mode='host-passthrough'>
I0819 19:02:16.232247 431169 main.go:141] libmachine: (old-k8s-version-104669)
I0819 19:02:16.232256 431169 main.go:141] libmachine: (old-k8s-version-104669) </cpu>
I0819 19:02:16.232269 431169 main.go:141] libmachine: (old-k8s-version-104669) <os>
I0819 19:02:16.232281 431169 main.go:141] libmachine: (old-k8s-version-104669) <type>hvm</type>
I0819 19:02:16.232298 431169 main.go:141] libmachine: (old-k8s-version-104669) <boot dev='cdrom'/>
I0819 19:02:16.232310 431169 main.go:141] libmachine: (old-k8s-version-104669) <boot dev='hd'/>
I0819 19:02:16.232321 431169 main.go:141] libmachine: (old-k8s-version-104669) <bootmenu enable='no'/>
I0819 19:02:16.232331 431169 main.go:141] libmachine: (old-k8s-version-104669) </os>
I0819 19:02:16.232343 431169 main.go:141] libmachine: (old-k8s-version-104669) <devices>
I0819 19:02:16.232359 431169 main.go:141] libmachine: (old-k8s-version-104669) <disk type='file' device='cdrom'>
I0819 19:02:16.232378 431169 main.go:141] libmachine: (old-k8s-version-104669) <source file='/home/jenkins/minikube-integration/19468-372744/.minikube/machines/old-k8s-version-104669/boot2docker.iso'/>
I0819 19:02:16.232390 431169 main.go:141] libmachine: (old-k8s-version-104669) <target dev='hdc' bus='scsi'/>
I0819 19:02:16.232401 431169 main.go:141] libmachine: (old-k8s-version-104669) <readonly/>
I0819 19:02:16.232410 431169 main.go:141] libmachine: (old-k8s-version-104669) </disk>
I0819 19:02:16.232421 431169 main.go:141] libmachine: (old-k8s-version-104669) <disk type='file' device='disk'>
I0819 19:02:16.232439 431169 main.go:141] libmachine: (old-k8s-version-104669) <driver name='qemu' type='raw' cache='default' io='threads' />
I0819 19:02:16.232479 431169 main.go:141] libmachine: (old-k8s-version-104669) <source file='/home/jenkins/minikube-integration/19468-372744/.minikube/machines/old-k8s-version-104669/old-k8s-version-104669.rawdisk'/>
I0819 19:02:16.232491 431169 main.go:141] libmachine: (old-k8s-version-104669) <target dev='hda' bus='virtio'/>
I0819 19:02:16.232531 431169 main.go:141] libmachine: (old-k8s-version-104669) </disk>
I0819 19:02:16.232555 431169 main.go:141] libmachine: (old-k8s-version-104669) <interface type='network'>
I0819 19:02:16.232566 431169 main.go:141] libmachine: (old-k8s-version-104669) <source network='mk-old-k8s-version-104669'/>
I0819 19:02:16.232577 431169 main.go:141] libmachine: (old-k8s-version-104669) <model type='virtio'/>
I0819 19:02:16.232591 431169 main.go:141] libmachine: (old-k8s-version-104669) </interface>
I0819 19:02:16.232603 431169 main.go:141] libmachine: (old-k8s-version-104669) <interface type='network'>
I0819 19:02:16.232614 431169 main.go:141] libmachine: (old-k8s-version-104669) <source network='default'/>
I0819 19:02:16.232625 431169 main.go:141] libmachine: (old-k8s-version-104669) <model type='virtio'/>
I0819 19:02:16.232662 431169 main.go:141] libmachine: (old-k8s-version-104669) </interface>
I0819 19:02:16.232690 431169 main.go:141] libmachine: (old-k8s-version-104669) <serial type='pty'>
I0819 19:02:16.232710 431169 main.go:141] libmachine: (old-k8s-version-104669) <target port='0'/>
I0819 19:02:16.232728 431169 main.go:141] libmachine: (old-k8s-version-104669) </serial>
I0819 19:02:16.232740 431169 main.go:141] libmachine: (old-k8s-version-104669) <console type='pty'>
I0819 19:02:16.232752 431169 main.go:141] libmachine: (old-k8s-version-104669) <target type='serial' port='0'/>
I0819 19:02:16.232763 431169 main.go:141] libmachine: (old-k8s-version-104669) </console>
I0819 19:02:16.232773 431169 main.go:141] libmachine: (old-k8s-version-104669) <rng model='virtio'>
I0819 19:02:16.232799 431169 main.go:141] libmachine: (old-k8s-version-104669) <backend model='random'>/dev/random</backend>
I0819 19:02:16.232815 431169 main.go:141] libmachine: (old-k8s-version-104669) </rng>
I0819 19:02:16.232829 431169 main.go:141] libmachine: (old-k8s-version-104669)
I0819 19:02:16.232839 431169 main.go:141] libmachine: (old-k8s-version-104669)
I0819 19:02:16.232851 431169 main.go:141] libmachine: (old-k8s-version-104669) </devices>
I0819 19:02:16.232860 431169 main.go:141] libmachine: (old-k8s-version-104669) </domain>
I0819 19:02:16.232872 431169 main.go:141] libmachine: (old-k8s-version-104669)
I0819 19:02:16.237064 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | domain old-k8s-version-104669 has defined MAC address 52:54:00:db:40:7b in network default
I0819 19:02:16.237651 431169 main.go:141] libmachine: (old-k8s-version-104669) Ensuring networks are active...
I0819 19:02:16.237678 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | domain old-k8s-version-104669 has defined MAC address 52:54:00:8c:ff:a3 in network mk-old-k8s-version-104669
I0819 19:02:16.238464 431169 main.go:141] libmachine: (old-k8s-version-104669) Ensuring network default is active
I0819 19:02:16.238840 431169 main.go:141] libmachine: (old-k8s-version-104669) Ensuring network mk-old-k8s-version-104669 is active
I0819 19:02:16.239323 431169 main.go:141] libmachine: (old-k8s-version-104669) Getting domain xml...
I0819 19:02:16.240193 431169 main.go:141] libmachine: (old-k8s-version-104669) Creating domain...
I0819 19:02:17.581462 431169 main.go:141] libmachine: (old-k8s-version-104669) Waiting to get IP...
I0819 19:02:17.582262 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | domain old-k8s-version-104669 has defined MAC address 52:54:00:8c:ff:a3 in network mk-old-k8s-version-104669
I0819 19:02:17.582722 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | unable to find current IP address of domain old-k8s-version-104669 in network mk-old-k8s-version-104669
I0819 19:02:17.582754 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | I0819 19:02:17.582724 431517 retry.go:31] will retry after 255.891838ms: waiting for machine to come up
I0819 19:02:17.840432 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | domain old-k8s-version-104669 has defined MAC address 52:54:00:8c:ff:a3 in network mk-old-k8s-version-104669
I0819 19:02:17.840988 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | unable to find current IP address of domain old-k8s-version-104669 in network mk-old-k8s-version-104669
I0819 19:02:17.841016 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | I0819 19:02:17.840945 431517 retry.go:31] will retry after 368.229938ms: waiting for machine to come up
I0819 19:02:18.211257 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | domain old-k8s-version-104669 has defined MAC address 52:54:00:8c:ff:a3 in network mk-old-k8s-version-104669
I0819 19:02:18.212316 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | unable to find current IP address of domain old-k8s-version-104669 in network mk-old-k8s-version-104669
I0819 19:02:18.212347 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | I0819 19:02:18.212281 431517 retry.go:31] will retry after 362.555152ms: waiting for machine to come up
I0819 19:02:18.577063 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | domain old-k8s-version-104669 has defined MAC address 52:54:00:8c:ff:a3 in network mk-old-k8s-version-104669
I0819 19:02:18.577707 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | unable to find current IP address of domain old-k8s-version-104669 in network mk-old-k8s-version-104669
I0819 19:02:18.577738 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | I0819 19:02:18.577655 431517 retry.go:31] will retry after 526.66832ms: waiting for machine to come up
I0819 19:02:19.106734 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | domain old-k8s-version-104669 has defined MAC address 52:54:00:8c:ff:a3 in network mk-old-k8s-version-104669
I0819 19:02:19.107307 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | unable to find current IP address of domain old-k8s-version-104669 in network mk-old-k8s-version-104669
I0819 19:02:19.107334 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | I0819 19:02:19.107260 431517 retry.go:31] will retry after 477.301708ms: waiting for machine to come up
I0819 19:02:19.585731 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | domain old-k8s-version-104669 has defined MAC address 52:54:00:8c:ff:a3 in network mk-old-k8s-version-104669
I0819 19:02:19.586203 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | unable to find current IP address of domain old-k8s-version-104669 in network mk-old-k8s-version-104669
I0819 19:02:19.586234 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | I0819 19:02:19.586166 431517 retry.go:31] will retry after 914.671525ms: waiting for machine to come up
I0819 19:02:20.503135 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | domain old-k8s-version-104669 has defined MAC address 52:54:00:8c:ff:a3 in network mk-old-k8s-version-104669
I0819 19:02:20.503969 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | unable to find current IP address of domain old-k8s-version-104669 in network mk-old-k8s-version-104669
I0819 19:02:20.504004 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | I0819 19:02:20.503908 431517 retry.go:31] will retry after 768.418836ms: waiting for machine to come up
I0819 19:02:21.275830 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | domain old-k8s-version-104669 has defined MAC address 52:54:00:8c:ff:a3 in network mk-old-k8s-version-104669
I0819 19:02:21.275871 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | unable to find current IP address of domain old-k8s-version-104669 in network mk-old-k8s-version-104669
I0819 19:02:21.275885 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | I0819 19:02:21.274536 431517 retry.go:31] will retry after 1.377092431s: waiting for machine to come up
I0819 19:02:22.653159 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | domain old-k8s-version-104669 has defined MAC address 52:54:00:8c:ff:a3 in network mk-old-k8s-version-104669
I0819 19:02:22.653712 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | unable to find current IP address of domain old-k8s-version-104669 in network mk-old-k8s-version-104669
I0819 19:02:22.653740 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | I0819 19:02:22.653656 431517 retry.go:31] will retry after 1.290834241s: waiting for machine to come up
I0819 19:02:23.946081 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | domain old-k8s-version-104669 has defined MAC address 52:54:00:8c:ff:a3 in network mk-old-k8s-version-104669
I0819 19:02:23.946568 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | unable to find current IP address of domain old-k8s-version-104669 in network mk-old-k8s-version-104669
I0819 19:02:23.946600 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | I0819 19:02:23.946505 431517 retry.go:31] will retry after 2.319921189s: waiting for machine to come up
I0819 19:02:26.267887 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | domain old-k8s-version-104669 has defined MAC address 52:54:00:8c:ff:a3 in network mk-old-k8s-version-104669
I0819 19:02:26.268553 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | unable to find current IP address of domain old-k8s-version-104669 in network mk-old-k8s-version-104669
I0819 19:02:26.268584 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | I0819 19:02:26.268467 431517 retry.go:31] will retry after 2.756634216s: waiting for machine to come up
I0819 19:02:29.026626 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | domain old-k8s-version-104669 has defined MAC address 52:54:00:8c:ff:a3 in network mk-old-k8s-version-104669
I0819 19:02:29.027250 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | unable to find current IP address of domain old-k8s-version-104669 in network mk-old-k8s-version-104669
I0819 19:02:29.027275 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | I0819 19:02:29.027190 431517 retry.go:31] will retry after 3.512615559s: waiting for machine to come up
I0819 19:02:32.938013 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | domain old-k8s-version-104669 has defined MAC address 52:54:00:8c:ff:a3 in network mk-old-k8s-version-104669
I0819 19:02:32.938601 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | unable to find current IP address of domain old-k8s-version-104669 in network mk-old-k8s-version-104669
I0819 19:02:32.938631 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | I0819 19:02:32.938547 431517 retry.go:31] will retry after 4.063996441s: waiting for machine to come up
I0819 19:02:37.004864 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | domain old-k8s-version-104669 has defined MAC address 52:54:00:8c:ff:a3 in network mk-old-k8s-version-104669
I0819 19:02:37.005444 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | unable to find current IP address of domain old-k8s-version-104669 in network mk-old-k8s-version-104669
I0819 19:02:37.005483 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | I0819 19:02:37.005377 431517 retry.go:31] will retry after 4.135723056s: waiting for machine to come up
I0819 19:02:41.142323 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | domain old-k8s-version-104669 has defined MAC address 52:54:00:8c:ff:a3 in network mk-old-k8s-version-104669
I0819 19:02:41.142905 431169 main.go:141] libmachine: (old-k8s-version-104669) Found IP for machine: 192.168.50.32
I0819 19:02:41.142934 431169 main.go:141] libmachine: (old-k8s-version-104669) Reserving static IP address...
I0819 19:02:41.142951 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | domain old-k8s-version-104669 has current primary IP address 192.168.50.32 and MAC address 52:54:00:8c:ff:a3 in network mk-old-k8s-version-104669
I0819 19:02:41.143258 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-104669", mac: "52:54:00:8c:ff:a3", ip: "192.168.50.32"} in network mk-old-k8s-version-104669
I0819 19:02:41.231709 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | Getting to WaitForSSH function...
I0819 19:02:41.231760 431169 main.go:141] libmachine: (old-k8s-version-104669) Reserved static IP address: 192.168.50.32
I0819 19:02:41.231775 431169 main.go:141] libmachine: (old-k8s-version-104669) Waiting for SSH to be available...
I0819 19:02:41.234888 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | domain old-k8s-version-104669 has defined MAC address 52:54:00:8c:ff:a3 in network mk-old-k8s-version-104669
I0819 19:02:41.235309 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | unable to find host DHCP lease matching {name: "", mac: "52:54:00:8c:ff:a3", ip: ""} in network mk-old-k8s-version-104669
I0819 19:02:41.235339 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | unable to find defined IP address of network mk-old-k8s-version-104669 interface with MAC address 52:54:00:8c:ff:a3
I0819 19:02:41.235521 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | Using SSH client type: external
I0819 19:02:41.235571 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | Using SSH private key: /home/jenkins/minikube-integration/19468-372744/.minikube/machines/old-k8s-version-104669/id_rsa (-rw-------)
I0819 19:02:41.235615 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@ -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19468-372744/.minikube/machines/old-k8s-version-104669/id_rsa -p 22] /usr/bin/ssh <nil>}
I0819 19:02:41.235643 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | About to run SSH command:
I0819 19:02:41.235661 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | exit 0
I0819 19:02:41.239557 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | SSH cmd err, output: exit status 255:
I0819 19:02:41.239596 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | Error getting ssh command 'exit 0' : ssh command error:
I0819 19:02:41.239615 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | command : exit 0
I0819 19:02:41.239627 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | err : exit status 255
I0819 19:02:41.239638 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | output :
I0819 19:02:44.239930 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | Getting to WaitForSSH function...
I0819 19:02:44.242914 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | domain old-k8s-version-104669 has defined MAC address 52:54:00:8c:ff:a3 in network mk-old-k8s-version-104669
I0819 19:02:44.243458 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:8c:ff:a3", ip: ""} in network mk-old-k8s-version-104669: {Iface:virbr2 ExpiryTime:2024-08-19 20:02:32 +0000 UTC Type:0 Mac:52:54:00:8c:ff:a3 Iaid: IPaddr:192.168.50.32 Prefix:24 Hostname:old-k8s-version-104669 Clientid:01:52:54:00:8c:ff:a3}
I0819 19:02:44.243493 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | domain old-k8s-version-104669 has defined IP address 192.168.50.32 and MAC address 52:54:00:8c:ff:a3 in network mk-old-k8s-version-104669
I0819 19:02:44.243693 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | Using SSH client type: external
I0819 19:02:44.243720 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | Using SSH private key: /home/jenkins/minikube-integration/19468-372744/.minikube/machines/old-k8s-version-104669/id_rsa (-rw-------)
I0819 19:02:44.243771 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.50.32 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19468-372744/.minikube/machines/old-k8s-version-104669/id_rsa -p 22] /usr/bin/ssh <nil>}
I0819 19:02:44.243798 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | About to run SSH command:
I0819 19:02:44.243817 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | exit 0
I0819 19:02:44.385104 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | SSH cmd err, output: <nil>:
I0819 19:02:44.385459 431169 main.go:141] libmachine: (old-k8s-version-104669) KVM machine creation complete!
I0819 19:02:44.385812 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetConfigRaw
I0819 19:02:44.386498 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .DriverName
I0819 19:02:44.386717 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .DriverName
I0819 19:02:44.386949 431169 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0819 19:02:44.386970 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetState
I0819 19:02:44.388298 431169 main.go:141] libmachine: Detecting operating system of created instance...
I0819 19:02:44.388315 431169 main.go:141] libmachine: Waiting for SSH to be available...
I0819 19:02:44.388323 431169 main.go:141] libmachine: Getting to WaitForSSH function...
I0819 19:02:44.388332 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetSSHHostname
I0819 19:02:44.390981 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | domain old-k8s-version-104669 has defined MAC address 52:54:00:8c:ff:a3 in network mk-old-k8s-version-104669
I0819 19:02:44.391386 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:8c:ff:a3", ip: ""} in network mk-old-k8s-version-104669: {Iface:virbr2 ExpiryTime:2024-08-19 20:02:32 +0000 UTC Type:0 Mac:52:54:00:8c:ff:a3 Iaid: IPaddr:192.168.50.32 Prefix:24 Hostname:old-k8s-version-104669 Clientid:01:52:54:00:8c:ff:a3}
I0819 19:02:44.391425 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | domain old-k8s-version-104669 has defined IP address 192.168.50.32 and MAC address 52:54:00:8c:ff:a3 in network mk-old-k8s-version-104669
I0819 19:02:44.391705 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetSSHPort
I0819 19:02:44.391923 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetSSHKeyPath
I0819 19:02:44.392113 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetSSHKeyPath
I0819 19:02:44.392279 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetSSHUsername
I0819 19:02:44.392467 431169 main.go:141] libmachine: Using SSH client type: native
I0819 19:02:44.392689 431169 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.50.32 22 <nil> <nil>}
I0819 19:02:44.392703 431169 main.go:141] libmachine: About to run SSH command:
exit 0
I0819 19:02:44.511242 431169 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0819 19:02:44.511275 431169 main.go:141] libmachine: Detecting the provisioner...
I0819 19:02:44.511287 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetSSHHostname
I0819 19:02:44.514049 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | domain old-k8s-version-104669 has defined MAC address 52:54:00:8c:ff:a3 in network mk-old-k8s-version-104669
I0819 19:02:44.514456 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:8c:ff:a3", ip: ""} in network mk-old-k8s-version-104669: {Iface:virbr2 ExpiryTime:2024-08-19 20:02:32 +0000 UTC Type:0 Mac:52:54:00:8c:ff:a3 Iaid: IPaddr:192.168.50.32 Prefix:24 Hostname:old-k8s-version-104669 Clientid:01:52:54:00:8c:ff:a3}
I0819 19:02:44.514486 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | domain old-k8s-version-104669 has defined IP address 192.168.50.32 and MAC address 52:54:00:8c:ff:a3 in network mk-old-k8s-version-104669
I0819 19:02:44.514703 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetSSHPort
I0819 19:02:44.514886 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetSSHKeyPath
I0819 19:02:44.515049 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetSSHKeyPath
I0819 19:02:44.515245 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetSSHUsername
I0819 19:02:44.515414 431169 main.go:141] libmachine: Using SSH client type: native
I0819 19:02:44.515607 431169 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.50.32 22 <nil> <nil>}
I0819 19:02:44.515620 431169 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0819 19:02:44.633270 431169 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0819 19:02:44.633338 431169 main.go:141] libmachine: found compatible host: buildroot
I0819 19:02:44.633348 431169 main.go:141] libmachine: Provisioning with buildroot...
I0819 19:02:44.633359 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetMachineName
I0819 19:02:44.633651 431169 buildroot.go:166] provisioning hostname "old-k8s-version-104669"
I0819 19:02:44.633683 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetMachineName
I0819 19:02:44.633937 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetSSHHostname
I0819 19:02:44.637055 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | domain old-k8s-version-104669 has defined MAC address 52:54:00:8c:ff:a3 in network mk-old-k8s-version-104669
I0819 19:02:44.637432 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:8c:ff:a3", ip: ""} in network mk-old-k8s-version-104669: {Iface:virbr2 ExpiryTime:2024-08-19 20:02:32 +0000 UTC Type:0 Mac:52:54:00:8c:ff:a3 Iaid: IPaddr:192.168.50.32 Prefix:24 Hostname:old-k8s-version-104669 Clientid:01:52:54:00:8c:ff:a3}
I0819 19:02:44.637468 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | domain old-k8s-version-104669 has defined IP address 192.168.50.32 and MAC address 52:54:00:8c:ff:a3 in network mk-old-k8s-version-104669
I0819 19:02:44.637749 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetSSHPort
I0819 19:02:44.637932 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetSSHKeyPath
I0819 19:02:44.638097 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetSSHKeyPath
I0819 19:02:44.638267 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetSSHUsername
I0819 19:02:44.638407 431169 main.go:141] libmachine: Using SSH client type: native
I0819 19:02:44.638644 431169 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.50.32 22 <nil> <nil>}
I0819 19:02:44.638661 431169 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-104669 && echo "old-k8s-version-104669" | sudo tee /etc/hostname
I0819 19:02:44.767020 431169 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-104669
I0819 19:02:44.767052 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetSSHHostname
I0819 19:02:44.770053 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | domain old-k8s-version-104669 has defined MAC address 52:54:00:8c:ff:a3 in network mk-old-k8s-version-104669
I0819 19:02:44.770372 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:8c:ff:a3", ip: ""} in network mk-old-k8s-version-104669: {Iface:virbr2 ExpiryTime:2024-08-19 20:02:32 +0000 UTC Type:0 Mac:52:54:00:8c:ff:a3 Iaid: IPaddr:192.168.50.32 Prefix:24 Hostname:old-k8s-version-104669 Clientid:01:52:54:00:8c:ff:a3}
I0819 19:02:44.770403 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | domain old-k8s-version-104669 has defined IP address 192.168.50.32 and MAC address 52:54:00:8c:ff:a3 in network mk-old-k8s-version-104669
I0819 19:02:44.770594 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetSSHPort
I0819 19:02:44.770775 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetSSHKeyPath
I0819 19:02:44.770939 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetSSHKeyPath
I0819 19:02:44.771045 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetSSHUsername
I0819 19:02:44.771243 431169 main.go:141] libmachine: Using SSH client type: native
I0819 19:02:44.771422 431169 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.50.32 22 <nil> <nil>}
I0819 19:02:44.771445 431169 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-104669' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-104669/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-104669' | sudo tee -a /etc/hosts;
fi
fi
I0819 19:02:44.893306 431169 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0819 19:02:44.893342 431169 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19468-372744/.minikube CaCertPath:/home/jenkins/minikube-integration/19468-372744/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19468-372744/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19468-372744/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19468-372744/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19468-372744/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19468-372744/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19468-372744/.minikube}
I0819 19:02:44.893392 431169 buildroot.go:174] setting up certificates
I0819 19:02:44.893405 431169 provision.go:84] configureAuth start
I0819 19:02:44.893417 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetMachineName
I0819 19:02:44.893704 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetIP
I0819 19:02:44.896387 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | domain old-k8s-version-104669 has defined MAC address 52:54:00:8c:ff:a3 in network mk-old-k8s-version-104669
I0819 19:02:44.896724 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:8c:ff:a3", ip: ""} in network mk-old-k8s-version-104669: {Iface:virbr2 ExpiryTime:2024-08-19 20:02:32 +0000 UTC Type:0 Mac:52:54:00:8c:ff:a3 Iaid: IPaddr:192.168.50.32 Prefix:24 Hostname:old-k8s-version-104669 Clientid:01:52:54:00:8c:ff:a3}
I0819 19:02:44.896747 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | domain old-k8s-version-104669 has defined IP address 192.168.50.32 and MAC address 52:54:00:8c:ff:a3 in network mk-old-k8s-version-104669
I0819 19:02:44.896878 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetSSHHostname
I0819 19:02:44.899586 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | domain old-k8s-version-104669 has defined MAC address 52:54:00:8c:ff:a3 in network mk-old-k8s-version-104669
I0819 19:02:44.899946 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:8c:ff:a3", ip: ""} in network mk-old-k8s-version-104669: {Iface:virbr2 ExpiryTime:2024-08-19 20:02:32 +0000 UTC Type:0 Mac:52:54:00:8c:ff:a3 Iaid: IPaddr:192.168.50.32 Prefix:24 Hostname:old-k8s-version-104669 Clientid:01:52:54:00:8c:ff:a3}
I0819 19:02:44.899975 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | domain old-k8s-version-104669 has defined IP address 192.168.50.32 and MAC address 52:54:00:8c:ff:a3 in network mk-old-k8s-version-104669
I0819 19:02:44.900117 431169 provision.go:143] copyHostCerts
I0819 19:02:44.900179 431169 exec_runner.go:144] found /home/jenkins/minikube-integration/19468-372744/.minikube/key.pem, removing ...
I0819 19:02:44.900196 431169 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19468-372744/.minikube/key.pem
I0819 19:02:44.900255 431169 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19468-372744/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19468-372744/.minikube/key.pem (1675 bytes)
I0819 19:02:44.900399 431169 exec_runner.go:144] found /home/jenkins/minikube-integration/19468-372744/.minikube/ca.pem, removing ...
I0819 19:02:44.900411 431169 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19468-372744/.minikube/ca.pem
I0819 19:02:44.900434 431169 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19468-372744/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19468-372744/.minikube/ca.pem (1082 bytes)
I0819 19:02:44.900504 431169 exec_runner.go:144] found /home/jenkins/minikube-integration/19468-372744/.minikube/cert.pem, removing ...
I0819 19:02:44.900512 431169 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19468-372744/.minikube/cert.pem
I0819 19:02:44.900530 431169 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19468-372744/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19468-372744/.minikube/cert.pem (1123 bytes)
I0819 19:02:44.900585 431169 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19468-372744/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19468-372744/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19468-372744/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-104669 san=[127.0.0.1 192.168.50.32 localhost minikube old-k8s-version-104669]
I0819 19:02:45.019651 431169 provision.go:177] copyRemoteCerts
I0819 19:02:45.019728 431169 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0819 19:02:45.019755 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetSSHHostname
I0819 19:02:45.022412 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | domain old-k8s-version-104669 has defined MAC address 52:54:00:8c:ff:a3 in network mk-old-k8s-version-104669
I0819 19:02:45.022715 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:8c:ff:a3", ip: ""} in network mk-old-k8s-version-104669: {Iface:virbr2 ExpiryTime:2024-08-19 20:02:32 +0000 UTC Type:0 Mac:52:54:00:8c:ff:a3 Iaid: IPaddr:192.168.50.32 Prefix:24 Hostname:old-k8s-version-104669 Clientid:01:52:54:00:8c:ff:a3}
I0819 19:02:45.022749 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | domain old-k8s-version-104669 has defined IP address 192.168.50.32 and MAC address 52:54:00:8c:ff:a3 in network mk-old-k8s-version-104669
I0819 19:02:45.022923 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetSSHPort
I0819 19:02:45.023155 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetSSHKeyPath
I0819 19:02:45.023416 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetSSHUsername
I0819 19:02:45.023585 431169 sshutil.go:53] new ssh client: &{IP:192.168.50.32 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19468-372744/.minikube/machines/old-k8s-version-104669/id_rsa Username:docker}
I0819 19:02:45.110648 431169 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19468-372744/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0819 19:02:45.136744 431169 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19468-372744/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0819 19:02:45.161150 431169 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19468-372744/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0819 19:02:45.185464 431169 provision.go:87] duration metric: took 292.041631ms to configureAuth
I0819 19:02:45.185502 431169 buildroot.go:189] setting minikube options for container-runtime
I0819 19:02:45.185685 431169 config.go:182] Loaded profile config "old-k8s-version-104669": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0819 19:02:45.185773 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetSSHHostname
I0819 19:02:45.188912 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | domain old-k8s-version-104669 has defined MAC address 52:54:00:8c:ff:a3 in network mk-old-k8s-version-104669
I0819 19:02:45.189253 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:8c:ff:a3", ip: ""} in network mk-old-k8s-version-104669: {Iface:virbr2 ExpiryTime:2024-08-19 20:02:32 +0000 UTC Type:0 Mac:52:54:00:8c:ff:a3 Iaid: IPaddr:192.168.50.32 Prefix:24 Hostname:old-k8s-version-104669 Clientid:01:52:54:00:8c:ff:a3}
I0819 19:02:45.189298 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | domain old-k8s-version-104669 has defined IP address 192.168.50.32 and MAC address 52:54:00:8c:ff:a3 in network mk-old-k8s-version-104669
I0819 19:02:45.189489 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetSSHPort
I0819 19:02:45.189693 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetSSHKeyPath
I0819 19:02:45.189819 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetSSHKeyPath
I0819 19:02:45.190007 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetSSHUsername
I0819 19:02:45.190181 431169 main.go:141] libmachine: Using SSH client type: native
I0819 19:02:45.190352 431169 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.50.32 22 <nil> <nil>}
I0819 19:02:45.190366 431169 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0819 19:02:45.469864 431169 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0819 19:02:45.469900 431169 main.go:141] libmachine: Checking connection to Docker...
I0819 19:02:45.469913 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetURL
I0819 19:02:45.471351 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | Using libvirt version 6000000
I0819 19:02:45.473713 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | domain old-k8s-version-104669 has defined MAC address 52:54:00:8c:ff:a3 in network mk-old-k8s-version-104669
I0819 19:02:45.474081 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:8c:ff:a3", ip: ""} in network mk-old-k8s-version-104669: {Iface:virbr2 ExpiryTime:2024-08-19 20:02:32 +0000 UTC Type:0 Mac:52:54:00:8c:ff:a3 Iaid: IPaddr:192.168.50.32 Prefix:24 Hostname:old-k8s-version-104669 Clientid:01:52:54:00:8c:ff:a3}
I0819 19:02:45.474114 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | domain old-k8s-version-104669 has defined IP address 192.168.50.32 and MAC address 52:54:00:8c:ff:a3 in network mk-old-k8s-version-104669
I0819 19:02:45.474271 431169 main.go:141] libmachine: Docker is up and running!
I0819 19:02:45.474291 431169 main.go:141] libmachine: Reticulating splines...
I0819 19:02:45.474300 431169 client.go:171] duration metric: took 29.78320122s to LocalClient.Create
I0819 19:02:45.474327 431169 start.go:167] duration metric: took 29.783261134s to libmachine.API.Create "old-k8s-version-104669"
I0819 19:02:45.474337 431169 start.go:293] postStartSetup for "old-k8s-version-104669" (driver="kvm2")
I0819 19:02:45.474348 431169 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0819 19:02:45.474376 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .DriverName
I0819 19:02:45.474633 431169 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0819 19:02:45.474659 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetSSHHostname
I0819 19:02:45.477170 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | domain old-k8s-version-104669 has defined MAC address 52:54:00:8c:ff:a3 in network mk-old-k8s-version-104669
I0819 19:02:45.477479 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:8c:ff:a3", ip: ""} in network mk-old-k8s-version-104669: {Iface:virbr2 ExpiryTime:2024-08-19 20:02:32 +0000 UTC Type:0 Mac:52:54:00:8c:ff:a3 Iaid: IPaddr:192.168.50.32 Prefix:24 Hostname:old-k8s-version-104669 Clientid:01:52:54:00:8c:ff:a3}
I0819 19:02:45.477512 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | domain old-k8s-version-104669 has defined IP address 192.168.50.32 and MAC address 52:54:00:8c:ff:a3 in network mk-old-k8s-version-104669
I0819 19:02:45.477653 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetSSHPort
I0819 19:02:45.477828 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetSSHKeyPath
I0819 19:02:45.478009 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetSSHUsername
I0819 19:02:45.478136 431169 sshutil.go:53] new ssh client: &{IP:192.168.50.32 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19468-372744/.minikube/machines/old-k8s-version-104669/id_rsa Username:docker}
I0819 19:02:45.566843 431169 ssh_runner.go:195] Run: cat /etc/os-release
I0819 19:02:45.571257 431169 info.go:137] Remote host: Buildroot 2023.02.9
I0819 19:02:45.571284 431169 filesync.go:126] Scanning /home/jenkins/minikube-integration/19468-372744/.minikube/addons for local assets ...
I0819 19:02:45.571344 431169 filesync.go:126] Scanning /home/jenkins/minikube-integration/19468-372744/.minikube/files for local assets ...
I0819 19:02:45.571416 431169 filesync.go:149] local asset: /home/jenkins/minikube-integration/19468-372744/.minikube/files/etc/ssl/certs/3800092.pem -> 3800092.pem in /etc/ssl/certs
I0819 19:02:45.571514 431169 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0819 19:02:45.580862 431169 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19468-372744/.minikube/files/etc/ssl/certs/3800092.pem --> /etc/ssl/certs/3800092.pem (1708 bytes)
I0819 19:02:45.606651 431169 start.go:296] duration metric: took 132.294733ms for postStartSetup
I0819 19:02:45.606725 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetConfigRaw
I0819 19:02:45.607338 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetIP
I0819 19:02:45.610223 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | domain old-k8s-version-104669 has defined MAC address 52:54:00:8c:ff:a3 in network mk-old-k8s-version-104669
I0819 19:02:45.610582 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:8c:ff:a3", ip: ""} in network mk-old-k8s-version-104669: {Iface:virbr2 ExpiryTime:2024-08-19 20:02:32 +0000 UTC Type:0 Mac:52:54:00:8c:ff:a3 Iaid: IPaddr:192.168.50.32 Prefix:24 Hostname:old-k8s-version-104669 Clientid:01:52:54:00:8c:ff:a3}
I0819 19:02:45.610605 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | domain old-k8s-version-104669 has defined IP address 192.168.50.32 and MAC address 52:54:00:8c:ff:a3 in network mk-old-k8s-version-104669
I0819 19:02:45.610876 431169 profile.go:143] Saving config to /home/jenkins/minikube-integration/19468-372744/.minikube/profiles/old-k8s-version-104669/config.json ...
I0819 19:02:45.611087 431169 start.go:128] duration metric: took 29.946081493s to createHost
I0819 19:02:45.611115 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetSSHHostname
I0819 19:02:45.613395 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | domain old-k8s-version-104669 has defined MAC address 52:54:00:8c:ff:a3 in network mk-old-k8s-version-104669
I0819 19:02:45.613720 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:8c:ff:a3", ip: ""} in network mk-old-k8s-version-104669: {Iface:virbr2 ExpiryTime:2024-08-19 20:02:32 +0000 UTC Type:0 Mac:52:54:00:8c:ff:a3 Iaid: IPaddr:192.168.50.32 Prefix:24 Hostname:old-k8s-version-104669 Clientid:01:52:54:00:8c:ff:a3}
I0819 19:02:45.613748 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | domain old-k8s-version-104669 has defined IP address 192.168.50.32 and MAC address 52:54:00:8c:ff:a3 in network mk-old-k8s-version-104669
I0819 19:02:45.613947 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetSSHPort
I0819 19:02:45.614186 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetSSHKeyPath
I0819 19:02:45.614385 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetSSHKeyPath
I0819 19:02:45.614527 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetSSHUsername
I0819 19:02:45.614687 431169 main.go:141] libmachine: Using SSH client type: native
I0819 19:02:45.614945 431169 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.50.32 22 <nil> <nil>}
I0819 19:02:45.614963 431169 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0819 19:02:45.732736 431169 main.go:141] libmachine: SSH cmd err, output: <nil>: 1724094165.710733372
I0819 19:02:45.732765 431169 fix.go:216] guest clock: 1724094165.710733372
I0819 19:02:45.732775 431169 fix.go:229] Guest: 2024-08-19 19:02:45.710733372 +0000 UTC Remote: 2024-08-19 19:02:45.611100575 +0000 UTC m=+47.945196205 (delta=99.632797ms)
I0819 19:02:45.732818 431169 fix.go:200] guest clock delta is within tolerance: 99.632797ms
I0819 19:02:45.732823 431169 start.go:83] releasing machines lock for "old-k8s-version-104669", held for 30.068015637s
I0819 19:02:45.732851 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .DriverName
I0819 19:02:45.733140 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetIP
I0819 19:02:45.736117 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | domain old-k8s-version-104669 has defined MAC address 52:54:00:8c:ff:a3 in network mk-old-k8s-version-104669
I0819 19:02:45.736473 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:8c:ff:a3", ip: ""} in network mk-old-k8s-version-104669: {Iface:virbr2 ExpiryTime:2024-08-19 20:02:32 +0000 UTC Type:0 Mac:52:54:00:8c:ff:a3 Iaid: IPaddr:192.168.50.32 Prefix:24 Hostname:old-k8s-version-104669 Clientid:01:52:54:00:8c:ff:a3}
I0819 19:02:45.736503 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | domain old-k8s-version-104669 has defined IP address 192.168.50.32 and MAC address 52:54:00:8c:ff:a3 in network mk-old-k8s-version-104669
I0819 19:02:45.736726 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .DriverName
I0819 19:02:45.737366 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .DriverName
I0819 19:02:45.737552 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .DriverName
I0819 19:02:45.737665 431169 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0819 19:02:45.737718 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetSSHHostname
I0819 19:02:45.737836 431169 ssh_runner.go:195] Run: cat /version.json
I0819 19:02:45.737865 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetSSHHostname
I0819 19:02:45.740790 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | domain old-k8s-version-104669 has defined MAC address 52:54:00:8c:ff:a3 in network mk-old-k8s-version-104669
I0819 19:02:45.740967 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | domain old-k8s-version-104669 has defined MAC address 52:54:00:8c:ff:a3 in network mk-old-k8s-version-104669
I0819 19:02:45.741139 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:8c:ff:a3", ip: ""} in network mk-old-k8s-version-104669: {Iface:virbr2 ExpiryTime:2024-08-19 20:02:32 +0000 UTC Type:0 Mac:52:54:00:8c:ff:a3 Iaid: IPaddr:192.168.50.32 Prefix:24 Hostname:old-k8s-version-104669 Clientid:01:52:54:00:8c:ff:a3}
I0819 19:02:45.741168 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | domain old-k8s-version-104669 has defined IP address 192.168.50.32 and MAC address 52:54:00:8c:ff:a3 in network mk-old-k8s-version-104669
I0819 19:02:45.741317 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetSSHPort
I0819 19:02:45.741327 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:8c:ff:a3", ip: ""} in network mk-old-k8s-version-104669: {Iface:virbr2 ExpiryTime:2024-08-19 20:02:32 +0000 UTC Type:0 Mac:52:54:00:8c:ff:a3 Iaid: IPaddr:192.168.50.32 Prefix:24 Hostname:old-k8s-version-104669 Clientid:01:52:54:00:8c:ff:a3}
I0819 19:02:45.741372 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | domain old-k8s-version-104669 has defined IP address 192.168.50.32 and MAC address 52:54:00:8c:ff:a3 in network mk-old-k8s-version-104669
I0819 19:02:45.741490 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetSSHKeyPath
I0819 19:02:45.741550 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetSSHPort
I0819 19:02:45.741630 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetSSHUsername
I0819 19:02:45.741723 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetSSHKeyPath
I0819 19:02:45.741735 431169 sshutil.go:53] new ssh client: &{IP:192.168.50.32 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19468-372744/.minikube/machines/old-k8s-version-104669/id_rsa Username:docker}
I0819 19:02:45.741902 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetSSHUsername
I0819 19:02:45.742039 431169 sshutil.go:53] new ssh client: &{IP:192.168.50.32 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19468-372744/.minikube/machines/old-k8s-version-104669/id_rsa Username:docker}
I0819 19:02:45.848845 431169 ssh_runner.go:195] Run: systemctl --version
I0819 19:02:45.855496 431169 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0819 19:02:46.028635 431169 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0819 19:02:46.035920 431169 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0819 19:02:46.036020 431169 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0819 19:02:46.052944 431169 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0819 19:02:46.052973 431169 start.go:495] detecting cgroup driver to use...
I0819 19:02:46.053053 431169 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0819 19:02:46.071388 431169 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0819 19:02:46.086055 431169 docker.go:217] disabling cri-docker service (if available) ...
I0819 19:02:46.086123 431169 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0819 19:02:46.100706 431169 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0819 19:02:46.115217 431169 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0819 19:02:46.234139 431169 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0819 19:02:46.394046 431169 docker.go:233] disabling docker service ...
I0819 19:02:46.394123 431169 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0819 19:02:46.408698 431169 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0819 19:02:46.423046 431169 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0819 19:02:46.564733 431169 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0819 19:02:46.679697 431169 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0819 19:02:46.697624 431169 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0819 19:02:46.717571 431169 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0819 19:02:46.717630 431169 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0819 19:02:46.729452 431169 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0819 19:02:46.729538 431169 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0819 19:02:46.741112 431169 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0819 19:02:46.752381 431169 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0819 19:02:46.763846 431169 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0819 19:02:46.776650 431169 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0819 19:02:46.786883 431169 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0819 19:02:46.786937 431169 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0819 19:02:46.804269 431169 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0819 19:02:46.814630 431169 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0819 19:02:46.937905 431169 ssh_runner.go:195] Run: sudo systemctl restart crio
I0819 19:02:47.089643 431169 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0819 19:02:47.089727 431169 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0819 19:02:47.094542 431169 start.go:563] Will wait 60s for crictl version
I0819 19:02:47.094608 431169 ssh_runner.go:195] Run: which crictl
I0819 19:02:47.098582 431169 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0819 19:02:47.145695 431169 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0819 19:02:47.145787 431169 ssh_runner.go:195] Run: crio --version
I0819 19:02:47.173900 431169 ssh_runner.go:195] Run: crio --version
I0819 19:02:47.205467 431169 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0819 19:02:47.206857 431169 main.go:141] libmachine: (old-k8s-version-104669) Calling .GetIP
I0819 19:02:47.210049 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | domain old-k8s-version-104669 has defined MAC address 52:54:00:8c:ff:a3 in network mk-old-k8s-version-104669
I0819 19:02:47.210538 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:8c:ff:a3", ip: ""} in network mk-old-k8s-version-104669: {Iface:virbr2 ExpiryTime:2024-08-19 20:02:32 +0000 UTC Type:0 Mac:52:54:00:8c:ff:a3 Iaid: IPaddr:192.168.50.32 Prefix:24 Hostname:old-k8s-version-104669 Clientid:01:52:54:00:8c:ff:a3}
I0819 19:02:47.210566 431169 main.go:141] libmachine: (old-k8s-version-104669) DBG | domain old-k8s-version-104669 has defined IP address 192.168.50.32 and MAC address 52:54:00:8c:ff:a3 in network mk-old-k8s-version-104669
I0819 19:02:47.210861 431169 ssh_runner.go:195] Run: grep 192.168.50.1 host.minikube.internal$ /etc/hosts
I0819 19:02:47.214947 431169 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.50.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0819 19:02:47.233554 431169 kubeadm.go:883] updating cluster {Name:old-k8s-version-104669 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19452/minikube-v1.33.1-1723740674-19452-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-104669 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.50.32 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mo
untPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0819 19:02:47.233670 431169 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0819 19:02:47.233712 431169 ssh_runner.go:195] Run: sudo crictl images --output json
I0819 19:02:47.273894 431169 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0819 19:02:47.273979 431169 ssh_runner.go:195] Run: which lz4
I0819 19:02:47.279023 431169 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0819 19:02:47.283977 431169 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0819 19:02:47.284011 431169 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19468-372744/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0819 19:02:49.008819 431169 crio.go:462] duration metric: took 1.729827884s to copy over tarball
I0819 19:02:49.008976 431169 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0819 19:02:51.980376 431169 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.971359868s)
I0819 19:02:51.980411 431169 crio.go:469] duration metric: took 2.971551956s to extract the tarball
I0819 19:02:51.980422 431169 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0819 19:02:52.043708 431169 ssh_runner.go:195] Run: sudo crictl images --output json
I0819 19:02:52.141120 431169 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0819 19:02:52.141153 431169 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0819 19:02:52.141238 431169 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0819 19:02:52.141268 431169 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0819 19:02:52.141278 431169 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0819 19:02:52.141300 431169 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0819 19:02:52.141270 431169 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0819 19:02:52.141359 431169 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I0819 19:02:52.141242 431169 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0819 19:02:52.141528 431169 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I0819 19:02:52.143278 431169 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0819 19:02:52.143318 431169 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0819 19:02:52.143323 431169 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0819 19:02:52.143321 431169 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0819 19:02:52.143367 431169 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0819 19:02:52.143411 431169 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0819 19:02:52.143519 431169 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0819 19:02:52.143555 431169 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0819 19:02:52.286466 431169 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0819 19:02:52.332079 431169 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0819 19:02:52.332145 431169 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0819 19:02:52.332198 431169 ssh_runner.go:195] Run: which crictl
I0819 19:02:52.338128 431169 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0819 19:02:52.372713 431169 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0819 19:02:52.382369 431169 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0819 19:02:52.454664 431169 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0819 19:02:52.454798 431169 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0819 19:02:52.454833 431169 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0819 19:02:52.454865 431169 ssh_runner.go:195] Run: which crictl
I0819 19:02:52.459835 431169 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0819 19:02:52.482903 431169 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0819 19:02:52.487052 431169 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0819 19:02:52.487085 431169 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0819 19:02:52.497084 431169 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0819 19:02:52.526201 431169 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19468-372744/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0819 19:02:52.531659 431169 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0819 19:02:52.560734 431169 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0819 19:02:52.705378 431169 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0819 19:02:52.705404 431169 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0819 19:02:52.705426 431169 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0819 19:02:52.705426 431169 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0819 19:02:52.705468 431169 ssh_runner.go:195] Run: which crictl
I0819 19:02:52.705468 431169 ssh_runner.go:195] Run: which crictl
I0819 19:02:52.714325 431169 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0819 19:02:52.714370 431169 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0819 19:02:52.714416 431169 ssh_runner.go:195] Run: which crictl
I0819 19:02:52.726619 431169 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0819 19:02:52.726666 431169 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0819 19:02:52.726720 431169 ssh_runner.go:195] Run: which crictl
I0819 19:02:52.726826 431169 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0819 19:02:52.726849 431169 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0819 19:02:52.726851 431169 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0819 19:02:52.726919 431169 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0819 19:02:52.726925 431169 ssh_runner.go:195] Run: which crictl
I0819 19:02:52.726982 431169 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0819 19:02:52.727042 431169 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0819 19:02:52.814581 431169 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0819 19:02:52.814694 431169 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0819 19:02:52.832823 431169 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0819 19:02:52.832966 431169 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0819 19:02:52.833031 431169 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19468-372744/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0819 19:02:52.833234 431169 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0819 19:02:52.912897 431169 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0819 19:02:52.932295 431169 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0819 19:02:52.955152 431169 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0819 19:02:52.955229 431169 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0819 19:02:52.965972 431169 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0819 19:02:53.022031 431169 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19468-372744/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0819 19:02:53.058501 431169 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0819 19:02:53.088317 431169 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0819 19:02:53.088473 431169 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19468-372744/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0819 19:02:53.090779 431169 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19468-372744/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0819 19:02:53.142107 431169 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19468-372744/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0819 19:02:53.142209 431169 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19468-372744/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0819 19:02:53.148012 431169 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0819 19:02:53.294954 431169 cache_images.go:92] duration metric: took 1.153778154s to LoadCachedImages
W0819 19:02:53.295052 431169 out.go:270] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19468-372744/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19468-372744/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0: no such file or directory
I0819 19:02:53.295069 431169 kubeadm.go:934] updating node { 192.168.50.32 8443 v1.20.0 crio true true} ...
I0819 19:02:53.295242 431169 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-104669 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.50.32
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-104669 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0819 19:02:53.295332 431169 ssh_runner.go:195] Run: crio config
I0819 19:02:53.349097 431169 cni.go:84] Creating CNI manager for ""
I0819 19:02:53.349119 431169 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0819 19:02:53.349131 431169 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0819 19:02:53.349156 431169 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.50.32 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-104669 NodeName:old-k8s-version-104669 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.50.32"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.50.32 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt Stati
cPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0819 19:02:53.349337 431169 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.50.32
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-104669"
kubeletExtraArgs:
node-ip: 192.168.50.32
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.50.32"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0819 19:02:53.349419 431169 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0819 19:02:53.361149 431169 binaries.go:44] Found k8s binaries, skipping transfer
I0819 19:02:53.361221 431169 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0819 19:02:53.372055 431169 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (429 bytes)
I0819 19:02:53.391590 431169 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0819 19:02:53.410780 431169 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2120 bytes)
I0819 19:02:53.430445 431169 ssh_runner.go:195] Run: grep 192.168.50.32 control-plane.minikube.internal$ /etc/hosts
I0819 19:02:53.435255 431169 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.50.32 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0819 19:02:53.448794 431169 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0819 19:02:53.580549 431169 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0819 19:02:53.601645 431169 certs.go:68] Setting up /home/jenkins/minikube-integration/19468-372744/.minikube/profiles/old-k8s-version-104669 for IP: 192.168.50.32
I0819 19:02:53.601676 431169 certs.go:194] generating shared ca certs ...
I0819 19:02:53.601696 431169 certs.go:226] acquiring lock for ca certs: {Name:mk639e03f593e0bccac045f6e9f5ba3b96cc81e9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0819 19:02:53.601835 431169 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19468-372744/.minikube/ca.key
I0819 19:02:53.601889 431169 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19468-372744/.minikube/proxy-client-ca.key
I0819 19:02:53.601901 431169 certs.go:256] generating profile certs ...
I0819 19:02:53.601976 431169 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19468-372744/.minikube/profiles/old-k8s-version-104669/client.key
I0819 19:02:53.602003 431169 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19468-372744/.minikube/profiles/old-k8s-version-104669/client.crt with IP's: []
I0819 19:02:53.884380 431169 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19468-372744/.minikube/profiles/old-k8s-version-104669/client.crt ...
I0819 19:02:53.884416 431169 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19468-372744/.minikube/profiles/old-k8s-version-104669/client.crt: {Name:mk6c401e3df0f25e49c8bc10318125ab025dd14f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0819 19:02:53.884627 431169 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19468-372744/.minikube/profiles/old-k8s-version-104669/client.key ...
I0819 19:02:53.884662 431169 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19468-372744/.minikube/profiles/old-k8s-version-104669/client.key: {Name:mkd0871925f8071f48385dc02a43159f4179be67 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0819 19:02:53.884819 431169 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19468-372744/.minikube/profiles/old-k8s-version-104669/apiserver.key.7101f8a0
I0819 19:02:53.884848 431169 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19468-372744/.minikube/profiles/old-k8s-version-104669/apiserver.crt.7101f8a0 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.50.32]
I0819 19:02:54.032819 431169 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19468-372744/.minikube/profiles/old-k8s-version-104669/apiserver.crt.7101f8a0 ...
I0819 19:02:54.032851 431169 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19468-372744/.minikube/profiles/old-k8s-version-104669/apiserver.crt.7101f8a0: {Name:mke20ce9bcad8da10234e3ce5139e86a4d709987 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0819 19:02:54.033067 431169 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19468-372744/.minikube/profiles/old-k8s-version-104669/apiserver.key.7101f8a0 ...
I0819 19:02:54.033092 431169 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19468-372744/.minikube/profiles/old-k8s-version-104669/apiserver.key.7101f8a0: {Name:mk48686063231d55072873df76da7aa6953afd11 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0819 19:02:54.033225 431169 certs.go:381] copying /home/jenkins/minikube-integration/19468-372744/.minikube/profiles/old-k8s-version-104669/apiserver.crt.7101f8a0 -> /home/jenkins/minikube-integration/19468-372744/.minikube/profiles/old-k8s-version-104669/apiserver.crt
I0819 19:02:54.033371 431169 certs.go:385] copying /home/jenkins/minikube-integration/19468-372744/.minikube/profiles/old-k8s-version-104669/apiserver.key.7101f8a0 -> /home/jenkins/minikube-integration/19468-372744/.minikube/profiles/old-k8s-version-104669/apiserver.key
I0819 19:02:54.033468 431169 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19468-372744/.minikube/profiles/old-k8s-version-104669/proxy-client.key
I0819 19:02:54.033491 431169 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19468-372744/.minikube/profiles/old-k8s-version-104669/proxy-client.crt with IP's: []
I0819 19:02:54.095565 431169 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19468-372744/.minikube/profiles/old-k8s-version-104669/proxy-client.crt ...
I0819 19:02:54.095599 431169 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19468-372744/.minikube/profiles/old-k8s-version-104669/proxy-client.crt: {Name:mk4b100f295ec93e5e66f7a92eb632b4b2734d35 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0819 19:02:54.095808 431169 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19468-372744/.minikube/profiles/old-k8s-version-104669/proxy-client.key ...
I0819 19:02:54.095830 431169 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19468-372744/.minikube/profiles/old-k8s-version-104669/proxy-client.key: {Name:mkff36998df1a9e70aaf9a7db7b3d6a7ba3cb607 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0819 19:02:54.096044 431169 certs.go:484] found cert: /home/jenkins/minikube-integration/19468-372744/.minikube/certs/380009.pem (1338 bytes)
W0819 19:02:54.096084 431169 certs.go:480] ignoring /home/jenkins/minikube-integration/19468-372744/.minikube/certs/380009_empty.pem, impossibly tiny 0 bytes
I0819 19:02:54.096094 431169 certs.go:484] found cert: /home/jenkins/minikube-integration/19468-372744/.minikube/certs/ca-key.pem (1675 bytes)
I0819 19:02:54.096122 431169 certs.go:484] found cert: /home/jenkins/minikube-integration/19468-372744/.minikube/certs/ca.pem (1082 bytes)
I0819 19:02:54.096178 431169 certs.go:484] found cert: /home/jenkins/minikube-integration/19468-372744/.minikube/certs/cert.pem (1123 bytes)
I0819 19:02:54.096204 431169 certs.go:484] found cert: /home/jenkins/minikube-integration/19468-372744/.minikube/certs/key.pem (1675 bytes)
I0819 19:02:54.096241 431169 certs.go:484] found cert: /home/jenkins/minikube-integration/19468-372744/.minikube/files/etc/ssl/certs/3800092.pem (1708 bytes)
I0819 19:02:54.096931 431169 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19468-372744/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0819 19:02:54.131345 431169 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19468-372744/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0819 19:02:54.160478 431169 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19468-372744/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0819 19:02:54.188356 431169 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19468-372744/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0819 19:02:54.233929 431169 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19468-372744/.minikube/profiles/old-k8s-version-104669/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0819 19:02:54.260838 431169 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19468-372744/.minikube/profiles/old-k8s-version-104669/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0819 19:02:54.289301 431169 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19468-372744/.minikube/profiles/old-k8s-version-104669/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0819 19:02:54.321042 431169 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19468-372744/.minikube/profiles/old-k8s-version-104669/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0819 19:02:54.352358 431169 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19468-372744/.minikube/files/etc/ssl/certs/3800092.pem --> /usr/share/ca-certificates/3800092.pem (1708 bytes)
I0819 19:02:54.380895 431169 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19468-372744/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0819 19:02:54.409999 431169 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19468-372744/.minikube/certs/380009.pem --> /usr/share/ca-certificates/380009.pem (1338 bytes)
I0819 19:02:54.435688 431169 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0819 19:02:54.453219 431169 ssh_runner.go:195] Run: openssl version
I0819 19:02:54.459710 431169 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/3800092.pem && ln -fs /usr/share/ca-certificates/3800092.pem /etc/ssl/certs/3800092.pem"
I0819 19:02:54.470275 431169 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/3800092.pem
I0819 19:02:54.474933 431169 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Aug 19 17:56 /usr/share/ca-certificates/3800092.pem
I0819 19:02:54.474988 431169 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/3800092.pem
I0819 19:02:54.482051 431169 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/3800092.pem /etc/ssl/certs/3ec20f2e.0"
I0819 19:02:54.493058 431169 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0819 19:02:54.503924 431169 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0819 19:02:54.509854 431169 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug 19 17:45 /usr/share/ca-certificates/minikubeCA.pem
I0819 19:02:54.509916 431169 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0819 19:02:54.516330 431169 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0819 19:02:54.531224 431169 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/380009.pem && ln -fs /usr/share/ca-certificates/380009.pem /etc/ssl/certs/380009.pem"
I0819 19:02:54.550397 431169 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/380009.pem
I0819 19:02:54.556067 431169 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Aug 19 17:56 /usr/share/ca-certificates/380009.pem
I0819 19:02:54.556132 431169 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/380009.pem
I0819 19:02:54.564932 431169 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/380009.pem /etc/ssl/certs/51391683.0"
I0819 19:02:54.584799 431169 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0819 19:02:54.595215 431169 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0819 19:02:54.595284 431169 kubeadm.go:392] StartCluster: {Name:old-k8s-version-104669 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19452/minikube-v1.33.1-1723740674-19452-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-104669 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.50.32 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0819 19:02:54.595392 431169 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0819 19:02:54.595474 431169 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0819 19:02:54.658279 431169 cri.go:89] found id: ""
I0819 19:02:54.658360 431169 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0819 19:02:54.669789 431169 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0819 19:02:54.680258 431169 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0819 19:02:54.691882 431169 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0819 19:02:54.691906 431169 kubeadm.go:157] found existing configuration files:
I0819 19:02:54.691965 431169 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0819 19:02:54.701857 431169 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0819 19:02:54.701938 431169 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0819 19:02:54.712914 431169 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0819 19:02:54.724237 431169 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0819 19:02:54.724306 431169 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0819 19:02:54.736840 431169 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0819 19:02:54.746786 431169 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0819 19:02:54.746861 431169 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0819 19:02:54.758589 431169 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0819 19:02:54.769764 431169 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0819 19:02:54.769831 431169 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0819 19:02:54.783509 431169 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0819 19:02:55.096863 431169 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0819 19:04:53.429854 431169 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0819 19:04:53.429996 431169 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0819 19:04:53.431462 431169 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0819 19:04:53.431524 431169 kubeadm.go:310] [preflight] Running pre-flight checks
I0819 19:04:53.431702 431169 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0819 19:04:53.431831 431169 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0819 19:04:53.431938 431169 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0819 19:04:53.431996 431169 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0819 19:04:53.433732 431169 out.go:235] - Generating certificates and keys ...
I0819 19:04:53.433813 431169 kubeadm.go:310] [certs] Using existing ca certificate authority
I0819 19:04:53.433870 431169 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0819 19:04:53.433973 431169 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0819 19:04:53.434022 431169 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0819 19:04:53.434073 431169 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0819 19:04:53.434116 431169 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0819 19:04:53.434164 431169 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0819 19:04:53.434359 431169 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-104669] and IPs [192.168.50.32 127.0.0.1 ::1]
I0819 19:04:53.434441 431169 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0819 19:04:53.434588 431169 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-104669] and IPs [192.168.50.32 127.0.0.1 ::1]
I0819 19:04:53.434687 431169 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0819 19:04:53.434784 431169 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0819 19:04:53.434839 431169 kubeadm.go:310] [certs] Generating "sa" key and public key
I0819 19:04:53.434953 431169 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0819 19:04:53.435035 431169 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0819 19:04:53.435115 431169 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0819 19:04:53.435206 431169 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0819 19:04:53.435292 431169 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0819 19:04:53.435420 431169 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0819 19:04:53.435534 431169 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0819 19:04:53.435600 431169 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0819 19:04:53.435702 431169 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0819 19:04:53.437265 431169 out.go:235] - Booting up control plane ...
I0819 19:04:53.437365 431169 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0819 19:04:53.437471 431169 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0819 19:04:53.437568 431169 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0819 19:04:53.437672 431169 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0819 19:04:53.437823 431169 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0819 19:04:53.437891 431169 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0819 19:04:53.437973 431169 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0819 19:04:53.438124 431169 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0819 19:04:53.438177 431169 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0819 19:04:53.438368 431169 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0819 19:04:53.438464 431169 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0819 19:04:53.438658 431169 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0819 19:04:53.438751 431169 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0819 19:04:53.438936 431169 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0819 19:04:53.439028 431169 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0819 19:04:53.439223 431169 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0819 19:04:53.439232 431169 kubeadm.go:310]
I0819 19:04:53.439281 431169 kubeadm.go:310] Unfortunately, an error has occurred:
I0819 19:04:53.439325 431169 kubeadm.go:310] timed out waiting for the condition
I0819 19:04:53.439331 431169 kubeadm.go:310]
I0819 19:04:53.439359 431169 kubeadm.go:310] This error is likely caused by:
I0819 19:04:53.439413 431169 kubeadm.go:310] - The kubelet is not running
I0819 19:04:53.439538 431169 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0819 19:04:53.439550 431169 kubeadm.go:310]
I0819 19:04:53.439637 431169 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0819 19:04:53.439666 431169 kubeadm.go:310] - 'systemctl status kubelet'
I0819 19:04:53.439716 431169 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0819 19:04:53.439724 431169 kubeadm.go:310]
I0819 19:04:53.439827 431169 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0819 19:04:53.439894 431169 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0819 19:04:53.439902 431169 kubeadm.go:310]
I0819 19:04:53.439983 431169 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0819 19:04:53.440064 431169 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0819 19:04:53.440183 431169 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0819 19:04:53.440266 431169 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0819 19:04:53.440274 431169 kubeadm.go:310]
W0819 19:04:53.440414 431169 out.go:270] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-104669] and IPs [192.168.50.32 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-104669] and IPs [192.168.50.32 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-104669] and IPs [192.168.50.32 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-104669] and IPs [192.168.50.32 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0819 19:04:53.440450 431169 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0819 19:04:54.930456 431169 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (1.489969772s)
I0819 19:04:54.930552 431169 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0819 19:04:54.944941 431169 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0819 19:04:54.956420 431169 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0819 19:04:54.956444 431169 kubeadm.go:157] found existing configuration files:
I0819 19:04:54.956500 431169 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0819 19:04:54.968075 431169 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0819 19:04:54.968139 431169 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0819 19:04:54.978183 431169 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0819 19:04:54.988804 431169 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0819 19:04:54.988861 431169 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0819 19:04:54.999591 431169 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0819 19:04:55.010599 431169 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0819 19:04:55.010663 431169 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0819 19:04:55.022296 431169 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0819 19:04:55.032082 431169 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0819 19:04:55.032147 431169 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0819 19:04:55.042603 431169 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0819 19:04:55.126852 431169 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0819 19:04:55.126915 431169 kubeadm.go:310] [preflight] Running pre-flight checks
I0819 19:04:55.274428 431169 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0819 19:04:55.274616 431169 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0819 19:04:55.274783 431169 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0819 19:04:55.485605 431169 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0819 19:04:55.487030 431169 out.go:235] - Generating certificates and keys ...
I0819 19:04:55.487135 431169 kubeadm.go:310] [certs] Using existing ca certificate authority
I0819 19:04:55.487219 431169 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0819 19:04:55.487323 431169 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0819 19:04:55.487393 431169 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0819 19:04:55.487475 431169 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0819 19:04:55.487547 431169 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0819 19:04:55.487625 431169 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0819 19:04:55.487722 431169 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0819 19:04:55.487822 431169 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0819 19:04:55.487944 431169 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0819 19:04:55.488016 431169 kubeadm.go:310] [certs] Using the existing "sa" key
I0819 19:04:55.488103 431169 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0819 19:04:55.852075 431169 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0819 19:04:56.049347 431169 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0819 19:04:56.145301 431169 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0819 19:04:56.262193 431169 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0819 19:04:56.277457 431169 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0819 19:04:56.279428 431169 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0819 19:04:56.279636 431169 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0819 19:04:56.414592 431169 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0819 19:04:56.416389 431169 out.go:235] - Booting up control plane ...
I0819 19:04:56.416534 431169 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0819 19:04:56.431030 431169 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0819 19:04:56.432570 431169 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0819 19:04:56.433453 431169 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0819 19:04:56.435916 431169 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0819 19:05:36.439617 431169 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0819 19:05:36.439874 431169 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0819 19:05:36.440107 431169 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0819 19:05:41.440647 431169 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0819 19:05:41.440857 431169 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0819 19:05:51.440795 431169 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0819 19:05:51.441054 431169 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0819 19:06:11.440220 431169 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0819 19:06:11.440437 431169 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0819 19:06:51.439744 431169 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0819 19:06:51.440004 431169 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0819 19:06:51.440018 431169 kubeadm.go:310]
I0819 19:06:51.440092 431169 kubeadm.go:310] Unfortunately, an error has occurred:
I0819 19:06:51.440169 431169 kubeadm.go:310] timed out waiting for the condition
I0819 19:06:51.440180 431169 kubeadm.go:310]
I0819 19:06:51.440235 431169 kubeadm.go:310] This error is likely caused by:
I0819 19:06:51.440296 431169 kubeadm.go:310] - The kubelet is not running
I0819 19:06:51.440438 431169 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0819 19:06:51.440452 431169 kubeadm.go:310]
I0819 19:06:51.440570 431169 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0819 19:06:51.440650 431169 kubeadm.go:310] - 'systemctl status kubelet'
I0819 19:06:51.440714 431169 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0819 19:06:51.440734 431169 kubeadm.go:310]
I0819 19:06:51.440878 431169 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0819 19:06:51.441003 431169 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0819 19:06:51.441020 431169 kubeadm.go:310]
I0819 19:06:51.441142 431169 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0819 19:06:51.441258 431169 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0819 19:06:51.441364 431169 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0819 19:06:51.441462 431169 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0819 19:06:51.441478 431169 kubeadm.go:310]
I0819 19:06:51.442105 431169 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0819 19:06:51.442222 431169 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0819 19:06:51.442311 431169 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0819 19:06:51.442406 431169 kubeadm.go:394] duration metric: took 3m56.847128616s to StartCluster
I0819 19:06:51.442449 431169 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0819 19:06:51.442503 431169 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0819 19:06:51.484671 431169 cri.go:89] found id: ""
I0819 19:06:51.484717 431169 logs.go:276] 0 containers: []
W0819 19:06:51.484729 431169 logs.go:278] No container was found matching "kube-apiserver"
I0819 19:06:51.484743 431169 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0819 19:06:51.484817 431169 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0819 19:06:51.518455 431169 cri.go:89] found id: ""
I0819 19:06:51.518486 431169 logs.go:276] 0 containers: []
W0819 19:06:51.518497 431169 logs.go:278] No container was found matching "etcd"
I0819 19:06:51.518505 431169 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0819 19:06:51.518572 431169 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0819 19:06:51.553221 431169 cri.go:89] found id: ""
I0819 19:06:51.553256 431169 logs.go:276] 0 containers: []
W0819 19:06:51.553264 431169 logs.go:278] No container was found matching "coredns"
I0819 19:06:51.553272 431169 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0819 19:06:51.553333 431169 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0819 19:06:51.593191 431169 cri.go:89] found id: ""
I0819 19:06:51.593231 431169 logs.go:276] 0 containers: []
W0819 19:06:51.593240 431169 logs.go:278] No container was found matching "kube-scheduler"
I0819 19:06:51.593248 431169 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0819 19:06:51.593303 431169 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0819 19:06:51.628452 431169 cri.go:89] found id: ""
I0819 19:06:51.628486 431169 logs.go:276] 0 containers: []
W0819 19:06:51.628495 431169 logs.go:278] No container was found matching "kube-proxy"
I0819 19:06:51.628502 431169 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0819 19:06:51.628557 431169 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0819 19:06:51.661826 431169 cri.go:89] found id: ""
I0819 19:06:51.661856 431169 logs.go:276] 0 containers: []
W0819 19:06:51.661866 431169 logs.go:278] No container was found matching "kube-controller-manager"
I0819 19:06:51.661874 431169 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0819 19:06:51.661931 431169 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0819 19:06:51.694801 431169 cri.go:89] found id: ""
I0819 19:06:51.694835 431169 logs.go:276] 0 containers: []
W0819 19:06:51.694848 431169 logs.go:278] No container was found matching "kindnet"
I0819 19:06:51.694863 431169 logs.go:123] Gathering logs for dmesg ...
I0819 19:06:51.694879 431169 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0819 19:06:51.708353 431169 logs.go:123] Gathering logs for describe nodes ...
I0819 19:06:51.708383 431169 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0819 19:06:51.839485 431169 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0819 19:06:51.839515 431169 logs.go:123] Gathering logs for CRI-O ...
I0819 19:06:51.839537 431169 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0819 19:06:51.952344 431169 logs.go:123] Gathering logs for container status ...
I0819 19:06:51.952385 431169 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0819 19:06:51.991568 431169 logs.go:123] Gathering logs for kubelet ...
I0819 19:06:51.991611 431169 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0819 19:06:52.039358 431169 out.go:418] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0819 19:06:52.039440 431169 out.go:270] *
*
W0819 19:06:52.039498 431169 out.go:270] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0819 19:06:52.039514 431169 out.go:270] *
*
W0819 19:06:52.040302 431169 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0819 19:06:52.043425 431169 out.go:201]
W0819 19:06:52.045080 431169 out.go:270] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0819 19:06:52.045132 431169 out.go:270] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0819 19:06:52.045162 431169 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0819 19:06:52.046699 431169 out.go:201]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-104669 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-104669 -n old-k8s-version-104669
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-104669 -n old-k8s-version-104669: exit status 6 (233.555608ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0819 19:06:52.322526 437669 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-104669" does not appear in /home/jenkins/minikube-integration/19468-372744/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-104669" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (294.68s)