=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-247539 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-247539 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m36.760300111s)
-- stdout --
* [old-k8s-version-247539] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=19423
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19423-7747/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19423-7747/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-247539" primary control-plane node in "old-k8s-version-247539" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0818 19:57:57.631272 67330 out.go:345] Setting OutFile to fd 1 ...
I0818 19:57:57.631374 67330 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0818 19:57:57.631395 67330 out.go:358] Setting ErrFile to fd 2...
I0818 19:57:57.631402 67330 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0818 19:57:57.631599 67330 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19423-7747/.minikube/bin
I0818 19:57:57.632162 67330 out.go:352] Setting JSON to false
I0818 19:57:57.633787 67330 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-10","uptime":6022,"bootTime":1724005056,"procs":303,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1066-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0818 19:57:57.633927 67330 start.go:139] virtualization: kvm guest
I0818 19:57:57.635982 67330 out.go:177] * [old-k8s-version-247539] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
I0818 19:57:57.638154 67330 out.go:177] - MINIKUBE_LOCATION=19423
I0818 19:57:57.638163 67330 notify.go:220] Checking for updates...
I0818 19:57:57.639908 67330 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0818 19:57:57.641396 67330 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19423-7747/kubeconfig
I0818 19:57:57.642819 67330 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19423-7747/.minikube
I0818 19:57:57.644128 67330 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0818 19:57:57.645540 67330 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0818 19:57:57.647796 67330 config.go:182] Loaded profile config "bridge-754609": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.0
I0818 19:57:57.647907 67330 config.go:182] Loaded profile config "flannel-754609": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.0
I0818 19:57:57.648002 67330 config.go:182] Loaded profile config "kubernetes-upgrade-179876": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.0
I0818 19:57:57.648102 67330 driver.go:394] Setting default libvirt URI to qemu:///system
I0818 19:57:57.689373 67330 out.go:177] * Using the kvm2 driver based on user configuration
I0818 19:57:57.690772 67330 start.go:297] selected driver: kvm2
I0818 19:57:57.690797 67330 start.go:901] validating driver "kvm2" against <nil>
I0818 19:57:57.690813 67330 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0818 19:57:57.691597 67330 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0818 19:57:57.691686 67330 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19423-7747/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0818 19:57:57.710728 67330 install.go:137] /home/jenkins/minikube-integration/19423-7747/.minikube/bin/docker-machine-driver-kvm2 version is 1.33.1
I0818 19:57:57.710785 67330 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0818 19:57:57.711052 67330 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0818 19:57:57.711111 67330 cni.go:84] Creating CNI manager for ""
I0818 19:57:57.711125 67330 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0818 19:57:57.711138 67330 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0818 19:57:57.711203 67330 start.go:340] cluster config:
{Name:old-k8s-version-247539 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-247539 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0818 19:57:57.711315 67330 iso.go:125] acquiring lock: {Name:mk9201a26af135372f8a85ea726fe0c576f878b5 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0818 19:57:57.713830 67330 out.go:177] * Starting "old-k8s-version-247539" primary control-plane node in "old-k8s-version-247539" cluster
I0818 19:57:57.715569 67330 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0818 19:57:57.715604 67330 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19423-7747/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0818 19:57:57.715613 67330 cache.go:56] Caching tarball of preloaded images
I0818 19:57:57.715707 67330 preload.go:172] Found /home/jenkins/minikube-integration/19423-7747/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0818 19:57:57.715720 67330 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0818 19:57:57.715807 67330 profile.go:143] Saving config to /home/jenkins/minikube-integration/19423-7747/.minikube/profiles/old-k8s-version-247539/config.json ...
I0818 19:57:57.715824 67330 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19423-7747/.minikube/profiles/old-k8s-version-247539/config.json: {Name:mkb4188f9b593942a2eada7595484de4b7d28645 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0818 19:57:57.715974 67330 start.go:360] acquireMachinesLock for old-k8s-version-247539: {Name:mkaa74026b854bae34a47a6811ef5a49f881e9e1 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0818 19:57:57.716009 67330 start.go:364] duration metric: took 18.162µs to acquireMachinesLock for "old-k8s-version-247539"
I0818 19:57:57.716032 67330 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-247539 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19452/minikube-v1.33.1-1723740674-19452-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-247539 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0818 19:57:57.716103 67330 start.go:125] createHost starting for "" (driver="kvm2")
I0818 19:57:57.717820 67330 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0818 19:57:57.718000 67330 main.go:141] libmachine: Found binary path at /home/jenkins/minikube-integration/19423-7747/.minikube/bin/docker-machine-driver-kvm2
I0818 19:57:57.718047 67330 main.go:141] libmachine: Launching plugin server for driver kvm2
I0818 19:57:57.736836 67330 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38881
I0818 19:57:57.737315 67330 main.go:141] libmachine: () Calling .GetVersion
I0818 19:57:57.738421 67330 main.go:141] libmachine: Using API Version 1
I0818 19:57:57.738444 67330 main.go:141] libmachine: () Calling .SetConfigRaw
I0818 19:57:57.738861 67330 main.go:141] libmachine: () Calling .GetMachineName
I0818 19:57:57.739197 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetMachineName
I0818 19:57:57.739369 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .DriverName
I0818 19:57:57.739567 67330 start.go:159] libmachine.API.Create for "old-k8s-version-247539" (driver="kvm2")
I0818 19:57:57.739593 67330 client.go:168] LocalClient.Create starting
I0818 19:57:57.739638 67330 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19423-7747/.minikube/certs/ca.pem
I0818 19:57:57.739684 67330 main.go:141] libmachine: Decoding PEM data...
I0818 19:57:57.739706 67330 main.go:141] libmachine: Parsing certificate...
I0818 19:57:57.739789 67330 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19423-7747/.minikube/certs/cert.pem
I0818 19:57:57.739815 67330 main.go:141] libmachine: Decoding PEM data...
I0818 19:57:57.739834 67330 main.go:141] libmachine: Parsing certificate...
I0818 19:57:57.739863 67330 main.go:141] libmachine: Running pre-create checks...
I0818 19:57:57.739880 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .PreCreateCheck
I0818 19:57:57.740278 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetConfigRaw
I0818 19:57:57.740661 67330 main.go:141] libmachine: Creating machine...
I0818 19:57:57.740676 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .Create
I0818 19:57:57.740819 67330 main.go:141] libmachine: (old-k8s-version-247539) Creating KVM machine...
I0818 19:57:57.742438 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | found existing default KVM network
I0818 19:57:57.744320 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | I0818 19:57:57.744138 67359 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:b9:2d:b9} reservation:<nil>}
I0818 19:57:57.745875 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | I0818 19:57:57.745799 67359 network.go:206] using free private subnet 192.168.50.0/24: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000348110}
I0818 19:57:57.746022 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | created network xml:
I0818 19:57:57.746047 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | <network>
I0818 19:57:57.746062 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | <name>mk-old-k8s-version-247539</name>
I0818 19:57:57.746075 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | <dns enable='no'/>
I0818 19:57:57.746085 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG |
I0818 19:57:57.746099 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | <ip address='192.168.50.1' netmask='255.255.255.0'>
I0818 19:57:57.746109 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | <dhcp>
I0818 19:57:57.746131 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | <range start='192.168.50.2' end='192.168.50.253'/>
I0818 19:57:57.746141 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | </dhcp>
I0818 19:57:57.746147 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | </ip>
I0818 19:57:57.746155 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG |
I0818 19:57:57.746163 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | </network>
I0818 19:57:57.746176 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG |
I0818 19:57:57.751775 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | trying to create private KVM network mk-old-k8s-version-247539 192.168.50.0/24...
I0818 19:57:57.864938 67330 main.go:141] libmachine: (old-k8s-version-247539) Setting up store path in /home/jenkins/minikube-integration/19423-7747/.minikube/machines/old-k8s-version-247539 ...
I0818 19:57:57.864962 67330 main.go:141] libmachine: (old-k8s-version-247539) Building disk image from file:///home/jenkins/minikube-integration/19423-7747/.minikube/cache/iso/amd64/minikube-v1.33.1-1723740674-19452-amd64.iso
I0818 19:57:57.864978 67330 main.go:141] libmachine: (old-k8s-version-247539) Downloading /home/jenkins/minikube-integration/19423-7747/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19423-7747/.minikube/cache/iso/amd64/minikube-v1.33.1-1723740674-19452-amd64.iso...
I0818 19:57:57.864992 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | private KVM network mk-old-k8s-version-247539 192.168.50.0/24 created
I0818 19:57:57.865003 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | I0818 19:57:57.864237 67359 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19423-7747/.minikube
I0818 19:57:58.184522 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | I0818 19:57:58.181782 67359 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19423-7747/.minikube/machines/old-k8s-version-247539/id_rsa...
I0818 19:57:58.575954 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | I0818 19:57:58.575836 67359 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19423-7747/.minikube/machines/old-k8s-version-247539/old-k8s-version-247539.rawdisk...
I0818 19:57:58.575997 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | Writing magic tar header
I0818 19:57:58.576014 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | Writing SSH key tar header
I0818 19:57:58.576027 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | I0818 19:57:58.575958 67359 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19423-7747/.minikube/machines/old-k8s-version-247539 ...
I0818 19:57:58.576043 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19423-7747/.minikube/machines/old-k8s-version-247539
I0818 19:57:58.576133 67330 main.go:141] libmachine: (old-k8s-version-247539) Setting executable bit set on /home/jenkins/minikube-integration/19423-7747/.minikube/machines/old-k8s-version-247539 (perms=drwx------)
I0818 19:57:58.576162 67330 main.go:141] libmachine: (old-k8s-version-247539) Setting executable bit set on /home/jenkins/minikube-integration/19423-7747/.minikube/machines (perms=drwxr-xr-x)
I0818 19:57:58.576175 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19423-7747/.minikube/machines
I0818 19:57:58.576193 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19423-7747/.minikube
I0818 19:57:58.576206 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19423-7747
I0818 19:57:58.576222 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0818 19:57:58.576241 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | Checking permissions on dir: /home/jenkins
I0818 19:57:58.576256 67330 main.go:141] libmachine: (old-k8s-version-247539) Setting executable bit set on /home/jenkins/minikube-integration/19423-7747/.minikube (perms=drwxr-xr-x)
I0818 19:57:58.576268 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | Checking permissions on dir: /home
I0818 19:57:58.576282 67330 main.go:141] libmachine: (old-k8s-version-247539) Setting executable bit set on /home/jenkins/minikube-integration/19423-7747 (perms=drwxrwxr-x)
I0818 19:57:58.576294 67330 main.go:141] libmachine: (old-k8s-version-247539) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0818 19:57:58.576307 67330 main.go:141] libmachine: (old-k8s-version-247539) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0818 19:57:58.576319 67330 main.go:141] libmachine: (old-k8s-version-247539) Creating domain...
I0818 19:57:58.576333 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | Skipping /home - not owner
I0818 19:57:58.577273 67330 main.go:141] libmachine: (old-k8s-version-247539) define libvirt domain using xml:
I0818 19:57:58.577315 67330 main.go:141] libmachine: (old-k8s-version-247539) <domain type='kvm'>
I0818 19:57:58.577326 67330 main.go:141] libmachine: (old-k8s-version-247539) <name>old-k8s-version-247539</name>
I0818 19:57:58.577337 67330 main.go:141] libmachine: (old-k8s-version-247539) <memory unit='MiB'>2200</memory>
I0818 19:57:58.577346 67330 main.go:141] libmachine: (old-k8s-version-247539) <vcpu>2</vcpu>
I0818 19:57:58.577356 67330 main.go:141] libmachine: (old-k8s-version-247539) <features>
I0818 19:57:58.577364 67330 main.go:141] libmachine: (old-k8s-version-247539) <acpi/>
I0818 19:57:58.577375 67330 main.go:141] libmachine: (old-k8s-version-247539) <apic/>
I0818 19:57:58.577392 67330 main.go:141] libmachine: (old-k8s-version-247539) <pae/>
I0818 19:57:58.577403 67330 main.go:141] libmachine: (old-k8s-version-247539)
I0818 19:57:58.577411 67330 main.go:141] libmachine: (old-k8s-version-247539) </features>
I0818 19:57:58.577422 67330 main.go:141] libmachine: (old-k8s-version-247539) <cpu mode='host-passthrough'>
I0818 19:57:58.577431 67330 main.go:141] libmachine: (old-k8s-version-247539)
I0818 19:57:58.577442 67330 main.go:141] libmachine: (old-k8s-version-247539) </cpu>
I0818 19:57:58.577450 67330 main.go:141] libmachine: (old-k8s-version-247539) <os>
I0818 19:57:58.577460 67330 main.go:141] libmachine: (old-k8s-version-247539) <type>hvm</type>
I0818 19:57:58.577472 67330 main.go:141] libmachine: (old-k8s-version-247539) <boot dev='cdrom'/>
I0818 19:57:58.577482 67330 main.go:141] libmachine: (old-k8s-version-247539) <boot dev='hd'/>
I0818 19:57:58.577494 67330 main.go:141] libmachine: (old-k8s-version-247539) <bootmenu enable='no'/>
I0818 19:57:58.577505 67330 main.go:141] libmachine: (old-k8s-version-247539) </os>
I0818 19:57:58.577515 67330 main.go:141] libmachine: (old-k8s-version-247539) <devices>
I0818 19:57:58.577524 67330 main.go:141] libmachine: (old-k8s-version-247539) <disk type='file' device='cdrom'>
I0818 19:57:58.577542 67330 main.go:141] libmachine: (old-k8s-version-247539) <source file='/home/jenkins/minikube-integration/19423-7747/.minikube/machines/old-k8s-version-247539/boot2docker.iso'/>
I0818 19:57:58.577554 67330 main.go:141] libmachine: (old-k8s-version-247539) <target dev='hdc' bus='scsi'/>
I0818 19:57:58.577567 67330 main.go:141] libmachine: (old-k8s-version-247539) <readonly/>
I0818 19:57:58.577577 67330 main.go:141] libmachine: (old-k8s-version-247539) </disk>
I0818 19:57:58.577587 67330 main.go:141] libmachine: (old-k8s-version-247539) <disk type='file' device='disk'>
I0818 19:57:58.577600 67330 main.go:141] libmachine: (old-k8s-version-247539) <driver name='qemu' type='raw' cache='default' io='threads' />
I0818 19:57:58.577623 67330 main.go:141] libmachine: (old-k8s-version-247539) <source file='/home/jenkins/minikube-integration/19423-7747/.minikube/machines/old-k8s-version-247539/old-k8s-version-247539.rawdisk'/>
I0818 19:57:58.577637 67330 main.go:141] libmachine: (old-k8s-version-247539) <target dev='hda' bus='virtio'/>
I0818 19:57:58.577646 67330 main.go:141] libmachine: (old-k8s-version-247539) </disk>
I0818 19:57:58.577659 67330 main.go:141] libmachine: (old-k8s-version-247539) <interface type='network'>
I0818 19:57:58.577672 67330 main.go:141] libmachine: (old-k8s-version-247539) <source network='mk-old-k8s-version-247539'/>
I0818 19:57:58.577684 67330 main.go:141] libmachine: (old-k8s-version-247539) <model type='virtio'/>
I0818 19:57:58.577694 67330 main.go:141] libmachine: (old-k8s-version-247539) </interface>
I0818 19:57:58.577705 67330 main.go:141] libmachine: (old-k8s-version-247539) <interface type='network'>
I0818 19:57:58.577717 67330 main.go:141] libmachine: (old-k8s-version-247539) <source network='default'/>
I0818 19:57:58.577736 67330 main.go:141] libmachine: (old-k8s-version-247539) <model type='virtio'/>
I0818 19:57:58.577749 67330 main.go:141] libmachine: (old-k8s-version-247539) </interface>
I0818 19:57:58.577757 67330 main.go:141] libmachine: (old-k8s-version-247539) <serial type='pty'>
I0818 19:57:58.577768 67330 main.go:141] libmachine: (old-k8s-version-247539) <target port='0'/>
I0818 19:57:58.577780 67330 main.go:141] libmachine: (old-k8s-version-247539) </serial>
I0818 19:57:58.577792 67330 main.go:141] libmachine: (old-k8s-version-247539) <console type='pty'>
I0818 19:57:58.577802 67330 main.go:141] libmachine: (old-k8s-version-247539) <target type='serial' port='0'/>
I0818 19:57:58.577813 67330 main.go:141] libmachine: (old-k8s-version-247539) </console>
I0818 19:57:58.577824 67330 main.go:141] libmachine: (old-k8s-version-247539) <rng model='virtio'>
I0818 19:57:58.577836 67330 main.go:141] libmachine: (old-k8s-version-247539) <backend model='random'>/dev/random</backend>
I0818 19:57:58.577847 67330 main.go:141] libmachine: (old-k8s-version-247539) </rng>
I0818 19:57:58.577855 67330 main.go:141] libmachine: (old-k8s-version-247539)
I0818 19:57:58.577865 67330 main.go:141] libmachine: (old-k8s-version-247539)
I0818 19:57:58.577874 67330 main.go:141] libmachine: (old-k8s-version-247539) </devices>
I0818 19:57:58.577884 67330 main.go:141] libmachine: (old-k8s-version-247539) </domain>
I0818 19:57:58.577894 67330 main.go:141] libmachine: (old-k8s-version-247539)
I0818 19:57:58.583173 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | domain old-k8s-version-247539 has defined MAC address 52:54:00:64:f0:ab in network default
I0818 19:57:58.583914 67330 main.go:141] libmachine: (old-k8s-version-247539) Ensuring networks are active...
I0818 19:57:58.583937 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | domain old-k8s-version-247539 has defined MAC address 52:54:00:5a:f6:41 in network mk-old-k8s-version-247539
I0818 19:57:58.584805 67330 main.go:141] libmachine: (old-k8s-version-247539) Ensuring network default is active
I0818 19:57:58.585149 67330 main.go:141] libmachine: (old-k8s-version-247539) Ensuring network mk-old-k8s-version-247539 is active
I0818 19:57:58.585834 67330 main.go:141] libmachine: (old-k8s-version-247539) Getting domain xml...
I0818 19:57:58.586674 67330 main.go:141] libmachine: (old-k8s-version-247539) Creating domain...
I0818 19:58:00.450709 67330 main.go:141] libmachine: (old-k8s-version-247539) Waiting to get IP...
I0818 19:58:00.451936 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | domain old-k8s-version-247539 has defined MAC address 52:54:00:5a:f6:41 in network mk-old-k8s-version-247539
I0818 19:58:00.452392 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | unable to find current IP address of domain old-k8s-version-247539 in network mk-old-k8s-version-247539
I0818 19:58:00.452434 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | I0818 19:58:00.452377 67359 retry.go:31] will retry after 241.241265ms: waiting for machine to come up
I0818 19:58:00.695927 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | domain old-k8s-version-247539 has defined MAC address 52:54:00:5a:f6:41 in network mk-old-k8s-version-247539
I0818 19:58:00.696655 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | unable to find current IP address of domain old-k8s-version-247539 in network mk-old-k8s-version-247539
I0818 19:58:00.696676 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | I0818 19:58:00.696568 67359 retry.go:31] will retry after 375.625845ms: waiting for machine to come up
I0818 19:58:01.074552 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | domain old-k8s-version-247539 has defined MAC address 52:54:00:5a:f6:41 in network mk-old-k8s-version-247539
I0818 19:58:01.075182 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | unable to find current IP address of domain old-k8s-version-247539 in network mk-old-k8s-version-247539
I0818 19:58:01.075329 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | I0818 19:58:01.075291 67359 retry.go:31] will retry after 377.725453ms: waiting for machine to come up
I0818 19:58:01.454965 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | domain old-k8s-version-247539 has defined MAC address 52:54:00:5a:f6:41 in network mk-old-k8s-version-247539
I0818 19:58:01.455653 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | unable to find current IP address of domain old-k8s-version-247539 in network mk-old-k8s-version-247539
I0818 19:58:01.455677 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | I0818 19:58:01.455600 67359 retry.go:31] will retry after 490.039131ms: waiting for machine to come up
I0818 19:58:01.946926 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | domain old-k8s-version-247539 has defined MAC address 52:54:00:5a:f6:41 in network mk-old-k8s-version-247539
I0818 19:58:01.947504 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | unable to find current IP address of domain old-k8s-version-247539 in network mk-old-k8s-version-247539
I0818 19:58:01.947537 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | I0818 19:58:01.947457 67359 retry.go:31] will retry after 578.750617ms: waiting for machine to come up
I0818 19:58:02.527972 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | domain old-k8s-version-247539 has defined MAC address 52:54:00:5a:f6:41 in network mk-old-k8s-version-247539
I0818 19:58:02.528785 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | unable to find current IP address of domain old-k8s-version-247539 in network mk-old-k8s-version-247539
I0818 19:58:02.528807 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | I0818 19:58:02.528707 67359 retry.go:31] will retry after 627.941976ms: waiting for machine to come up
I0818 19:58:03.158619 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | domain old-k8s-version-247539 has defined MAC address 52:54:00:5a:f6:41 in network mk-old-k8s-version-247539
I0818 19:58:03.159084 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | unable to find current IP address of domain old-k8s-version-247539 in network mk-old-k8s-version-247539
I0818 19:58:03.159111 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | I0818 19:58:03.159041 67359 retry.go:31] will retry after 1.110108246s: waiting for machine to come up
I0818 19:58:04.270727 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | domain old-k8s-version-247539 has defined MAC address 52:54:00:5a:f6:41 in network mk-old-k8s-version-247539
I0818 19:58:04.271362 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | unable to find current IP address of domain old-k8s-version-247539 in network mk-old-k8s-version-247539
I0818 19:58:04.271411 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | I0818 19:58:04.271303 67359 retry.go:31] will retry after 998.273726ms: waiting for machine to come up
I0818 19:58:05.270986 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | domain old-k8s-version-247539 has defined MAC address 52:54:00:5a:f6:41 in network mk-old-k8s-version-247539
I0818 19:58:05.271554 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | unable to find current IP address of domain old-k8s-version-247539 in network mk-old-k8s-version-247539
I0818 19:58:05.271582 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | I0818 19:58:05.271519 67359 retry.go:31] will retry after 1.240428493s: waiting for machine to come up
I0818 19:58:06.513857 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | domain old-k8s-version-247539 has defined MAC address 52:54:00:5a:f6:41 in network mk-old-k8s-version-247539
I0818 19:58:06.514626 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | unable to find current IP address of domain old-k8s-version-247539 in network mk-old-k8s-version-247539
I0818 19:58:06.514653 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | I0818 19:58:06.514588 67359 retry.go:31] will retry after 2.299995679s: waiting for machine to come up
I0818 19:58:08.816324 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | domain old-k8s-version-247539 has defined MAC address 52:54:00:5a:f6:41 in network mk-old-k8s-version-247539
I0818 19:58:08.816956 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | unable to find current IP address of domain old-k8s-version-247539 in network mk-old-k8s-version-247539
I0818 19:58:08.816985 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | I0818 19:58:08.816896 67359 retry.go:31] will retry after 2.65092011s: waiting for machine to come up
I0818 19:58:11.469337 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | domain old-k8s-version-247539 has defined MAC address 52:54:00:5a:f6:41 in network mk-old-k8s-version-247539
I0818 19:58:11.469815 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | unable to find current IP address of domain old-k8s-version-247539 in network mk-old-k8s-version-247539
I0818 19:58:11.469847 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | I0818 19:58:11.469767 67359 retry.go:31] will retry after 2.606526377s: waiting for machine to come up
I0818 19:58:14.078595 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | domain old-k8s-version-247539 has defined MAC address 52:54:00:5a:f6:41 in network mk-old-k8s-version-247539
I0818 19:58:14.079224 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | unable to find current IP address of domain old-k8s-version-247539 in network mk-old-k8s-version-247539
I0818 19:58:14.079245 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | I0818 19:58:14.079160 67359 retry.go:31] will retry after 3.862765663s: waiting for machine to come up
I0818 19:58:17.943070 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | domain old-k8s-version-247539 has defined MAC address 52:54:00:5a:f6:41 in network mk-old-k8s-version-247539
I0818 19:58:17.943640 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | unable to find current IP address of domain old-k8s-version-247539 in network mk-old-k8s-version-247539
I0818 19:58:17.943666 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | I0818 19:58:17.943598 67359 retry.go:31] will retry after 5.486952781s: waiting for machine to come up
I0818 19:58:23.432278 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | domain old-k8s-version-247539 has defined MAC address 52:54:00:5a:f6:41 in network mk-old-k8s-version-247539
I0818 19:58:23.432756 67330 main.go:141] libmachine: (old-k8s-version-247539) Found IP for machine: 192.168.50.105
I0818 19:58:23.432777 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | domain old-k8s-version-247539 has current primary IP address 192.168.50.105 and MAC address 52:54:00:5a:f6:41 in network mk-old-k8s-version-247539
I0818 19:58:23.432784 67330 main.go:141] libmachine: (old-k8s-version-247539) Reserving static IP address...
I0818 19:58:23.433120 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-247539", mac: "52:54:00:5a:f6:41", ip: "192.168.50.105"} in network mk-old-k8s-version-247539
I0818 19:58:23.510525 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | Getting to WaitForSSH function...
I0818 19:58:23.510566 67330 main.go:141] libmachine: (old-k8s-version-247539) Reserved static IP address: 192.168.50.105
I0818 19:58:23.510581 67330 main.go:141] libmachine: (old-k8s-version-247539) Waiting for SSH to be available...
I0818 19:58:23.513568 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | domain old-k8s-version-247539 has defined MAC address 52:54:00:5a:f6:41 in network mk-old-k8s-version-247539
I0818 19:58:23.514021 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | unable to find host DHCP lease matching {name: "", mac: "52:54:00:5a:f6:41", ip: ""} in network mk-old-k8s-version-247539
I0818 19:58:23.514051 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | unable to find defined IP address of network mk-old-k8s-version-247539 interface with MAC address 52:54:00:5a:f6:41
I0818 19:58:23.514200 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | Using SSH client type: external
I0818 19:58:23.514223 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | Using SSH private key: /home/jenkins/minikube-integration/19423-7747/.minikube/machines/old-k8s-version-247539/id_rsa (-rw-------)
I0818 19:58:23.514249 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@ -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19423-7747/.minikube/machines/old-k8s-version-247539/id_rsa -p 22] /usr/bin/ssh <nil>}
I0818 19:58:23.514264 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | About to run SSH command:
I0818 19:58:23.514294 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | exit 0
I0818 19:58:23.517950 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | SSH cmd err, output: exit status 255:
I0818 19:58:23.517974 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | Error getting ssh command 'exit 0' : ssh command error:
I0818 19:58:23.517984 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | command : exit 0
I0818 19:58:23.517991 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | err : exit status 255
I0818 19:58:23.518002 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | output :
I0818 19:58:26.519525 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | Getting to WaitForSSH function...
I0818 19:58:26.522568 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | domain old-k8s-version-247539 has defined MAC address 52:54:00:5a:f6:41 in network mk-old-k8s-version-247539
I0818 19:58:26.522996 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5a:f6:41", ip: ""} in network mk-old-k8s-version-247539: {Iface:virbr2 ExpiryTime:2024-08-18 20:58:15 +0000 UTC Type:0 Mac:52:54:00:5a:f6:41 Iaid: IPaddr:192.168.50.105 Prefix:24 Hostname:old-k8s-version-247539 Clientid:01:52:54:00:5a:f6:41}
I0818 19:58:26.523036 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | domain old-k8s-version-247539 has defined IP address 192.168.50.105 and MAC address 52:54:00:5a:f6:41 in network mk-old-k8s-version-247539
I0818 19:58:26.523222 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | Using SSH client type: external
I0818 19:58:26.523248 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | Using SSH private key: /home/jenkins/minikube-integration/19423-7747/.minikube/machines/old-k8s-version-247539/id_rsa (-rw-------)
I0818 19:58:26.523288 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.50.105 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19423-7747/.minikube/machines/old-k8s-version-247539/id_rsa -p 22] /usr/bin/ssh <nil>}
I0818 19:58:26.523301 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | About to run SSH command:
I0818 19:58:26.523315 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | exit 0
I0818 19:58:26.651465 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | SSH cmd err, output: <nil>:
I0818 19:58:26.651749 67330 main.go:141] libmachine: (old-k8s-version-247539) KVM machine creation complete!
I0818 19:58:26.652060 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetConfigRaw
I0818 19:58:26.652589 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .DriverName
I0818 19:58:26.652794 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .DriverName
I0818 19:58:26.652945 67330 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0818 19:58:26.652959 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetState
I0818 19:58:26.654251 67330 main.go:141] libmachine: Detecting operating system of created instance...
I0818 19:58:26.654267 67330 main.go:141] libmachine: Waiting for SSH to be available...
I0818 19:58:26.654274 67330 main.go:141] libmachine: Getting to WaitForSSH function...
I0818 19:58:26.654283 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetSSHHostname
I0818 19:58:26.656571 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | domain old-k8s-version-247539 has defined MAC address 52:54:00:5a:f6:41 in network mk-old-k8s-version-247539
I0818 19:58:26.656974 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5a:f6:41", ip: ""} in network mk-old-k8s-version-247539: {Iface:virbr2 ExpiryTime:2024-08-18 20:58:15 +0000 UTC Type:0 Mac:52:54:00:5a:f6:41 Iaid: IPaddr:192.168.50.105 Prefix:24 Hostname:old-k8s-version-247539 Clientid:01:52:54:00:5a:f6:41}
I0818 19:58:26.657009 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | domain old-k8s-version-247539 has defined IP address 192.168.50.105 and MAC address 52:54:00:5a:f6:41 in network mk-old-k8s-version-247539
I0818 19:58:26.657091 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetSSHPort
I0818 19:58:26.657281 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetSSHKeyPath
I0818 19:58:26.657448 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetSSHKeyPath
I0818 19:58:26.657603 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetSSHUsername
I0818 19:58:26.657763 67330 main.go:141] libmachine: Using SSH client type: native
I0818 19:58:26.658024 67330 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.50.105 22 <nil> <nil>}
I0818 19:58:26.658042 67330 main.go:141] libmachine: About to run SSH command:
exit 0
I0818 19:58:26.771790 67330 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0818 19:58:26.771814 67330 main.go:141] libmachine: Detecting the provisioner...
I0818 19:58:26.771825 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetSSHHostname
I0818 19:58:26.776184 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | domain old-k8s-version-247539 has defined MAC address 52:54:00:5a:f6:41 in network mk-old-k8s-version-247539
I0818 19:58:26.776616 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5a:f6:41", ip: ""} in network mk-old-k8s-version-247539: {Iface:virbr2 ExpiryTime:2024-08-18 20:58:15 +0000 UTC Type:0 Mac:52:54:00:5a:f6:41 Iaid: IPaddr:192.168.50.105 Prefix:24 Hostname:old-k8s-version-247539 Clientid:01:52:54:00:5a:f6:41}
I0818 19:58:26.776648 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | domain old-k8s-version-247539 has defined IP address 192.168.50.105 and MAC address 52:54:00:5a:f6:41 in network mk-old-k8s-version-247539
I0818 19:58:26.776804 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetSSHPort
I0818 19:58:26.777010 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetSSHKeyPath
I0818 19:58:26.777209 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetSSHKeyPath
I0818 19:58:26.777370 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetSSHUsername
I0818 19:58:26.777544 67330 main.go:141] libmachine: Using SSH client type: native
I0818 19:58:26.777705 67330 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.50.105 22 <nil> <nil>}
I0818 19:58:26.777715 67330 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0818 19:58:26.900605 67330 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0818 19:58:26.900706 67330 main.go:141] libmachine: found compatible host: buildroot
I0818 19:58:26.900719 67330 main.go:141] libmachine: Provisioning with buildroot...
I0818 19:58:26.900731 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetMachineName
I0818 19:58:26.900985 67330 buildroot.go:166] provisioning hostname "old-k8s-version-247539"
I0818 19:58:26.901007 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetMachineName
I0818 19:58:26.901196 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetSSHHostname
I0818 19:58:26.903745 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | domain old-k8s-version-247539 has defined MAC address 52:54:00:5a:f6:41 in network mk-old-k8s-version-247539
I0818 19:58:27.096297 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5a:f6:41", ip: ""} in network mk-old-k8s-version-247539: {Iface:virbr2 ExpiryTime:2024-08-18 20:58:15 +0000 UTC Type:0 Mac:52:54:00:5a:f6:41 Iaid: IPaddr:192.168.50.105 Prefix:24 Hostname:old-k8s-version-247539 Clientid:01:52:54:00:5a:f6:41}
I0818 19:58:27.096328 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | domain old-k8s-version-247539 has defined IP address 192.168.50.105 and MAC address 52:54:00:5a:f6:41 in network mk-old-k8s-version-247539
I0818 19:58:27.096490 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetSSHPort
I0818 19:58:27.096749 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetSSHKeyPath
I0818 19:58:27.096961 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetSSHKeyPath
I0818 19:58:27.097125 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetSSHUsername
I0818 19:58:27.097305 67330 main.go:141] libmachine: Using SSH client type: native
I0818 19:58:27.097517 67330 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.50.105 22 <nil> <nil>}
I0818 19:58:27.097536 67330 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-247539 && echo "old-k8s-version-247539" | sudo tee /etc/hostname
I0818 19:58:27.228583 67330 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-247539
I0818 19:58:27.228613 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetSSHHostname
I0818 19:58:27.445006 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | domain old-k8s-version-247539 has defined MAC address 52:54:00:5a:f6:41 in network mk-old-k8s-version-247539
I0818 19:58:27.445432 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5a:f6:41", ip: ""} in network mk-old-k8s-version-247539: {Iface:virbr2 ExpiryTime:2024-08-18 20:58:15 +0000 UTC Type:0 Mac:52:54:00:5a:f6:41 Iaid: IPaddr:192.168.50.105 Prefix:24 Hostname:old-k8s-version-247539 Clientid:01:52:54:00:5a:f6:41}
I0818 19:58:27.445470 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | domain old-k8s-version-247539 has defined IP address 192.168.50.105 and MAC address 52:54:00:5a:f6:41 in network mk-old-k8s-version-247539
I0818 19:58:27.445760 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetSSHPort
I0818 19:58:27.445959 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetSSHKeyPath
I0818 19:58:27.446151 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetSSHKeyPath
I0818 19:58:27.446289 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetSSHUsername
I0818 19:58:27.446497 67330 main.go:141] libmachine: Using SSH client type: native
I0818 19:58:27.446699 67330 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.50.105 22 <nil> <nil>}
I0818 19:58:27.446724 67330 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-247539' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-247539/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-247539' | sudo tee -a /etc/hosts;
fi
fi
I0818 19:58:27.580472 67330 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0818 19:58:27.580505 67330 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19423-7747/.minikube CaCertPath:/home/jenkins/minikube-integration/19423-7747/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19423-7747/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19423-7747/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19423-7747/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19423-7747/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19423-7747/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19423-7747/.minikube}
I0818 19:58:27.580535 67330 buildroot.go:174] setting up certificates
I0818 19:58:27.580549 67330 provision.go:84] configureAuth start
I0818 19:58:27.580563 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetMachineName
I0818 19:58:27.580846 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetIP
I0818 19:58:27.584235 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | domain old-k8s-version-247539 has defined MAC address 52:54:00:5a:f6:41 in network mk-old-k8s-version-247539
I0818 19:58:27.584614 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5a:f6:41", ip: ""} in network mk-old-k8s-version-247539: {Iface:virbr2 ExpiryTime:2024-08-18 20:58:15 +0000 UTC Type:0 Mac:52:54:00:5a:f6:41 Iaid: IPaddr:192.168.50.105 Prefix:24 Hostname:old-k8s-version-247539 Clientid:01:52:54:00:5a:f6:41}
I0818 19:58:27.584644 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | domain old-k8s-version-247539 has defined IP address 192.168.50.105 and MAC address 52:54:00:5a:f6:41 in network mk-old-k8s-version-247539
I0818 19:58:27.584813 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetSSHHostname
I0818 19:58:27.587440 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | domain old-k8s-version-247539 has defined MAC address 52:54:00:5a:f6:41 in network mk-old-k8s-version-247539
I0818 19:58:27.587902 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5a:f6:41", ip: ""} in network mk-old-k8s-version-247539: {Iface:virbr2 ExpiryTime:2024-08-18 20:58:15 +0000 UTC Type:0 Mac:52:54:00:5a:f6:41 Iaid: IPaddr:192.168.50.105 Prefix:24 Hostname:old-k8s-version-247539 Clientid:01:52:54:00:5a:f6:41}
I0818 19:58:27.587929 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | domain old-k8s-version-247539 has defined IP address 192.168.50.105 and MAC address 52:54:00:5a:f6:41 in network mk-old-k8s-version-247539
I0818 19:58:27.588104 67330 provision.go:143] copyHostCerts
I0818 19:58:27.588149 67330 exec_runner.go:144] found /home/jenkins/minikube-integration/19423-7747/.minikube/ca.pem, removing ...
I0818 19:58:27.588163 67330 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19423-7747/.minikube/ca.pem
I0818 19:58:27.588226 67330 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19423-7747/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19423-7747/.minikube/ca.pem (1082 bytes)
I0818 19:58:27.588349 67330 exec_runner.go:144] found /home/jenkins/minikube-integration/19423-7747/.minikube/cert.pem, removing ...
I0818 19:58:27.588359 67330 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19423-7747/.minikube/cert.pem
I0818 19:58:27.588383 67330 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19423-7747/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19423-7747/.minikube/cert.pem (1123 bytes)
I0818 19:58:27.588449 67330 exec_runner.go:144] found /home/jenkins/minikube-integration/19423-7747/.minikube/key.pem, removing ...
I0818 19:58:27.588456 67330 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19423-7747/.minikube/key.pem
I0818 19:58:27.588483 67330 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19423-7747/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19423-7747/.minikube/key.pem (1675 bytes)
I0818 19:58:27.588541 67330 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19423-7747/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19423-7747/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19423-7747/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-247539 san=[127.0.0.1 192.168.50.105 localhost minikube old-k8s-version-247539]
I0818 19:58:27.674599 67330 provision.go:177] copyRemoteCerts
I0818 19:58:27.674645 67330 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0818 19:58:27.674663 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetSSHHostname
I0818 19:58:27.677681 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | domain old-k8s-version-247539 has defined MAC address 52:54:00:5a:f6:41 in network mk-old-k8s-version-247539
I0818 19:58:27.678056 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5a:f6:41", ip: ""} in network mk-old-k8s-version-247539: {Iface:virbr2 ExpiryTime:2024-08-18 20:58:15 +0000 UTC Type:0 Mac:52:54:00:5a:f6:41 Iaid: IPaddr:192.168.50.105 Prefix:24 Hostname:old-k8s-version-247539 Clientid:01:52:54:00:5a:f6:41}
I0818 19:58:27.678087 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | domain old-k8s-version-247539 has defined IP address 192.168.50.105 and MAC address 52:54:00:5a:f6:41 in network mk-old-k8s-version-247539
I0818 19:58:27.678290 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetSSHPort
I0818 19:58:27.678518 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetSSHKeyPath
I0818 19:58:27.678700 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetSSHUsername
I0818 19:58:27.678834 67330 sshutil.go:53] new ssh client: &{IP:192.168.50.105 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19423-7747/.minikube/machines/old-k8s-version-247539/id_rsa Username:docker}
I0818 19:58:27.777194 67330 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19423-7747/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0818 19:58:27.809123 67330 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19423-7747/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0818 19:58:27.836736 67330 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19423-7747/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0818 19:58:27.862771 67330 provision.go:87] duration metric: took 282.208275ms to configureAuth
I0818 19:58:27.862796 67330 buildroot.go:189] setting minikube options for container-runtime
I0818 19:58:27.862927 67330 config.go:182] Loaded profile config "old-k8s-version-247539": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0818 19:58:27.863006 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetSSHHostname
I0818 19:58:27.866440 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | domain old-k8s-version-247539 has defined MAC address 52:54:00:5a:f6:41 in network mk-old-k8s-version-247539
I0818 19:58:27.866863 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5a:f6:41", ip: ""} in network mk-old-k8s-version-247539: {Iface:virbr2 ExpiryTime:2024-08-18 20:58:15 +0000 UTC Type:0 Mac:52:54:00:5a:f6:41 Iaid: IPaddr:192.168.50.105 Prefix:24 Hostname:old-k8s-version-247539 Clientid:01:52:54:00:5a:f6:41}
I0818 19:58:27.866893 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | domain old-k8s-version-247539 has defined IP address 192.168.50.105 and MAC address 52:54:00:5a:f6:41 in network mk-old-k8s-version-247539
I0818 19:58:27.867047 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetSSHPort
I0818 19:58:27.867252 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetSSHKeyPath
I0818 19:58:27.867475 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetSSHKeyPath
I0818 19:58:27.867650 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetSSHUsername
I0818 19:58:27.867835 67330 main.go:141] libmachine: Using SSH client type: native
I0818 19:58:27.868009 67330 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.50.105 22 <nil> <nil>}
I0818 19:58:27.868032 67330 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0818 19:58:28.149928 67330 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0818 19:58:28.149955 67330 main.go:141] libmachine: Checking connection to Docker...
I0818 19:58:28.149965 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetURL
I0818 19:58:28.151235 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | Using libvirt version 6000000
I0818 19:58:28.153459 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | domain old-k8s-version-247539 has defined MAC address 52:54:00:5a:f6:41 in network mk-old-k8s-version-247539
I0818 19:58:28.153788 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5a:f6:41", ip: ""} in network mk-old-k8s-version-247539: {Iface:virbr2 ExpiryTime:2024-08-18 20:58:15 +0000 UTC Type:0 Mac:52:54:00:5a:f6:41 Iaid: IPaddr:192.168.50.105 Prefix:24 Hostname:old-k8s-version-247539 Clientid:01:52:54:00:5a:f6:41}
I0818 19:58:28.153814 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | domain old-k8s-version-247539 has defined IP address 192.168.50.105 and MAC address 52:54:00:5a:f6:41 in network mk-old-k8s-version-247539
I0818 19:58:28.153962 67330 main.go:141] libmachine: Docker is up and running!
I0818 19:58:28.153976 67330 main.go:141] libmachine: Reticulating splines...
I0818 19:58:28.153984 67330 client.go:171] duration metric: took 30.414379591s to LocalClient.Create
I0818 19:58:28.154008 67330 start.go:167] duration metric: took 30.414441056s to libmachine.API.Create "old-k8s-version-247539"
I0818 19:58:28.154022 67330 start.go:293] postStartSetup for "old-k8s-version-247539" (driver="kvm2")
I0818 19:58:28.154034 67330 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0818 19:58:28.154049 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .DriverName
I0818 19:58:28.154302 67330 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0818 19:58:28.154325 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetSSHHostname
I0818 19:58:28.156469 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | domain old-k8s-version-247539 has defined MAC address 52:54:00:5a:f6:41 in network mk-old-k8s-version-247539
I0818 19:58:28.156825 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5a:f6:41", ip: ""} in network mk-old-k8s-version-247539: {Iface:virbr2 ExpiryTime:2024-08-18 20:58:15 +0000 UTC Type:0 Mac:52:54:00:5a:f6:41 Iaid: IPaddr:192.168.50.105 Prefix:24 Hostname:old-k8s-version-247539 Clientid:01:52:54:00:5a:f6:41}
I0818 19:58:28.156855 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | domain old-k8s-version-247539 has defined IP address 192.168.50.105 and MAC address 52:54:00:5a:f6:41 in network mk-old-k8s-version-247539
I0818 19:58:28.157028 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetSSHPort
I0818 19:58:28.157204 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetSSHKeyPath
I0818 19:58:28.157360 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetSSHUsername
I0818 19:58:28.157486 67330 sshutil.go:53] new ssh client: &{IP:192.168.50.105 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19423-7747/.minikube/machines/old-k8s-version-247539/id_rsa Username:docker}
I0818 19:58:28.245979 67330 ssh_runner.go:195] Run: cat /etc/os-release
I0818 19:58:28.250754 67330 info.go:137] Remote host: Buildroot 2023.02.9
I0818 19:58:28.250773 67330 filesync.go:126] Scanning /home/jenkins/minikube-integration/19423-7747/.minikube/addons for local assets ...
I0818 19:58:28.250833 67330 filesync.go:126] Scanning /home/jenkins/minikube-integration/19423-7747/.minikube/files for local assets ...
I0818 19:58:28.250934 67330 filesync.go:149] local asset: /home/jenkins/minikube-integration/19423-7747/.minikube/files/etc/ssl/certs/149342.pem -> 149342.pem in /etc/ssl/certs
I0818 19:58:28.251049 67330 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0818 19:58:28.260674 67330 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19423-7747/.minikube/files/etc/ssl/certs/149342.pem --> /etc/ssl/certs/149342.pem (1708 bytes)
I0818 19:58:28.284451 67330 start.go:296] duration metric: took 130.415166ms for postStartSetup
I0818 19:58:28.284519 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetConfigRaw
I0818 19:58:28.285111 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetIP
I0818 19:58:28.288038 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | domain old-k8s-version-247539 has defined MAC address 52:54:00:5a:f6:41 in network mk-old-k8s-version-247539
I0818 19:58:28.288488 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5a:f6:41", ip: ""} in network mk-old-k8s-version-247539: {Iface:virbr2 ExpiryTime:2024-08-18 20:58:15 +0000 UTC Type:0 Mac:52:54:00:5a:f6:41 Iaid: IPaddr:192.168.50.105 Prefix:24 Hostname:old-k8s-version-247539 Clientid:01:52:54:00:5a:f6:41}
I0818 19:58:28.288520 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | domain old-k8s-version-247539 has defined IP address 192.168.50.105 and MAC address 52:54:00:5a:f6:41 in network mk-old-k8s-version-247539
I0818 19:58:28.288793 67330 profile.go:143] Saving config to /home/jenkins/minikube-integration/19423-7747/.minikube/profiles/old-k8s-version-247539/config.json ...
I0818 19:58:28.288957 67330 start.go:128] duration metric: took 30.572843413s to createHost
I0818 19:58:28.288977 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetSSHHostname
I0818 19:58:28.291482 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | domain old-k8s-version-247539 has defined MAC address 52:54:00:5a:f6:41 in network mk-old-k8s-version-247539
I0818 19:58:28.291756 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5a:f6:41", ip: ""} in network mk-old-k8s-version-247539: {Iface:virbr2 ExpiryTime:2024-08-18 20:58:15 +0000 UTC Type:0 Mac:52:54:00:5a:f6:41 Iaid: IPaddr:192.168.50.105 Prefix:24 Hostname:old-k8s-version-247539 Clientid:01:52:54:00:5a:f6:41}
I0818 19:58:28.291781 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | domain old-k8s-version-247539 has defined IP address 192.168.50.105 and MAC address 52:54:00:5a:f6:41 in network mk-old-k8s-version-247539
I0818 19:58:28.291932 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetSSHPort
I0818 19:58:28.292098 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetSSHKeyPath
I0818 19:58:28.292262 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetSSHKeyPath
I0818 19:58:28.292411 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetSSHUsername
I0818 19:58:28.292535 67330 main.go:141] libmachine: Using SSH client type: native
I0818 19:58:28.292735 67330 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.50.105 22 <nil> <nil>}
I0818 19:58:28.292747 67330 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0818 19:58:28.404275 67330 main.go:141] libmachine: SSH cmd err, output: <nil>: 1724011108.381683474
I0818 19:58:28.404300 67330 fix.go:216] guest clock: 1724011108.381683474
I0818 19:58:28.404310 67330 fix.go:229] Guest: 2024-08-18 19:58:28.381683474 +0000 UTC Remote: 2024-08-18 19:58:28.288967742 +0000 UTC m=+30.695821952 (delta=92.715732ms)
I0818 19:58:28.404334 67330 fix.go:200] guest clock delta is within tolerance: 92.715732ms
I0818 19:58:28.404339 67330 start.go:83] releasing machines lock for "old-k8s-version-247539", held for 30.688319361s
I0818 19:58:28.404362 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .DriverName
I0818 19:58:28.404646 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetIP
I0818 19:58:28.407775 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | domain old-k8s-version-247539 has defined MAC address 52:54:00:5a:f6:41 in network mk-old-k8s-version-247539
I0818 19:58:28.408143 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5a:f6:41", ip: ""} in network mk-old-k8s-version-247539: {Iface:virbr2 ExpiryTime:2024-08-18 20:58:15 +0000 UTC Type:0 Mac:52:54:00:5a:f6:41 Iaid: IPaddr:192.168.50.105 Prefix:24 Hostname:old-k8s-version-247539 Clientid:01:52:54:00:5a:f6:41}
I0818 19:58:28.408170 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | domain old-k8s-version-247539 has defined IP address 192.168.50.105 and MAC address 52:54:00:5a:f6:41 in network mk-old-k8s-version-247539
I0818 19:58:28.408313 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .DriverName
I0818 19:58:28.408843 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .DriverName
I0818 19:58:28.409027 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .DriverName
I0818 19:58:28.409131 67330 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0818 19:58:28.409182 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetSSHHostname
I0818 19:58:28.409264 67330 ssh_runner.go:195] Run: cat /version.json
I0818 19:58:28.409295 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetSSHHostname
I0818 19:58:28.411929 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | domain old-k8s-version-247539 has defined MAC address 52:54:00:5a:f6:41 in network mk-old-k8s-version-247539
I0818 19:58:28.412196 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | domain old-k8s-version-247539 has defined MAC address 52:54:00:5a:f6:41 in network mk-old-k8s-version-247539
I0818 19:58:28.412287 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5a:f6:41", ip: ""} in network mk-old-k8s-version-247539: {Iface:virbr2 ExpiryTime:2024-08-18 20:58:15 +0000 UTC Type:0 Mac:52:54:00:5a:f6:41 Iaid: IPaddr:192.168.50.105 Prefix:24 Hostname:old-k8s-version-247539 Clientid:01:52:54:00:5a:f6:41}
I0818 19:58:28.412324 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | domain old-k8s-version-247539 has defined IP address 192.168.50.105 and MAC address 52:54:00:5a:f6:41 in network mk-old-k8s-version-247539
I0818 19:58:28.412443 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetSSHPort
I0818 19:58:28.412531 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5a:f6:41", ip: ""} in network mk-old-k8s-version-247539: {Iface:virbr2 ExpiryTime:2024-08-18 20:58:15 +0000 UTC Type:0 Mac:52:54:00:5a:f6:41 Iaid: IPaddr:192.168.50.105 Prefix:24 Hostname:old-k8s-version-247539 Clientid:01:52:54:00:5a:f6:41}
I0818 19:58:28.412557 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | domain old-k8s-version-247539 has defined IP address 192.168.50.105 and MAC address 52:54:00:5a:f6:41 in network mk-old-k8s-version-247539
I0818 19:58:28.412619 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetSSHKeyPath
I0818 19:58:28.412735 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetSSHPort
I0818 19:58:28.412801 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetSSHUsername
I0818 19:58:28.412890 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetSSHKeyPath
I0818 19:58:28.412960 67330 sshutil.go:53] new ssh client: &{IP:192.168.50.105 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19423-7747/.minikube/machines/old-k8s-version-247539/id_rsa Username:docker}
I0818 19:58:28.413014 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetSSHUsername
I0818 19:58:28.413142 67330 sshutil.go:53] new ssh client: &{IP:192.168.50.105 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19423-7747/.minikube/machines/old-k8s-version-247539/id_rsa Username:docker}
I0818 19:58:28.497471 67330 ssh_runner.go:195] Run: systemctl --version
I0818 19:58:28.523749 67330 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0818 19:58:28.683621 67330 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0818 19:58:28.690751 67330 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0818 19:58:28.690831 67330 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0818 19:58:28.708219 67330 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0818 19:58:28.708247 67330 start.go:495] detecting cgroup driver to use...
I0818 19:58:28.708327 67330 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0818 19:58:28.728875 67330 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0818 19:58:28.745627 67330 docker.go:217] disabling cri-docker service (if available) ...
I0818 19:58:28.745689 67330 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0818 19:58:28.762042 67330 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0818 19:58:28.777741 67330 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0818 19:58:28.903144 67330 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0818 19:58:29.068947 67330 docker.go:233] disabling docker service ...
I0818 19:58:29.069004 67330 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0818 19:58:29.084501 67330 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0818 19:58:29.099099 67330 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0818 19:58:29.232540 67330 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0818 19:58:29.356028 67330 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0818 19:58:29.372379 67330 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0818 19:58:29.391249 67330 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0818 19:58:29.391311 67330 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0818 19:58:29.402152 67330 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0818 19:58:29.402206 67330 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0818 19:58:29.412194 67330 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0818 19:58:29.427182 67330 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0818 19:58:29.441255 67330 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0818 19:58:29.451525 67330 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0818 19:58:29.460654 67330 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0818 19:58:29.460714 67330 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0818 19:58:29.474283 67330 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0818 19:58:29.483671 67330 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0818 19:58:29.610463 67330 ssh_runner.go:195] Run: sudo systemctl restart crio
I0818 19:58:29.760753 67330 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0818 19:58:29.760822 67330 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0818 19:58:29.766300 67330 start.go:563] Will wait 60s for crictl version
I0818 19:58:29.766345 67330 ssh_runner.go:195] Run: which crictl
I0818 19:58:29.770276 67330 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0818 19:58:29.811408 67330 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0818 19:58:29.811522 67330 ssh_runner.go:195] Run: crio --version
I0818 19:58:29.840556 67330 ssh_runner.go:195] Run: crio --version
I0818 19:58:29.875421 67330 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0818 19:58:29.876810 67330 main.go:141] libmachine: (old-k8s-version-247539) Calling .GetIP
I0818 19:58:29.880826 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | domain old-k8s-version-247539 has defined MAC address 52:54:00:5a:f6:41 in network mk-old-k8s-version-247539
I0818 19:58:29.881628 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5a:f6:41", ip: ""} in network mk-old-k8s-version-247539: {Iface:virbr2 ExpiryTime:2024-08-18 20:58:15 +0000 UTC Type:0 Mac:52:54:00:5a:f6:41 Iaid: IPaddr:192.168.50.105 Prefix:24 Hostname:old-k8s-version-247539 Clientid:01:52:54:00:5a:f6:41}
I0818 19:58:29.881668 67330 main.go:141] libmachine: (old-k8s-version-247539) DBG | domain old-k8s-version-247539 has defined IP address 192.168.50.105 and MAC address 52:54:00:5a:f6:41 in network mk-old-k8s-version-247539
I0818 19:58:29.882008 67330 ssh_runner.go:195] Run: grep 192.168.50.1 host.minikube.internal$ /etc/hosts
I0818 19:58:29.886676 67330 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.50.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0818 19:58:29.900439 67330 kubeadm.go:883] updating cluster {Name:old-k8s-version-247539 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19452/minikube-v1.33.1-1723740674-19452-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-247539 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.50.105 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] M
ountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0818 19:58:29.900539 67330 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0818 19:58:29.900586 67330 ssh_runner.go:195] Run: sudo crictl images --output json
I0818 19:58:29.936690 67330 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0818 19:58:29.936765 67330 ssh_runner.go:195] Run: which lz4
I0818 19:58:29.940979 67330 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0818 19:58:29.945294 67330 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0818 19:58:29.945339 67330 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19423-7747/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0818 19:58:31.683109 67330 crio.go:462] duration metric: took 1.742162722s to copy over tarball
I0818 19:58:31.683231 67330 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0818 19:58:34.481757 67330 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.798495772s)
I0818 19:58:34.481789 67330 crio.go:469] duration metric: took 2.798602184s to extract the tarball
I0818 19:58:34.481800 67330 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0818 19:58:34.525798 67330 ssh_runner.go:195] Run: sudo crictl images --output json
I0818 19:58:34.577951 67330 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0818 19:58:34.577974 67330 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0818 19:58:34.578041 67330 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0818 19:58:34.578063 67330 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I0818 19:58:34.578087 67330 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0818 19:58:34.578086 67330 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0818 19:58:34.578041 67330 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0818 19:58:34.578163 67330 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0818 19:58:34.578175 67330 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I0818 19:58:34.578308 67330 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0818 19:58:34.579901 67330 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0818 19:58:34.579948 67330 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0818 19:58:34.579955 67330 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0818 19:58:34.579956 67330 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0818 19:58:34.579979 67330 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0818 19:58:34.580025 67330 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0818 19:58:34.579906 67330 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0818 19:58:34.580253 67330 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0818 19:58:34.726710 67330 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0818 19:58:34.738435 67330 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0818 19:58:34.777740 67330 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0818 19:58:34.777791 67330 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0818 19:58:34.777843 67330 ssh_runner.go:195] Run: which crictl
I0818 19:58:34.797712 67330 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0818 19:58:34.797754 67330 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0818 19:58:34.797790 67330 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0818 19:58:34.797794 67330 ssh_runner.go:195] Run: which crictl
I0818 19:58:34.802844 67330 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0818 19:58:34.827567 67330 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0818 19:58:34.854340 67330 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0818 19:58:34.865963 67330 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0818 19:58:34.917797 67330 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0818 19:58:34.926774 67330 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0818 19:58:34.929098 67330 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0818 19:58:34.933396 67330 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0818 19:58:34.933393 67330 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0818 19:58:34.933487 67330 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0818 19:58:34.933530 67330 ssh_runner.go:195] Run: which crictl
I0818 19:58:34.946522 67330 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0818 19:58:34.967234 67330 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0818 19:58:35.083134 67330 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0818 19:58:35.083229 67330 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0818 19:58:35.083244 67330 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19423-7747/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0818 19:58:35.083249 67330 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0818 19:58:35.083288 67330 ssh_runner.go:195] Run: which crictl
I0818 19:58:35.083294 67330 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0818 19:58:35.083307 67330 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0818 19:58:35.083331 67330 ssh_runner.go:195] Run: which crictl
I0818 19:58:35.083185 67330 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0818 19:58:35.083363 67330 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19423-7747/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0818 19:58:35.083367 67330 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0818 19:58:35.083408 67330 ssh_runner.go:195] Run: which crictl
I0818 19:58:35.086725 67330 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0818 19:58:35.086763 67330 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0818 19:58:35.086801 67330 ssh_runner.go:195] Run: which crictl
I0818 19:58:35.091958 67330 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0818 19:58:35.139743 67330 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0818 19:58:35.139784 67330 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0818 19:58:35.139837 67330 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0818 19:58:35.139855 67330 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0818 19:58:35.153495 67330 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0818 19:58:35.250381 67330 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0818 19:58:35.250436 67330 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0818 19:58:35.253218 67330 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0818 19:58:35.253262 67330 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0818 19:58:35.268027 67330 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0818 19:58:35.341262 67330 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0818 19:58:35.341315 67330 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0818 19:58:35.367187 67330 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19423-7747/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0818 19:58:35.375453 67330 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0818 19:58:35.386153 67330 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19423-7747/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0818 19:58:35.433799 67330 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19423-7747/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0818 19:58:35.433856 67330 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19423-7747/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0818 19:58:35.449822 67330 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19423-7747/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0818 19:58:35.516645 67330 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0818 19:58:35.664736 67330 cache_images.go:92] duration metric: took 1.08674885s to LoadCachedImages
W0818 19:58:35.664826 67330 out.go:270] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19423-7747/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19423-7747/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0: no such file or directory
I0818 19:58:35.664840 67330 kubeadm.go:934] updating node { 192.168.50.105 8443 v1.20.0 crio true true} ...
I0818 19:58:35.664936 67330 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-247539 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.50.105
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-247539 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0818 19:58:35.665001 67330 ssh_runner.go:195] Run: crio config
I0818 19:58:35.727710 67330 cni.go:84] Creating CNI manager for ""
I0818 19:58:35.727732 67330 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0818 19:58:35.727744 67330 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0818 19:58:35.727769 67330 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.50.105 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-247539 NodeName:old-k8s-version-247539 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.50.105"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.50.105 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0818 19:58:35.727904 67330 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.50.105
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-247539"
kubeletExtraArgs:
node-ip: 192.168.50.105
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.50.105"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0818 19:58:35.727964 67330 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0818 19:58:35.739040 67330 binaries.go:44] Found k8s binaries, skipping transfer
I0818 19:58:35.739107 67330 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0818 19:58:35.754102 67330 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0818 19:58:35.776619 67330 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0818 19:58:35.798837 67330 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2123 bytes)
I0818 19:58:35.820673 67330 ssh_runner.go:195] Run: grep 192.168.50.105 control-plane.minikube.internal$ /etc/hosts
I0818 19:58:35.824706 67330 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.50.105 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0818 19:58:35.838562 67330 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0818 19:58:35.972713 67330 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0818 19:58:35.993624 67330 certs.go:68] Setting up /home/jenkins/minikube-integration/19423-7747/.minikube/profiles/old-k8s-version-247539 for IP: 192.168.50.105
I0818 19:58:35.993646 67330 certs.go:194] generating shared ca certs ...
I0818 19:58:35.993681 67330 certs.go:226] acquiring lock for ca certs: {Name:mka2b3e7c58af327d3df7eeeef3669cd7427d211 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0818 19:58:35.993822 67330 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19423-7747/.minikube/ca.key
I0818 19:58:35.993875 67330 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19423-7747/.minikube/proxy-client-ca.key
I0818 19:58:35.993888 67330 certs.go:256] generating profile certs ...
I0818 19:58:35.993952 67330 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19423-7747/.minikube/profiles/old-k8s-version-247539/client.key
I0818 19:58:35.993976 67330 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19423-7747/.minikube/profiles/old-k8s-version-247539/client.crt with IP's: []
I0818 19:58:36.145863 67330 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19423-7747/.minikube/profiles/old-k8s-version-247539/client.crt ...
I0818 19:58:36.145898 67330 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19423-7747/.minikube/profiles/old-k8s-version-247539/client.crt: {Name:mk6d59a5ff7041e4bc80fa239aa2afc0424b99bd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0818 19:58:36.146085 67330 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19423-7747/.minikube/profiles/old-k8s-version-247539/client.key ...
I0818 19:58:36.146109 67330 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19423-7747/.minikube/profiles/old-k8s-version-247539/client.key: {Name:mk16be4c70d0b1657a0e6183ed79fe3dc82e0869 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0818 19:58:36.146237 67330 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19423-7747/.minikube/profiles/old-k8s-version-247539/apiserver.key.3812b43e
I0818 19:58:36.146262 67330 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19423-7747/.minikube/profiles/old-k8s-version-247539/apiserver.crt.3812b43e with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.50.105]
I0818 19:58:36.558825 67330 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19423-7747/.minikube/profiles/old-k8s-version-247539/apiserver.crt.3812b43e ...
I0818 19:58:36.558853 67330 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19423-7747/.minikube/profiles/old-k8s-version-247539/apiserver.crt.3812b43e: {Name:mkd6ab8d33ca241cc9980a55cc8cf274230fc9c1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0818 19:58:36.616604 67330 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19423-7747/.minikube/profiles/old-k8s-version-247539/apiserver.key.3812b43e ...
I0818 19:58:36.616650 67330 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19423-7747/.minikube/profiles/old-k8s-version-247539/apiserver.key.3812b43e: {Name:mk110d186a321fbeef0e24a13d32396f8833ad45 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0818 19:58:36.616805 67330 certs.go:381] copying /home/jenkins/minikube-integration/19423-7747/.minikube/profiles/old-k8s-version-247539/apiserver.crt.3812b43e -> /home/jenkins/minikube-integration/19423-7747/.minikube/profiles/old-k8s-version-247539/apiserver.crt
I0818 19:58:36.616908 67330 certs.go:385] copying /home/jenkins/minikube-integration/19423-7747/.minikube/profiles/old-k8s-version-247539/apiserver.key.3812b43e -> /home/jenkins/minikube-integration/19423-7747/.minikube/profiles/old-k8s-version-247539/apiserver.key
I0818 19:58:36.616989 67330 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19423-7747/.minikube/profiles/old-k8s-version-247539/proxy-client.key
I0818 19:58:36.617007 67330 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19423-7747/.minikube/profiles/old-k8s-version-247539/proxy-client.crt with IP's: []
I0818 19:58:36.889103 67330 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19423-7747/.minikube/profiles/old-k8s-version-247539/proxy-client.crt ...
I0818 19:58:36.889133 67330 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19423-7747/.minikube/profiles/old-k8s-version-247539/proxy-client.crt: {Name:mk6baeaa7934b12b08ad5a893ee97a2c7aa88306 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0818 19:58:36.918227 67330 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19423-7747/.minikube/profiles/old-k8s-version-247539/proxy-client.key ...
I0818 19:58:36.918261 67330 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19423-7747/.minikube/profiles/old-k8s-version-247539/proxy-client.key: {Name:mk538f933cd5c64c7b904132dbeddeb60517a2f6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0818 19:58:36.918520 67330 certs.go:484] found cert: /home/jenkins/minikube-integration/19423-7747/.minikube/certs/14934.pem (1338 bytes)
W0818 19:58:36.918578 67330 certs.go:480] ignoring /home/jenkins/minikube-integration/19423-7747/.minikube/certs/14934_empty.pem, impossibly tiny 0 bytes
I0818 19:58:36.918604 67330 certs.go:484] found cert: /home/jenkins/minikube-integration/19423-7747/.minikube/certs/ca-key.pem (1679 bytes)
I0818 19:58:36.918639 67330 certs.go:484] found cert: /home/jenkins/minikube-integration/19423-7747/.minikube/certs/ca.pem (1082 bytes)
I0818 19:58:36.918678 67330 certs.go:484] found cert: /home/jenkins/minikube-integration/19423-7747/.minikube/certs/cert.pem (1123 bytes)
I0818 19:58:36.918717 67330 certs.go:484] found cert: /home/jenkins/minikube-integration/19423-7747/.minikube/certs/key.pem (1675 bytes)
I0818 19:58:36.918849 67330 certs.go:484] found cert: /home/jenkins/minikube-integration/19423-7747/.minikube/files/etc/ssl/certs/149342.pem (1708 bytes)
I0818 19:58:36.919796 67330 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19423-7747/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0818 19:58:36.957524 67330 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19423-7747/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0818 19:58:36.993791 67330 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19423-7747/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0818 19:58:37.032163 67330 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19423-7747/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0818 19:58:37.073628 67330 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19423-7747/.minikube/profiles/old-k8s-version-247539/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0818 19:58:37.100720 67330 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19423-7747/.minikube/profiles/old-k8s-version-247539/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0818 19:58:37.132032 67330 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19423-7747/.minikube/profiles/old-k8s-version-247539/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0818 19:58:37.159014 67330 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19423-7747/.minikube/profiles/old-k8s-version-247539/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0818 19:58:37.192650 67330 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19423-7747/.minikube/certs/14934.pem --> /usr/share/ca-certificates/14934.pem (1338 bytes)
I0818 19:58:37.223734 67330 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19423-7747/.minikube/files/etc/ssl/certs/149342.pem --> /usr/share/ca-certificates/149342.pem (1708 bytes)
I0818 19:58:37.260148 67330 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19423-7747/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0818 19:58:37.287346 67330 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0818 19:58:37.307361 67330 ssh_runner.go:195] Run: openssl version
I0818 19:58:37.313275 67330 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/14934.pem && ln -fs /usr/share/ca-certificates/14934.pem /etc/ssl/certs/14934.pem"
I0818 19:58:37.325426 67330 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/14934.pem
I0818 19:58:37.330715 67330 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Aug 18 18:51 /usr/share/ca-certificates/14934.pem
I0818 19:58:37.330768 67330 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/14934.pem
I0818 19:58:37.336861 67330 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/14934.pem /etc/ssl/certs/51391683.0"
I0818 19:58:37.347737 67330 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/149342.pem && ln -fs /usr/share/ca-certificates/149342.pem /etc/ssl/certs/149342.pem"
I0818 19:58:37.361279 67330 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/149342.pem
I0818 19:58:37.365888 67330 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Aug 18 18:51 /usr/share/ca-certificates/149342.pem
I0818 19:58:37.365946 67330 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/149342.pem
I0818 19:58:37.371651 67330 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/149342.pem /etc/ssl/certs/3ec20f2e.0"
I0818 19:58:37.382008 67330 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0818 19:58:37.392652 67330 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0818 19:58:37.397105 67330 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug 18 18:39 /usr/share/ca-certificates/minikubeCA.pem
I0818 19:58:37.397162 67330 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0818 19:58:37.402686 67330 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0818 19:58:37.413360 67330 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0818 19:58:37.417556 67330 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0818 19:58:37.417610 67330 kubeadm.go:392] StartCluster: {Name:old-k8s-version-247539 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19452/minikube-v1.33.1-1723740674-19452-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-247539 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.50.105 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Moun
tPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0818 19:58:37.417703 67330 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0818 19:58:37.417765 67330 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0818 19:58:37.460817 67330 cri.go:89] found id: ""
I0818 19:58:37.460885 67330 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0818 19:58:37.472242 67330 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0818 19:58:37.481981 67330 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0818 19:58:37.491661 67330 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0818 19:58:37.491681 67330 kubeadm.go:157] found existing configuration files:
I0818 19:58:37.491723 67330 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0818 19:58:37.500732 67330 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0818 19:58:37.500785 67330 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0818 19:58:37.510832 67330 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0818 19:58:37.523234 67330 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0818 19:58:37.523291 67330 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0818 19:58:37.532835 67330 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0818 19:58:37.542350 67330 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0818 19:58:37.542405 67330 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0818 19:58:37.554775 67330 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0818 19:58:37.566470 67330 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0818 19:58:37.566531 67330 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0818 19:58:37.579326 67330 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0818 19:58:37.717211 67330 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0818 19:58:37.717293 67330 kubeadm.go:310] [preflight] Running pre-flight checks
I0818 19:58:37.913289 67330 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0818 19:58:37.913470 67330 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0818 19:58:37.913624 67330 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0818 19:58:38.118976 67330 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0818 19:58:38.120533 67330 out.go:235] - Generating certificates and keys ...
I0818 19:58:38.120632 67330 kubeadm.go:310] [certs] Using existing ca certificate authority
I0818 19:58:38.120716 67330 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0818 19:58:38.217949 67330 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0818 19:58:38.480674 67330 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0818 19:58:38.698258 67330 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0818 19:58:38.891526 67330 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0818 19:58:39.122021 67330 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0818 19:58:39.122343 67330 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-247539] and IPs [192.168.50.105 127.0.0.1 ::1]
I0818 19:58:39.361399 67330 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0818 19:58:39.361796 67330 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-247539] and IPs [192.168.50.105 127.0.0.1 ::1]
I0818 19:58:39.514998 67330 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0818 19:58:40.173577 67330 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0818 19:58:40.219360 67330 kubeadm.go:310] [certs] Generating "sa" key and public key
I0818 19:58:40.219689 67330 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0818 19:58:40.269420 67330 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0818 19:58:40.789377 67330 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0818 19:58:41.236515 67330 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0818 19:58:41.517116 67330 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0818 19:58:41.547586 67330 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0818 19:58:41.550758 67330 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0818 19:58:41.550833 67330 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0818 19:58:41.714129 67330 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0818 19:58:41.716713 67330 out.go:235] - Booting up control plane ...
I0818 19:58:41.716851 67330 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0818 19:58:41.723766 67330 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0818 19:58:41.725262 67330 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0818 19:58:41.726774 67330 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0818 19:58:41.732085 67330 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0818 19:59:21.727561 67330 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0818 19:59:21.728164 67330 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0818 19:59:21.728439 67330 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0818 19:59:26.727945 67330 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0818 19:59:26.728254 67330 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0818 19:59:36.728265 67330 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0818 19:59:36.728572 67330 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0818 19:59:56.728222 67330 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0818 19:59:56.728521 67330 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0818 20:00:36.729736 67330 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0818 20:00:36.730009 67330 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0818 20:00:36.730028 67330 kubeadm.go:310]
I0818 20:00:36.730079 67330 kubeadm.go:310] Unfortunately, an error has occurred:
I0818 20:00:36.730164 67330 kubeadm.go:310] timed out waiting for the condition
I0818 20:00:36.730190 67330 kubeadm.go:310]
I0818 20:00:36.730245 67330 kubeadm.go:310] This error is likely caused by:
I0818 20:00:36.730309 67330 kubeadm.go:310] - The kubelet is not running
I0818 20:00:36.730465 67330 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0818 20:00:36.730474 67330 kubeadm.go:310]
I0818 20:00:36.730572 67330 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0818 20:00:36.730617 67330 kubeadm.go:310] - 'systemctl status kubelet'
I0818 20:00:36.730646 67330 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0818 20:00:36.730653 67330 kubeadm.go:310]
I0818 20:00:36.730790 67330 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0818 20:00:36.730904 67330 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0818 20:00:36.730919 67330 kubeadm.go:310]
I0818 20:00:36.731072 67330 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0818 20:00:36.731205 67330 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0818 20:00:36.731305 67330 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0818 20:00:36.731399 67330 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0818 20:00:36.731418 67330 kubeadm.go:310]
I0818 20:00:36.732553 67330 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0818 20:00:36.732653 67330 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0818 20:00:36.732721 67330 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
W0818 20:00:36.732859 67330 out.go:270] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-247539] and IPs [192.168.50.105 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-247539] and IPs [192.168.50.105 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-247539] and IPs [192.168.50.105 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-247539] and IPs [192.168.50.105 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0818 20:00:36.732899 67330 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0818 20:00:37.224328 67330 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0818 20:00:37.238466 67330 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0818 20:00:37.248271 67330 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0818 20:00:37.248291 67330 kubeadm.go:157] found existing configuration files:
I0818 20:00:37.248334 67330 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0818 20:00:37.257513 67330 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0818 20:00:37.257576 67330 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0818 20:00:37.267081 67330 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0818 20:00:37.276095 67330 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0818 20:00:37.276157 67330 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0818 20:00:37.285237 67330 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0818 20:00:37.293838 67330 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0818 20:00:37.293889 67330 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0818 20:00:37.303426 67330 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0818 20:00:37.312542 67330 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0818 20:00:37.312604 67330 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0818 20:00:37.323453 67330 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0818 20:00:37.531159 67330 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0818 20:02:33.720024 67330 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0818 20:02:33.720108 67330 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0818 20:02:33.721898 67330 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0818 20:02:33.721982 67330 kubeadm.go:310] [preflight] Running pre-flight checks
I0818 20:02:33.722082 67330 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0818 20:02:33.722166 67330 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0818 20:02:33.722263 67330 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0818 20:02:33.722314 67330 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0818 20:02:33.724278 67330 out.go:235] - Generating certificates and keys ...
I0818 20:02:33.724340 67330 kubeadm.go:310] [certs] Using existing ca certificate authority
I0818 20:02:33.724402 67330 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0818 20:02:33.724466 67330 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0818 20:02:33.724513 67330 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0818 20:02:33.724567 67330 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0818 20:02:33.724608 67330 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0818 20:02:33.724679 67330 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0818 20:02:33.724732 67330 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0818 20:02:33.724788 67330 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0818 20:02:33.724852 67330 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0818 20:02:33.724885 67330 kubeadm.go:310] [certs] Using the existing "sa" key
I0818 20:02:33.724928 67330 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0818 20:02:33.724974 67330 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0818 20:02:33.725018 67330 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0818 20:02:33.725083 67330 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0818 20:02:33.725143 67330 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0818 20:02:33.725237 67330 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0818 20:02:33.725345 67330 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0818 20:02:33.725406 67330 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0818 20:02:33.725489 67330 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0818 20:02:33.727068 67330 out.go:235] - Booting up control plane ...
I0818 20:02:33.727159 67330 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0818 20:02:33.727223 67330 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0818 20:02:33.727285 67330 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0818 20:02:33.727362 67330 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0818 20:02:33.727516 67330 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0818 20:02:33.727563 67330 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0818 20:02:33.727622 67330 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0818 20:02:33.727785 67330 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0818 20:02:33.727877 67330 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0818 20:02:33.728053 67330 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0818 20:02:33.728141 67330 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0818 20:02:33.728322 67330 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0818 20:02:33.728415 67330 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0818 20:02:33.728649 67330 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0818 20:02:33.728750 67330 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0818 20:02:33.728917 67330 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0818 20:02:33.728925 67330 kubeadm.go:310]
I0818 20:02:33.728958 67330 kubeadm.go:310] Unfortunately, an error has occurred:
I0818 20:02:33.728992 67330 kubeadm.go:310] timed out waiting for the condition
I0818 20:02:33.728999 67330 kubeadm.go:310]
I0818 20:02:33.729038 67330 kubeadm.go:310] This error is likely caused by:
I0818 20:02:33.729085 67330 kubeadm.go:310] - The kubelet is not running
I0818 20:02:33.729201 67330 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0818 20:02:33.729209 67330 kubeadm.go:310]
I0818 20:02:33.729322 67330 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0818 20:02:33.729376 67330 kubeadm.go:310] - 'systemctl status kubelet'
I0818 20:02:33.729425 67330 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0818 20:02:33.729434 67330 kubeadm.go:310]
I0818 20:02:33.729550 67330 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0818 20:02:33.729650 67330 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0818 20:02:33.729662 67330 kubeadm.go:310]
I0818 20:02:33.729781 67330 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0818 20:02:33.729890 67330 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0818 20:02:33.730004 67330 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0818 20:02:33.730086 67330 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0818 20:02:33.730111 67330 kubeadm.go:310]
I0818 20:02:33.730154 67330 kubeadm.go:394] duration metric: took 3m56.312548713s to StartCluster
I0818 20:02:33.730186 67330 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0818 20:02:33.730233 67330 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0818 20:02:33.786325 67330 cri.go:89] found id: ""
I0818 20:02:33.786363 67330 logs.go:276] 0 containers: []
W0818 20:02:33.786372 67330 logs.go:278] No container was found matching "kube-apiserver"
I0818 20:02:33.786377 67330 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0818 20:02:33.786434 67330 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0818 20:02:33.826899 67330 cri.go:89] found id: ""
I0818 20:02:33.826923 67330 logs.go:276] 0 containers: []
W0818 20:02:33.826930 67330 logs.go:278] No container was found matching "etcd"
I0818 20:02:33.826936 67330 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0818 20:02:33.826982 67330 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0818 20:02:33.860140 67330 cri.go:89] found id: ""
I0818 20:02:33.860164 67330 logs.go:276] 0 containers: []
W0818 20:02:33.860175 67330 logs.go:278] No container was found matching "coredns"
I0818 20:02:33.860195 67330 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0818 20:02:33.860257 67330 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0818 20:02:33.899777 67330 cri.go:89] found id: ""
I0818 20:02:33.899802 67330 logs.go:276] 0 containers: []
W0818 20:02:33.899810 67330 logs.go:278] No container was found matching "kube-scheduler"
I0818 20:02:33.899816 67330 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0818 20:02:33.899877 67330 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0818 20:02:33.934477 67330 cri.go:89] found id: ""
I0818 20:02:33.934505 67330 logs.go:276] 0 containers: []
W0818 20:02:33.934516 67330 logs.go:278] No container was found matching "kube-proxy"
I0818 20:02:33.934523 67330 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0818 20:02:33.934583 67330 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0818 20:02:33.973173 67330 cri.go:89] found id: ""
I0818 20:02:33.973207 67330 logs.go:276] 0 containers: []
W0818 20:02:33.973217 67330 logs.go:278] No container was found matching "kube-controller-manager"
I0818 20:02:33.973225 67330 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0818 20:02:33.973283 67330 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0818 20:02:34.007941 67330 cri.go:89] found id: ""
I0818 20:02:34.007973 67330 logs.go:276] 0 containers: []
W0818 20:02:34.007983 67330 logs.go:278] No container was found matching "kindnet"
I0818 20:02:34.007994 67330 logs.go:123] Gathering logs for kubelet ...
I0818 20:02:34.008005 67330 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0818 20:02:34.059983 67330 logs.go:123] Gathering logs for dmesg ...
I0818 20:02:34.060020 67330 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0818 20:02:34.074180 67330 logs.go:123] Gathering logs for describe nodes ...
I0818 20:02:34.074209 67330 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0818 20:02:34.190709 67330 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0818 20:02:34.190731 67330 logs.go:123] Gathering logs for CRI-O ...
I0818 20:02:34.190743 67330 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0818 20:02:34.299742 67330 logs.go:123] Gathering logs for container status ...
I0818 20:02:34.299781 67330 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0818 20:02:34.337617 67330 out.go:418] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0818 20:02:34.337685 67330 out.go:270] *
*
W0818 20:02:34.337738 67330 out.go:270] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0818 20:02:34.337755 67330 out.go:270] *
*
W0818 20:02:34.338537 67330 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0818 20:02:34.341919 67330 out.go:201]
W0818 20:02:34.343196 67330 out.go:270] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0818 20:02:34.343278 67330 out.go:270] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0818 20:02:34.343305 67330 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0818 20:02:34.344889 67330 out.go:201]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-247539 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-247539 -n old-k8s-version-247539
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-247539 -n old-k8s-version-247539: exit status 6 (222.756276ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0818 20:02:34.615457 73363 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-247539" does not appear in /home/jenkins/minikube-integration/19423-7747/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-247539" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (277.04s)