=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-740194 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-740194 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m50.447536901s)
-- stdout --
* [old-k8s-version-740194] minikube v1.34.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=19667
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19667-7671/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19667-7671/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-740194" primary control-plane node in "old-k8s-version-740194" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0918 20:54:25.217162 57636 out.go:345] Setting OutFile to fd 1 ...
I0918 20:54:25.217316 57636 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0918 20:54:25.217329 57636 out.go:358] Setting ErrFile to fd 2...
I0918 20:54:25.217342 57636 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0918 20:54:25.217647 57636 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19667-7671/.minikube/bin
I0918 20:54:25.218443 57636 out.go:352] Setting JSON to false
I0918 20:54:25.219781 57636 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-8","uptime":5809,"bootTime":1726687056,"procs":214,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1069-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0918 20:54:25.219925 57636 start.go:139] virtualization: kvm guest
I0918 20:54:25.223213 57636 out.go:177] * [old-k8s-version-740194] minikube v1.34.0 on Ubuntu 20.04 (kvm/amd64)
I0918 20:54:25.225154 57636 notify.go:220] Checking for updates...
I0918 20:54:25.225206 57636 out.go:177] - MINIKUBE_LOCATION=19667
I0918 20:54:25.226962 57636 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0918 20:54:25.228651 57636 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19667-7671/kubeconfig
I0918 20:54:25.230373 57636 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19667-7671/.minikube
I0918 20:54:25.231981 57636 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0918 20:54:25.233429 57636 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0918 20:54:25.235533 57636 config.go:182] Loaded profile config "cert-options-347585": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.1
I0918 20:54:25.235678 57636 config.go:182] Loaded profile config "kubernetes-upgrade-878094": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0918 20:54:25.235796 57636 config.go:182] Loaded profile config "pause-543700": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.1
I0918 20:54:25.235925 57636 driver.go:394] Setting default libvirt URI to qemu:///system
I0918 20:54:25.276500 57636 out.go:177] * Using the kvm2 driver based on user configuration
I0918 20:54:25.277785 57636 start.go:297] selected driver: kvm2
I0918 20:54:25.277808 57636 start.go:901] validating driver "kvm2" against <nil>
I0918 20:54:25.277823 57636 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0918 20:54:25.278901 57636 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0918 20:54:25.278982 57636 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19667-7671/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0918 20:54:25.296763 57636 install.go:137] /home/jenkins/minikube-integration/19667-7671/.minikube/bin/docker-machine-driver-kvm2 version is 1.34.0
I0918 20:54:25.296842 57636 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0918 20:54:25.297196 57636 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0918 20:54:25.297253 57636 cni.go:84] Creating CNI manager for ""
I0918 20:54:25.297322 57636 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0918 20:54:25.297337 57636 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0918 20:54:25.297406 57636 start.go:340] cluster config:
{Name:old-k8s-version-740194 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726589491-19662@sha256:6370b9fec173944088c2d87d44b01819c0ec611a83d9e2f38d36352dff8121a4 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-740194 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0918 20:54:25.297559 57636 iso.go:125] acquiring lock: {Name:mkbcf4d84f3091567a39802cd5e773cb10b8c545 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0918 20:54:25.299637 57636 out.go:177] * Starting "old-k8s-version-740194" primary control-plane node in "old-k8s-version-740194" cluster
I0918 20:54:25.301007 57636 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0918 20:54:25.301067 57636 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19667-7671/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0918 20:54:25.301083 57636 cache.go:56] Caching tarball of preloaded images
I0918 20:54:25.301208 57636 preload.go:172] Found /home/jenkins/minikube-integration/19667-7671/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0918 20:54:25.301222 57636 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0918 20:54:25.301372 57636 profile.go:143] Saving config to /home/jenkins/minikube-integration/19667-7671/.minikube/profiles/old-k8s-version-740194/config.json ...
I0918 20:54:25.301402 57636 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19667-7671/.minikube/profiles/old-k8s-version-740194/config.json: {Name:mk01958a732544452df4228f15c108da27c14f58 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0918 20:54:25.301596 57636 start.go:360] acquireMachinesLock for old-k8s-version-740194: {Name:mk1b0d68a0b7d9d4bc8204d5d81cb9eb77222526 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0918 20:54:44.012911 57636 start.go:364] duration metric: took 18.711233892s to acquireMachinesLock for "old-k8s-version-740194"
I0918 20:54:44.013008 57636 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-740194 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19649/minikube-v1.34.0-1726481713-19649-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726589491-19662@sha256:6370b9fec173944088c2d87d44b01819c0ec611a83d9e2f38d36352dff8121a4 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-740194 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0918 20:54:44.013113 57636 start.go:125] createHost starting for "" (driver="kvm2")
I0918 20:54:44.015315 57636 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0918 20:54:44.015526 57636 main.go:141] libmachine: Found binary path at /home/jenkins/minikube-integration/19667-7671/.minikube/bin/docker-machine-driver-kvm2
I0918 20:54:44.015577 57636 main.go:141] libmachine: Launching plugin server for driver kvm2
I0918 20:54:44.032565 57636 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42795
I0918 20:54:44.033031 57636 main.go:141] libmachine: () Calling .GetVersion
I0918 20:54:44.033579 57636 main.go:141] libmachine: Using API Version 1
I0918 20:54:44.033625 57636 main.go:141] libmachine: () Calling .SetConfigRaw
I0918 20:54:44.033985 57636 main.go:141] libmachine: () Calling .GetMachineName
I0918 20:54:44.034220 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetMachineName
I0918 20:54:44.034374 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .DriverName
I0918 20:54:44.034564 57636 start.go:159] libmachine.API.Create for "old-k8s-version-740194" (driver="kvm2")
I0918 20:54:44.034604 57636 client.go:168] LocalClient.Create starting
I0918 20:54:44.034639 57636 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19667-7671/.minikube/certs/ca.pem
I0918 20:54:44.034678 57636 main.go:141] libmachine: Decoding PEM data...
I0918 20:54:44.034702 57636 main.go:141] libmachine: Parsing certificate...
I0918 20:54:44.034765 57636 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19667-7671/.minikube/certs/cert.pem
I0918 20:54:44.034791 57636 main.go:141] libmachine: Decoding PEM data...
I0918 20:54:44.034813 57636 main.go:141] libmachine: Parsing certificate...
I0918 20:54:44.034840 57636 main.go:141] libmachine: Running pre-create checks...
I0918 20:54:44.034852 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .PreCreateCheck
I0918 20:54:44.035275 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetConfigRaw
I0918 20:54:44.035729 57636 main.go:141] libmachine: Creating machine...
I0918 20:54:44.035747 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .Create
I0918 20:54:44.035897 57636 main.go:141] libmachine: (old-k8s-version-740194) Creating KVM machine...
I0918 20:54:44.037334 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | found existing default KVM network
I0918 20:54:44.038818 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | I0918 20:54:44.038656 57927 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:f9:46:d3} reservation:<nil>}
I0918 20:54:44.039551 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | I0918 20:54:44.039470 57927 network.go:211] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr4 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:3f:b5:c1} reservation:<nil>}
I0918 20:54:44.040619 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | I0918 20:54:44.040550 57927 network.go:211] skipping subnet 192.168.61.0/24 that is taken: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName:virbr2 IfaceIPv4:192.168.61.1 IfaceMTU:1500 IfaceMAC:52:54:00:b8:c8:5a} reservation:<nil>}
I0918 20:54:44.041693 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | I0918 20:54:44.041582 57927 network.go:206] using free private subnet 192.168.72.0/24: &{IP:192.168.72.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.72.0/24 Gateway:192.168.72.1 ClientMin:192.168.72.2 ClientMax:192.168.72.254 Broadcast:192.168.72.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0002856e0}
I0918 20:54:44.041720 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | created network xml:
I0918 20:54:44.041769 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | <network>
I0918 20:54:44.041793 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | <name>mk-old-k8s-version-740194</name>
I0918 20:54:44.041848 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | <dns enable='no'/>
I0918 20:54:44.041869 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG |
I0918 20:54:44.041882 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | <ip address='192.168.72.1' netmask='255.255.255.0'>
I0918 20:54:44.041893 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | <dhcp>
I0918 20:54:44.041907 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | <range start='192.168.72.2' end='192.168.72.253'/>
I0918 20:54:44.041917 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | </dhcp>
I0918 20:54:44.041928 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | </ip>
I0918 20:54:44.041940 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG |
I0918 20:54:44.041949 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | </network>
I0918 20:54:44.041958 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG |
I0918 20:54:44.047193 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | trying to create private KVM network mk-old-k8s-version-740194 192.168.72.0/24...
I0918 20:54:44.123496 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | private KVM network mk-old-k8s-version-740194 192.168.72.0/24 created
I0918 20:54:44.123531 57636 main.go:141] libmachine: (old-k8s-version-740194) Setting up store path in /home/jenkins/minikube-integration/19667-7671/.minikube/machines/old-k8s-version-740194 ...
I0918 20:54:44.123556 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | I0918 20:54:44.123449 57927 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19667-7671/.minikube
I0918 20:54:44.123568 57636 main.go:141] libmachine: (old-k8s-version-740194) Building disk image from file:///home/jenkins/minikube-integration/19667-7671/.minikube/cache/iso/amd64/minikube-v1.34.0-1726481713-19649-amd64.iso
I0918 20:54:44.123608 57636 main.go:141] libmachine: (old-k8s-version-740194) Downloading /home/jenkins/minikube-integration/19667-7671/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19667-7671/.minikube/cache/iso/amd64/minikube-v1.34.0-1726481713-19649-amd64.iso...
I0918 20:54:44.376922 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | I0918 20:54:44.376788 57927 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19667-7671/.minikube/machines/old-k8s-version-740194/id_rsa...
I0918 20:54:44.739886 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | I0918 20:54:44.739749 57927 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19667-7671/.minikube/machines/old-k8s-version-740194/old-k8s-version-740194.rawdisk...
I0918 20:54:44.739941 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | Writing magic tar header
I0918 20:54:44.739960 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | Writing SSH key tar header
I0918 20:54:44.739981 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | I0918 20:54:44.739857 57927 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19667-7671/.minikube/machines/old-k8s-version-740194 ...
I0918 20:54:44.740042 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19667-7671/.minikube/machines/old-k8s-version-740194
I0918 20:54:44.740063 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19667-7671/.minikube/machines
I0918 20:54:44.740081 57636 main.go:141] libmachine: (old-k8s-version-740194) Setting executable bit set on /home/jenkins/minikube-integration/19667-7671/.minikube/machines/old-k8s-version-740194 (perms=drwx------)
I0918 20:54:44.740097 57636 main.go:141] libmachine: (old-k8s-version-740194) Setting executable bit set on /home/jenkins/minikube-integration/19667-7671/.minikube/machines (perms=drwxr-xr-x)
I0918 20:54:44.740111 57636 main.go:141] libmachine: (old-k8s-version-740194) Setting executable bit set on /home/jenkins/minikube-integration/19667-7671/.minikube (perms=drwxr-xr-x)
I0918 20:54:44.740122 57636 main.go:141] libmachine: (old-k8s-version-740194) Setting executable bit set on /home/jenkins/minikube-integration/19667-7671 (perms=drwxrwxr-x)
I0918 20:54:44.740138 57636 main.go:141] libmachine: (old-k8s-version-740194) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0918 20:54:44.740152 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19667-7671/.minikube
I0918 20:54:44.740162 57636 main.go:141] libmachine: (old-k8s-version-740194) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0918 20:54:44.740176 57636 main.go:141] libmachine: (old-k8s-version-740194) Creating domain...
I0918 20:54:44.740188 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19667-7671
I0918 20:54:44.740198 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0918 20:54:44.740208 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | Checking permissions on dir: /home/jenkins
I0918 20:54:44.740218 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | Checking permissions on dir: /home
I0918 20:54:44.740226 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | Skipping /home - not owner
I0918 20:54:44.741491 57636 main.go:141] libmachine: (old-k8s-version-740194) define libvirt domain using xml:
I0918 20:54:44.741520 57636 main.go:141] libmachine: (old-k8s-version-740194) <domain type='kvm'>
I0918 20:54:44.741559 57636 main.go:141] libmachine: (old-k8s-version-740194) <name>old-k8s-version-740194</name>
I0918 20:54:44.741584 57636 main.go:141] libmachine: (old-k8s-version-740194) <memory unit='MiB'>2200</memory>
I0918 20:54:44.741594 57636 main.go:141] libmachine: (old-k8s-version-740194) <vcpu>2</vcpu>
I0918 20:54:44.741604 57636 main.go:141] libmachine: (old-k8s-version-740194) <features>
I0918 20:54:44.741629 57636 main.go:141] libmachine: (old-k8s-version-740194) <acpi/>
I0918 20:54:44.741638 57636 main.go:141] libmachine: (old-k8s-version-740194) <apic/>
I0918 20:54:44.741645 57636 main.go:141] libmachine: (old-k8s-version-740194) <pae/>
I0918 20:54:44.741654 57636 main.go:141] libmachine: (old-k8s-version-740194)
I0918 20:54:44.741662 57636 main.go:141] libmachine: (old-k8s-version-740194) </features>
I0918 20:54:44.741677 57636 main.go:141] libmachine: (old-k8s-version-740194) <cpu mode='host-passthrough'>
I0918 20:54:44.741688 57636 main.go:141] libmachine: (old-k8s-version-740194)
I0918 20:54:44.741697 57636 main.go:141] libmachine: (old-k8s-version-740194) </cpu>
I0918 20:54:44.741705 57636 main.go:141] libmachine: (old-k8s-version-740194) <os>
I0918 20:54:44.741714 57636 main.go:141] libmachine: (old-k8s-version-740194) <type>hvm</type>
I0918 20:54:44.741724 57636 main.go:141] libmachine: (old-k8s-version-740194) <boot dev='cdrom'/>
I0918 20:54:44.741734 57636 main.go:141] libmachine: (old-k8s-version-740194) <boot dev='hd'/>
I0918 20:54:44.741742 57636 main.go:141] libmachine: (old-k8s-version-740194) <bootmenu enable='no'/>
I0918 20:54:44.741760 57636 main.go:141] libmachine: (old-k8s-version-740194) </os>
I0918 20:54:44.741772 57636 main.go:141] libmachine: (old-k8s-version-740194) <devices>
I0918 20:54:44.741795 57636 main.go:141] libmachine: (old-k8s-version-740194) <disk type='file' device='cdrom'>
I0918 20:54:44.741820 57636 main.go:141] libmachine: (old-k8s-version-740194) <source file='/home/jenkins/minikube-integration/19667-7671/.minikube/machines/old-k8s-version-740194/boot2docker.iso'/>
I0918 20:54:44.741829 57636 main.go:141] libmachine: (old-k8s-version-740194) <target dev='hdc' bus='scsi'/>
I0918 20:54:44.741834 57636 main.go:141] libmachine: (old-k8s-version-740194) <readonly/>
I0918 20:54:44.741841 57636 main.go:141] libmachine: (old-k8s-version-740194) </disk>
I0918 20:54:44.741846 57636 main.go:141] libmachine: (old-k8s-version-740194) <disk type='file' device='disk'>
I0918 20:54:44.741856 57636 main.go:141] libmachine: (old-k8s-version-740194) <driver name='qemu' type='raw' cache='default' io='threads' />
I0918 20:54:44.741865 57636 main.go:141] libmachine: (old-k8s-version-740194) <source file='/home/jenkins/minikube-integration/19667-7671/.minikube/machines/old-k8s-version-740194/old-k8s-version-740194.rawdisk'/>
I0918 20:54:44.741871 57636 main.go:141] libmachine: (old-k8s-version-740194) <target dev='hda' bus='virtio'/>
I0918 20:54:44.741877 57636 main.go:141] libmachine: (old-k8s-version-740194) </disk>
I0918 20:54:44.741883 57636 main.go:141] libmachine: (old-k8s-version-740194) <interface type='network'>
I0918 20:54:44.741893 57636 main.go:141] libmachine: (old-k8s-version-740194) <source network='mk-old-k8s-version-740194'/>
I0918 20:54:44.741901 57636 main.go:141] libmachine: (old-k8s-version-740194) <model type='virtio'/>
I0918 20:54:44.741908 57636 main.go:141] libmachine: (old-k8s-version-740194) </interface>
I0918 20:54:44.741934 57636 main.go:141] libmachine: (old-k8s-version-740194) <interface type='network'>
I0918 20:54:44.741961 57636 main.go:141] libmachine: (old-k8s-version-740194) <source network='default'/>
I0918 20:54:44.741973 57636 main.go:141] libmachine: (old-k8s-version-740194) <model type='virtio'/>
I0918 20:54:44.741984 57636 main.go:141] libmachine: (old-k8s-version-740194) </interface>
I0918 20:54:44.741992 57636 main.go:141] libmachine: (old-k8s-version-740194) <serial type='pty'>
I0918 20:54:44.742002 57636 main.go:141] libmachine: (old-k8s-version-740194) <target port='0'/>
I0918 20:54:44.742012 57636 main.go:141] libmachine: (old-k8s-version-740194) </serial>
I0918 20:54:44.742023 57636 main.go:141] libmachine: (old-k8s-version-740194) <console type='pty'>
I0918 20:54:44.742034 57636 main.go:141] libmachine: (old-k8s-version-740194) <target type='serial' port='0'/>
I0918 20:54:44.742048 57636 main.go:141] libmachine: (old-k8s-version-740194) </console>
I0918 20:54:44.742071 57636 main.go:141] libmachine: (old-k8s-version-740194) <rng model='virtio'>
I0918 20:54:44.742083 57636 main.go:141] libmachine: (old-k8s-version-740194) <backend model='random'>/dev/random</backend>
I0918 20:54:44.742095 57636 main.go:141] libmachine: (old-k8s-version-740194) </rng>
I0918 20:54:44.742103 57636 main.go:141] libmachine: (old-k8s-version-740194)
I0918 20:54:44.742110 57636 main.go:141] libmachine: (old-k8s-version-740194)
I0918 20:54:44.742119 57636 main.go:141] libmachine: (old-k8s-version-740194) </devices>
I0918 20:54:44.742130 57636 main.go:141] libmachine: (old-k8s-version-740194) </domain>
I0918 20:54:44.742138 57636 main.go:141] libmachine: (old-k8s-version-740194)
I0918 20:54:44.747273 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | domain old-k8s-version-740194 has defined MAC address 52:54:00:46:43:78 in network default
I0918 20:54:44.747937 57636 main.go:141] libmachine: (old-k8s-version-740194) Ensuring networks are active...
I0918 20:54:44.747956 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | domain old-k8s-version-740194 has defined MAC address 52:54:00:3f:a7:11 in network mk-old-k8s-version-740194
I0918 20:54:44.748973 57636 main.go:141] libmachine: (old-k8s-version-740194) Ensuring network default is active
I0918 20:54:44.749587 57636 main.go:141] libmachine: (old-k8s-version-740194) Ensuring network mk-old-k8s-version-740194 is active
I0918 20:54:44.750143 57636 main.go:141] libmachine: (old-k8s-version-740194) Getting domain xml...
I0918 20:54:44.751026 57636 main.go:141] libmachine: (old-k8s-version-740194) Creating domain...
I0918 20:54:46.186742 57636 main.go:141] libmachine: (old-k8s-version-740194) Waiting to get IP...
I0918 20:54:46.187704 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | domain old-k8s-version-740194 has defined MAC address 52:54:00:3f:a7:11 in network mk-old-k8s-version-740194
I0918 20:54:46.188244 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | unable to find current IP address of domain old-k8s-version-740194 in network mk-old-k8s-version-740194
I0918 20:54:46.188297 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | I0918 20:54:46.188233 57927 retry.go:31] will retry after 228.869302ms: waiting for machine to come up
I0918 20:54:46.419198 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | domain old-k8s-version-740194 has defined MAC address 52:54:00:3f:a7:11 in network mk-old-k8s-version-740194
I0918 20:54:46.419743 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | unable to find current IP address of domain old-k8s-version-740194 in network mk-old-k8s-version-740194
I0918 20:54:46.419821 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | I0918 20:54:46.419713 57927 retry.go:31] will retry after 389.854092ms: waiting for machine to come up
I0918 20:54:46.811651 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | domain old-k8s-version-740194 has defined MAC address 52:54:00:3f:a7:11 in network mk-old-k8s-version-740194
I0918 20:54:46.812259 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | unable to find current IP address of domain old-k8s-version-740194 in network mk-old-k8s-version-740194
I0918 20:54:46.812284 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | I0918 20:54:46.812212 57927 retry.go:31] will retry after 383.050394ms: waiting for machine to come up
I0918 20:54:47.196937 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | domain old-k8s-version-740194 has defined MAC address 52:54:00:3f:a7:11 in network mk-old-k8s-version-740194
I0918 20:54:47.197463 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | unable to find current IP address of domain old-k8s-version-740194 in network mk-old-k8s-version-740194
I0918 20:54:47.197491 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | I0918 20:54:47.197411 57927 retry.go:31] will retry after 556.442033ms: waiting for machine to come up
I0918 20:54:47.755788 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | domain old-k8s-version-740194 has defined MAC address 52:54:00:3f:a7:11 in network mk-old-k8s-version-740194
I0918 20:54:47.756306 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | unable to find current IP address of domain old-k8s-version-740194 in network mk-old-k8s-version-740194
I0918 20:54:47.756331 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | I0918 20:54:47.756268 57927 retry.go:31] will retry after 491.387205ms: waiting for machine to come up
I0918 20:54:48.248880 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | domain old-k8s-version-740194 has defined MAC address 52:54:00:3f:a7:11 in network mk-old-k8s-version-740194
I0918 20:54:48.249407 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | unable to find current IP address of domain old-k8s-version-740194 in network mk-old-k8s-version-740194
I0918 20:54:48.249438 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | I0918 20:54:48.249337 57927 retry.go:31] will retry after 832.286861ms: waiting for machine to come up
I0918 20:54:49.083217 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | domain old-k8s-version-740194 has defined MAC address 52:54:00:3f:a7:11 in network mk-old-k8s-version-740194
I0918 20:54:49.083746 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | unable to find current IP address of domain old-k8s-version-740194 in network mk-old-k8s-version-740194
I0918 20:54:49.083775 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | I0918 20:54:49.083701 57927 retry.go:31] will retry after 779.02114ms: waiting for machine to come up
I0918 20:54:49.864702 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | domain old-k8s-version-740194 has defined MAC address 52:54:00:3f:a7:11 in network mk-old-k8s-version-740194
I0918 20:54:49.865178 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | unable to find current IP address of domain old-k8s-version-740194 in network mk-old-k8s-version-740194
I0918 20:54:49.865202 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | I0918 20:54:49.865148 57927 retry.go:31] will retry after 1.461684769s: waiting for machine to come up
I0918 20:54:51.328223 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | domain old-k8s-version-740194 has defined MAC address 52:54:00:3f:a7:11 in network mk-old-k8s-version-740194
I0918 20:54:51.328729 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | unable to find current IP address of domain old-k8s-version-740194 in network mk-old-k8s-version-740194
I0918 20:54:51.328755 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | I0918 20:54:51.328672 57927 retry.go:31] will retry after 1.227657824s: waiting for machine to come up
I0918 20:54:52.558390 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | domain old-k8s-version-740194 has defined MAC address 52:54:00:3f:a7:11 in network mk-old-k8s-version-740194
I0918 20:54:52.558995 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | unable to find current IP address of domain old-k8s-version-740194 in network mk-old-k8s-version-740194
I0918 20:54:52.559026 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | I0918 20:54:52.558935 57927 retry.go:31] will retry after 2.030269752s: waiting for machine to come up
I0918 20:54:54.591505 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | domain old-k8s-version-740194 has defined MAC address 52:54:00:3f:a7:11 in network mk-old-k8s-version-740194
I0918 20:54:54.592128 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | unable to find current IP address of domain old-k8s-version-740194 in network mk-old-k8s-version-740194
I0918 20:54:54.592160 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | I0918 20:54:54.592072 57927 retry.go:31] will retry after 2.759759247s: waiting for machine to come up
I0918 20:54:57.355323 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | domain old-k8s-version-740194 has defined MAC address 52:54:00:3f:a7:11 in network mk-old-k8s-version-740194
I0918 20:54:57.355888 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | unable to find current IP address of domain old-k8s-version-740194 in network mk-old-k8s-version-740194
I0918 20:54:57.355917 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | I0918 20:54:57.355848 57927 retry.go:31] will retry after 2.975347857s: waiting for machine to come up
I0918 20:55:00.333439 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | domain old-k8s-version-740194 has defined MAC address 52:54:00:3f:a7:11 in network mk-old-k8s-version-740194
I0918 20:55:00.334163 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | unable to find current IP address of domain old-k8s-version-740194 in network mk-old-k8s-version-740194
I0918 20:55:00.334186 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | I0918 20:55:00.334108 57927 retry.go:31] will retry after 3.419652423s: waiting for machine to come up
I0918 20:55:03.757482 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | domain old-k8s-version-740194 has defined MAC address 52:54:00:3f:a7:11 in network mk-old-k8s-version-740194
I0918 20:55:03.758295 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | unable to find current IP address of domain old-k8s-version-740194 in network mk-old-k8s-version-740194
I0918 20:55:03.758346 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | I0918 20:55:03.758262 57927 retry.go:31] will retry after 4.65098527s: waiting for machine to come up
I0918 20:55:08.410525 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | domain old-k8s-version-740194 has defined MAC address 52:54:00:3f:a7:11 in network mk-old-k8s-version-740194
I0918 20:55:08.411016 57636 main.go:141] libmachine: (old-k8s-version-740194) Found IP for machine: 192.168.72.53
I0918 20:55:08.411044 57636 main.go:141] libmachine: (old-k8s-version-740194) Reserving static IP address...
I0918 20:55:08.411069 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | domain old-k8s-version-740194 has current primary IP address 192.168.72.53 and MAC address 52:54:00:3f:a7:11 in network mk-old-k8s-version-740194
I0918 20:55:08.411464 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-740194", mac: "52:54:00:3f:a7:11", ip: "192.168.72.53"} in network mk-old-k8s-version-740194
I0918 20:55:08.493115 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | Getting to WaitForSSH function...
I0918 20:55:08.493147 57636 main.go:141] libmachine: (old-k8s-version-740194) Reserved static IP address: 192.168.72.53
I0918 20:55:08.493160 57636 main.go:141] libmachine: (old-k8s-version-740194) Waiting for SSH to be available...
I0918 20:55:08.496193 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | domain old-k8s-version-740194 has defined MAC address 52:54:00:3f:a7:11 in network mk-old-k8s-version-740194
I0918 20:55:08.496581 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3f:a7:11", ip: ""} in network mk-old-k8s-version-740194: {Iface:virbr3 ExpiryTime:2024-09-18 21:54:58 +0000 UTC Type:0 Mac:52:54:00:3f:a7:11 Iaid: IPaddr:192.168.72.53 Prefix:24 Hostname:minikube Clientid:01:52:54:00:3f:a7:11}
I0918 20:55:08.496607 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | domain old-k8s-version-740194 has defined IP address 192.168.72.53 and MAC address 52:54:00:3f:a7:11 in network mk-old-k8s-version-740194
I0918 20:55:08.496736 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | Using SSH client type: external
I0918 20:55:08.496764 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | Using SSH private key: /home/jenkins/minikube-integration/19667-7671/.minikube/machines/old-k8s-version-740194/id_rsa (-rw-------)
I0918 20:55:08.496795 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.72.53 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19667-7671/.minikube/machines/old-k8s-version-740194/id_rsa -p 22] /usr/bin/ssh <nil>}
I0918 20:55:08.496807 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | About to run SSH command:
I0918 20:55:08.496855 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | exit 0
I0918 20:55:08.624642 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | SSH cmd err, output: <nil>:
I0918 20:55:08.624933 57636 main.go:141] libmachine: (old-k8s-version-740194) KVM machine creation complete!
I0918 20:55:08.625332 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetConfigRaw
I0918 20:55:08.625885 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .DriverName
I0918 20:55:08.626081 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .DriverName
I0918 20:55:08.626267 57636 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0918 20:55:08.626299 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetState
I0918 20:55:08.627920 57636 main.go:141] libmachine: Detecting operating system of created instance...
I0918 20:55:08.627939 57636 main.go:141] libmachine: Waiting for SSH to be available...
I0918 20:55:08.627947 57636 main.go:141] libmachine: Getting to WaitForSSH function...
I0918 20:55:08.627957 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetSSHHostname
I0918 20:55:08.630628 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | domain old-k8s-version-740194 has defined MAC address 52:54:00:3f:a7:11 in network mk-old-k8s-version-740194
I0918 20:55:08.631008 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3f:a7:11", ip: ""} in network mk-old-k8s-version-740194: {Iface:virbr3 ExpiryTime:2024-09-18 21:54:58 +0000 UTC Type:0 Mac:52:54:00:3f:a7:11 Iaid: IPaddr:192.168.72.53 Prefix:24 Hostname:old-k8s-version-740194 Clientid:01:52:54:00:3f:a7:11}
I0918 20:55:08.631039 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | domain old-k8s-version-740194 has defined IP address 192.168.72.53 and MAC address 52:54:00:3f:a7:11 in network mk-old-k8s-version-740194
I0918 20:55:08.631162 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetSSHPort
I0918 20:55:08.631322 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetSSHKeyPath
I0918 20:55:08.631484 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetSSHKeyPath
I0918 20:55:08.631608 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetSSHUsername
I0918 20:55:08.631802 57636 main.go:141] libmachine: Using SSH client type: native
I0918 20:55:08.632049 57636 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x86c560] 0x86f240 <nil> [] 0s} 192.168.72.53 22 <nil> <nil>}
I0918 20:55:08.632065 57636 main.go:141] libmachine: About to run SSH command:
exit 0
I0918 20:55:08.739160 57636 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0918 20:55:08.739189 57636 main.go:141] libmachine: Detecting the provisioner...
I0918 20:55:08.739199 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetSSHHostname
I0918 20:55:08.742019 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | domain old-k8s-version-740194 has defined MAC address 52:54:00:3f:a7:11 in network mk-old-k8s-version-740194
I0918 20:55:08.742459 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3f:a7:11", ip: ""} in network mk-old-k8s-version-740194: {Iface:virbr3 ExpiryTime:2024-09-18 21:54:58 +0000 UTC Type:0 Mac:52:54:00:3f:a7:11 Iaid: IPaddr:192.168.72.53 Prefix:24 Hostname:old-k8s-version-740194 Clientid:01:52:54:00:3f:a7:11}
I0918 20:55:08.742501 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | domain old-k8s-version-740194 has defined IP address 192.168.72.53 and MAC address 52:54:00:3f:a7:11 in network mk-old-k8s-version-740194
I0918 20:55:08.742675 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetSSHPort
I0918 20:55:08.742871 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetSSHKeyPath
I0918 20:55:08.743064 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetSSHKeyPath
I0918 20:55:08.743173 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetSSHUsername
I0918 20:55:08.743363 57636 main.go:141] libmachine: Using SSH client type: native
I0918 20:55:08.743521 57636 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x86c560] 0x86f240 <nil> [] 0s} 192.168.72.53 22 <nil> <nil>}
I0918 20:55:08.743530 57636 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0918 20:55:08.852594 57636 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0918 20:55:08.852666 57636 main.go:141] libmachine: found compatible host: buildroot
I0918 20:55:08.852672 57636 main.go:141] libmachine: Provisioning with buildroot...
I0918 20:55:08.852680 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetMachineName
I0918 20:55:08.852940 57636 buildroot.go:166] provisioning hostname "old-k8s-version-740194"
I0918 20:55:08.852989 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetMachineName
I0918 20:55:08.853205 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetSSHHostname
I0918 20:55:08.855759 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | domain old-k8s-version-740194 has defined MAC address 52:54:00:3f:a7:11 in network mk-old-k8s-version-740194
I0918 20:55:08.856224 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3f:a7:11", ip: ""} in network mk-old-k8s-version-740194: {Iface:virbr3 ExpiryTime:2024-09-18 21:54:58 +0000 UTC Type:0 Mac:52:54:00:3f:a7:11 Iaid: IPaddr:192.168.72.53 Prefix:24 Hostname:old-k8s-version-740194 Clientid:01:52:54:00:3f:a7:11}
I0918 20:55:08.856254 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | domain old-k8s-version-740194 has defined IP address 192.168.72.53 and MAC address 52:54:00:3f:a7:11 in network mk-old-k8s-version-740194
I0918 20:55:08.856447 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetSSHPort
I0918 20:55:08.856661 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetSSHKeyPath
I0918 20:55:08.856855 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetSSHKeyPath
I0918 20:55:08.857035 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetSSHUsername
I0918 20:55:08.857174 57636 main.go:141] libmachine: Using SSH client type: native
I0918 20:55:08.857356 57636 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x86c560] 0x86f240 <nil> [] 0s} 192.168.72.53 22 <nil> <nil>}
I0918 20:55:08.857377 57636 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-740194 && echo "old-k8s-version-740194" | sudo tee /etc/hostname
I0918 20:55:08.978698 57636 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-740194
I0918 20:55:08.978734 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetSSHHostname
I0918 20:55:08.981586 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | domain old-k8s-version-740194 has defined MAC address 52:54:00:3f:a7:11 in network mk-old-k8s-version-740194
I0918 20:55:08.981955 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3f:a7:11", ip: ""} in network mk-old-k8s-version-740194: {Iface:virbr3 ExpiryTime:2024-09-18 21:54:58 +0000 UTC Type:0 Mac:52:54:00:3f:a7:11 Iaid: IPaddr:192.168.72.53 Prefix:24 Hostname:old-k8s-version-740194 Clientid:01:52:54:00:3f:a7:11}
I0918 20:55:08.982001 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | domain old-k8s-version-740194 has defined IP address 192.168.72.53 and MAC address 52:54:00:3f:a7:11 in network mk-old-k8s-version-740194
I0918 20:55:08.982134 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetSSHPort
I0918 20:55:08.982336 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetSSHKeyPath
I0918 20:55:08.982535 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetSSHKeyPath
I0918 20:55:08.982680 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetSSHUsername
I0918 20:55:08.982891 57636 main.go:141] libmachine: Using SSH client type: native
I0918 20:55:08.983069 57636 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x86c560] 0x86f240 <nil> [] 0s} 192.168.72.53 22 <nil> <nil>}
I0918 20:55:08.983087 57636 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-740194' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-740194/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-740194' | sudo tee -a /etc/hosts;
fi
fi
I0918 20:55:09.100431 57636 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0918 20:55:09.100460 57636 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19667-7671/.minikube CaCertPath:/home/jenkins/minikube-integration/19667-7671/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19667-7671/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19667-7671/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19667-7671/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19667-7671/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19667-7671/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19667-7671/.minikube}
I0918 20:55:09.100501 57636 buildroot.go:174] setting up certificates
I0918 20:55:09.100515 57636 provision.go:84] configureAuth start
I0918 20:55:09.100526 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetMachineName
I0918 20:55:09.100847 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetIP
I0918 20:55:09.103511 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | domain old-k8s-version-740194 has defined MAC address 52:54:00:3f:a7:11 in network mk-old-k8s-version-740194
I0918 20:55:09.103894 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3f:a7:11", ip: ""} in network mk-old-k8s-version-740194: {Iface:virbr3 ExpiryTime:2024-09-18 21:54:58 +0000 UTC Type:0 Mac:52:54:00:3f:a7:11 Iaid: IPaddr:192.168.72.53 Prefix:24 Hostname:old-k8s-version-740194 Clientid:01:52:54:00:3f:a7:11}
I0918 20:55:09.103926 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | domain old-k8s-version-740194 has defined IP address 192.168.72.53 and MAC address 52:54:00:3f:a7:11 in network mk-old-k8s-version-740194
I0918 20:55:09.104138 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetSSHHostname
I0918 20:55:09.106349 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | domain old-k8s-version-740194 has defined MAC address 52:54:00:3f:a7:11 in network mk-old-k8s-version-740194
I0918 20:55:09.106702 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3f:a7:11", ip: ""} in network mk-old-k8s-version-740194: {Iface:virbr3 ExpiryTime:2024-09-18 21:54:58 +0000 UTC Type:0 Mac:52:54:00:3f:a7:11 Iaid: IPaddr:192.168.72.53 Prefix:24 Hostname:old-k8s-version-740194 Clientid:01:52:54:00:3f:a7:11}
I0918 20:55:09.106744 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | domain old-k8s-version-740194 has defined IP address 192.168.72.53 and MAC address 52:54:00:3f:a7:11 in network mk-old-k8s-version-740194
I0918 20:55:09.106875 57636 provision.go:143] copyHostCerts
I0918 20:55:09.106942 57636 exec_runner.go:144] found /home/jenkins/minikube-integration/19667-7671/.minikube/ca.pem, removing ...
I0918 20:55:09.106952 57636 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19667-7671/.minikube/ca.pem
I0918 20:55:09.107006 57636 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19667-7671/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19667-7671/.minikube/ca.pem (1082 bytes)
I0918 20:55:09.107102 57636 exec_runner.go:144] found /home/jenkins/minikube-integration/19667-7671/.minikube/cert.pem, removing ...
I0918 20:55:09.107109 57636 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19667-7671/.minikube/cert.pem
I0918 20:55:09.107130 57636 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19667-7671/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19667-7671/.minikube/cert.pem (1123 bytes)
I0918 20:55:09.107192 57636 exec_runner.go:144] found /home/jenkins/minikube-integration/19667-7671/.minikube/key.pem, removing ...
I0918 20:55:09.107199 57636 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19667-7671/.minikube/key.pem
I0918 20:55:09.107219 57636 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19667-7671/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19667-7671/.minikube/key.pem (1679 bytes)
I0918 20:55:09.107311 57636 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19667-7671/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19667-7671/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19667-7671/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-740194 san=[127.0.0.1 192.168.72.53 localhost minikube old-k8s-version-740194]
I0918 20:55:09.278662 57636 provision.go:177] copyRemoteCerts
I0918 20:55:09.278726 57636 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0918 20:55:09.278748 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetSSHHostname
I0918 20:55:09.281784 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | domain old-k8s-version-740194 has defined MAC address 52:54:00:3f:a7:11 in network mk-old-k8s-version-740194
I0918 20:55:09.282111 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3f:a7:11", ip: ""} in network mk-old-k8s-version-740194: {Iface:virbr3 ExpiryTime:2024-09-18 21:54:58 +0000 UTC Type:0 Mac:52:54:00:3f:a7:11 Iaid: IPaddr:192.168.72.53 Prefix:24 Hostname:old-k8s-version-740194 Clientid:01:52:54:00:3f:a7:11}
I0918 20:55:09.282146 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | domain old-k8s-version-740194 has defined IP address 192.168.72.53 and MAC address 52:54:00:3f:a7:11 in network mk-old-k8s-version-740194
I0918 20:55:09.282332 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetSSHPort
I0918 20:55:09.282609 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetSSHKeyPath
I0918 20:55:09.282793 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetSSHUsername
I0918 20:55:09.282936 57636 sshutil.go:53] new ssh client: &{IP:192.168.72.53 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19667-7671/.minikube/machines/old-k8s-version-740194/id_rsa Username:docker}
I0918 20:55:09.366798 57636 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19667-7671/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0918 20:55:09.392263 57636 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19667-7671/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0918 20:55:09.417073 57636 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19667-7671/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0918 20:55:09.441344 57636 provision.go:87] duration metric: took 340.817597ms to configureAuth
I0918 20:55:09.441380 57636 buildroot.go:189] setting minikube options for container-runtime
I0918 20:55:09.441559 57636 config.go:182] Loaded profile config "old-k8s-version-740194": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0918 20:55:09.441646 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetSSHHostname
I0918 20:55:09.444803 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | domain old-k8s-version-740194 has defined MAC address 52:54:00:3f:a7:11 in network mk-old-k8s-version-740194
I0918 20:55:09.445187 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3f:a7:11", ip: ""} in network mk-old-k8s-version-740194: {Iface:virbr3 ExpiryTime:2024-09-18 21:54:58 +0000 UTC Type:0 Mac:52:54:00:3f:a7:11 Iaid: IPaddr:192.168.72.53 Prefix:24 Hostname:old-k8s-version-740194 Clientid:01:52:54:00:3f:a7:11}
I0918 20:55:09.445219 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | domain old-k8s-version-740194 has defined IP address 192.168.72.53 and MAC address 52:54:00:3f:a7:11 in network mk-old-k8s-version-740194
I0918 20:55:09.445405 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetSSHPort
I0918 20:55:09.445884 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetSSHKeyPath
I0918 20:55:09.447554 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetSSHKeyPath
I0918 20:55:09.447849 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetSSHUsername
I0918 20:55:09.448101 57636 main.go:141] libmachine: Using SSH client type: native
I0918 20:55:09.448272 57636 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x86c560] 0x86f240 <nil> [] 0s} 192.168.72.53 22 <nil> <nil>}
I0918 20:55:09.448287 57636 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0918 20:55:09.682989 57636 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0918 20:55:09.683023 57636 main.go:141] libmachine: Checking connection to Docker...
I0918 20:55:09.683031 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetURL
I0918 20:55:09.684566 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | Using libvirt version 6000000
I0918 20:55:09.687010 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | domain old-k8s-version-740194 has defined MAC address 52:54:00:3f:a7:11 in network mk-old-k8s-version-740194
I0918 20:55:09.687327 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3f:a7:11", ip: ""} in network mk-old-k8s-version-740194: {Iface:virbr3 ExpiryTime:2024-09-18 21:54:58 +0000 UTC Type:0 Mac:52:54:00:3f:a7:11 Iaid: IPaddr:192.168.72.53 Prefix:24 Hostname:old-k8s-version-740194 Clientid:01:52:54:00:3f:a7:11}
I0918 20:55:09.687353 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | domain old-k8s-version-740194 has defined IP address 192.168.72.53 and MAC address 52:54:00:3f:a7:11 in network mk-old-k8s-version-740194
I0918 20:55:09.687721 57636 main.go:141] libmachine: Docker is up and running!
I0918 20:55:09.687738 57636 main.go:141] libmachine: Reticulating splines...
I0918 20:55:09.687745 57636 client.go:171] duration metric: took 25.653131026s to LocalClient.Create
I0918 20:55:09.687778 57636 start.go:167] duration metric: took 25.653216108s to libmachine.API.Create "old-k8s-version-740194"
I0918 20:55:09.687792 57636 start.go:293] postStartSetup for "old-k8s-version-740194" (driver="kvm2")
I0918 20:55:09.687810 57636 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0918 20:55:09.687836 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .DriverName
I0918 20:55:09.688117 57636 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0918 20:55:09.688145 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetSSHHostname
I0918 20:55:09.690471 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | domain old-k8s-version-740194 has defined MAC address 52:54:00:3f:a7:11 in network mk-old-k8s-version-740194
I0918 20:55:09.690832 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3f:a7:11", ip: ""} in network mk-old-k8s-version-740194: {Iface:virbr3 ExpiryTime:2024-09-18 21:54:58 +0000 UTC Type:0 Mac:52:54:00:3f:a7:11 Iaid: IPaddr:192.168.72.53 Prefix:24 Hostname:old-k8s-version-740194 Clientid:01:52:54:00:3f:a7:11}
I0918 20:55:09.690863 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | domain old-k8s-version-740194 has defined IP address 192.168.72.53 and MAC address 52:54:00:3f:a7:11 in network mk-old-k8s-version-740194
I0918 20:55:09.690993 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetSSHPort
I0918 20:55:09.691180 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetSSHKeyPath
I0918 20:55:09.691381 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetSSHUsername
I0918 20:55:09.691507 57636 sshutil.go:53] new ssh client: &{IP:192.168.72.53 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19667-7671/.minikube/machines/old-k8s-version-740194/id_rsa Username:docker}
I0918 20:55:09.774814 57636 ssh_runner.go:195] Run: cat /etc/os-release
I0918 20:55:09.779012 57636 info.go:137] Remote host: Buildroot 2023.02.9
I0918 20:55:09.779038 57636 filesync.go:126] Scanning /home/jenkins/minikube-integration/19667-7671/.minikube/addons for local assets ...
I0918 20:55:09.779109 57636 filesync.go:126] Scanning /home/jenkins/minikube-integration/19667-7671/.minikube/files for local assets ...
I0918 20:55:09.779217 57636 filesync.go:149] local asset: /home/jenkins/minikube-integration/19667-7671/.minikube/files/etc/ssl/certs/148782.pem -> 148782.pem in /etc/ssl/certs
I0918 20:55:09.779353 57636 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0918 20:55:09.789687 57636 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19667-7671/.minikube/files/etc/ssl/certs/148782.pem --> /etc/ssl/certs/148782.pem (1708 bytes)
I0918 20:55:09.814308 57636 start.go:296] duration metric: took 126.497475ms for postStartSetup
I0918 20:55:09.814377 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetConfigRaw
I0918 20:55:09.814993 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetIP
I0918 20:55:09.817812 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | domain old-k8s-version-740194 has defined MAC address 52:54:00:3f:a7:11 in network mk-old-k8s-version-740194
I0918 20:55:09.818126 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3f:a7:11", ip: ""} in network mk-old-k8s-version-740194: {Iface:virbr3 ExpiryTime:2024-09-18 21:54:58 +0000 UTC Type:0 Mac:52:54:00:3f:a7:11 Iaid: IPaddr:192.168.72.53 Prefix:24 Hostname:old-k8s-version-740194 Clientid:01:52:54:00:3f:a7:11}
I0918 20:55:09.818153 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | domain old-k8s-version-740194 has defined IP address 192.168.72.53 and MAC address 52:54:00:3f:a7:11 in network mk-old-k8s-version-740194
I0918 20:55:09.818428 57636 profile.go:143] Saving config to /home/jenkins/minikube-integration/19667-7671/.minikube/profiles/old-k8s-version-740194/config.json ...
I0918 20:55:09.818694 57636 start.go:128] duration metric: took 25.80556582s to createHost
I0918 20:55:09.818747 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetSSHHostname
I0918 20:55:09.821252 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | domain old-k8s-version-740194 has defined MAC address 52:54:00:3f:a7:11 in network mk-old-k8s-version-740194
I0918 20:55:09.821606 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3f:a7:11", ip: ""} in network mk-old-k8s-version-740194: {Iface:virbr3 ExpiryTime:2024-09-18 21:54:58 +0000 UTC Type:0 Mac:52:54:00:3f:a7:11 Iaid: IPaddr:192.168.72.53 Prefix:24 Hostname:old-k8s-version-740194 Clientid:01:52:54:00:3f:a7:11}
I0918 20:55:09.821649 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | domain old-k8s-version-740194 has defined IP address 192.168.72.53 and MAC address 52:54:00:3f:a7:11 in network mk-old-k8s-version-740194
I0918 20:55:09.821820 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetSSHPort
I0918 20:55:09.821997 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetSSHKeyPath
I0918 20:55:09.822150 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetSSHKeyPath
I0918 20:55:09.822286 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetSSHUsername
I0918 20:55:09.822439 57636 main.go:141] libmachine: Using SSH client type: native
I0918 20:55:09.822606 57636 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x86c560] 0x86f240 <nil> [] 0s} 192.168.72.53 22 <nil> <nil>}
I0918 20:55:09.822619 57636 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0918 20:55:09.932740 57636 main.go:141] libmachine: SSH cmd err, output: <nil>: 1726692909.909985434
I0918 20:55:09.932772 57636 fix.go:216] guest clock: 1726692909.909985434
I0918 20:55:09.932781 57636 fix.go:229] Guest: 2024-09-18 20:55:09.909985434 +0000 UTC Remote: 2024-09-18 20:55:09.818706944 +0000 UTC m=+44.644157749 (delta=91.27849ms)
I0918 20:55:09.932813 57636 fix.go:200] guest clock delta is within tolerance: 91.27849ms
I0918 20:55:09.932817 57636 start.go:83] releasing machines lock for "old-k8s-version-740194", held for 25.919872088s
I0918 20:55:09.932840 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .DriverName
I0918 20:55:09.933145 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetIP
I0918 20:55:09.936372 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | domain old-k8s-version-740194 has defined MAC address 52:54:00:3f:a7:11 in network mk-old-k8s-version-740194
I0918 20:55:09.936826 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3f:a7:11", ip: ""} in network mk-old-k8s-version-740194: {Iface:virbr3 ExpiryTime:2024-09-18 21:54:58 +0000 UTC Type:0 Mac:52:54:00:3f:a7:11 Iaid: IPaddr:192.168.72.53 Prefix:24 Hostname:old-k8s-version-740194 Clientid:01:52:54:00:3f:a7:11}
I0918 20:55:09.936856 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | domain old-k8s-version-740194 has defined IP address 192.168.72.53 and MAC address 52:54:00:3f:a7:11 in network mk-old-k8s-version-740194
I0918 20:55:09.937012 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .DriverName
I0918 20:55:09.937568 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .DriverName
I0918 20:55:09.937775 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .DriverName
I0918 20:55:09.937842 57636 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0918 20:55:09.937894 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetSSHHostname
I0918 20:55:09.938020 57636 ssh_runner.go:195] Run: cat /version.json
I0918 20:55:09.938045 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetSSHHostname
I0918 20:55:09.940641 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | domain old-k8s-version-740194 has defined MAC address 52:54:00:3f:a7:11 in network mk-old-k8s-version-740194
I0918 20:55:09.941522 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3f:a7:11", ip: ""} in network mk-old-k8s-version-740194: {Iface:virbr3 ExpiryTime:2024-09-18 21:54:58 +0000 UTC Type:0 Mac:52:54:00:3f:a7:11 Iaid: IPaddr:192.168.72.53 Prefix:24 Hostname:old-k8s-version-740194 Clientid:01:52:54:00:3f:a7:11}
I0918 20:55:09.941554 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | domain old-k8s-version-740194 has defined MAC address 52:54:00:3f:a7:11 in network mk-old-k8s-version-740194
I0918 20:55:09.941578 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | domain old-k8s-version-740194 has defined IP address 192.168.72.53 and MAC address 52:54:00:3f:a7:11 in network mk-old-k8s-version-740194
I0918 20:55:09.941922 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetSSHPort
I0918 20:55:09.942136 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetSSHKeyPath
I0918 20:55:09.942288 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3f:a7:11", ip: ""} in network mk-old-k8s-version-740194: {Iface:virbr3 ExpiryTime:2024-09-18 21:54:58 +0000 UTC Type:0 Mac:52:54:00:3f:a7:11 Iaid: IPaddr:192.168.72.53 Prefix:24 Hostname:old-k8s-version-740194 Clientid:01:52:54:00:3f:a7:11}
I0918 20:55:09.942289 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetSSHUsername
I0918 20:55:09.942312 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | domain old-k8s-version-740194 has defined IP address 192.168.72.53 and MAC address 52:54:00:3f:a7:11 in network mk-old-k8s-version-740194
I0918 20:55:09.942501 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetSSHPort
I0918 20:55:09.942501 57636 sshutil.go:53] new ssh client: &{IP:192.168.72.53 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19667-7671/.minikube/machines/old-k8s-version-740194/id_rsa Username:docker}
I0918 20:55:09.942705 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetSSHKeyPath
I0918 20:55:09.942862 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetSSHUsername
I0918 20:55:09.942987 57636 sshutil.go:53] new ssh client: &{IP:192.168.72.53 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19667-7671/.minikube/machines/old-k8s-version-740194/id_rsa Username:docker}
I0918 20:55:10.054479 57636 ssh_runner.go:195] Run: systemctl --version
I0918 20:55:10.060868 57636 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0918 20:55:10.226147 57636 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0918 20:55:10.232494 57636 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0918 20:55:10.232573 57636 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0918 20:55:10.250626 57636 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0918 20:55:10.250658 57636 start.go:495] detecting cgroup driver to use...
I0918 20:55:10.250721 57636 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0918 20:55:10.266867 57636 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0918 20:55:10.282481 57636 docker.go:217] disabling cri-docker service (if available) ...
I0918 20:55:10.282548 57636 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0918 20:55:10.297209 57636 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0918 20:55:10.311601 57636 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0918 20:55:10.423924 57636 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0918 20:55:10.588448 57636 docker.go:233] disabling docker service ...
I0918 20:55:10.588541 57636 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0918 20:55:10.603979 57636 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0918 20:55:10.619540 57636 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0918 20:55:10.762470 57636 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0918 20:55:10.889355 57636 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0918 20:55:10.903278 57636 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0918 20:55:10.921603 57636 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0918 20:55:10.921673 57636 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0918 20:55:10.933104 57636 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0918 20:55:10.933180 57636 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0918 20:55:10.944268 57636 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0918 20:55:10.955712 57636 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0918 20:55:10.966952 57636 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0918 20:55:10.979202 57636 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0918 20:55:10.989755 57636 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0918 20:55:10.989830 57636 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0918 20:55:11.004599 57636 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0918 20:55:11.015051 57636 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0918 20:55:11.130786 57636 ssh_runner.go:195] Run: sudo systemctl restart crio
I0918 20:55:11.224382 57636 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0918 20:55:11.224461 57636 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0918 20:55:11.229024 57636 start.go:563] Will wait 60s for crictl version
I0918 20:55:11.229082 57636 ssh_runner.go:195] Run: which crictl
I0918 20:55:11.232661 57636 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0918 20:55:11.268431 57636 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0918 20:55:11.268519 57636 ssh_runner.go:195] Run: crio --version
I0918 20:55:11.295080 57636 ssh_runner.go:195] Run: crio --version
I0918 20:55:11.324593 57636 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0918 20:55:11.326125 57636 main.go:141] libmachine: (old-k8s-version-740194) Calling .GetIP
I0918 20:55:11.329075 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | domain old-k8s-version-740194 has defined MAC address 52:54:00:3f:a7:11 in network mk-old-k8s-version-740194
I0918 20:55:11.329447 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3f:a7:11", ip: ""} in network mk-old-k8s-version-740194: {Iface:virbr3 ExpiryTime:2024-09-18 21:54:58 +0000 UTC Type:0 Mac:52:54:00:3f:a7:11 Iaid: IPaddr:192.168.72.53 Prefix:24 Hostname:old-k8s-version-740194 Clientid:01:52:54:00:3f:a7:11}
I0918 20:55:11.329477 57636 main.go:141] libmachine: (old-k8s-version-740194) DBG | domain old-k8s-version-740194 has defined IP address 192.168.72.53 and MAC address 52:54:00:3f:a7:11 in network mk-old-k8s-version-740194
I0918 20:55:11.329722 57636 ssh_runner.go:195] Run: grep 192.168.72.1 host.minikube.internal$ /etc/hosts
I0918 20:55:11.333758 57636 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.72.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0918 20:55:11.345820 57636 kubeadm.go:883] updating cluster {Name:old-k8s-version-740194 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19649/minikube-v1.34.0-1726481713-19649-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726589491-19662@sha256:6370b9fec173944088c2d87d44b01819c0ec611a83d9e2f38d36352dff8121a4 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-740194 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.53 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mo
untPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0918 20:55:11.345941 57636 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0918 20:55:11.345994 57636 ssh_runner.go:195] Run: sudo crictl images --output json
I0918 20:55:11.377097 57636 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0918 20:55:11.377175 57636 ssh_runner.go:195] Run: which lz4
I0918 20:55:11.380770 57636 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0918 20:55:11.384664 57636 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0918 20:55:11.384697 57636 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19667-7671/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0918 20:55:12.923532 57636 crio.go:462] duration metric: took 1.542787572s to copy over tarball
I0918 20:55:12.923606 57636 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0918 20:55:15.493562 57636 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.569925133s)
I0918 20:55:15.493611 57636 crio.go:469] duration metric: took 2.57005265s to extract the tarball
I0918 20:55:15.493621 57636 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0918 20:55:15.535424 57636 ssh_runner.go:195] Run: sudo crictl images --output json
I0918 20:55:15.584361 57636 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0918 20:55:15.584389 57636 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0918 20:55:15.584456 57636 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0918 20:55:15.584477 57636 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0918 20:55:15.584490 57636 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I0918 20:55:15.584525 57636 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0918 20:55:15.584548 57636 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I0918 20:55:15.584572 57636 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0918 20:55:15.584476 57636 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0918 20:55:15.584455 57636 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0918 20:55:15.585878 57636 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0918 20:55:15.585914 57636 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0918 20:55:15.585878 57636 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0918 20:55:15.585972 57636 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0918 20:55:15.586004 57636 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0918 20:55:15.585879 57636 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0918 20:55:15.585882 57636 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0918 20:55:15.585887 57636 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0918 20:55:15.842727 57636 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0918 20:55:15.870921 57636 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0918 20:55:15.880322 57636 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0918 20:55:15.895373 57636 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0918 20:55:15.896681 57636 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0918 20:55:15.896746 57636 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0918 20:55:15.896796 57636 ssh_runner.go:195] Run: which crictl
I0918 20:55:15.897630 57636 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0918 20:55:15.901148 57636 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0918 20:55:15.916439 57636 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0918 20:55:15.985111 57636 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0918 20:55:15.985161 57636 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0918 20:55:15.985219 57636 ssh_runner.go:195] Run: which crictl
I0918 20:55:16.039560 57636 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0918 20:55:16.039618 57636 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0918 20:55:16.039636 57636 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0918 20:55:16.039670 57636 ssh_runner.go:195] Run: which crictl
I0918 20:55:16.039697 57636 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0918 20:55:16.039671 57636 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0918 20:55:16.039749 57636 ssh_runner.go:195] Run: which crictl
I0918 20:55:16.074791 57636 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0918 20:55:16.074837 57636 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0918 20:55:16.074845 57636 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0918 20:55:16.074858 57636 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0918 20:55:16.074896 57636 ssh_runner.go:195] Run: which crictl
I0918 20:55:16.074903 57636 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0918 20:55:16.074938 57636 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0918 20:55:16.074896 57636 ssh_runner.go:195] Run: which crictl
I0918 20:55:16.074981 57636 ssh_runner.go:195] Run: which crictl
I0918 20:55:16.074994 57636 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0918 20:55:16.075090 57636 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0918 20:55:16.075094 57636 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0918 20:55:16.140474 57636 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0918 20:55:16.140591 57636 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0918 20:55:16.140629 57636 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0918 20:55:16.182345 57636 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0918 20:55:16.182542 57636 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0918 20:55:16.195664 57636 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0918 20:55:16.195911 57636 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0918 20:55:16.218831 57636 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0918 20:55:16.349049 57636 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0918 20:55:16.349085 57636 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0918 20:55:16.349143 57636 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0918 20:55:16.349207 57636 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0918 20:55:16.351578 57636 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0918 20:55:16.370453 57636 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0918 20:55:16.370458 57636 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19667-7671/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0918 20:55:16.482871 57636 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0918 20:55:16.482911 57636 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0918 20:55:16.492420 57636 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19667-7671/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0918 20:55:16.494024 57636 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19667-7671/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0918 20:55:16.494231 57636 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0918 20:55:16.503450 57636 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19667-7671/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0918 20:55:16.556922 57636 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19667-7671/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0918 20:55:16.556922 57636 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19667-7671/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0918 20:55:16.562490 57636 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19667-7671/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0918 20:55:16.745862 57636 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0918 20:55:16.892118 57636 cache_images.go:92] duration metric: took 1.307712475s to LoadCachedImages
W0918 20:55:16.892210 57636 out.go:270] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19667-7671/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19667-7671/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2: no such file or directory
I0918 20:55:16.892229 57636 kubeadm.go:934] updating node { 192.168.72.53 8443 v1.20.0 crio true true} ...
I0918 20:55:16.892452 57636 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-740194 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.72.53
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-740194 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0918 20:55:16.892581 57636 ssh_runner.go:195] Run: crio config
I0918 20:55:16.942196 57636 cni.go:84] Creating CNI manager for ""
I0918 20:55:16.942227 57636 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0918 20:55:16.942238 57636 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0918 20:55:16.942263 57636 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.72.53 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-740194 NodeName:old-k8s-version-740194 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.72.53"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.72.53 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt Stati
cPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0918 20:55:16.942447 57636 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.72.53
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-740194"
kubeletExtraArgs:
node-ip: 192.168.72.53
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.72.53"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0918 20:55:16.942527 57636 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0918 20:55:16.952779 57636 binaries.go:44] Found k8s binaries, skipping transfer
I0918 20:55:16.952862 57636 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0918 20:55:16.962332 57636 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (429 bytes)
I0918 20:55:16.981875 57636 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0918 20:55:17.004242 57636 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2120 bytes)
I0918 20:55:17.022865 57636 ssh_runner.go:195] Run: grep 192.168.72.53 control-plane.minikube.internal$ /etc/hosts
I0918 20:55:17.026842 57636 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.72.53 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0918 20:55:17.042388 57636 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0918 20:55:17.171035 57636 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0918 20:55:17.189352 57636 certs.go:68] Setting up /home/jenkins/minikube-integration/19667-7671/.minikube/profiles/old-k8s-version-740194 for IP: 192.168.72.53
I0918 20:55:17.189381 57636 certs.go:194] generating shared ca certs ...
I0918 20:55:17.189401 57636 certs.go:226] acquiring lock for ca certs: {Name:mkf54e0e71ed884c4372f9d3d4cb308ea4600185 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0918 20:55:17.189602 57636 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19667-7671/.minikube/ca.key
I0918 20:55:17.189660 57636 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19667-7671/.minikube/proxy-client-ca.key
I0918 20:55:17.189676 57636 certs.go:256] generating profile certs ...
I0918 20:55:17.189746 57636 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19667-7671/.minikube/profiles/old-k8s-version-740194/client.key
I0918 20:55:17.189777 57636 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19667-7671/.minikube/profiles/old-k8s-version-740194/client.crt with IP's: []
I0918 20:55:17.326815 57636 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19667-7671/.minikube/profiles/old-k8s-version-740194/client.crt ...
I0918 20:55:17.326849 57636 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19667-7671/.minikube/profiles/old-k8s-version-740194/client.crt: {Name:mkbb010070226d055a77716a97cda1707537eddc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0918 20:55:17.347721 57636 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19667-7671/.minikube/profiles/old-k8s-version-740194/client.key ...
I0918 20:55:17.347768 57636 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19667-7671/.minikube/profiles/old-k8s-version-740194/client.key: {Name:mkc2b90fb15edb238d44c85d26279306419d060f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0918 20:55:17.347922 57636 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19667-7671/.minikube/profiles/old-k8s-version-740194/apiserver.key.424b07d9
I0918 20:55:17.347947 57636 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19667-7671/.minikube/profiles/old-k8s-version-740194/apiserver.crt.424b07d9 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.72.53]
I0918 20:55:17.559343 57636 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19667-7671/.minikube/profiles/old-k8s-version-740194/apiserver.crt.424b07d9 ...
I0918 20:55:17.559380 57636 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19667-7671/.minikube/profiles/old-k8s-version-740194/apiserver.crt.424b07d9: {Name:mke5e3e6951aaa1a48948d99429f2ec714ee1720 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0918 20:55:17.559571 57636 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19667-7671/.minikube/profiles/old-k8s-version-740194/apiserver.key.424b07d9 ...
I0918 20:55:17.559587 57636 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19667-7671/.minikube/profiles/old-k8s-version-740194/apiserver.key.424b07d9: {Name:mkefc7668c386d2a7c0ea0401c6ac467c79807be Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0918 20:55:17.559695 57636 certs.go:381] copying /home/jenkins/minikube-integration/19667-7671/.minikube/profiles/old-k8s-version-740194/apiserver.crt.424b07d9 -> /home/jenkins/minikube-integration/19667-7671/.minikube/profiles/old-k8s-version-740194/apiserver.crt
I0918 20:55:17.559770 57636 certs.go:385] copying /home/jenkins/minikube-integration/19667-7671/.minikube/profiles/old-k8s-version-740194/apiserver.key.424b07d9 -> /home/jenkins/minikube-integration/19667-7671/.minikube/profiles/old-k8s-version-740194/apiserver.key
I0918 20:55:17.559823 57636 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19667-7671/.minikube/profiles/old-k8s-version-740194/proxy-client.key
I0918 20:55:17.559838 57636 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19667-7671/.minikube/profiles/old-k8s-version-740194/proxy-client.crt with IP's: []
I0918 20:55:17.802201 57636 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19667-7671/.minikube/profiles/old-k8s-version-740194/proxy-client.crt ...
I0918 20:55:17.802235 57636 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19667-7671/.minikube/profiles/old-k8s-version-740194/proxy-client.crt: {Name:mkb6f1dcbeee9315c20c455baab06377c3b43d5a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0918 20:55:17.802425 57636 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19667-7671/.minikube/profiles/old-k8s-version-740194/proxy-client.key ...
I0918 20:55:17.802442 57636 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19667-7671/.minikube/profiles/old-k8s-version-740194/proxy-client.key: {Name:mkf3d462232fdbc2cc7af80bb1ac3b6a4be0b835 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0918 20:55:17.802645 57636 certs.go:484] found cert: /home/jenkins/minikube-integration/19667-7671/.minikube/certs/14878.pem (1338 bytes)
W0918 20:55:17.802699 57636 certs.go:480] ignoring /home/jenkins/minikube-integration/19667-7671/.minikube/certs/14878_empty.pem, impossibly tiny 0 bytes
I0918 20:55:17.802712 57636 certs.go:484] found cert: /home/jenkins/minikube-integration/19667-7671/.minikube/certs/ca-key.pem (1675 bytes)
I0918 20:55:17.802741 57636 certs.go:484] found cert: /home/jenkins/minikube-integration/19667-7671/.minikube/certs/ca.pem (1082 bytes)
I0918 20:55:17.802766 57636 certs.go:484] found cert: /home/jenkins/minikube-integration/19667-7671/.minikube/certs/cert.pem (1123 bytes)
I0918 20:55:17.802787 57636 certs.go:484] found cert: /home/jenkins/minikube-integration/19667-7671/.minikube/certs/key.pem (1679 bytes)
I0918 20:55:17.802831 57636 certs.go:484] found cert: /home/jenkins/minikube-integration/19667-7671/.minikube/files/etc/ssl/certs/148782.pem (1708 bytes)
I0918 20:55:17.803581 57636 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19667-7671/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0918 20:55:17.830931 57636 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19667-7671/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0918 20:55:17.857184 57636 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19667-7671/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0918 20:55:17.884559 57636 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19667-7671/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0918 20:55:17.910628 57636 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19667-7671/.minikube/profiles/old-k8s-version-740194/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0918 20:55:17.945495 57636 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19667-7671/.minikube/profiles/old-k8s-version-740194/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0918 20:55:17.977502 57636 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19667-7671/.minikube/profiles/old-k8s-version-740194/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0918 20:55:18.008922 57636 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19667-7671/.minikube/profiles/old-k8s-version-740194/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0918 20:55:18.037316 57636 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19667-7671/.minikube/files/etc/ssl/certs/148782.pem --> /usr/share/ca-certificates/148782.pem (1708 bytes)
I0918 20:55:18.084740 57636 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19667-7671/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0918 20:55:18.123750 57636 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19667-7671/.minikube/certs/14878.pem --> /usr/share/ca-certificates/14878.pem (1338 bytes)
I0918 20:55:18.147967 57636 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0918 20:55:18.164614 57636 ssh_runner.go:195] Run: openssl version
I0918 20:55:18.170999 57636 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/148782.pem && ln -fs /usr/share/ca-certificates/148782.pem /etc/ssl/certs/148782.pem"
I0918 20:55:18.182029 57636 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/148782.pem
I0918 20:55:18.186747 57636 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Sep 18 19:57 /usr/share/ca-certificates/148782.pem
I0918 20:55:18.186826 57636 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/148782.pem
I0918 20:55:18.192865 57636 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/148782.pem /etc/ssl/certs/3ec20f2e.0"
I0918 20:55:18.203725 57636 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0918 20:55:18.215107 57636 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0918 20:55:18.219493 57636 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 18 19:39 /usr/share/ca-certificates/minikubeCA.pem
I0918 20:55:18.219552 57636 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0918 20:55:18.225615 57636 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0918 20:55:18.238100 57636 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/14878.pem && ln -fs /usr/share/ca-certificates/14878.pem /etc/ssl/certs/14878.pem"
I0918 20:55:18.250040 57636 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/14878.pem
I0918 20:55:18.254995 57636 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Sep 18 19:57 /usr/share/ca-certificates/14878.pem
I0918 20:55:18.255071 57636 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/14878.pem
I0918 20:55:18.260925 57636 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/14878.pem /etc/ssl/certs/51391683.0"
I0918 20:55:18.271600 57636 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0918 20:55:18.275666 57636 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0918 20:55:18.275725 57636 kubeadm.go:392] StartCluster: {Name:old-k8s-version-740194 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19649/minikube-v1.34.0-1726481713-19649-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726589491-19662@sha256:6370b9fec173944088c2d87d44b01819c0ec611a83d9e2f38d36352dff8121a4 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-740194 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.53 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0918 20:55:18.275805 57636 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0918 20:55:18.275861 57636 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0918 20:55:18.320938 57636 cri.go:89] found id: ""
I0918 20:55:18.321002 57636 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0918 20:55:18.332487 57636 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0918 20:55:18.345115 57636 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0918 20:55:18.358424 57636 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0918 20:55:18.358458 57636 kubeadm.go:157] found existing configuration files:
I0918 20:55:18.358511 57636 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0918 20:55:18.370163 57636 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0918 20:55:18.370240 57636 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0918 20:55:18.383434 57636 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0918 20:55:18.396260 57636 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0918 20:55:18.396349 57636 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0918 20:55:18.409721 57636 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0918 20:55:18.422421 57636 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0918 20:55:18.422491 57636 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0918 20:55:18.435647 57636 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0918 20:55:18.446133 57636 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0918 20:55:18.446200 57636 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0918 20:55:18.457811 57636 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0918 20:55:18.574170 57636 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0918 20:55:18.574286 57636 kubeadm.go:310] [preflight] Running pre-flight checks
I0918 20:55:18.731732 57636 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0918 20:55:18.731890 57636 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0918 20:55:18.732059 57636 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0918 20:55:18.943964 57636 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0918 20:55:19.129180 57636 out.go:235] - Generating certificates and keys ...
I0918 20:55:19.129310 57636 kubeadm.go:310] [certs] Using existing ca certificate authority
I0918 20:55:19.129406 57636 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0918 20:55:19.177825 57636 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0918 20:55:19.276131 57636 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0918 20:55:19.576307 57636 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0918 20:55:20.071570 57636 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0918 20:55:20.130790 57636 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0918 20:55:20.131142 57636 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-740194] and IPs [192.168.72.53 127.0.0.1 ::1]
I0918 20:55:20.429324 57636 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0918 20:55:20.429538 57636 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-740194] and IPs [192.168.72.53 127.0.0.1 ::1]
I0918 20:55:20.607036 57636 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0918 20:55:20.788906 57636 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0918 20:55:20.936236 57636 kubeadm.go:310] [certs] Generating "sa" key and public key
I0918 20:55:20.936534 57636 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0918 20:55:21.147533 57636 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0918 20:55:21.242447 57636 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0918 20:55:21.350636 57636 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0918 20:55:21.487245 57636 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0918 20:55:21.508149 57636 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0918 20:55:21.509578 57636 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0918 20:55:21.510063 57636 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0918 20:55:21.646954 57636 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0918 20:55:21.649151 57636 out.go:235] - Booting up control plane ...
I0918 20:55:21.649280 57636 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0918 20:55:21.667665 57636 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0918 20:55:21.667774 57636 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0918 20:55:21.668188 57636 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0918 20:55:21.677377 57636 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0918 20:56:01.672361 57636 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0918 20:56:01.673259 57636 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0918 20:56:01.673516 57636 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0918 20:56:06.673719 57636 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0918 20:56:06.673968 57636 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0918 20:56:16.672974 57636 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0918 20:56:16.673270 57636 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0918 20:56:36.672842 57636 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0918 20:56:36.673115 57636 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0918 20:57:16.674480 57636 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0918 20:57:16.674756 57636 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0918 20:57:16.674789 57636 kubeadm.go:310]
I0918 20:57:16.674839 57636 kubeadm.go:310] Unfortunately, an error has occurred:
I0918 20:57:16.674901 57636 kubeadm.go:310] timed out waiting for the condition
I0918 20:57:16.674912 57636 kubeadm.go:310]
I0918 20:57:16.674973 57636 kubeadm.go:310] This error is likely caused by:
I0918 20:57:16.675022 57636 kubeadm.go:310] - The kubelet is not running
I0918 20:57:16.675178 57636 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0918 20:57:16.675201 57636 kubeadm.go:310]
I0918 20:57:16.675319 57636 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0918 20:57:16.675387 57636 kubeadm.go:310] - 'systemctl status kubelet'
I0918 20:57:16.675431 57636 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0918 20:57:16.675442 57636 kubeadm.go:310]
I0918 20:57:16.675542 57636 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0918 20:57:16.675621 57636 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0918 20:57:16.675631 57636 kubeadm.go:310]
I0918 20:57:16.675720 57636 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0918 20:57:16.675808 57636 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0918 20:57:16.675921 57636 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0918 20:57:16.675991 57636 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0918 20:57:16.675999 57636 kubeadm.go:310]
I0918 20:57:16.676696 57636 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0918 20:57:16.676808 57636 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0918 20:57:16.676869 57636 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
W0918 20:57:16.677005 57636 out.go:270] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-740194] and IPs [192.168.72.53 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-740194] and IPs [192.168.72.53 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-740194] and IPs [192.168.72.53 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-740194] and IPs [192.168.72.53 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0918 20:57:16.677049 57636 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0918 20:57:18.660716 57636 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (1.983637838s)
I0918 20:57:18.660808 57636 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0918 20:57:18.676937 57636 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0918 20:57:18.690993 57636 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0918 20:57:18.691017 57636 kubeadm.go:157] found existing configuration files:
I0918 20:57:18.691072 57636 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0918 20:57:18.705235 57636 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0918 20:57:18.705321 57636 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0918 20:57:18.718804 57636 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0918 20:57:18.732166 57636 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0918 20:57:18.732241 57636 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0918 20:57:18.745577 57636 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0918 20:57:18.758624 57636 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0918 20:57:18.758695 57636 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0918 20:57:18.769185 57636 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0918 20:57:18.782607 57636 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0918 20:57:18.782679 57636 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0918 20:57:18.792849 57636 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0918 20:57:18.869283 57636 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0918 20:57:18.869396 57636 kubeadm.go:310] [preflight] Running pre-flight checks
I0918 20:57:19.032714 57636 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0918 20:57:19.032891 57636 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0918 20:57:19.033041 57636 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0918 20:57:19.230705 57636 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0918 20:57:19.232667 57636 out.go:235] - Generating certificates and keys ...
I0918 20:57:19.232774 57636 kubeadm.go:310] [certs] Using existing ca certificate authority
I0918 20:57:19.232859 57636 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0918 20:57:19.232975 57636 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0918 20:57:19.233082 57636 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0918 20:57:19.233188 57636 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0918 20:57:19.233287 57636 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0918 20:57:19.233374 57636 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0918 20:57:19.233470 57636 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0918 20:57:19.233596 57636 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0918 20:57:19.233712 57636 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0918 20:57:19.233772 57636 kubeadm.go:310] [certs] Using the existing "sa" key
I0918 20:57:19.233846 57636 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0918 20:57:19.285829 57636 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0918 20:57:19.352792 57636 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0918 20:57:19.509110 57636 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0918 20:57:19.807064 57636 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0918 20:57:19.824364 57636 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0918 20:57:19.825647 57636 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0918 20:57:19.825728 57636 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0918 20:57:19.988597 57636 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0918 20:57:19.990336 57636 out.go:235] - Booting up control plane ...
I0918 20:57:19.990479 57636 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0918 20:57:19.997517 57636 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0918 20:57:19.998636 57636 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0918 20:57:19.999389 57636 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0918 20:57:20.001591 57636 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0918 20:58:00.004643 57636 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0918 20:58:00.004746 57636 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0918 20:58:00.004934 57636 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0918 20:58:05.005433 57636 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0918 20:58:05.005724 57636 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0918 20:58:15.007364 57636 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0918 20:58:15.010753 57636 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0918 20:58:35.007799 57636 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0918 20:58:35.008116 57636 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0918 20:59:15.007913 57636 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0918 20:59:15.008115 57636 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0918 20:59:15.008157 57636 kubeadm.go:310]
I0918 20:59:15.008254 57636 kubeadm.go:310] Unfortunately, an error has occurred:
I0918 20:59:15.008330 57636 kubeadm.go:310] timed out waiting for the condition
I0918 20:59:15.008346 57636 kubeadm.go:310]
I0918 20:59:15.008387 57636 kubeadm.go:310] This error is likely caused by:
I0918 20:59:15.008453 57636 kubeadm.go:310] - The kubelet is not running
I0918 20:59:15.008587 57636 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0918 20:59:15.008610 57636 kubeadm.go:310]
I0918 20:59:15.008755 57636 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0918 20:59:15.008805 57636 kubeadm.go:310] - 'systemctl status kubelet'
I0918 20:59:15.008853 57636 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0918 20:59:15.008863 57636 kubeadm.go:310]
I0918 20:59:15.009005 57636 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0918 20:59:15.009107 57636 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0918 20:59:15.009119 57636 kubeadm.go:310]
I0918 20:59:15.009254 57636 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0918 20:59:15.009362 57636 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0918 20:59:15.009470 57636 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0918 20:59:15.009588 57636 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0918 20:59:15.009606 57636 kubeadm.go:310]
I0918 20:59:15.010021 57636 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0918 20:59:15.010118 57636 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0918 20:59:15.010192 57636 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0918 20:59:15.010264 57636 kubeadm.go:394] duration metric: took 3m56.73454432s to StartCluster
I0918 20:59:15.010317 57636 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0918 20:59:15.010370 57636 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0918 20:59:15.051228 57636 cri.go:89] found id: ""
I0918 20:59:15.051256 57636 logs.go:276] 0 containers: []
W0918 20:59:15.051264 57636 logs.go:278] No container was found matching "kube-apiserver"
I0918 20:59:15.051271 57636 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0918 20:59:15.051325 57636 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0918 20:59:15.095700 57636 cri.go:89] found id: ""
I0918 20:59:15.095734 57636 logs.go:276] 0 containers: []
W0918 20:59:15.095747 57636 logs.go:278] No container was found matching "etcd"
I0918 20:59:15.095755 57636 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0918 20:59:15.095822 57636 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0918 20:59:15.130172 57636 cri.go:89] found id: ""
I0918 20:59:15.130205 57636 logs.go:276] 0 containers: []
W0918 20:59:15.130213 57636 logs.go:278] No container was found matching "coredns"
I0918 20:59:15.130219 57636 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0918 20:59:15.130268 57636 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0918 20:59:15.162779 57636 cri.go:89] found id: ""
I0918 20:59:15.162813 57636 logs.go:276] 0 containers: []
W0918 20:59:15.162828 57636 logs.go:278] No container was found matching "kube-scheduler"
I0918 20:59:15.162836 57636 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0918 20:59:15.162895 57636 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0918 20:59:15.195904 57636 cri.go:89] found id: ""
I0918 20:59:15.195934 57636 logs.go:276] 0 containers: []
W0918 20:59:15.195944 57636 logs.go:278] No container was found matching "kube-proxy"
I0918 20:59:15.195952 57636 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0918 20:59:15.196008 57636 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0918 20:59:15.236095 57636 cri.go:89] found id: ""
I0918 20:59:15.236126 57636 logs.go:276] 0 containers: []
W0918 20:59:15.236135 57636 logs.go:278] No container was found matching "kube-controller-manager"
I0918 20:59:15.236141 57636 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0918 20:59:15.236191 57636 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0918 20:59:15.271718 57636 cri.go:89] found id: ""
I0918 20:59:15.271743 57636 logs.go:276] 0 containers: []
W0918 20:59:15.271751 57636 logs.go:278] No container was found matching "kindnet"
I0918 20:59:15.271766 57636 logs.go:123] Gathering logs for kubelet ...
I0918 20:59:15.271777 57636 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0918 20:59:15.325280 57636 logs.go:123] Gathering logs for dmesg ...
I0918 20:59:15.325334 57636 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0918 20:59:15.344079 57636 logs.go:123] Gathering logs for describe nodes ...
I0918 20:59:15.344111 57636 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0918 20:59:15.467386 57636 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0918 20:59:15.467411 57636 logs.go:123] Gathering logs for CRI-O ...
I0918 20:59:15.467432 57636 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0918 20:59:15.567448 57636 logs.go:123] Gathering logs for container status ...
I0918 20:59:15.567492 57636 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0918 20:59:15.605905 57636 out.go:418] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0918 20:59:15.605960 57636 out.go:270] *
*
W0918 20:59:15.606010 57636 out.go:270] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0918 20:59:15.606022 57636 out.go:270] *
*
W0918 20:59:15.606922 57636 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0918 20:59:15.609965 57636 out.go:201]
W0918 20:59:15.611055 57636 out.go:270] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0918 20:59:15.611113 57636 out.go:270] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0918 20:59:15.611158 57636 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0918 20:59:15.612879 57636 out.go:201]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-740194 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-740194 -n old-k8s-version-740194
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-740194 -n old-k8s-version-740194: exit status 6 (234.497565ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0918 20:59:15.899755 60998 status.go:451] kubeconfig endpoint: get endpoint: "old-k8s-version-740194" does not appear in /home/jenkins/minikube-integration/19667-7671/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-740194" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (290.74s)