=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-510301 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-510301 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m34.359219641s)
-- stdout --
* [old-k8s-version-510301] minikube v1.34.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=19700
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19700-3751/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19700-3751/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-510301" primary control-plane node in "old-k8s-version-510301" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0924 19:36:34.274199 62664 out.go:345] Setting OutFile to fd 1 ...
I0924 19:36:34.274299 62664 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0924 19:36:34.274310 62664 out.go:358] Setting ErrFile to fd 2...
I0924 19:36:34.274314 62664 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0924 19:36:34.274543 62664 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19700-3751/.minikube/bin
I0924 19:36:34.275189 62664 out.go:352] Setting JSON to false
I0924 19:36:34.276477 62664 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-2","uptime":4745,"bootTime":1727201849,"procs":310,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1069-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0924 19:36:34.276594 62664 start.go:139] virtualization: kvm guest
I0924 19:36:34.278699 62664 out.go:177] * [old-k8s-version-510301] minikube v1.34.0 on Ubuntu 20.04 (kvm/amd64)
I0924 19:36:34.280198 62664 out.go:177] - MINIKUBE_LOCATION=19700
I0924 19:36:34.280216 62664 notify.go:220] Checking for updates...
I0924 19:36:34.282591 62664 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0924 19:36:34.283763 62664 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19700-3751/kubeconfig
I0924 19:36:34.284997 62664 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19700-3751/.minikube
I0924 19:36:34.286251 62664 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0924 19:36:34.287545 62664 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0924 19:36:34.289252 62664 config.go:182] Loaded profile config "bridge-038637": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.1
I0924 19:36:34.289391 62664 config.go:182] Loaded profile config "calico-038637": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.1
I0924 19:36:34.289493 62664 config.go:182] Loaded profile config "custom-flannel-038637": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.1
I0924 19:36:34.289599 62664 driver.go:394] Setting default libvirt URI to qemu:///system
I0924 19:36:34.333000 62664 out.go:177] * Using the kvm2 driver based on user configuration
I0924 19:36:34.334169 62664 start.go:297] selected driver: kvm2
I0924 19:36:34.334186 62664 start.go:901] validating driver "kvm2" against <nil>
I0924 19:36:34.334201 62664 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0924 19:36:34.336791 62664 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0924 19:36:34.336954 62664 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19700-3751/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0924 19:36:34.352722 62664 install.go:137] /home/jenkins/minikube-integration/19700-3751/.minikube/bin/docker-machine-driver-kvm2 version is 1.34.0
I0924 19:36:34.352765 62664 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0924 19:36:34.352963 62664 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0924 19:36:34.352988 62664 cni.go:84] Creating CNI manager for ""
I0924 19:36:34.353010 62664 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0924 19:36:34.353018 62664 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0924 19:36:34.353056 62664 start.go:340] cluster config:
{Name:old-k8s-version-510301 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-510301 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0924 19:36:34.353155 62664 iso.go:125] acquiring lock: {Name:mke95c23e106ba13242358330b98be70d572c626 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0924 19:36:34.355008 62664 out.go:177] * Starting "old-k8s-version-510301" primary control-plane node in "old-k8s-version-510301" cluster
I0924 19:36:34.356093 62664 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0924 19:36:34.356121 62664 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19700-3751/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0924 19:36:34.356130 62664 cache.go:56] Caching tarball of preloaded images
I0924 19:36:34.356209 62664 preload.go:172] Found /home/jenkins/minikube-integration/19700-3751/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0924 19:36:34.356222 62664 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0924 19:36:34.356293 62664 profile.go:143] Saving config to /home/jenkins/minikube-integration/19700-3751/.minikube/profiles/old-k8s-version-510301/config.json ...
I0924 19:36:34.356310 62664 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19700-3751/.minikube/profiles/old-k8s-version-510301/config.json: {Name:mkdf927324aa8fab3a779211ed6628f8827b91d7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0924 19:36:34.356449 62664 start.go:360] acquireMachinesLock for old-k8s-version-510301: {Name:mk2c75caa9e95878010bc0bf0b82c06d2b0740a7 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0924 19:36:35.672558 62664 start.go:364] duration metric: took 1.316070798s to acquireMachinesLock for "old-k8s-version-510301"
I0924 19:36:35.672654 62664 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-510301 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19696/minikube-v1.34.0-1727108440-19696-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-510301 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0924 19:36:35.672753 62664 start.go:125] createHost starting for "" (driver="kvm2")
I0924 19:36:35.674467 62664 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0924 19:36:35.674674 62664 main.go:141] libmachine: Found binary path at /home/jenkins/minikube-integration/19700-3751/.minikube/bin/docker-machine-driver-kvm2
I0924 19:36:35.674719 62664 main.go:141] libmachine: Launching plugin server for driver kvm2
I0924 19:36:35.693049 62664 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43685
I0924 19:36:35.693454 62664 main.go:141] libmachine: () Calling .GetVersion
I0924 19:36:35.693971 62664 main.go:141] libmachine: Using API Version 1
I0924 19:36:35.693986 62664 main.go:141] libmachine: () Calling .SetConfigRaw
I0924 19:36:35.694316 62664 main.go:141] libmachine: () Calling .GetMachineName
I0924 19:36:35.694501 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetMachineName
I0924 19:36:35.694639 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .DriverName
I0924 19:36:35.694779 62664 start.go:159] libmachine.API.Create for "old-k8s-version-510301" (driver="kvm2")
I0924 19:36:35.694812 62664 client.go:168] LocalClient.Create starting
I0924 19:36:35.694874 62664 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19700-3751/.minikube/certs/ca.pem
I0924 19:36:35.694923 62664 main.go:141] libmachine: Decoding PEM data...
I0924 19:36:35.694946 62664 main.go:141] libmachine: Parsing certificate...
I0924 19:36:35.695012 62664 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19700-3751/.minikube/certs/cert.pem
I0924 19:36:35.695039 62664 main.go:141] libmachine: Decoding PEM data...
I0924 19:36:35.695054 62664 main.go:141] libmachine: Parsing certificate...
I0924 19:36:35.695079 62664 main.go:141] libmachine: Running pre-create checks...
I0924 19:36:35.695091 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .PreCreateCheck
I0924 19:36:35.695464 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetConfigRaw
I0924 19:36:35.695829 62664 main.go:141] libmachine: Creating machine...
I0924 19:36:35.695845 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .Create
I0924 19:36:35.695972 62664 main.go:141] libmachine: (old-k8s-version-510301) Creating KVM machine...
I0924 19:36:35.697472 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | found existing default KVM network
I0924 19:36:35.699013 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | I0924 19:36:35.698745 62713 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:b1:77:91} reservation:<nil>}
I0924 19:36:35.700265 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | I0924 19:36:35.700162 62713 network.go:211] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr4 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:ec:9f:ef} reservation:<nil>}
I0924 19:36:35.701262 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | I0924 19:36:35.701139 62713 network.go:211] skipping subnet 192.168.61.0/24 that is taken: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName:virbr3 IfaceIPv4:192.168.61.1 IfaceMTU:1500 IfaceMAC:52:54:00:bb:03:18} reservation:<nil>}
I0924 19:36:35.702502 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | I0924 19:36:35.702419 62713 network.go:206] using free private subnet 192.168.72.0/24: &{IP:192.168.72.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.72.0/24 Gateway:192.168.72.1 ClientMin:192.168.72.2 ClientMax:192.168.72.254 Broadcast:192.168.72.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc00028ba90}
I0924 19:36:35.702668 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | created network xml:
I0924 19:36:35.702691 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | <network>
I0924 19:36:35.702702 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | <name>mk-old-k8s-version-510301</name>
I0924 19:36:35.702709 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | <dns enable='no'/>
I0924 19:36:35.702720 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG |
I0924 19:36:35.702730 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | <ip address='192.168.72.1' netmask='255.255.255.0'>
I0924 19:36:35.702740 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | <dhcp>
I0924 19:36:35.702750 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | <range start='192.168.72.2' end='192.168.72.253'/>
I0924 19:36:35.702762 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | </dhcp>
I0924 19:36:35.702769 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | </ip>
I0924 19:36:35.702806 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG |
I0924 19:36:35.702866 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | </network>
I0924 19:36:35.702882 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG |
I0924 19:36:35.707746 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | trying to create private KVM network mk-old-k8s-version-510301 192.168.72.0/24...
I0924 19:36:35.789188 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | private KVM network mk-old-k8s-version-510301 192.168.72.0/24 created
I0924 19:36:35.789237 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | I0924 19:36:35.789179 62713 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19700-3751/.minikube
I0924 19:36:35.789280 62664 main.go:141] libmachine: (old-k8s-version-510301) Setting up store path in /home/jenkins/minikube-integration/19700-3751/.minikube/machines/old-k8s-version-510301 ...
I0924 19:36:35.789311 62664 main.go:141] libmachine: (old-k8s-version-510301) Building disk image from file:///home/jenkins/minikube-integration/19700-3751/.minikube/cache/iso/amd64/minikube-v1.34.0-1727108440-19696-amd64.iso
I0924 19:36:35.789375 62664 main.go:141] libmachine: (old-k8s-version-510301) Downloading /home/jenkins/minikube-integration/19700-3751/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19700-3751/.minikube/cache/iso/amd64/minikube-v1.34.0-1727108440-19696-amd64.iso...
I0924 19:36:36.053783 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | I0924 19:36:36.053661 62713 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19700-3751/.minikube/machines/old-k8s-version-510301/id_rsa...
I0924 19:36:36.191210 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | I0924 19:36:36.191074 62713 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19700-3751/.minikube/machines/old-k8s-version-510301/old-k8s-version-510301.rawdisk...
I0924 19:36:36.191250 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | Writing magic tar header
I0924 19:36:36.191275 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | Writing SSH key tar header
I0924 19:36:36.191298 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | I0924 19:36:36.191230 62713 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19700-3751/.minikube/machines/old-k8s-version-510301 ...
I0924 19:36:36.191416 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19700-3751/.minikube/machines/old-k8s-version-510301
I0924 19:36:36.191439 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19700-3751/.minikube/machines
I0924 19:36:36.191457 62664 main.go:141] libmachine: (old-k8s-version-510301) Setting executable bit set on /home/jenkins/minikube-integration/19700-3751/.minikube/machines/old-k8s-version-510301 (perms=drwx------)
I0924 19:36:36.191466 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19700-3751/.minikube
I0924 19:36:36.191475 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19700-3751
I0924 19:36:36.191485 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0924 19:36:36.191497 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | Checking permissions on dir: /home/jenkins
I0924 19:36:36.191508 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | Checking permissions on dir: /home
I0924 19:36:36.191525 62664 main.go:141] libmachine: (old-k8s-version-510301) Setting executable bit set on /home/jenkins/minikube-integration/19700-3751/.minikube/machines (perms=drwxr-xr-x)
I0924 19:36:36.191533 62664 main.go:141] libmachine: (old-k8s-version-510301) Setting executable bit set on /home/jenkins/minikube-integration/19700-3751/.minikube (perms=drwxr-xr-x)
I0924 19:36:36.191538 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | Skipping /home - not owner
I0924 19:36:36.191548 62664 main.go:141] libmachine: (old-k8s-version-510301) Setting executable bit set on /home/jenkins/minikube-integration/19700-3751 (perms=drwxrwxr-x)
I0924 19:36:36.191556 62664 main.go:141] libmachine: (old-k8s-version-510301) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0924 19:36:36.191566 62664 main.go:141] libmachine: (old-k8s-version-510301) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0924 19:36:36.191576 62664 main.go:141] libmachine: (old-k8s-version-510301) Creating domain...
I0924 19:36:36.192712 62664 main.go:141] libmachine: (old-k8s-version-510301) define libvirt domain using xml:
I0924 19:36:36.192736 62664 main.go:141] libmachine: (old-k8s-version-510301) <domain type='kvm'>
I0924 19:36:36.192767 62664 main.go:141] libmachine: (old-k8s-version-510301) <name>old-k8s-version-510301</name>
I0924 19:36:36.192796 62664 main.go:141] libmachine: (old-k8s-version-510301) <memory unit='MiB'>2200</memory>
I0924 19:36:36.192809 62664 main.go:141] libmachine: (old-k8s-version-510301) <vcpu>2</vcpu>
I0924 19:36:36.192818 62664 main.go:141] libmachine: (old-k8s-version-510301) <features>
I0924 19:36:36.192841 62664 main.go:141] libmachine: (old-k8s-version-510301) <acpi/>
I0924 19:36:36.192851 62664 main.go:141] libmachine: (old-k8s-version-510301) <apic/>
I0924 19:36:36.192859 62664 main.go:141] libmachine: (old-k8s-version-510301) <pae/>
I0924 19:36:36.192867 62664 main.go:141] libmachine: (old-k8s-version-510301)
I0924 19:36:36.192877 62664 main.go:141] libmachine: (old-k8s-version-510301) </features>
I0924 19:36:36.192885 62664 main.go:141] libmachine: (old-k8s-version-510301) <cpu mode='host-passthrough'>
I0924 19:36:36.192896 62664 main.go:141] libmachine: (old-k8s-version-510301)
I0924 19:36:36.192903 62664 main.go:141] libmachine: (old-k8s-version-510301) </cpu>
I0924 19:36:36.192914 62664 main.go:141] libmachine: (old-k8s-version-510301) <os>
I0924 19:36:36.192924 62664 main.go:141] libmachine: (old-k8s-version-510301) <type>hvm</type>
I0924 19:36:36.192932 62664 main.go:141] libmachine: (old-k8s-version-510301) <boot dev='cdrom'/>
I0924 19:36:36.192944 62664 main.go:141] libmachine: (old-k8s-version-510301) <boot dev='hd'/>
I0924 19:36:36.192955 62664 main.go:141] libmachine: (old-k8s-version-510301) <bootmenu enable='no'/>
I0924 19:36:36.192961 62664 main.go:141] libmachine: (old-k8s-version-510301) </os>
I0924 19:36:36.192977 62664 main.go:141] libmachine: (old-k8s-version-510301) <devices>
I0924 19:36:36.192987 62664 main.go:141] libmachine: (old-k8s-version-510301) <disk type='file' device='cdrom'>
I0924 19:36:36.193002 62664 main.go:141] libmachine: (old-k8s-version-510301) <source file='/home/jenkins/minikube-integration/19700-3751/.minikube/machines/old-k8s-version-510301/boot2docker.iso'/>
I0924 19:36:36.193013 62664 main.go:141] libmachine: (old-k8s-version-510301) <target dev='hdc' bus='scsi'/>
I0924 19:36:36.193024 62664 main.go:141] libmachine: (old-k8s-version-510301) <readonly/>
I0924 19:36:36.193033 62664 main.go:141] libmachine: (old-k8s-version-510301) </disk>
I0924 19:36:36.193042 62664 main.go:141] libmachine: (old-k8s-version-510301) <disk type='file' device='disk'>
I0924 19:36:36.193052 62664 main.go:141] libmachine: (old-k8s-version-510301) <driver name='qemu' type='raw' cache='default' io='threads' />
I0924 19:36:36.193064 62664 main.go:141] libmachine: (old-k8s-version-510301) <source file='/home/jenkins/minikube-integration/19700-3751/.minikube/machines/old-k8s-version-510301/old-k8s-version-510301.rawdisk'/>
I0924 19:36:36.193074 62664 main.go:141] libmachine: (old-k8s-version-510301) <target dev='hda' bus='virtio'/>
I0924 19:36:36.193085 62664 main.go:141] libmachine: (old-k8s-version-510301) </disk>
I0924 19:36:36.193093 62664 main.go:141] libmachine: (old-k8s-version-510301) <interface type='network'>
I0924 19:36:36.193106 62664 main.go:141] libmachine: (old-k8s-version-510301) <source network='mk-old-k8s-version-510301'/>
I0924 19:36:36.193141 62664 main.go:141] libmachine: (old-k8s-version-510301) <model type='virtio'/>
I0924 19:36:36.193184 62664 main.go:141] libmachine: (old-k8s-version-510301) </interface>
I0924 19:36:36.193196 62664 main.go:141] libmachine: (old-k8s-version-510301) <interface type='network'>
I0924 19:36:36.193237 62664 main.go:141] libmachine: (old-k8s-version-510301) <source network='default'/>
I0924 19:36:36.193251 62664 main.go:141] libmachine: (old-k8s-version-510301) <model type='virtio'/>
I0924 19:36:36.193262 62664 main.go:141] libmachine: (old-k8s-version-510301) </interface>
I0924 19:36:36.193271 62664 main.go:141] libmachine: (old-k8s-version-510301) <serial type='pty'>
I0924 19:36:36.193280 62664 main.go:141] libmachine: (old-k8s-version-510301) <target port='0'/>
I0924 19:36:36.193289 62664 main.go:141] libmachine: (old-k8s-version-510301) </serial>
I0924 19:36:36.193297 62664 main.go:141] libmachine: (old-k8s-version-510301) <console type='pty'>
I0924 19:36:36.193307 62664 main.go:141] libmachine: (old-k8s-version-510301) <target type='serial' port='0'/>
I0924 19:36:36.193315 62664 main.go:141] libmachine: (old-k8s-version-510301) </console>
I0924 19:36:36.193325 62664 main.go:141] libmachine: (old-k8s-version-510301) <rng model='virtio'>
I0924 19:36:36.193334 62664 main.go:141] libmachine: (old-k8s-version-510301) <backend model='random'>/dev/random</backend>
I0924 19:36:36.193344 62664 main.go:141] libmachine: (old-k8s-version-510301) </rng>
I0924 19:36:36.193352 62664 main.go:141] libmachine: (old-k8s-version-510301)
I0924 19:36:36.193361 62664 main.go:141] libmachine: (old-k8s-version-510301)
I0924 19:36:36.193374 62664 main.go:141] libmachine: (old-k8s-version-510301) </devices>
I0924 19:36:36.193384 62664 main.go:141] libmachine: (old-k8s-version-510301) </domain>
I0924 19:36:36.193394 62664 main.go:141] libmachine: (old-k8s-version-510301)
I0924 19:36:36.197386 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | domain old-k8s-version-510301 has defined MAC address 52:54:00:44:3b:4c in network default
I0924 19:36:36.198162 62664 main.go:141] libmachine: (old-k8s-version-510301) Ensuring networks are active...
I0924 19:36:36.198188 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | domain old-k8s-version-510301 has defined MAC address 52:54:00:72:11:f0 in network mk-old-k8s-version-510301
I0924 19:36:36.199075 62664 main.go:141] libmachine: (old-k8s-version-510301) Ensuring network default is active
I0924 19:36:36.199469 62664 main.go:141] libmachine: (old-k8s-version-510301) Ensuring network mk-old-k8s-version-510301 is active
I0924 19:36:36.200191 62664 main.go:141] libmachine: (old-k8s-version-510301) Getting domain xml...
I0924 19:36:36.201067 62664 main.go:141] libmachine: (old-k8s-version-510301) Creating domain...
I0924 19:36:37.551858 62664 main.go:141] libmachine: (old-k8s-version-510301) Waiting to get IP...
I0924 19:36:37.553029 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | domain old-k8s-version-510301 has defined MAC address 52:54:00:72:11:f0 in network mk-old-k8s-version-510301
I0924 19:36:37.553626 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | unable to find current IP address of domain old-k8s-version-510301 in network mk-old-k8s-version-510301
I0924 19:36:37.553655 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | I0924 19:36:37.553627 62713 retry.go:31] will retry after 299.812936ms: waiting for machine to come up
I0924 19:36:37.855430 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | domain old-k8s-version-510301 has defined MAC address 52:54:00:72:11:f0 in network mk-old-k8s-version-510301
I0924 19:36:37.856026 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | unable to find current IP address of domain old-k8s-version-510301 in network mk-old-k8s-version-510301
I0924 19:36:37.856074 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | I0924 19:36:37.855990 62713 retry.go:31] will retry after 359.760091ms: waiting for machine to come up
I0924 19:36:38.217602 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | domain old-k8s-version-510301 has defined MAC address 52:54:00:72:11:f0 in network mk-old-k8s-version-510301
I0924 19:36:38.218269 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | unable to find current IP address of domain old-k8s-version-510301 in network mk-old-k8s-version-510301
I0924 19:36:38.218291 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | I0924 19:36:38.218230 62713 retry.go:31] will retry after 296.677763ms: waiting for machine to come up
I0924 19:36:38.516906 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | domain old-k8s-version-510301 has defined MAC address 52:54:00:72:11:f0 in network mk-old-k8s-version-510301
I0924 19:36:38.517448 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | unable to find current IP address of domain old-k8s-version-510301 in network mk-old-k8s-version-510301
I0924 19:36:38.517480 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | I0924 19:36:38.517401 62713 retry.go:31] will retry after 497.753844ms: waiting for machine to come up
I0924 19:36:39.017057 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | domain old-k8s-version-510301 has defined MAC address 52:54:00:72:11:f0 in network mk-old-k8s-version-510301
I0924 19:36:39.017734 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | unable to find current IP address of domain old-k8s-version-510301 in network mk-old-k8s-version-510301
I0924 19:36:39.017763 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | I0924 19:36:39.017653 62713 retry.go:31] will retry after 578.443253ms: waiting for machine to come up
I0924 19:36:39.597493 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | domain old-k8s-version-510301 has defined MAC address 52:54:00:72:11:f0 in network mk-old-k8s-version-510301
I0924 19:36:39.598080 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | unable to find current IP address of domain old-k8s-version-510301 in network mk-old-k8s-version-510301
I0924 19:36:39.598115 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | I0924 19:36:39.598031 62713 retry.go:31] will retry after 844.703736ms: waiting for machine to come up
I0924 19:36:40.444081 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | domain old-k8s-version-510301 has defined MAC address 52:54:00:72:11:f0 in network mk-old-k8s-version-510301
I0924 19:36:40.445256 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | unable to find current IP address of domain old-k8s-version-510301 in network mk-old-k8s-version-510301
I0924 19:36:40.445291 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | I0924 19:36:40.445197 62713 retry.go:31] will retry after 820.762581ms: waiting for machine to come up
I0924 19:36:41.267970 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | domain old-k8s-version-510301 has defined MAC address 52:54:00:72:11:f0 in network mk-old-k8s-version-510301
I0924 19:36:41.268548 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | unable to find current IP address of domain old-k8s-version-510301 in network mk-old-k8s-version-510301
I0924 19:36:41.268577 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | I0924 19:36:41.268496 62713 retry.go:31] will retry after 1.126432933s: waiting for machine to come up
I0924 19:36:42.397082 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | domain old-k8s-version-510301 has defined MAC address 52:54:00:72:11:f0 in network mk-old-k8s-version-510301
I0924 19:36:42.397534 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | unable to find current IP address of domain old-k8s-version-510301 in network mk-old-k8s-version-510301
I0924 19:36:42.397590 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | I0924 19:36:42.397522 62713 retry.go:31] will retry after 1.272574515s: waiting for machine to come up
I0924 19:36:43.672082 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | domain old-k8s-version-510301 has defined MAC address 52:54:00:72:11:f0 in network mk-old-k8s-version-510301
I0924 19:36:43.672561 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | unable to find current IP address of domain old-k8s-version-510301 in network mk-old-k8s-version-510301
I0924 19:36:43.672594 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | I0924 19:36:43.672508 62713 retry.go:31] will retry after 2.225667355s: waiting for machine to come up
I0924 19:36:45.899472 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | domain old-k8s-version-510301 has defined MAC address 52:54:00:72:11:f0 in network mk-old-k8s-version-510301
I0924 19:36:45.899958 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | unable to find current IP address of domain old-k8s-version-510301 in network mk-old-k8s-version-510301
I0924 19:36:45.899983 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | I0924 19:36:45.899935 62713 retry.go:31] will retry after 2.373195555s: waiting for machine to come up
I0924 19:36:48.276044 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | domain old-k8s-version-510301 has defined MAC address 52:54:00:72:11:f0 in network mk-old-k8s-version-510301
I0924 19:36:48.276718 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | unable to find current IP address of domain old-k8s-version-510301 in network mk-old-k8s-version-510301
I0924 19:36:48.276747 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | I0924 19:36:48.276636 62713 retry.go:31] will retry after 3.548066204s: waiting for machine to come up
I0924 19:36:51.826156 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | domain old-k8s-version-510301 has defined MAC address 52:54:00:72:11:f0 in network mk-old-k8s-version-510301
I0924 19:36:51.826680 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | unable to find current IP address of domain old-k8s-version-510301 in network mk-old-k8s-version-510301
I0924 19:36:51.826701 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | I0924 19:36:51.826646 62713 retry.go:31] will retry after 4.098574416s: waiting for machine to come up
I0924 19:36:55.926515 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | domain old-k8s-version-510301 has defined MAC address 52:54:00:72:11:f0 in network mk-old-k8s-version-510301
I0924 19:36:55.927185 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | unable to find current IP address of domain old-k8s-version-510301 in network mk-old-k8s-version-510301
I0924 19:36:55.927210 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | I0924 19:36:55.927148 62713 retry.go:31] will retry after 4.562350139s: waiting for machine to come up
I0924 19:37:00.492020 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | domain old-k8s-version-510301 has defined MAC address 52:54:00:72:11:f0 in network mk-old-k8s-version-510301
I0924 19:37:00.492647 62664 main.go:141] libmachine: (old-k8s-version-510301) Found IP for machine: 192.168.72.81
I0924 19:37:00.492672 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | domain old-k8s-version-510301 has current primary IP address 192.168.72.81 and MAC address 52:54:00:72:11:f0 in network mk-old-k8s-version-510301
I0924 19:37:00.492679 62664 main.go:141] libmachine: (old-k8s-version-510301) Reserving static IP address...
I0924 19:37:00.493086 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-510301", mac: "52:54:00:72:11:f0", ip: "192.168.72.81"} in network mk-old-k8s-version-510301
I0924 19:37:00.581420 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | Getting to WaitForSSH function...
I0924 19:37:00.581449 62664 main.go:141] libmachine: (old-k8s-version-510301) Reserved static IP address: 192.168.72.81
I0924 19:37:00.581462 62664 main.go:141] libmachine: (old-k8s-version-510301) Waiting for SSH to be available...
I0924 19:37:00.584944 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | domain old-k8s-version-510301 has defined MAC address 52:54:00:72:11:f0 in network mk-old-k8s-version-510301
I0924 19:37:00.585511 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:72:11:f0", ip: ""} in network mk-old-k8s-version-510301: {Iface:virbr2 ExpiryTime:2024-09-24 20:36:51 +0000 UTC Type:0 Mac:52:54:00:72:11:f0 Iaid: IPaddr:192.168.72.81 Prefix:24 Hostname:minikube Clientid:01:52:54:00:72:11:f0}
I0924 19:37:00.585539 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | domain old-k8s-version-510301 has defined IP address 192.168.72.81 and MAC address 52:54:00:72:11:f0 in network mk-old-k8s-version-510301
I0924 19:37:00.585723 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | Using SSH client type: external
I0924 19:37:00.585755 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | Using SSH private key: /home/jenkins/minikube-integration/19700-3751/.minikube/machines/old-k8s-version-510301/id_rsa (-rw-------)
I0924 19:37:00.585786 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.72.81 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19700-3751/.minikube/machines/old-k8s-version-510301/id_rsa -p 22] /usr/bin/ssh <nil>}
I0924 19:37:00.585799 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | About to run SSH command:
I0924 19:37:00.585810 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | exit 0
I0924 19:37:00.715843 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | SSH cmd err, output: <nil>:
I0924 19:37:00.716301 62664 main.go:141] libmachine: (old-k8s-version-510301) KVM machine creation complete!
I0924 19:37:00.716728 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetConfigRaw
I0924 19:37:00.717306 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .DriverName
I0924 19:37:00.717558 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .DriverName
I0924 19:37:00.717746 62664 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0924 19:37:00.717761 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetState
I0924 19:37:00.719186 62664 main.go:141] libmachine: Detecting operating system of created instance...
I0924 19:37:00.719200 62664 main.go:141] libmachine: Waiting for SSH to be available...
I0924 19:37:00.719206 62664 main.go:141] libmachine: Getting to WaitForSSH function...
I0924 19:37:00.719215 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetSSHHostname
I0924 19:37:00.722255 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | domain old-k8s-version-510301 has defined MAC address 52:54:00:72:11:f0 in network mk-old-k8s-version-510301
I0924 19:37:00.722812 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:72:11:f0", ip: ""} in network mk-old-k8s-version-510301: {Iface:virbr2 ExpiryTime:2024-09-24 20:36:51 +0000 UTC Type:0 Mac:52:54:00:72:11:f0 Iaid: IPaddr:192.168.72.81 Prefix:24 Hostname:old-k8s-version-510301 Clientid:01:52:54:00:72:11:f0}
I0924 19:37:00.722853 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | domain old-k8s-version-510301 has defined IP address 192.168.72.81 and MAC address 52:54:00:72:11:f0 in network mk-old-k8s-version-510301
I0924 19:37:00.723059 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetSSHPort
I0924 19:37:00.723215 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetSSHKeyPath
I0924 19:37:00.723391 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetSSHKeyPath
I0924 19:37:00.723523 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetSSHUsername
I0924 19:37:00.723685 62664 main.go:141] libmachine: Using SSH client type: native
I0924 19:37:00.723890 62664 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil> [] 0s} 192.168.72.81 22 <nil> <nil>}
I0924 19:37:00.723904 62664 main.go:141] libmachine: About to run SSH command:
exit 0
I0924 19:37:00.830637 62664 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0924 19:37:00.830664 62664 main.go:141] libmachine: Detecting the provisioner...
I0924 19:37:00.830675 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetSSHHostname
I0924 19:37:00.833916 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | domain old-k8s-version-510301 has defined MAC address 52:54:00:72:11:f0 in network mk-old-k8s-version-510301
I0924 19:37:00.834359 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:72:11:f0", ip: ""} in network mk-old-k8s-version-510301: {Iface:virbr2 ExpiryTime:2024-09-24 20:36:51 +0000 UTC Type:0 Mac:52:54:00:72:11:f0 Iaid: IPaddr:192.168.72.81 Prefix:24 Hostname:old-k8s-version-510301 Clientid:01:52:54:00:72:11:f0}
I0924 19:37:00.834387 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | domain old-k8s-version-510301 has defined IP address 192.168.72.81 and MAC address 52:54:00:72:11:f0 in network mk-old-k8s-version-510301
I0924 19:37:00.834616 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetSSHPort
I0924 19:37:00.834821 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetSSHKeyPath
I0924 19:37:00.835045 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetSSHKeyPath
I0924 19:37:00.835214 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetSSHUsername
I0924 19:37:00.835387 62664 main.go:141] libmachine: Using SSH client type: native
I0924 19:37:00.835624 62664 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil> [] 0s} 192.168.72.81 22 <nil> <nil>}
I0924 19:37:00.835640 62664 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0924 19:37:00.936367 62664 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0924 19:37:00.936442 62664 main.go:141] libmachine: found compatible host: buildroot
I0924 19:37:00.936452 62664 main.go:141] libmachine: Provisioning with buildroot...
I0924 19:37:00.936469 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetMachineName
I0924 19:37:00.936760 62664 buildroot.go:166] provisioning hostname "old-k8s-version-510301"
I0924 19:37:00.936790 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetMachineName
I0924 19:37:00.937065 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetSSHHostname
I0924 19:37:00.940192 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | domain old-k8s-version-510301 has defined MAC address 52:54:00:72:11:f0 in network mk-old-k8s-version-510301
I0924 19:37:00.940714 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:72:11:f0", ip: ""} in network mk-old-k8s-version-510301: {Iface:virbr2 ExpiryTime:2024-09-24 20:36:51 +0000 UTC Type:0 Mac:52:54:00:72:11:f0 Iaid: IPaddr:192.168.72.81 Prefix:24 Hostname:old-k8s-version-510301 Clientid:01:52:54:00:72:11:f0}
I0924 19:37:00.940740 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | domain old-k8s-version-510301 has defined IP address 192.168.72.81 and MAC address 52:54:00:72:11:f0 in network mk-old-k8s-version-510301
I0924 19:37:00.940832 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetSSHPort
I0924 19:37:00.941032 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetSSHKeyPath
I0924 19:37:00.941211 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetSSHKeyPath
I0924 19:37:00.941385 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetSSHUsername
I0924 19:37:00.941575 62664 main.go:141] libmachine: Using SSH client type: native
I0924 19:37:00.941805 62664 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil> [] 0s} 192.168.72.81 22 <nil> <nil>}
I0924 19:37:00.941820 62664 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-510301 && echo "old-k8s-version-510301" | sudo tee /etc/hostname
I0924 19:37:01.059156 62664 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-510301
I0924 19:37:01.059189 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetSSHHostname
I0924 19:37:01.062381 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | domain old-k8s-version-510301 has defined MAC address 52:54:00:72:11:f0 in network mk-old-k8s-version-510301
I0924 19:37:01.062776 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:72:11:f0", ip: ""} in network mk-old-k8s-version-510301: {Iface:virbr2 ExpiryTime:2024-09-24 20:36:51 +0000 UTC Type:0 Mac:52:54:00:72:11:f0 Iaid: IPaddr:192.168.72.81 Prefix:24 Hostname:old-k8s-version-510301 Clientid:01:52:54:00:72:11:f0}
I0924 19:37:01.062805 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | domain old-k8s-version-510301 has defined IP address 192.168.72.81 and MAC address 52:54:00:72:11:f0 in network mk-old-k8s-version-510301
I0924 19:37:01.062974 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetSSHPort
I0924 19:37:01.063176 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetSSHKeyPath
I0924 19:37:01.063348 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetSSHKeyPath
I0924 19:37:01.063524 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetSSHUsername
I0924 19:37:01.063694 62664 main.go:141] libmachine: Using SSH client type: native
I0924 19:37:01.063905 62664 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil> [] 0s} 192.168.72.81 22 <nil> <nil>}
I0924 19:37:01.063938 62664 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-510301' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-510301/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-510301' | sudo tee -a /etc/hosts;
fi
fi
I0924 19:37:01.182758 62664 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0924 19:37:01.182791 62664 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19700-3751/.minikube CaCertPath:/home/jenkins/minikube-integration/19700-3751/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19700-3751/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19700-3751/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19700-3751/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19700-3751/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19700-3751/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19700-3751/.minikube}
I0924 19:37:01.182886 62664 buildroot.go:174] setting up certificates
I0924 19:37:01.182960 62664 provision.go:84] configureAuth start
I0924 19:37:01.182987 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetMachineName
I0924 19:37:01.183276 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetIP
I0924 19:37:01.186625 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | domain old-k8s-version-510301 has defined MAC address 52:54:00:72:11:f0 in network mk-old-k8s-version-510301
I0924 19:37:01.187062 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:72:11:f0", ip: ""} in network mk-old-k8s-version-510301: {Iface:virbr2 ExpiryTime:2024-09-24 20:36:51 +0000 UTC Type:0 Mac:52:54:00:72:11:f0 Iaid: IPaddr:192.168.72.81 Prefix:24 Hostname:old-k8s-version-510301 Clientid:01:52:54:00:72:11:f0}
I0924 19:37:01.187085 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | domain old-k8s-version-510301 has defined IP address 192.168.72.81 and MAC address 52:54:00:72:11:f0 in network mk-old-k8s-version-510301
I0924 19:37:01.187297 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetSSHHostname
I0924 19:37:01.190005 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | domain old-k8s-version-510301 has defined MAC address 52:54:00:72:11:f0 in network mk-old-k8s-version-510301
I0924 19:37:01.190349 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:72:11:f0", ip: ""} in network mk-old-k8s-version-510301: {Iface:virbr2 ExpiryTime:2024-09-24 20:36:51 +0000 UTC Type:0 Mac:52:54:00:72:11:f0 Iaid: IPaddr:192.168.72.81 Prefix:24 Hostname:old-k8s-version-510301 Clientid:01:52:54:00:72:11:f0}
I0924 19:37:01.190412 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | domain old-k8s-version-510301 has defined IP address 192.168.72.81 and MAC address 52:54:00:72:11:f0 in network mk-old-k8s-version-510301
I0924 19:37:01.190511 62664 provision.go:143] copyHostCerts
I0924 19:37:01.190573 62664 exec_runner.go:144] found /home/jenkins/minikube-integration/19700-3751/.minikube/ca.pem, removing ...
I0924 19:37:01.190585 62664 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19700-3751/.minikube/ca.pem
I0924 19:37:01.190643 62664 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19700-3751/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19700-3751/.minikube/ca.pem (1078 bytes)
I0924 19:37:01.190753 62664 exec_runner.go:144] found /home/jenkins/minikube-integration/19700-3751/.minikube/cert.pem, removing ...
I0924 19:37:01.190763 62664 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19700-3751/.minikube/cert.pem
I0924 19:37:01.190795 62664 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19700-3751/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19700-3751/.minikube/cert.pem (1123 bytes)
I0924 19:37:01.190920 62664 exec_runner.go:144] found /home/jenkins/minikube-integration/19700-3751/.minikube/key.pem, removing ...
I0924 19:37:01.190933 62664 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19700-3751/.minikube/key.pem
I0924 19:37:01.190965 62664 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19700-3751/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19700-3751/.minikube/key.pem (1675 bytes)
I0924 19:37:01.191044 62664 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19700-3751/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19700-3751/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19700-3751/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-510301 san=[127.0.0.1 192.168.72.81 localhost minikube old-k8s-version-510301]
I0924 19:37:01.452291 62664 provision.go:177] copyRemoteCerts
I0924 19:37:01.452352 62664 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0924 19:37:01.452374 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetSSHHostname
I0924 19:37:01.455652 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | domain old-k8s-version-510301 has defined MAC address 52:54:00:72:11:f0 in network mk-old-k8s-version-510301
I0924 19:37:01.456109 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:72:11:f0", ip: ""} in network mk-old-k8s-version-510301: {Iface:virbr2 ExpiryTime:2024-09-24 20:36:51 +0000 UTC Type:0 Mac:52:54:00:72:11:f0 Iaid: IPaddr:192.168.72.81 Prefix:24 Hostname:old-k8s-version-510301 Clientid:01:52:54:00:72:11:f0}
I0924 19:37:01.456140 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | domain old-k8s-version-510301 has defined IP address 192.168.72.81 and MAC address 52:54:00:72:11:f0 in network mk-old-k8s-version-510301
I0924 19:37:01.456291 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetSSHPort
I0924 19:37:01.456480 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetSSHKeyPath
I0924 19:37:01.456664 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetSSHUsername
I0924 19:37:01.456819 62664 sshutil.go:53] new ssh client: &{IP:192.168.72.81 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19700-3751/.minikube/machines/old-k8s-version-510301/id_rsa Username:docker}
I0924 19:37:01.552297 62664 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19700-3751/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0924 19:37:01.575723 62664 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19700-3751/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0924 19:37:01.604297 62664 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19700-3751/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0924 19:37:01.630443 62664 provision.go:87] duration metric: took 447.463211ms to configureAuth
I0924 19:37:01.630473 62664 buildroot.go:189] setting minikube options for container-runtime
I0924 19:37:01.630678 62664 config.go:182] Loaded profile config "old-k8s-version-510301": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0924 19:37:01.630757 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetSSHHostname
I0924 19:37:01.633442 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | domain old-k8s-version-510301 has defined MAC address 52:54:00:72:11:f0 in network mk-old-k8s-version-510301
I0924 19:37:01.633959 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:72:11:f0", ip: ""} in network mk-old-k8s-version-510301: {Iface:virbr2 ExpiryTime:2024-09-24 20:36:51 +0000 UTC Type:0 Mac:52:54:00:72:11:f0 Iaid: IPaddr:192.168.72.81 Prefix:24 Hostname:old-k8s-version-510301 Clientid:01:52:54:00:72:11:f0}
I0924 19:37:01.633988 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | domain old-k8s-version-510301 has defined IP address 192.168.72.81 and MAC address 52:54:00:72:11:f0 in network mk-old-k8s-version-510301
I0924 19:37:01.634156 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetSSHPort
I0924 19:37:01.634381 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetSSHKeyPath
I0924 19:37:01.634894 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetSSHKeyPath
I0924 19:37:01.635094 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetSSHUsername
I0924 19:37:01.635273 62664 main.go:141] libmachine: Using SSH client type: native
I0924 19:37:01.635477 62664 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil> [] 0s} 192.168.72.81 22 <nil> <nil>}
I0924 19:37:01.635537 62664 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0924 19:37:01.883315 62664 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0924 19:37:01.883348 62664 main.go:141] libmachine: Checking connection to Docker...
I0924 19:37:01.883361 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetURL
I0924 19:37:01.884841 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | Using libvirt version 6000000
I0924 19:37:01.887644 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | domain old-k8s-version-510301 has defined MAC address 52:54:00:72:11:f0 in network mk-old-k8s-version-510301
I0924 19:37:01.888041 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:72:11:f0", ip: ""} in network mk-old-k8s-version-510301: {Iface:virbr2 ExpiryTime:2024-09-24 20:36:51 +0000 UTC Type:0 Mac:52:54:00:72:11:f0 Iaid: IPaddr:192.168.72.81 Prefix:24 Hostname:old-k8s-version-510301 Clientid:01:52:54:00:72:11:f0}
I0924 19:37:01.888070 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | domain old-k8s-version-510301 has defined IP address 192.168.72.81 and MAC address 52:54:00:72:11:f0 in network mk-old-k8s-version-510301
I0924 19:37:01.888288 62664 main.go:141] libmachine: Docker is up and running!
I0924 19:37:01.888301 62664 main.go:141] libmachine: Reticulating splines...
I0924 19:37:01.888307 62664 client.go:171] duration metric: took 26.19348615s to LocalClient.Create
I0924 19:37:01.888329 62664 start.go:167] duration metric: took 26.193550591s to libmachine.API.Create "old-k8s-version-510301"
I0924 19:37:01.888341 62664 start.go:293] postStartSetup for "old-k8s-version-510301" (driver="kvm2")
I0924 19:37:01.888357 62664 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0924 19:37:01.888379 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .DriverName
I0924 19:37:01.888656 62664 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0924 19:37:01.888681 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetSSHHostname
I0924 19:37:01.891521 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | domain old-k8s-version-510301 has defined MAC address 52:54:00:72:11:f0 in network mk-old-k8s-version-510301
I0924 19:37:01.894147 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:72:11:f0", ip: ""} in network mk-old-k8s-version-510301: {Iface:virbr2 ExpiryTime:2024-09-24 20:36:51 +0000 UTC Type:0 Mac:52:54:00:72:11:f0 Iaid: IPaddr:192.168.72.81 Prefix:24 Hostname:old-k8s-version-510301 Clientid:01:52:54:00:72:11:f0}
I0924 19:37:01.894173 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | domain old-k8s-version-510301 has defined IP address 192.168.72.81 and MAC address 52:54:00:72:11:f0 in network mk-old-k8s-version-510301
I0924 19:37:01.894407 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetSSHPort
I0924 19:37:01.894569 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetSSHKeyPath
I0924 19:37:01.894734 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetSSHUsername
I0924 19:37:01.894856 62664 sshutil.go:53] new ssh client: &{IP:192.168.72.81 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19700-3751/.minikube/machines/old-k8s-version-510301/id_rsa Username:docker}
I0924 19:37:01.977769 62664 ssh_runner.go:195] Run: cat /etc/os-release
I0924 19:37:01.983219 62664 info.go:137] Remote host: Buildroot 2023.02.9
I0924 19:37:01.983240 62664 filesync.go:126] Scanning /home/jenkins/minikube-integration/19700-3751/.minikube/addons for local assets ...
I0924 19:37:01.983292 62664 filesync.go:126] Scanning /home/jenkins/minikube-integration/19700-3751/.minikube/files for local assets ...
I0924 19:37:01.984037 62664 filesync.go:149] local asset: /home/jenkins/minikube-integration/19700-3751/.minikube/files/etc/ssl/certs/109492.pem -> 109492.pem in /etc/ssl/certs
I0924 19:37:01.984159 62664 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0924 19:37:01.998059 62664 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19700-3751/.minikube/files/etc/ssl/certs/109492.pem --> /etc/ssl/certs/109492.pem (1708 bytes)
I0924 19:37:02.028048 62664 start.go:296] duration metric: took 139.691305ms for postStartSetup
I0924 19:37:02.028097 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetConfigRaw
I0924 19:37:02.028782 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetIP
I0924 19:37:02.031786 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | domain old-k8s-version-510301 has defined MAC address 52:54:00:72:11:f0 in network mk-old-k8s-version-510301
I0924 19:37:02.032248 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:72:11:f0", ip: ""} in network mk-old-k8s-version-510301: {Iface:virbr2 ExpiryTime:2024-09-24 20:36:51 +0000 UTC Type:0 Mac:52:54:00:72:11:f0 Iaid: IPaddr:192.168.72.81 Prefix:24 Hostname:old-k8s-version-510301 Clientid:01:52:54:00:72:11:f0}
I0924 19:37:02.032275 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | domain old-k8s-version-510301 has defined IP address 192.168.72.81 and MAC address 52:54:00:72:11:f0 in network mk-old-k8s-version-510301
I0924 19:37:02.032623 62664 profile.go:143] Saving config to /home/jenkins/minikube-integration/19700-3751/.minikube/profiles/old-k8s-version-510301/config.json ...
I0924 19:37:02.032844 62664 start.go:128] duration metric: took 26.360076927s to createHost
I0924 19:37:02.032868 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetSSHHostname
I0924 19:37:02.035596 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | domain old-k8s-version-510301 has defined MAC address 52:54:00:72:11:f0 in network mk-old-k8s-version-510301
I0924 19:37:02.035980 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:72:11:f0", ip: ""} in network mk-old-k8s-version-510301: {Iface:virbr2 ExpiryTime:2024-09-24 20:36:51 +0000 UTC Type:0 Mac:52:54:00:72:11:f0 Iaid: IPaddr:192.168.72.81 Prefix:24 Hostname:old-k8s-version-510301 Clientid:01:52:54:00:72:11:f0}
I0924 19:37:02.036007 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | domain old-k8s-version-510301 has defined IP address 192.168.72.81 and MAC address 52:54:00:72:11:f0 in network mk-old-k8s-version-510301
I0924 19:37:02.036161 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetSSHPort
I0924 19:37:02.036362 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetSSHKeyPath
I0924 19:37:02.036525 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetSSHKeyPath
I0924 19:37:02.036690 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetSSHUsername
I0924 19:37:02.036864 62664 main.go:141] libmachine: Using SSH client type: native
I0924 19:37:02.037047 62664 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil> [] 0s} 192.168.72.81 22 <nil> <nil>}
I0924 19:37:02.037064 62664 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0924 19:37:02.145079 62664 main.go:141] libmachine: SSH cmd err, output: <nil>: 1727206622.093992659
I0924 19:37:02.145098 62664 fix.go:216] guest clock: 1727206622.093992659
I0924 19:37:02.145107 62664 fix.go:229] Guest: 2024-09-24 19:37:02.093992659 +0000 UTC Remote: 2024-09-24 19:37:02.03285697 +0000 UTC m=+27.799455964 (delta=61.135689ms)
I0924 19:37:02.145129 62664 fix.go:200] guest clock delta is within tolerance: 61.135689ms
I0924 19:37:02.145136 62664 start.go:83] releasing machines lock for "old-k8s-version-510301", held for 26.472530334s
I0924 19:37:02.145157 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .DriverName
I0924 19:37:02.145449 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetIP
I0924 19:37:02.148832 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | domain old-k8s-version-510301 has defined MAC address 52:54:00:72:11:f0 in network mk-old-k8s-version-510301
I0924 19:37:02.149244 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:72:11:f0", ip: ""} in network mk-old-k8s-version-510301: {Iface:virbr2 ExpiryTime:2024-09-24 20:36:51 +0000 UTC Type:0 Mac:52:54:00:72:11:f0 Iaid: IPaddr:192.168.72.81 Prefix:24 Hostname:old-k8s-version-510301 Clientid:01:52:54:00:72:11:f0}
I0924 19:37:02.149268 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | domain old-k8s-version-510301 has defined IP address 192.168.72.81 and MAC address 52:54:00:72:11:f0 in network mk-old-k8s-version-510301
I0924 19:37:02.149419 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .DriverName
I0924 19:37:02.149900 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .DriverName
I0924 19:37:02.150077 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .DriverName
I0924 19:37:02.150146 62664 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0924 19:37:02.150202 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetSSHHostname
I0924 19:37:02.150264 62664 ssh_runner.go:195] Run: cat /version.json
I0924 19:37:02.150289 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetSSHHostname
I0924 19:37:02.153049 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | domain old-k8s-version-510301 has defined MAC address 52:54:00:72:11:f0 in network mk-old-k8s-version-510301
I0924 19:37:02.153247 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | domain old-k8s-version-510301 has defined MAC address 52:54:00:72:11:f0 in network mk-old-k8s-version-510301
I0924 19:37:02.153424 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:72:11:f0", ip: ""} in network mk-old-k8s-version-510301: {Iface:virbr2 ExpiryTime:2024-09-24 20:36:51 +0000 UTC Type:0 Mac:52:54:00:72:11:f0 Iaid: IPaddr:192.168.72.81 Prefix:24 Hostname:old-k8s-version-510301 Clientid:01:52:54:00:72:11:f0}
I0924 19:37:02.153447 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | domain old-k8s-version-510301 has defined IP address 192.168.72.81 and MAC address 52:54:00:72:11:f0 in network mk-old-k8s-version-510301
I0924 19:37:02.153583 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetSSHPort
I0924 19:37:02.153703 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:72:11:f0", ip: ""} in network mk-old-k8s-version-510301: {Iface:virbr2 ExpiryTime:2024-09-24 20:36:51 +0000 UTC Type:0 Mac:52:54:00:72:11:f0 Iaid: IPaddr:192.168.72.81 Prefix:24 Hostname:old-k8s-version-510301 Clientid:01:52:54:00:72:11:f0}
I0924 19:37:02.153721 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | domain old-k8s-version-510301 has defined IP address 192.168.72.81 and MAC address 52:54:00:72:11:f0 in network mk-old-k8s-version-510301
I0924 19:37:02.153778 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetSSHKeyPath
I0924 19:37:02.153933 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetSSHUsername
I0924 19:37:02.154009 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetSSHPort
I0924 19:37:02.154089 62664 sshutil.go:53] new ssh client: &{IP:192.168.72.81 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19700-3751/.minikube/machines/old-k8s-version-510301/id_rsa Username:docker}
I0924 19:37:02.154462 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetSSHKeyPath
I0924 19:37:02.154637 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetSSHUsername
I0924 19:37:02.154769 62664 sshutil.go:53] new ssh client: &{IP:192.168.72.81 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19700-3751/.minikube/machines/old-k8s-version-510301/id_rsa Username:docker}
I0924 19:37:02.234673 62664 ssh_runner.go:195] Run: systemctl --version
I0924 19:37:02.259089 62664 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0924 19:37:02.428057 62664 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0924 19:37:02.434400 62664 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0924 19:37:02.434454 62664 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0924 19:37:02.454540 62664 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0924 19:37:02.454560 62664 start.go:495] detecting cgroup driver to use...
I0924 19:37:02.454628 62664 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0924 19:37:02.472914 62664 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0924 19:37:02.486632 62664 docker.go:217] disabling cri-docker service (if available) ...
I0924 19:37:02.486705 62664 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0924 19:37:02.499735 62664 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0924 19:37:02.514873 62664 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0924 19:37:02.676264 62664 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0924 19:37:02.872378 62664 docker.go:233] disabling docker service ...
I0924 19:37:02.872454 62664 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0924 19:37:02.890856 62664 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0924 19:37:02.904255 62664 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0924 19:37:03.068912 62664 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0924 19:37:03.205715 62664 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0924 19:37:03.220287 62664 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0924 19:37:03.243162 62664 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0924 19:37:03.243221 62664 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0924 19:37:03.261040 62664 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0924 19:37:03.261113 62664 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0924 19:37:03.272937 62664 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0924 19:37:03.287397 62664 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0924 19:37:03.299718 62664 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0924 19:37:03.311197 62664 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0924 19:37:03.320972 62664 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0924 19:37:03.321026 62664 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0924 19:37:03.338288 62664 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0924 19:37:03.350706 62664 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0924 19:37:03.491579 62664 ssh_runner.go:195] Run: sudo systemctl restart crio
I0924 19:37:03.593463 62664 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0924 19:37:03.593546 62664 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0924 19:37:03.599072 62664 start.go:563] Will wait 60s for crictl version
I0924 19:37:03.599133 62664 ssh_runner.go:195] Run: which crictl
I0924 19:37:03.604043 62664 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0924 19:37:03.664509 62664 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0924 19:37:03.664599 62664 ssh_runner.go:195] Run: crio --version
I0924 19:37:03.708083 62664 ssh_runner.go:195] Run: crio --version
I0924 19:37:03.756303 62664 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0924 19:37:03.757975 62664 main.go:141] libmachine: (old-k8s-version-510301) Calling .GetIP
I0924 19:37:03.762020 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | domain old-k8s-version-510301 has defined MAC address 52:54:00:72:11:f0 in network mk-old-k8s-version-510301
I0924 19:37:03.762387 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:72:11:f0", ip: ""} in network mk-old-k8s-version-510301: {Iface:virbr2 ExpiryTime:2024-09-24 20:36:51 +0000 UTC Type:0 Mac:52:54:00:72:11:f0 Iaid: IPaddr:192.168.72.81 Prefix:24 Hostname:old-k8s-version-510301 Clientid:01:52:54:00:72:11:f0}
I0924 19:37:03.762412 62664 main.go:141] libmachine: (old-k8s-version-510301) DBG | domain old-k8s-version-510301 has defined IP address 192.168.72.81 and MAC address 52:54:00:72:11:f0 in network mk-old-k8s-version-510301
I0924 19:37:03.762658 62664 ssh_runner.go:195] Run: grep 192.168.72.1 host.minikube.internal$ /etc/hosts
I0924 19:37:03.770475 62664 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.72.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0924 19:37:03.785156 62664 kubeadm.go:883] updating cluster {Name:old-k8s-version-510301 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19696/minikube-v1.34.0-1727108440-19696-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-510301 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.81 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mo
untPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0924 19:37:03.785287 62664 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0924 19:37:03.785349 62664 ssh_runner.go:195] Run: sudo crictl images --output json
I0924 19:37:03.821553 62664 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0924 19:37:03.821626 62664 ssh_runner.go:195] Run: which lz4
I0924 19:37:03.825721 62664 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0924 19:37:03.830963 62664 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0924 19:37:03.830994 62664 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19700-3751/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0924 19:37:05.418496 62664 crio.go:462] duration metric: took 1.592807826s to copy over tarball
I0924 19:37:05.418564 62664 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0924 19:37:08.383355 62664 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.964770418s)
I0924 19:37:08.383415 62664 crio.go:469] duration metric: took 2.9648553s to extract the tarball
I0924 19:37:08.383428 62664 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0924 19:37:08.431129 62664 ssh_runner.go:195] Run: sudo crictl images --output json
I0924 19:37:08.519053 62664 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0924 19:37:08.519078 62664 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0924 19:37:08.519132 62664 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0924 19:37:08.519392 62664 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I0924 19:37:08.519432 62664 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0924 19:37:08.519515 62664 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0924 19:37:08.519620 62664 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0924 19:37:08.519391 62664 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0924 19:37:08.519774 62664 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0924 19:37:08.519621 62664 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I0924 19:37:08.520800 62664 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0924 19:37:08.521103 62664 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0924 19:37:08.521151 62664 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0924 19:37:08.521300 62664 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0924 19:37:08.521404 62664 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0924 19:37:08.521593 62664 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0924 19:37:08.522052 62664 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0924 19:37:08.522972 62664 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0924 19:37:08.662964 62664 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0924 19:37:08.669487 62664 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0924 19:37:08.675386 62664 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0924 19:37:08.683666 62664 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0924 19:37:08.695884 62664 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0924 19:37:08.696676 62664 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0924 19:37:08.753375 62664 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0924 19:37:08.753418 62664 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0924 19:37:08.753456 62664 ssh_runner.go:195] Run: which crictl
I0924 19:37:08.755361 62664 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0924 19:37:08.816297 62664 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0924 19:37:08.816349 62664 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0924 19:37:08.816397 62664 ssh_runner.go:195] Run: which crictl
I0924 19:37:08.821741 62664 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0924 19:37:08.821782 62664 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0924 19:37:08.821839 62664 ssh_runner.go:195] Run: which crictl
I0924 19:37:08.823009 62664 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0924 19:37:08.823043 62664 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0924 19:37:08.823082 62664 ssh_runner.go:195] Run: which crictl
I0924 19:37:08.851830 62664 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0924 19:37:08.851856 62664 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0924 19:37:08.851874 62664 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0924 19:37:08.851891 62664 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0924 19:37:08.851915 62664 ssh_runner.go:195] Run: which crictl
I0924 19:37:08.851927 62664 ssh_runner.go:195] Run: which crictl
I0924 19:37:08.851933 62664 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0924 19:37:08.857926 62664 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0924 19:37:08.857964 62664 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0924 19:37:08.857970 62664 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0924 19:37:08.857987 62664 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0924 19:37:08.857999 62664 ssh_runner.go:195] Run: which crictl
I0924 19:37:08.858039 62664 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0924 19:37:08.862350 62664 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0924 19:37:08.951764 62664 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0924 19:37:08.951775 62664 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0924 19:37:08.954124 62664 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0924 19:37:08.982320 62664 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0924 19:37:08.982388 62664 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0924 19:37:08.982481 62664 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0924 19:37:08.982517 62664 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0924 19:37:09.081321 62664 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0924 19:37:09.083124 62664 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0924 19:37:09.092217 62664 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0924 19:37:09.150538 62664 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0924 19:37:09.163109 62664 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0924 19:37:09.163265 62664 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0924 19:37:09.163365 62664 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0924 19:37:09.198167 62664 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0924 19:37:09.219237 62664 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19700-3751/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0924 19:37:09.232123 62664 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19700-3751/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0924 19:37:09.311263 62664 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19700-3751/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0924 19:37:09.311310 62664 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19700-3751/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0924 19:37:09.313801 62664 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0924 19:37:09.313803 62664 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19700-3751/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0924 19:37:09.313865 62664 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19700-3751/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0924 19:37:09.346124 62664 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19700-3751/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0924 19:37:09.562013 62664 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0924 19:37:09.700468 62664 cache_images.go:92] duration metric: took 1.18137326s to LoadCachedImages
W0924 19:37:09.700574 62664 out.go:270] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19700-3751/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19700-3751/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0: no such file or directory
I0924 19:37:09.700590 62664 kubeadm.go:934] updating node { 192.168.72.81 8443 v1.20.0 crio true true} ...
I0924 19:37:09.700692 62664 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-510301 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.72.81
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-510301 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0924 19:37:09.700768 62664 ssh_runner.go:195] Run: crio config
I0924 19:37:09.749310 62664 cni.go:84] Creating CNI manager for ""
I0924 19:37:09.749331 62664 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0924 19:37:09.749341 62664 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0924 19:37:09.749359 62664 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.72.81 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-510301 NodeName:old-k8s-version-510301 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.72.81"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.72.81 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt Stati
cPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0924 19:37:09.749478 62664 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.72.81
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-510301"
kubeletExtraArgs:
node-ip: 192.168.72.81
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.72.81"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0924 19:37:09.749536 62664 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0924 19:37:09.759879 62664 binaries.go:44] Found k8s binaries, skipping transfer
I0924 19:37:09.759950 62664 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0924 19:37:09.769291 62664 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (429 bytes)
I0924 19:37:09.786761 62664 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0924 19:37:09.802761 62664 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2120 bytes)
I0924 19:37:09.820855 62664 ssh_runner.go:195] Run: grep 192.168.72.81 control-plane.minikube.internal$ /etc/hosts
I0924 19:37:09.826167 62664 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.72.81 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0924 19:37:09.838556 62664 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0924 19:37:09.969818 62664 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0924 19:37:09.986978 62664 certs.go:68] Setting up /home/jenkins/minikube-integration/19700-3751/.minikube/profiles/old-k8s-version-510301 for IP: 192.168.72.81
I0924 19:37:09.986996 62664 certs.go:194] generating shared ca certs ...
I0924 19:37:09.987012 62664 certs.go:226] acquiring lock for ca certs: {Name:mkf91a44a1711af5d6a0cffa7b91f5cc433daa9b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0924 19:37:09.987142 62664 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19700-3751/.minikube/ca.key
I0924 19:37:09.987180 62664 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19700-3751/.minikube/proxy-client-ca.key
I0924 19:37:09.987187 62664 certs.go:256] generating profile certs ...
I0924 19:37:09.987235 62664 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19700-3751/.minikube/profiles/old-k8s-version-510301/client.key
I0924 19:37:09.987248 62664 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19700-3751/.minikube/profiles/old-k8s-version-510301/client.crt with IP's: []
I0924 19:37:10.080917 62664 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19700-3751/.minikube/profiles/old-k8s-version-510301/client.crt ...
I0924 19:37:10.080944 62664 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19700-3751/.minikube/profiles/old-k8s-version-510301/client.crt: {Name:mk3579af0b254e09c8f77a596c5759850666b081 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0924 19:37:10.081100 62664 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19700-3751/.minikube/profiles/old-k8s-version-510301/client.key ...
I0924 19:37:10.081113 62664 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19700-3751/.minikube/profiles/old-k8s-version-510301/client.key: {Name:mk346af4c69506cd487f32da434f85424217d71d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0924 19:37:10.081191 62664 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19700-3751/.minikube/profiles/old-k8s-version-510301/apiserver.key.32de9897
I0924 19:37:10.081206 62664 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19700-3751/.minikube/profiles/old-k8s-version-510301/apiserver.crt.32de9897 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.72.81]
I0924 19:37:10.341074 62664 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19700-3751/.minikube/profiles/old-k8s-version-510301/apiserver.crt.32de9897 ...
I0924 19:37:10.341103 62664 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19700-3751/.minikube/profiles/old-k8s-version-510301/apiserver.crt.32de9897: {Name:mkfb643259d6a2af5687de358ec2648a5db68174 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0924 19:37:10.341256 62664 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19700-3751/.minikube/profiles/old-k8s-version-510301/apiserver.key.32de9897 ...
I0924 19:37:10.341268 62664 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19700-3751/.minikube/profiles/old-k8s-version-510301/apiserver.key.32de9897: {Name:mkd147191861e6583278e999a3f1f4d437b4271d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0924 19:37:10.341338 62664 certs.go:381] copying /home/jenkins/minikube-integration/19700-3751/.minikube/profiles/old-k8s-version-510301/apiserver.crt.32de9897 -> /home/jenkins/minikube-integration/19700-3751/.minikube/profiles/old-k8s-version-510301/apiserver.crt
I0924 19:37:10.341409 62664 certs.go:385] copying /home/jenkins/minikube-integration/19700-3751/.minikube/profiles/old-k8s-version-510301/apiserver.key.32de9897 -> /home/jenkins/minikube-integration/19700-3751/.minikube/profiles/old-k8s-version-510301/apiserver.key
I0924 19:37:10.341464 62664 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19700-3751/.minikube/profiles/old-k8s-version-510301/proxy-client.key
I0924 19:37:10.341479 62664 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19700-3751/.minikube/profiles/old-k8s-version-510301/proxy-client.crt with IP's: []
I0924 19:37:10.476543 62664 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19700-3751/.minikube/profiles/old-k8s-version-510301/proxy-client.crt ...
I0924 19:37:10.476575 62664 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19700-3751/.minikube/profiles/old-k8s-version-510301/proxy-client.crt: {Name:mk9efa20e4512a7c6c7dcac41d6430de46a5fa86 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0924 19:37:10.479905 62664 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19700-3751/.minikube/profiles/old-k8s-version-510301/proxy-client.key ...
I0924 19:37:10.479934 62664 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19700-3751/.minikube/profiles/old-k8s-version-510301/proxy-client.key: {Name:mkb32bc1228b09aa3cf3118bc4d40394ea93b955 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0924 19:37:10.480213 62664 certs.go:484] found cert: /home/jenkins/minikube-integration/19700-3751/.minikube/certs/10949.pem (1338 bytes)
W0924 19:37:10.480260 62664 certs.go:480] ignoring /home/jenkins/minikube-integration/19700-3751/.minikube/certs/10949_empty.pem, impossibly tiny 0 bytes
I0924 19:37:10.480274 62664 certs.go:484] found cert: /home/jenkins/minikube-integration/19700-3751/.minikube/certs/ca-key.pem (1679 bytes)
I0924 19:37:10.480303 62664 certs.go:484] found cert: /home/jenkins/minikube-integration/19700-3751/.minikube/certs/ca.pem (1078 bytes)
I0924 19:37:10.480335 62664 certs.go:484] found cert: /home/jenkins/minikube-integration/19700-3751/.minikube/certs/cert.pem (1123 bytes)
I0924 19:37:10.480365 62664 certs.go:484] found cert: /home/jenkins/minikube-integration/19700-3751/.minikube/certs/key.pem (1675 bytes)
I0924 19:37:10.480415 62664 certs.go:484] found cert: /home/jenkins/minikube-integration/19700-3751/.minikube/files/etc/ssl/certs/109492.pem (1708 bytes)
I0924 19:37:10.481273 62664 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19700-3751/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0924 19:37:10.507969 62664 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19700-3751/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0924 19:37:10.532499 62664 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19700-3751/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0924 19:37:10.557196 62664 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19700-3751/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0924 19:37:10.586010 62664 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19700-3751/.minikube/profiles/old-k8s-version-510301/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0924 19:37:10.620154 62664 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19700-3751/.minikube/profiles/old-k8s-version-510301/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0924 19:37:10.646747 62664 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19700-3751/.minikube/profiles/old-k8s-version-510301/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0924 19:37:10.676450 62664 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19700-3751/.minikube/profiles/old-k8s-version-510301/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0924 19:37:10.707573 62664 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19700-3751/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0924 19:37:10.733888 62664 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19700-3751/.minikube/certs/10949.pem --> /usr/share/ca-certificates/10949.pem (1338 bytes)
I0924 19:37:10.759095 62664 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19700-3751/.minikube/files/etc/ssl/certs/109492.pem --> /usr/share/ca-certificates/109492.pem (1708 bytes)
I0924 19:37:10.784490 62664 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0924 19:37:10.805338 62664 ssh_runner.go:195] Run: openssl version
I0924 19:37:10.811805 62664 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0924 19:37:10.833058 62664 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0924 19:37:10.849568 62664 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 24 18:20 /usr/share/ca-certificates/minikubeCA.pem
I0924 19:37:10.849617 62664 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0924 19:37:10.857482 62664 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0924 19:37:10.872917 62664 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/10949.pem && ln -fs /usr/share/ca-certificates/10949.pem /etc/ssl/certs/10949.pem"
I0924 19:37:10.890201 62664 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/10949.pem
I0924 19:37:10.897869 62664 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Sep 24 18:37 /usr/share/ca-certificates/10949.pem
I0924 19:37:10.897928 62664 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/10949.pem
I0924 19:37:10.904979 62664 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/10949.pem /etc/ssl/certs/51391683.0"
I0924 19:37:10.922873 62664 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/109492.pem && ln -fs /usr/share/ca-certificates/109492.pem /etc/ssl/certs/109492.pem"
I0924 19:37:10.938425 62664 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/109492.pem
I0924 19:37:10.947344 62664 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Sep 24 18:37 /usr/share/ca-certificates/109492.pem
I0924 19:37:10.947410 62664 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/109492.pem
I0924 19:37:10.953837 62664 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/109492.pem /etc/ssl/certs/3ec20f2e.0"
I0924 19:37:10.964786 62664 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0924 19:37:10.968890 62664 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0924 19:37:10.968946 62664 kubeadm.go:392] StartCluster: {Name:old-k8s-version-510301 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19696/minikube-v1.34.0-1727108440-19696-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-510301 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.81 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0924 19:37:10.969022 62664 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0924 19:37:10.969071 62664 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0924 19:37:11.013878 62664 cri.go:89] found id: ""
I0924 19:37:11.013952 62664 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0924 19:37:11.026890 62664 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0924 19:37:11.038605 62664 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0924 19:37:11.050095 62664 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0924 19:37:11.050116 62664 kubeadm.go:157] found existing configuration files:
I0924 19:37:11.050163 62664 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0924 19:37:11.061106 62664 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0924 19:37:11.061165 62664 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0924 19:37:11.073274 62664 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0924 19:37:11.084898 62664 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0924 19:37:11.084943 62664 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0924 19:37:11.096752 62664 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0924 19:37:11.109203 62664 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0924 19:37:11.109250 62664 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0924 19:37:11.120754 62664 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0924 19:37:11.130956 62664 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0924 19:37:11.131000 62664 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0924 19:37:11.142735 62664 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0924 19:37:11.297236 62664 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0924 19:37:11.297315 62664 kubeadm.go:310] [preflight] Running pre-flight checks
I0924 19:37:11.482186 62664 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0924 19:37:11.482288 62664 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0924 19:37:11.482371 62664 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0924 19:37:11.701107 62664 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0924 19:37:11.703815 62664 out.go:235] - Generating certificates and keys ...
I0924 19:37:11.703928 62664 kubeadm.go:310] [certs] Using existing ca certificate authority
I0924 19:37:11.704037 62664 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0924 19:37:12.037814 62664 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0924 19:37:12.146799 62664 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0924 19:37:12.295015 62664 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0924 19:37:13.264799 62664 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0924 19:37:13.490667 62664 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0924 19:37:13.490987 62664 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-510301] and IPs [192.168.72.81 127.0.0.1 ::1]
I0924 19:37:13.854305 62664 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0924 19:37:13.854481 62664 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-510301] and IPs [192.168.72.81 127.0.0.1 ::1]
I0924 19:37:14.107207 62664 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0924 19:37:14.382737 62664 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0924 19:37:14.738976 62664 kubeadm.go:310] [certs] Generating "sa" key and public key
I0924 19:37:14.739059 62664 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0924 19:37:15.184525 62664 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0924 19:37:15.316940 62664 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0924 19:37:15.672408 62664 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0924 19:37:16.133438 62664 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0924 19:37:16.159136 62664 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0924 19:37:16.159294 62664 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0924 19:37:16.159359 62664 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0924 19:37:16.347512 62664 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0924 19:37:16.544706 62664 out.go:235] - Booting up control plane ...
I0924 19:37:16.544856 62664 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0924 19:37:16.544962 62664 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0924 19:37:16.545056 62664 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0924 19:37:16.545158 62664 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0924 19:37:16.545371 62664 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0924 19:37:56.326578 62664 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0924 19:37:56.326712 62664 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0924 19:37:56.326983 62664 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0924 19:38:01.326338 62664 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0924 19:38:01.326563 62664 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0924 19:38:11.325653 62664 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0924 19:38:11.325945 62664 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0924 19:38:31.325556 62664 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0924 19:38:31.325816 62664 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0924 19:39:11.327312 62664 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0924 19:39:11.327714 62664 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0924 19:39:11.327748 62664 kubeadm.go:310]
I0924 19:39:11.327815 62664 kubeadm.go:310] Unfortunately, an error has occurred:
I0924 19:39:11.327868 62664 kubeadm.go:310] timed out waiting for the condition
I0924 19:39:11.327878 62664 kubeadm.go:310]
I0924 19:39:11.327920 62664 kubeadm.go:310] This error is likely caused by:
I0924 19:39:11.327970 62664 kubeadm.go:310] - The kubelet is not running
I0924 19:39:11.328142 62664 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0924 19:39:11.328155 62664 kubeadm.go:310]
I0924 19:39:11.328290 62664 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0924 19:39:11.328341 62664 kubeadm.go:310] - 'systemctl status kubelet'
I0924 19:39:11.328389 62664 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0924 19:39:11.328402 62664 kubeadm.go:310]
I0924 19:39:11.328545 62664 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0924 19:39:11.328665 62664 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0924 19:39:11.328676 62664 kubeadm.go:310]
I0924 19:39:11.328761 62664 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0924 19:39:11.328889 62664 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0924 19:39:11.328989 62664 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0924 19:39:11.329104 62664 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0924 19:39:11.329147 62664 kubeadm.go:310]
I0924 19:39:11.329310 62664 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0924 19:39:11.329426 62664 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0924 19:39:11.329599 62664 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
W0924 19:39:11.329680 62664 out.go:270] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-510301] and IPs [192.168.72.81 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-510301] and IPs [192.168.72.81 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-510301] and IPs [192.168.72.81 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-510301] and IPs [192.168.72.81 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0924 19:39:11.329733 62664 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0924 19:39:11.774376 62664 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0924 19:39:11.787871 62664 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0924 19:39:11.796263 62664 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0924 19:39:11.796279 62664 kubeadm.go:157] found existing configuration files:
I0924 19:39:11.796320 62664 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0924 19:39:11.804127 62664 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0924 19:39:11.804168 62664 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0924 19:39:11.812048 62664 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0924 19:39:11.819700 62664 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0924 19:39:11.819742 62664 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0924 19:39:11.827970 62664 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0924 19:39:11.835852 62664 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0924 19:39:11.835898 62664 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0924 19:39:11.844328 62664 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0924 19:39:11.852507 62664 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0924 19:39:11.852582 62664 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0924 19:39:11.860977 62664 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0924 19:39:11.922914 62664 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0924 19:39:11.922989 62664 kubeadm.go:310] [preflight] Running pre-flight checks
I0924 19:39:12.047881 62664 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0924 19:39:12.047997 62664 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0924 19:39:12.048110 62664 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0924 19:39:12.201672 62664 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0924 19:39:12.204268 62664 out.go:235] - Generating certificates and keys ...
I0924 19:39:12.204375 62664 kubeadm.go:310] [certs] Using existing ca certificate authority
I0924 19:39:12.204476 62664 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0924 19:39:12.204588 62664 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0924 19:39:12.204693 62664 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0924 19:39:12.204777 62664 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0924 19:39:12.204839 62664 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0924 19:39:12.204912 62664 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0924 19:39:12.204995 62664 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0924 19:39:12.205120 62664 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0924 19:39:12.205233 62664 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0924 19:39:12.205299 62664 kubeadm.go:310] [certs] Using the existing "sa" key
I0924 19:39:12.205385 62664 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0924 19:39:12.346234 62664 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0924 19:39:12.417104 62664 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0924 19:39:12.718065 62664 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0924 19:39:12.873523 62664 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0924 19:39:12.891292 62664 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0924 19:39:12.892349 62664 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0924 19:39:12.892420 62664 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0924 19:39:13.008215 62664 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0924 19:39:13.010973 62664 out.go:235] - Booting up control plane ...
I0924 19:39:13.011106 62664 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0924 19:39:13.018143 62664 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0924 19:39:13.019102 62664 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0924 19:39:13.019801 62664 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0924 19:39:13.022199 62664 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0924 19:39:53.024564 62664 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0924 19:39:53.024686 62664 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0924 19:39:53.024991 62664 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0924 19:39:58.025613 62664 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0924 19:39:58.025859 62664 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0924 19:40:08.026485 62664 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0924 19:40:08.026708 62664 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0924 19:40:28.028264 62664 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0924 19:40:28.028451 62664 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0924 19:41:08.030072 62664 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0924 19:41:08.030284 62664 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0924 19:41:08.030316 62664 kubeadm.go:310]
I0924 19:41:08.030391 62664 kubeadm.go:310] Unfortunately, an error has occurred:
I0924 19:41:08.030468 62664 kubeadm.go:310] timed out waiting for the condition
I0924 19:41:08.030486 62664 kubeadm.go:310]
I0924 19:41:08.030541 62664 kubeadm.go:310] This error is likely caused by:
I0924 19:41:08.030584 62664 kubeadm.go:310] - The kubelet is not running
I0924 19:41:08.030726 62664 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0924 19:41:08.030738 62664 kubeadm.go:310]
I0924 19:41:08.030900 62664 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0924 19:41:08.030966 62664 kubeadm.go:310] - 'systemctl status kubelet'
I0924 19:41:08.031024 62664 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0924 19:41:08.031038 62664 kubeadm.go:310]
I0924 19:41:08.031164 62664 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0924 19:41:08.031275 62664 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0924 19:41:08.031295 62664 kubeadm.go:310]
I0924 19:41:08.031430 62664 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0924 19:41:08.031546 62664 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0924 19:41:08.031669 62664 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0924 19:41:08.031771 62664 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0924 19:41:08.031782 62664 kubeadm.go:310]
I0924 19:41:08.032170 62664 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0924 19:41:08.032272 62664 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0924 19:41:08.032368 62664 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0924 19:41:08.032438 62664 kubeadm.go:394] duration metric: took 3m57.063494409s to StartCluster
I0924 19:41:08.032488 62664 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0924 19:41:08.032546 62664 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0924 19:41:08.064676 62664 cri.go:89] found id: ""
I0924 19:41:08.064710 62664 logs.go:276] 0 containers: []
W0924 19:41:08.064722 62664 logs.go:278] No container was found matching "kube-apiserver"
I0924 19:41:08.064729 62664 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0924 19:41:08.064781 62664 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0924 19:41:08.094718 62664 cri.go:89] found id: ""
I0924 19:41:08.094741 62664 logs.go:276] 0 containers: []
W0924 19:41:08.094749 62664 logs.go:278] No container was found matching "etcd"
I0924 19:41:08.094755 62664 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0924 19:41:08.094803 62664 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0924 19:41:08.125033 62664 cri.go:89] found id: ""
I0924 19:41:08.125065 62664 logs.go:276] 0 containers: []
W0924 19:41:08.125076 62664 logs.go:278] No container was found matching "coredns"
I0924 19:41:08.125084 62664 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0924 19:41:08.125136 62664 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0924 19:41:08.162277 62664 cri.go:89] found id: ""
I0924 19:41:08.162305 62664 logs.go:276] 0 containers: []
W0924 19:41:08.162316 62664 logs.go:278] No container was found matching "kube-scheduler"
I0924 19:41:08.162323 62664 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0924 19:41:08.162385 62664 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0924 19:41:08.193375 62664 cri.go:89] found id: ""
I0924 19:41:08.193400 62664 logs.go:276] 0 containers: []
W0924 19:41:08.193408 62664 logs.go:278] No container was found matching "kube-proxy"
I0924 19:41:08.193418 62664 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0924 19:41:08.193468 62664 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0924 19:41:08.225540 62664 cri.go:89] found id: ""
I0924 19:41:08.225566 62664 logs.go:276] 0 containers: []
W0924 19:41:08.225574 62664 logs.go:278] No container was found matching "kube-controller-manager"
I0924 19:41:08.225585 62664 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0924 19:41:08.225641 62664 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0924 19:41:08.264333 62664 cri.go:89] found id: ""
I0924 19:41:08.264362 62664 logs.go:276] 0 containers: []
W0924 19:41:08.264373 62664 logs.go:278] No container was found matching "kindnet"
I0924 19:41:08.264384 62664 logs.go:123] Gathering logs for CRI-O ...
I0924 19:41:08.264398 62664 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0924 19:41:08.379170 62664 logs.go:123] Gathering logs for container status ...
I0924 19:41:08.379212 62664 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0924 19:41:08.414820 62664 logs.go:123] Gathering logs for kubelet ...
I0924 19:41:08.414869 62664 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0924 19:41:08.462309 62664 logs.go:123] Gathering logs for dmesg ...
I0924 19:41:08.462345 62664 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0924 19:41:08.475641 62664 logs.go:123] Gathering logs for describe nodes ...
I0924 19:41:08.475668 62664 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0924 19:41:08.576521 62664 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
W0924 19:41:08.576551 62664 out.go:418] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0924 19:41:08.576599 62664 out.go:270] *
*
W0924 19:41:08.576656 62664 out.go:270] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0924 19:41:08.576673 62664 out.go:270] *
*
W0924 19:41:08.577544 62664 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0924 19:41:08.580411 62664 out.go:201]
W0924 19:41:08.581936 62664 out.go:270] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0924 19:41:08.581993 62664 out.go:270] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0924 19:41:08.582020 62664 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0924 19:41:08.583604 62664 out.go:201]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-510301 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-510301 -n old-k8s-version-510301
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-510301 -n old-k8s-version-510301: exit status 6 (220.098544ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0924 19:41:08.846352 69150 status.go:451] kubeconfig endpoint: get endpoint: "old-k8s-version-510301" does not appear in /home/jenkins/minikube-integration/19700-3751/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-510301" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (274.63s)