=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-004791 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-004791 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (5m6.340990506s)
-- stdout --
* [old-k8s-version-004791] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=18375
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/18375-4912/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/18375-4912/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-004791" primary control-plane node in "old-k8s-version-004791" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0314 00:47:12.590290 58903 out.go:291] Setting OutFile to fd 1 ...
I0314 00:47:12.590574 58903 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0314 00:47:12.590585 58903 out.go:304] Setting ErrFile to fd 2...
I0314 00:47:12.590589 58903 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0314 00:47:12.590858 58903 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18375-4912/.minikube/bin
I0314 00:47:12.591556 58903 out.go:298] Setting JSON to false
I0314 00:47:12.592661 58903 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-8","uptime":5376,"bootTime":1710371857,"procs":296,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1053-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0314 00:47:12.592728 58903 start.go:139] virtualization: kvm guest
I0314 00:47:12.595115 58903 out.go:177] * [old-k8s-version-004791] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
I0314 00:47:12.596918 58903 out.go:177] - MINIKUBE_LOCATION=18375
I0314 00:47:12.598313 58903 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0314 00:47:12.596914 58903 notify.go:220] Checking for updates...
I0314 00:47:12.600008 58903 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/18375-4912/kubeconfig
I0314 00:47:12.601420 58903 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/18375-4912/.minikube
I0314 00:47:12.602879 58903 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0314 00:47:12.604408 58903 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0314 00:47:12.606142 58903 config.go:182] Loaded profile config "bridge-326260": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0314 00:47:12.606260 58903 config.go:182] Loaded profile config "enable-default-cni-326260": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0314 00:47:12.606351 58903 config.go:182] Loaded profile config "flannel-326260": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0314 00:47:12.606467 58903 driver.go:392] Setting default libvirt URI to qemu:///system
I0314 00:47:12.644404 58903 out.go:177] * Using the kvm2 driver based on user configuration
I0314 00:47:12.645672 58903 start.go:297] selected driver: kvm2
I0314 00:47:12.645684 58903 start.go:901] validating driver "kvm2" against <nil>
I0314 00:47:12.645698 58903 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0314 00:47:12.646407 58903 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0314 00:47:12.646489 58903 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/18375-4912/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0314 00:47:12.662581 58903 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.32.0
I0314 00:47:12.662631 58903 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0314 00:47:12.662918 58903 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0314 00:47:12.662950 58903 cni.go:84] Creating CNI manager for ""
I0314 00:47:12.662958 58903 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0314 00:47:12.662967 58903 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0314 00:47:12.663013 58903 start.go:340] cluster config:
{Name:old-k8s-version-004791 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-004791 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0314 00:47:12.663109 58903 iso.go:125] acquiring lock: {Name:mke91ca51c8ff7dca6e70f37053e800141f67cd8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0314 00:47:12.665052 58903 out.go:177] * Starting "old-k8s-version-004791" primary control-plane node in "old-k8s-version-004791" cluster
I0314 00:47:12.666713 58903 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0314 00:47:12.666756 58903 preload.go:147] Found local preload: /home/jenkins/minikube-integration/18375-4912/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0314 00:47:12.666783 58903 cache.go:56] Caching tarball of preloaded images
I0314 00:47:12.666884 58903 preload.go:173] Found /home/jenkins/minikube-integration/18375-4912/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0314 00:47:12.666896 58903 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0314 00:47:12.667000 58903 profile.go:142] Saving config to /home/jenkins/minikube-integration/18375-4912/.minikube/profiles/old-k8s-version-004791/config.json ...
I0314 00:47:12.667027 58903 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18375-4912/.minikube/profiles/old-k8s-version-004791/config.json: {Name:mk572591233ba21ac399c256edaa21a1b118ecb7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0314 00:47:12.667158 58903 start.go:360] acquireMachinesLock for old-k8s-version-004791: {Name:mk037e8d27925138311e43eefa39d28b8c4cedd5 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0314 00:47:44.328231 58903 start.go:364] duration metric: took 31.661035787s to acquireMachinesLock for "old-k8s-version-004791"
I0314 00:47:44.328289 58903 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-004791 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18375/minikube-v1.32.1-1710348681-18375-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-004791 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0314 00:47:44.328448 58903 start.go:125] createHost starting for "" (driver="kvm2")
I0314 00:47:44.331940 58903 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0314 00:47:44.332163 58903 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0314 00:47:44.332213 58903 main.go:141] libmachine: Launching plugin server for driver kvm2
I0314 00:47:44.350107 58903 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41523
I0314 00:47:44.350614 58903 main.go:141] libmachine: () Calling .GetVersion
I0314 00:47:44.351185 58903 main.go:141] libmachine: Using API Version 1
I0314 00:47:44.351210 58903 main.go:141] libmachine: () Calling .SetConfigRaw
I0314 00:47:44.351542 58903 main.go:141] libmachine: () Calling .GetMachineName
I0314 00:47:44.351721 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetMachineName
I0314 00:47:44.351869 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .DriverName
I0314 00:47:44.352078 58903 start.go:159] libmachine.API.Create for "old-k8s-version-004791" (driver="kvm2")
I0314 00:47:44.352109 58903 client.go:168] LocalClient.Create starting
I0314 00:47:44.352145 58903 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18375-4912/.minikube/certs/ca.pem
I0314 00:47:44.352184 58903 main.go:141] libmachine: Decoding PEM data...
I0314 00:47:44.352206 58903 main.go:141] libmachine: Parsing certificate...
I0314 00:47:44.352277 58903 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18375-4912/.minikube/certs/cert.pem
I0314 00:47:44.352300 58903 main.go:141] libmachine: Decoding PEM data...
I0314 00:47:44.352319 58903 main.go:141] libmachine: Parsing certificate...
I0314 00:47:44.352342 58903 main.go:141] libmachine: Running pre-create checks...
I0314 00:47:44.352355 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .PreCreateCheck
I0314 00:47:44.352709 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetConfigRaw
I0314 00:47:44.353162 58903 main.go:141] libmachine: Creating machine...
I0314 00:47:44.353179 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .Create
I0314 00:47:44.353310 58903 main.go:141] libmachine: (old-k8s-version-004791) Creating KVM machine...
I0314 00:47:44.354794 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | found existing default KVM network
I0314 00:47:44.356187 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | I0314 00:47:44.355997 59210 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr4 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:c1:af:ff} reservation:<nil>}
I0314 00:47:44.357093 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | I0314 00:47:44.357000 59210 network.go:211] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr2 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:9a:7b:3c} reservation:<nil>}
I0314 00:47:44.358079 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | I0314 00:47:44.357967 59210 network.go:211] skipping subnet 192.168.61.0/24 that is taken: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.61.1 IfaceMTU:1500 IfaceMAC:52:54:00:77:b5:68} reservation:<nil>}
I0314 00:47:44.359143 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | I0314 00:47:44.359042 59210 network.go:206] using free private subnet 192.168.72.0/24: &{IP:192.168.72.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.72.0/24 Gateway:192.168.72.1 ClientMin:192.168.72.2 ClientMax:192.168.72.254 Broadcast:192.168.72.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0003672f0}
I0314 00:47:44.359216 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | created network xml:
I0314 00:47:44.359237 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | <network>
I0314 00:47:44.359265 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | <name>mk-old-k8s-version-004791</name>
I0314 00:47:44.359302 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | <dns enable='no'/>
I0314 00:47:44.359312 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG |
I0314 00:47:44.359321 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | <ip address='192.168.72.1' netmask='255.255.255.0'>
I0314 00:47:44.359330 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | <dhcp>
I0314 00:47:44.359340 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | <range start='192.168.72.2' end='192.168.72.253'/>
I0314 00:47:44.359348 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | </dhcp>
I0314 00:47:44.359367 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | </ip>
I0314 00:47:44.359375 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG |
I0314 00:47:44.359388 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | </network>
I0314 00:47:44.359398 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG |
I0314 00:47:44.364710 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | trying to create private KVM network mk-old-k8s-version-004791 192.168.72.0/24...
I0314 00:47:44.440210 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | private KVM network mk-old-k8s-version-004791 192.168.72.0/24 created
I0314 00:47:44.440258 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | I0314 00:47:44.440192 59210 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/18375-4912/.minikube
I0314 00:47:44.440279 58903 main.go:141] libmachine: (old-k8s-version-004791) Setting up store path in /home/jenkins/minikube-integration/18375-4912/.minikube/machines/old-k8s-version-004791 ...
I0314 00:47:44.440293 58903 main.go:141] libmachine: (old-k8s-version-004791) Building disk image from file:///home/jenkins/minikube-integration/18375-4912/.minikube/cache/iso/amd64/minikube-v1.32.1-1710348681-18375-amd64.iso
I0314 00:47:44.440477 58903 main.go:141] libmachine: (old-k8s-version-004791) Downloading /home/jenkins/minikube-integration/18375-4912/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/18375-4912/.minikube/cache/iso/amd64/minikube-v1.32.1-1710348681-18375-amd64.iso...
I0314 00:47:44.683610 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | I0314 00:47:44.683474 59210 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/18375-4912/.minikube/machines/old-k8s-version-004791/id_rsa...
I0314 00:47:44.977913 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | I0314 00:47:44.977771 59210 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/18375-4912/.minikube/machines/old-k8s-version-004791/old-k8s-version-004791.rawdisk...
I0314 00:47:44.977952 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | Writing magic tar header
I0314 00:47:44.977983 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | Writing SSH key tar header
I0314 00:47:44.977997 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | I0314 00:47:44.977919 59210 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/18375-4912/.minikube/machines/old-k8s-version-004791 ...
I0314 00:47:44.978087 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18375-4912/.minikube/machines/old-k8s-version-004791
I0314 00:47:44.978118 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18375-4912/.minikube/machines
I0314 00:47:44.978132 58903 main.go:141] libmachine: (old-k8s-version-004791) Setting executable bit set on /home/jenkins/minikube-integration/18375-4912/.minikube/machines/old-k8s-version-004791 (perms=drwx------)
I0314 00:47:44.978148 58903 main.go:141] libmachine: (old-k8s-version-004791) Setting executable bit set on /home/jenkins/minikube-integration/18375-4912/.minikube/machines (perms=drwxr-xr-x)
I0314 00:47:44.978164 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18375-4912/.minikube
I0314 00:47:44.978176 58903 main.go:141] libmachine: (old-k8s-version-004791) Setting executable bit set on /home/jenkins/minikube-integration/18375-4912/.minikube (perms=drwxr-xr-x)
I0314 00:47:44.978504 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18375-4912
I0314 00:47:44.978556 58903 main.go:141] libmachine: (old-k8s-version-004791) Setting executable bit set on /home/jenkins/minikube-integration/18375-4912 (perms=drwxrwxr-x)
I0314 00:47:44.978569 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0314 00:47:44.978843 58903 main.go:141] libmachine: (old-k8s-version-004791) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0314 00:47:44.978867 58903 main.go:141] libmachine: (old-k8s-version-004791) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0314 00:47:44.978895 58903 main.go:141] libmachine: (old-k8s-version-004791) Creating domain...
I0314 00:47:44.978936 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | Checking permissions on dir: /home/jenkins
I0314 00:47:44.978961 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | Checking permissions on dir: /home
I0314 00:47:44.978985 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | Skipping /home - not owner
I0314 00:47:44.980356 58903 main.go:141] libmachine: (old-k8s-version-004791) define libvirt domain using xml:
I0314 00:47:44.980382 58903 main.go:141] libmachine: (old-k8s-version-004791) <domain type='kvm'>
I0314 00:47:44.980399 58903 main.go:141] libmachine: (old-k8s-version-004791) <name>old-k8s-version-004791</name>
I0314 00:47:44.980408 58903 main.go:141] libmachine: (old-k8s-version-004791) <memory unit='MiB'>2200</memory>
I0314 00:47:44.980419 58903 main.go:141] libmachine: (old-k8s-version-004791) <vcpu>2</vcpu>
I0314 00:47:44.980435 58903 main.go:141] libmachine: (old-k8s-version-004791) <features>
I0314 00:47:44.980502 58903 main.go:141] libmachine: (old-k8s-version-004791) <acpi/>
I0314 00:47:44.980522 58903 main.go:141] libmachine: (old-k8s-version-004791) <apic/>
I0314 00:47:44.980541 58903 main.go:141] libmachine: (old-k8s-version-004791) <pae/>
I0314 00:47:44.980555 58903 main.go:141] libmachine: (old-k8s-version-004791)
I0314 00:47:44.980572 58903 main.go:141] libmachine: (old-k8s-version-004791) </features>
I0314 00:47:44.980584 58903 main.go:141] libmachine: (old-k8s-version-004791) <cpu mode='host-passthrough'>
I0314 00:47:44.980596 58903 main.go:141] libmachine: (old-k8s-version-004791)
I0314 00:47:44.980611 58903 main.go:141] libmachine: (old-k8s-version-004791) </cpu>
I0314 00:47:44.980706 58903 main.go:141] libmachine: (old-k8s-version-004791) <os>
I0314 00:47:44.980725 58903 main.go:141] libmachine: (old-k8s-version-004791) <type>hvm</type>
I0314 00:47:44.980744 58903 main.go:141] libmachine: (old-k8s-version-004791) <boot dev='cdrom'/>
I0314 00:47:44.980753 58903 main.go:141] libmachine: (old-k8s-version-004791) <boot dev='hd'/>
I0314 00:47:44.980773 58903 main.go:141] libmachine: (old-k8s-version-004791) <bootmenu enable='no'/>
I0314 00:47:44.980782 58903 main.go:141] libmachine: (old-k8s-version-004791) </os>
I0314 00:47:44.980791 58903 main.go:141] libmachine: (old-k8s-version-004791) <devices>
I0314 00:47:44.980805 58903 main.go:141] libmachine: (old-k8s-version-004791) <disk type='file' device='cdrom'>
I0314 00:47:44.980819 58903 main.go:141] libmachine: (old-k8s-version-004791) <source file='/home/jenkins/minikube-integration/18375-4912/.minikube/machines/old-k8s-version-004791/boot2docker.iso'/>
I0314 00:47:44.980828 58903 main.go:141] libmachine: (old-k8s-version-004791) <target dev='hdc' bus='scsi'/>
I0314 00:47:44.980843 58903 main.go:141] libmachine: (old-k8s-version-004791) <readonly/>
I0314 00:47:44.980851 58903 main.go:141] libmachine: (old-k8s-version-004791) </disk>
I0314 00:47:44.980866 58903 main.go:141] libmachine: (old-k8s-version-004791) <disk type='file' device='disk'>
I0314 00:47:44.980877 58903 main.go:141] libmachine: (old-k8s-version-004791) <driver name='qemu' type='raw' cache='default' io='threads' />
I0314 00:47:44.980907 58903 main.go:141] libmachine: (old-k8s-version-004791) <source file='/home/jenkins/minikube-integration/18375-4912/.minikube/machines/old-k8s-version-004791/old-k8s-version-004791.rawdisk'/>
I0314 00:47:44.980934 58903 main.go:141] libmachine: (old-k8s-version-004791) <target dev='hda' bus='virtio'/>
I0314 00:47:44.980943 58903 main.go:141] libmachine: (old-k8s-version-004791) </disk>
I0314 00:47:44.980988 58903 main.go:141] libmachine: (old-k8s-version-004791) <interface type='network'>
I0314 00:47:44.981002 58903 main.go:141] libmachine: (old-k8s-version-004791) <source network='mk-old-k8s-version-004791'/>
I0314 00:47:44.981021 58903 main.go:141] libmachine: (old-k8s-version-004791) <model type='virtio'/>
I0314 00:47:44.981366 58903 main.go:141] libmachine: (old-k8s-version-004791) </interface>
I0314 00:47:44.981401 58903 main.go:141] libmachine: (old-k8s-version-004791) <interface type='network'>
I0314 00:47:44.981414 58903 main.go:141] libmachine: (old-k8s-version-004791) <source network='default'/>
I0314 00:47:44.981426 58903 main.go:141] libmachine: (old-k8s-version-004791) <model type='virtio'/>
I0314 00:47:44.981436 58903 main.go:141] libmachine: (old-k8s-version-004791) </interface>
I0314 00:47:44.981446 58903 main.go:141] libmachine: (old-k8s-version-004791) <serial type='pty'>
I0314 00:47:44.981455 58903 main.go:141] libmachine: (old-k8s-version-004791) <target port='0'/>
I0314 00:47:44.981464 58903 main.go:141] libmachine: (old-k8s-version-004791) </serial>
I0314 00:47:44.981473 58903 main.go:141] libmachine: (old-k8s-version-004791) <console type='pty'>
I0314 00:47:44.981484 58903 main.go:141] libmachine: (old-k8s-version-004791) <target type='serial' port='0'/>
I0314 00:47:44.981492 58903 main.go:141] libmachine: (old-k8s-version-004791) </console>
I0314 00:47:44.981507 58903 main.go:141] libmachine: (old-k8s-version-004791) <rng model='virtio'>
I0314 00:47:44.981518 58903 main.go:141] libmachine: (old-k8s-version-004791) <backend model='random'>/dev/random</backend>
I0314 00:47:44.981529 58903 main.go:141] libmachine: (old-k8s-version-004791) </rng>
I0314 00:47:44.981543 58903 main.go:141] libmachine: (old-k8s-version-004791)
I0314 00:47:44.981553 58903 main.go:141] libmachine: (old-k8s-version-004791)
I0314 00:47:44.981562 58903 main.go:141] libmachine: (old-k8s-version-004791) </devices>
I0314 00:47:44.981571 58903 main.go:141] libmachine: (old-k8s-version-004791) </domain>
I0314 00:47:44.981581 58903 main.go:141] libmachine: (old-k8s-version-004791)
I0314 00:47:44.988064 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | domain old-k8s-version-004791 has defined MAC address 52:54:00:20:23:3d in network default
I0314 00:47:44.988865 58903 main.go:141] libmachine: (old-k8s-version-004791) Ensuring networks are active...
I0314 00:47:44.988892 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | domain old-k8s-version-004791 has defined MAC address 52:54:00:32:09:2e in network mk-old-k8s-version-004791
I0314 00:47:44.989789 58903 main.go:141] libmachine: (old-k8s-version-004791) Ensuring network default is active
I0314 00:47:44.990177 58903 main.go:141] libmachine: (old-k8s-version-004791) Ensuring network mk-old-k8s-version-004791 is active
I0314 00:47:44.990900 58903 main.go:141] libmachine: (old-k8s-version-004791) Getting domain xml...
I0314 00:47:44.991700 58903 main.go:141] libmachine: (old-k8s-version-004791) Creating domain...
I0314 00:47:46.504788 58903 main.go:141] libmachine: (old-k8s-version-004791) Waiting to get IP...
I0314 00:47:46.506029 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | domain old-k8s-version-004791 has defined MAC address 52:54:00:32:09:2e in network mk-old-k8s-version-004791
I0314 00:47:46.506465 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | unable to find current IP address of domain old-k8s-version-004791 in network mk-old-k8s-version-004791
I0314 00:47:46.506498 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | I0314 00:47:46.506430 59210 retry.go:31] will retry after 217.535758ms: waiting for machine to come up
I0314 00:47:46.725983 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | domain old-k8s-version-004791 has defined MAC address 52:54:00:32:09:2e in network mk-old-k8s-version-004791
I0314 00:47:46.726749 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | unable to find current IP address of domain old-k8s-version-004791 in network mk-old-k8s-version-004791
I0314 00:47:46.726794 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | I0314 00:47:46.726633 59210 retry.go:31] will retry after 257.690975ms: waiting for machine to come up
I0314 00:47:46.986272 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | domain old-k8s-version-004791 has defined MAC address 52:54:00:32:09:2e in network mk-old-k8s-version-004791
I0314 00:47:46.986831 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | unable to find current IP address of domain old-k8s-version-004791 in network mk-old-k8s-version-004791
I0314 00:47:46.986855 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | I0314 00:47:46.986791 59210 retry.go:31] will retry after 396.303627ms: waiting for machine to come up
I0314 00:47:47.384481 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | domain old-k8s-version-004791 has defined MAC address 52:54:00:32:09:2e in network mk-old-k8s-version-004791
I0314 00:47:47.385212 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | unable to find current IP address of domain old-k8s-version-004791 in network mk-old-k8s-version-004791
I0314 00:47:47.385245 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | I0314 00:47:47.385176 59210 retry.go:31] will retry after 407.130219ms: waiting for machine to come up
I0314 00:47:47.793590 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | domain old-k8s-version-004791 has defined MAC address 52:54:00:32:09:2e in network mk-old-k8s-version-004791
I0314 00:47:47.794311 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | unable to find current IP address of domain old-k8s-version-004791 in network mk-old-k8s-version-004791
I0314 00:47:47.794329 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | I0314 00:47:47.794230 59210 retry.go:31] will retry after 758.888762ms: waiting for machine to come up
I0314 00:47:48.555415 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | domain old-k8s-version-004791 has defined MAC address 52:54:00:32:09:2e in network mk-old-k8s-version-004791
I0314 00:47:48.556192 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | unable to find current IP address of domain old-k8s-version-004791 in network mk-old-k8s-version-004791
I0314 00:47:48.556223 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | I0314 00:47:48.556108 59210 retry.go:31] will retry after 661.188214ms: waiting for machine to come up
I0314 00:47:49.219186 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | domain old-k8s-version-004791 has defined MAC address 52:54:00:32:09:2e in network mk-old-k8s-version-004791
I0314 00:47:49.219667 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | unable to find current IP address of domain old-k8s-version-004791 in network mk-old-k8s-version-004791
I0314 00:47:49.219690 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | I0314 00:47:49.219591 59210 retry.go:31] will retry after 1.016208807s: waiting for machine to come up
I0314 00:47:50.237154 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | domain old-k8s-version-004791 has defined MAC address 52:54:00:32:09:2e in network mk-old-k8s-version-004791
I0314 00:47:50.237872 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | unable to find current IP address of domain old-k8s-version-004791 in network mk-old-k8s-version-004791
I0314 00:47:50.237899 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | I0314 00:47:50.237782 59210 retry.go:31] will retry after 1.323603195s: waiting for machine to come up
I0314 00:47:51.563511 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | domain old-k8s-version-004791 has defined MAC address 52:54:00:32:09:2e in network mk-old-k8s-version-004791
I0314 00:47:51.564079 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | unable to find current IP address of domain old-k8s-version-004791 in network mk-old-k8s-version-004791
I0314 00:47:51.564111 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | I0314 00:47:51.564018 59210 retry.go:31] will retry after 1.788277837s: waiting for machine to come up
I0314 00:47:53.354176 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | domain old-k8s-version-004791 has defined MAC address 52:54:00:32:09:2e in network mk-old-k8s-version-004791
I0314 00:47:53.354747 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | unable to find current IP address of domain old-k8s-version-004791 in network mk-old-k8s-version-004791
I0314 00:47:53.354797 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | I0314 00:47:53.354672 59210 retry.go:31] will retry after 1.953524329s: waiting for machine to come up
I0314 00:47:55.309469 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | domain old-k8s-version-004791 has defined MAC address 52:54:00:32:09:2e in network mk-old-k8s-version-004791
I0314 00:47:55.309974 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | unable to find current IP address of domain old-k8s-version-004791 in network mk-old-k8s-version-004791
I0314 00:47:55.310012 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | I0314 00:47:55.309919 59210 retry.go:31] will retry after 2.194777573s: waiting for machine to come up
I0314 00:47:57.506572 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | domain old-k8s-version-004791 has defined MAC address 52:54:00:32:09:2e in network mk-old-k8s-version-004791
I0314 00:47:57.507320 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | unable to find current IP address of domain old-k8s-version-004791 in network mk-old-k8s-version-004791
I0314 00:47:57.507339 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | I0314 00:47:57.507255 59210 retry.go:31] will retry after 3.257244537s: waiting for machine to come up
I0314 00:48:00.766213 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | domain old-k8s-version-004791 has defined MAC address 52:54:00:32:09:2e in network mk-old-k8s-version-004791
I0314 00:48:00.766688 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | unable to find current IP address of domain old-k8s-version-004791 in network mk-old-k8s-version-004791
I0314 00:48:00.766716 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | I0314 00:48:00.766643 59210 retry.go:31] will retry after 3.681362872s: waiting for machine to come up
I0314 00:48:04.449887 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | domain old-k8s-version-004791 has defined MAC address 52:54:00:32:09:2e in network mk-old-k8s-version-004791
I0314 00:48:04.450419 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | unable to find current IP address of domain old-k8s-version-004791 in network mk-old-k8s-version-004791
I0314 00:48:04.450456 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | I0314 00:48:04.450368 59210 retry.go:31] will retry after 4.974259216s: waiting for machine to come up
I0314 00:48:09.425522 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | domain old-k8s-version-004791 has defined MAC address 52:54:00:32:09:2e in network mk-old-k8s-version-004791
I0314 00:48:09.426043 58903 main.go:141] libmachine: (old-k8s-version-004791) Found IP for machine: 192.168.72.11
I0314 00:48:09.426064 58903 main.go:141] libmachine: (old-k8s-version-004791) Reserving static IP address...
I0314 00:48:09.426080 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | domain old-k8s-version-004791 has current primary IP address 192.168.72.11 and MAC address 52:54:00:32:09:2e in network mk-old-k8s-version-004791
I0314 00:48:09.426531 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-004791", mac: "52:54:00:32:09:2e", ip: "192.168.72.11"} in network mk-old-k8s-version-004791
I0314 00:48:09.512607 58903 main.go:141] libmachine: (old-k8s-version-004791) Reserved static IP address: 192.168.72.11
I0314 00:48:09.512643 58903 main.go:141] libmachine: (old-k8s-version-004791) Waiting for SSH to be available...
I0314 00:48:09.512667 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | Getting to WaitForSSH function...
I0314 00:48:09.515922 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | domain old-k8s-version-004791 has defined MAC address 52:54:00:32:09:2e in network mk-old-k8s-version-004791
I0314 00:48:09.516364 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:32:09:2e", ip: ""} in network mk-old-k8s-version-004791: {Iface:virbr3 ExpiryTime:2024-03-14 01:48:01 +0000 UTC Type:0 Mac:52:54:00:32:09:2e Iaid: IPaddr:192.168.72.11 Prefix:24 Hostname:minikube Clientid:01:52:54:00:32:09:2e}
I0314 00:48:09.516400 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | domain old-k8s-version-004791 has defined IP address 192.168.72.11 and MAC address 52:54:00:32:09:2e in network mk-old-k8s-version-004791
I0314 00:48:09.516573 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | Using SSH client type: external
I0314 00:48:09.516618 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | Using SSH private key: /home/jenkins/minikube-integration/18375-4912/.minikube/machines/old-k8s-version-004791/id_rsa (-rw-------)
I0314 00:48:09.516654 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.72.11 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/18375-4912/.minikube/machines/old-k8s-version-004791/id_rsa -p 22] /usr/bin/ssh <nil>}
I0314 00:48:09.516670 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | About to run SSH command:
I0314 00:48:09.516684 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | exit 0
I0314 00:48:09.647401 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | SSH cmd err, output: <nil>:
I0314 00:48:09.647628 58903 main.go:141] libmachine: (old-k8s-version-004791) KVM machine creation complete!
I0314 00:48:09.648012 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetConfigRaw
I0314 00:48:09.648562 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .DriverName
I0314 00:48:09.648828 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .DriverName
I0314 00:48:09.648994 58903 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0314 00:48:09.649022 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetState
I0314 00:48:09.650579 58903 main.go:141] libmachine: Detecting operating system of created instance...
I0314 00:48:09.650597 58903 main.go:141] libmachine: Waiting for SSH to be available...
I0314 00:48:09.650604 58903 main.go:141] libmachine: Getting to WaitForSSH function...
I0314 00:48:09.650612 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetSSHHostname
I0314 00:48:09.653078 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | domain old-k8s-version-004791 has defined MAC address 52:54:00:32:09:2e in network mk-old-k8s-version-004791
I0314 00:48:09.653540 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:32:09:2e", ip: ""} in network mk-old-k8s-version-004791: {Iface:virbr3 ExpiryTime:2024-03-14 01:48:01 +0000 UTC Type:0 Mac:52:54:00:32:09:2e Iaid: IPaddr:192.168.72.11 Prefix:24 Hostname:old-k8s-version-004791 Clientid:01:52:54:00:32:09:2e}
I0314 00:48:09.653569 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | domain old-k8s-version-004791 has defined IP address 192.168.72.11 and MAC address 52:54:00:32:09:2e in network mk-old-k8s-version-004791
I0314 00:48:09.653744 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetSSHPort
I0314 00:48:09.653926 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetSSHKeyPath
I0314 00:48:09.654140 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetSSHKeyPath
I0314 00:48:09.654329 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetSSHUsername
I0314 00:48:09.654532 58903 main.go:141] libmachine: Using SSH client type: native
I0314 00:48:09.654759 58903 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4a0] 0x830200 <nil> [] 0s} 192.168.72.11 22 <nil> <nil>}
I0314 00:48:09.654794 58903 main.go:141] libmachine: About to run SSH command:
exit 0
I0314 00:48:09.758581 58903 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0314 00:48:09.758605 58903 main.go:141] libmachine: Detecting the provisioner...
I0314 00:48:09.758619 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetSSHHostname
I0314 00:48:09.761895 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | domain old-k8s-version-004791 has defined MAC address 52:54:00:32:09:2e in network mk-old-k8s-version-004791
I0314 00:48:09.762290 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:32:09:2e", ip: ""} in network mk-old-k8s-version-004791: {Iface:virbr3 ExpiryTime:2024-03-14 01:48:01 +0000 UTC Type:0 Mac:52:54:00:32:09:2e Iaid: IPaddr:192.168.72.11 Prefix:24 Hostname:old-k8s-version-004791 Clientid:01:52:54:00:32:09:2e}
I0314 00:48:09.762320 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | domain old-k8s-version-004791 has defined IP address 192.168.72.11 and MAC address 52:54:00:32:09:2e in network mk-old-k8s-version-004791
I0314 00:48:09.762491 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetSSHPort
I0314 00:48:09.762712 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetSSHKeyPath
I0314 00:48:09.762903 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetSSHKeyPath
I0314 00:48:09.763044 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetSSHUsername
I0314 00:48:09.763244 58903 main.go:141] libmachine: Using SSH client type: native
I0314 00:48:09.763471 58903 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4a0] 0x830200 <nil> [] 0s} 192.168.72.11 22 <nil> <nil>}
I0314 00:48:09.763488 58903 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0314 00:48:09.868195 58903 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0314 00:48:09.868284 58903 main.go:141] libmachine: found compatible host: buildroot
I0314 00:48:09.868298 58903 main.go:141] libmachine: Provisioning with buildroot...
I0314 00:48:09.868306 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetMachineName
I0314 00:48:09.868505 58903 buildroot.go:166] provisioning hostname "old-k8s-version-004791"
I0314 00:48:09.868527 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetMachineName
I0314 00:48:09.868721 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetSSHHostname
I0314 00:48:09.872193 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | domain old-k8s-version-004791 has defined MAC address 52:54:00:32:09:2e in network mk-old-k8s-version-004791
I0314 00:48:09.872730 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:32:09:2e", ip: ""} in network mk-old-k8s-version-004791: {Iface:virbr3 ExpiryTime:2024-03-14 01:48:01 +0000 UTC Type:0 Mac:52:54:00:32:09:2e Iaid: IPaddr:192.168.72.11 Prefix:24 Hostname:old-k8s-version-004791 Clientid:01:52:54:00:32:09:2e}
I0314 00:48:09.872764 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | domain old-k8s-version-004791 has defined IP address 192.168.72.11 and MAC address 52:54:00:32:09:2e in network mk-old-k8s-version-004791
I0314 00:48:09.872920 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetSSHPort
I0314 00:48:09.873113 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetSSHKeyPath
I0314 00:48:09.873330 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetSSHKeyPath
I0314 00:48:09.873499 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetSSHUsername
I0314 00:48:09.873692 58903 main.go:141] libmachine: Using SSH client type: native
I0314 00:48:09.873933 58903 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4a0] 0x830200 <nil> [] 0s} 192.168.72.11 22 <nil> <nil>}
I0314 00:48:09.873954 58903 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-004791 && echo "old-k8s-version-004791" | sudo tee /etc/hostname
I0314 00:48:09.997817 58903 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-004791
I0314 00:48:09.997849 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetSSHHostname
I0314 00:48:10.000765 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | domain old-k8s-version-004791 has defined MAC address 52:54:00:32:09:2e in network mk-old-k8s-version-004791
I0314 00:48:10.001081 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:32:09:2e", ip: ""} in network mk-old-k8s-version-004791: {Iface:virbr3 ExpiryTime:2024-03-14 01:48:01 +0000 UTC Type:0 Mac:52:54:00:32:09:2e Iaid: IPaddr:192.168.72.11 Prefix:24 Hostname:old-k8s-version-004791 Clientid:01:52:54:00:32:09:2e}
I0314 00:48:10.001117 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | domain old-k8s-version-004791 has defined IP address 192.168.72.11 and MAC address 52:54:00:32:09:2e in network mk-old-k8s-version-004791
I0314 00:48:10.001521 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetSSHPort
I0314 00:48:10.001691 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetSSHKeyPath
I0314 00:48:10.001867 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetSSHKeyPath
I0314 00:48:10.002014 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetSSHUsername
I0314 00:48:10.002382 58903 main.go:141] libmachine: Using SSH client type: native
I0314 00:48:10.002577 58903 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4a0] 0x830200 <nil> [] 0s} 192.168.72.11 22 <nil> <nil>}
I0314 00:48:10.002599 58903 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-004791' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-004791/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-004791' | sudo tee -a /etc/hosts;
fi
fi
I0314 00:48:10.122408 58903 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0314 00:48:10.122445 58903 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/18375-4912/.minikube CaCertPath:/home/jenkins/minikube-integration/18375-4912/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18375-4912/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18375-4912/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18375-4912/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18375-4912/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18375-4912/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18375-4912/.minikube}
I0314 00:48:10.122484 58903 buildroot.go:174] setting up certificates
I0314 00:48:10.122500 58903 provision.go:84] configureAuth start
I0314 00:48:10.122516 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetMachineName
I0314 00:48:10.122813 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetIP
I0314 00:48:10.126020 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | domain old-k8s-version-004791 has defined MAC address 52:54:00:32:09:2e in network mk-old-k8s-version-004791
I0314 00:48:10.126492 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:32:09:2e", ip: ""} in network mk-old-k8s-version-004791: {Iface:virbr3 ExpiryTime:2024-03-14 01:48:01 +0000 UTC Type:0 Mac:52:54:00:32:09:2e Iaid: IPaddr:192.168.72.11 Prefix:24 Hostname:old-k8s-version-004791 Clientid:01:52:54:00:32:09:2e}
I0314 00:48:10.126527 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | domain old-k8s-version-004791 has defined IP address 192.168.72.11 and MAC address 52:54:00:32:09:2e in network mk-old-k8s-version-004791
I0314 00:48:10.126814 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetSSHHostname
I0314 00:48:10.129560 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | domain old-k8s-version-004791 has defined MAC address 52:54:00:32:09:2e in network mk-old-k8s-version-004791
I0314 00:48:10.129927 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:32:09:2e", ip: ""} in network mk-old-k8s-version-004791: {Iface:virbr3 ExpiryTime:2024-03-14 01:48:01 +0000 UTC Type:0 Mac:52:54:00:32:09:2e Iaid: IPaddr:192.168.72.11 Prefix:24 Hostname:old-k8s-version-004791 Clientid:01:52:54:00:32:09:2e}
I0314 00:48:10.129963 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | domain old-k8s-version-004791 has defined IP address 192.168.72.11 and MAC address 52:54:00:32:09:2e in network mk-old-k8s-version-004791
I0314 00:48:10.130196 58903 provision.go:143] copyHostCerts
I0314 00:48:10.130279 58903 exec_runner.go:144] found /home/jenkins/minikube-integration/18375-4912/.minikube/ca.pem, removing ...
I0314 00:48:10.130302 58903 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18375-4912/.minikube/ca.pem
I0314 00:48:10.130377 58903 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18375-4912/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18375-4912/.minikube/ca.pem (1078 bytes)
I0314 00:48:10.130504 58903 exec_runner.go:144] found /home/jenkins/minikube-integration/18375-4912/.minikube/cert.pem, removing ...
I0314 00:48:10.130517 58903 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18375-4912/.minikube/cert.pem
I0314 00:48:10.130549 58903 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18375-4912/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18375-4912/.minikube/cert.pem (1123 bytes)
I0314 00:48:10.130634 58903 exec_runner.go:144] found /home/jenkins/minikube-integration/18375-4912/.minikube/key.pem, removing ...
I0314 00:48:10.130645 58903 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18375-4912/.minikube/key.pem
I0314 00:48:10.130672 58903 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18375-4912/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18375-4912/.minikube/key.pem (1675 bytes)
I0314 00:48:10.130759 58903 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18375-4912/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18375-4912/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18375-4912/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-004791 san=[127.0.0.1 192.168.72.11 localhost minikube old-k8s-version-004791]
I0314 00:48:10.195076 58903 provision.go:177] copyRemoteCerts
I0314 00:48:10.195147 58903 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0314 00:48:10.195181 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetSSHHostname
I0314 00:48:10.198495 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | domain old-k8s-version-004791 has defined MAC address 52:54:00:32:09:2e in network mk-old-k8s-version-004791
I0314 00:48:10.198841 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:32:09:2e", ip: ""} in network mk-old-k8s-version-004791: {Iface:virbr3 ExpiryTime:2024-03-14 01:48:01 +0000 UTC Type:0 Mac:52:54:00:32:09:2e Iaid: IPaddr:192.168.72.11 Prefix:24 Hostname:old-k8s-version-004791 Clientid:01:52:54:00:32:09:2e}
I0314 00:48:10.198876 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | domain old-k8s-version-004791 has defined IP address 192.168.72.11 and MAC address 52:54:00:32:09:2e in network mk-old-k8s-version-004791
I0314 00:48:10.199067 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetSSHPort
I0314 00:48:10.199311 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetSSHKeyPath
I0314 00:48:10.199512 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetSSHUsername
I0314 00:48:10.199689 58903 sshutil.go:53] new ssh client: &{IP:192.168.72.11 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18375-4912/.minikube/machines/old-k8s-version-004791/id_rsa Username:docker}
I0314 00:48:10.288509 58903 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18375-4912/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0314 00:48:10.322353 58903 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18375-4912/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0314 00:48:10.351254 58903 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18375-4912/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0314 00:48:10.381172 58903 provision.go:87] duration metric: took 258.654733ms to configureAuth
I0314 00:48:10.381200 58903 buildroot.go:189] setting minikube options for container-runtime
I0314 00:48:10.381373 58903 config.go:182] Loaded profile config "old-k8s-version-004791": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0314 00:48:10.381476 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetSSHHostname
I0314 00:48:10.385873 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | domain old-k8s-version-004791 has defined MAC address 52:54:00:32:09:2e in network mk-old-k8s-version-004791
I0314 00:48:10.386332 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:32:09:2e", ip: ""} in network mk-old-k8s-version-004791: {Iface:virbr3 ExpiryTime:2024-03-14 01:48:01 +0000 UTC Type:0 Mac:52:54:00:32:09:2e Iaid: IPaddr:192.168.72.11 Prefix:24 Hostname:old-k8s-version-004791 Clientid:01:52:54:00:32:09:2e}
I0314 00:48:10.386363 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | domain old-k8s-version-004791 has defined IP address 192.168.72.11 and MAC address 52:54:00:32:09:2e in network mk-old-k8s-version-004791
I0314 00:48:10.386533 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetSSHPort
I0314 00:48:10.386783 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetSSHKeyPath
I0314 00:48:10.386930 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetSSHKeyPath
I0314 00:48:10.387124 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetSSHUsername
I0314 00:48:10.387298 58903 main.go:141] libmachine: Using SSH client type: native
I0314 00:48:10.387519 58903 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4a0] 0x830200 <nil> [] 0s} 192.168.72.11 22 <nil> <nil>}
I0314 00:48:10.387542 58903 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0314 00:48:10.708376 58903 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0314 00:48:10.708403 58903 main.go:141] libmachine: Checking connection to Docker...
I0314 00:48:10.708415 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetURL
I0314 00:48:10.709735 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | Using libvirt version 6000000
I0314 00:48:10.712343 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | domain old-k8s-version-004791 has defined MAC address 52:54:00:32:09:2e in network mk-old-k8s-version-004791
I0314 00:48:10.712749 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:32:09:2e", ip: ""} in network mk-old-k8s-version-004791: {Iface:virbr3 ExpiryTime:2024-03-14 01:48:01 +0000 UTC Type:0 Mac:52:54:00:32:09:2e Iaid: IPaddr:192.168.72.11 Prefix:24 Hostname:old-k8s-version-004791 Clientid:01:52:54:00:32:09:2e}
I0314 00:48:10.712783 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | domain old-k8s-version-004791 has defined IP address 192.168.72.11 and MAC address 52:54:00:32:09:2e in network mk-old-k8s-version-004791
I0314 00:48:10.713171 58903 main.go:141] libmachine: Docker is up and running!
I0314 00:48:10.713185 58903 main.go:141] libmachine: Reticulating splines...
I0314 00:48:10.713193 58903 client.go:171] duration metric: took 26.361073507s to LocalClient.Create
I0314 00:48:10.713213 58903 start.go:167] duration metric: took 26.361134039s to libmachine.API.Create "old-k8s-version-004791"
I0314 00:48:10.713223 58903 start.go:293] postStartSetup for "old-k8s-version-004791" (driver="kvm2")
I0314 00:48:10.713235 58903 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0314 00:48:10.713260 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .DriverName
I0314 00:48:10.713543 58903 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0314 00:48:10.713565 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetSSHHostname
I0314 00:48:10.716577 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | domain old-k8s-version-004791 has defined MAC address 52:54:00:32:09:2e in network mk-old-k8s-version-004791
I0314 00:48:10.717063 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:32:09:2e", ip: ""} in network mk-old-k8s-version-004791: {Iface:virbr3 ExpiryTime:2024-03-14 01:48:01 +0000 UTC Type:0 Mac:52:54:00:32:09:2e Iaid: IPaddr:192.168.72.11 Prefix:24 Hostname:old-k8s-version-004791 Clientid:01:52:54:00:32:09:2e}
I0314 00:48:10.717087 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | domain old-k8s-version-004791 has defined IP address 192.168.72.11 and MAC address 52:54:00:32:09:2e in network mk-old-k8s-version-004791
I0314 00:48:10.717290 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetSSHPort
I0314 00:48:10.717468 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetSSHKeyPath
I0314 00:48:10.717730 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetSSHUsername
I0314 00:48:10.717833 58903 sshutil.go:53] new ssh client: &{IP:192.168.72.11 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18375-4912/.minikube/machines/old-k8s-version-004791/id_rsa Username:docker}
I0314 00:48:10.807249 58903 ssh_runner.go:195] Run: cat /etc/os-release
I0314 00:48:10.812237 58903 info.go:137] Remote host: Buildroot 2023.02.9
I0314 00:48:10.812264 58903 filesync.go:126] Scanning /home/jenkins/minikube-integration/18375-4912/.minikube/addons for local assets ...
I0314 00:48:10.812321 58903 filesync.go:126] Scanning /home/jenkins/minikube-integration/18375-4912/.minikube/files for local assets ...
I0314 00:48:10.812408 58903 filesync.go:149] local asset: /home/jenkins/minikube-integration/18375-4912/.minikube/files/etc/ssl/certs/122682.pem -> 122682.pem in /etc/ssl/certs
I0314 00:48:10.812514 58903 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0314 00:48:10.823610 58903 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18375-4912/.minikube/files/etc/ssl/certs/122682.pem --> /etc/ssl/certs/122682.pem (1708 bytes)
I0314 00:48:10.856142 58903 start.go:296] duration metric: took 142.905682ms for postStartSetup
I0314 00:48:10.856211 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetConfigRaw
I0314 00:48:10.856876 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetIP
I0314 00:48:10.860434 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | domain old-k8s-version-004791 has defined MAC address 52:54:00:32:09:2e in network mk-old-k8s-version-004791
I0314 00:48:10.860909 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:32:09:2e", ip: ""} in network mk-old-k8s-version-004791: {Iface:virbr3 ExpiryTime:2024-03-14 01:48:01 +0000 UTC Type:0 Mac:52:54:00:32:09:2e Iaid: IPaddr:192.168.72.11 Prefix:24 Hostname:old-k8s-version-004791 Clientid:01:52:54:00:32:09:2e}
I0314 00:48:10.860972 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | domain old-k8s-version-004791 has defined IP address 192.168.72.11 and MAC address 52:54:00:32:09:2e in network mk-old-k8s-version-004791
I0314 00:48:10.861251 58903 profile.go:142] Saving config to /home/jenkins/minikube-integration/18375-4912/.minikube/profiles/old-k8s-version-004791/config.json ...
I0314 00:48:10.861495 58903 start.go:128] duration metric: took 26.533034368s to createHost
I0314 00:48:10.861526 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetSSHHostname
I0314 00:48:10.864163 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | domain old-k8s-version-004791 has defined MAC address 52:54:00:32:09:2e in network mk-old-k8s-version-004791
I0314 00:48:10.864511 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:32:09:2e", ip: ""} in network mk-old-k8s-version-004791: {Iface:virbr3 ExpiryTime:2024-03-14 01:48:01 +0000 UTC Type:0 Mac:52:54:00:32:09:2e Iaid: IPaddr:192.168.72.11 Prefix:24 Hostname:old-k8s-version-004791 Clientid:01:52:54:00:32:09:2e}
I0314 00:48:10.864537 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | domain old-k8s-version-004791 has defined IP address 192.168.72.11 and MAC address 52:54:00:32:09:2e in network mk-old-k8s-version-004791
I0314 00:48:10.864723 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetSSHPort
I0314 00:48:10.864943 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetSSHKeyPath
I0314 00:48:10.865121 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetSSHKeyPath
I0314 00:48:10.865328 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetSSHUsername
I0314 00:48:10.865515 58903 main.go:141] libmachine: Using SSH client type: native
I0314 00:48:10.865726 58903 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4a0] 0x830200 <nil> [] 0s} 192.168.72.11 22 <nil> <nil>}
I0314 00:48:10.865745 58903 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0314 00:48:10.977118 58903 main.go:141] libmachine: SSH cmd err, output: <nil>: 1710377290.956347540
I0314 00:48:10.977140 58903 fix.go:216] guest clock: 1710377290.956347540
I0314 00:48:10.977149 58903 fix.go:229] Guest: 2024-03-14 00:48:10.95634754 +0000 UTC Remote: 2024-03-14 00:48:10.86151171 +0000 UTC m=+58.320332881 (delta=94.83583ms)
I0314 00:48:10.977181 58903 fix.go:200] guest clock delta is within tolerance: 94.83583ms
I0314 00:48:10.977189 58903 start.go:83] releasing machines lock for "old-k8s-version-004791", held for 26.648936313s
I0314 00:48:10.977221 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .DriverName
I0314 00:48:10.977525 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetIP
I0314 00:48:10.981086 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | domain old-k8s-version-004791 has defined MAC address 52:54:00:32:09:2e in network mk-old-k8s-version-004791
I0314 00:48:10.981440 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:32:09:2e", ip: ""} in network mk-old-k8s-version-004791: {Iface:virbr3 ExpiryTime:2024-03-14 01:48:01 +0000 UTC Type:0 Mac:52:54:00:32:09:2e Iaid: IPaddr:192.168.72.11 Prefix:24 Hostname:old-k8s-version-004791 Clientid:01:52:54:00:32:09:2e}
I0314 00:48:10.981479 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | domain old-k8s-version-004791 has defined IP address 192.168.72.11 and MAC address 52:54:00:32:09:2e in network mk-old-k8s-version-004791
I0314 00:48:10.981778 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .DriverName
I0314 00:48:10.982368 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .DriverName
I0314 00:48:10.982972 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .DriverName
I0314 00:48:10.983051 58903 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0314 00:48:10.983096 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetSSHHostname
I0314 00:48:10.983169 58903 ssh_runner.go:195] Run: cat /version.json
I0314 00:48:10.983187 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetSSHHostname
I0314 00:48:10.987125 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | domain old-k8s-version-004791 has defined MAC address 52:54:00:32:09:2e in network mk-old-k8s-version-004791
I0314 00:48:10.987156 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | domain old-k8s-version-004791 has defined MAC address 52:54:00:32:09:2e in network mk-old-k8s-version-004791
I0314 00:48:10.987193 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:32:09:2e", ip: ""} in network mk-old-k8s-version-004791: {Iface:virbr3 ExpiryTime:2024-03-14 01:48:01 +0000 UTC Type:0 Mac:52:54:00:32:09:2e Iaid: IPaddr:192.168.72.11 Prefix:24 Hostname:old-k8s-version-004791 Clientid:01:52:54:00:32:09:2e}
I0314 00:48:10.987238 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | domain old-k8s-version-004791 has defined IP address 192.168.72.11 and MAC address 52:54:00:32:09:2e in network mk-old-k8s-version-004791
I0314 00:48:10.987417 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetSSHPort
I0314 00:48:10.987571 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:32:09:2e", ip: ""} in network mk-old-k8s-version-004791: {Iface:virbr3 ExpiryTime:2024-03-14 01:48:01 +0000 UTC Type:0 Mac:52:54:00:32:09:2e Iaid: IPaddr:192.168.72.11 Prefix:24 Hostname:old-k8s-version-004791 Clientid:01:52:54:00:32:09:2e}
I0314 00:48:10.987688 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | domain old-k8s-version-004791 has defined IP address 192.168.72.11 and MAC address 52:54:00:32:09:2e in network mk-old-k8s-version-004791
I0314 00:48:10.987850 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetSSHKeyPath
I0314 00:48:10.987858 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetSSHPort
I0314 00:48:10.988089 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetSSHUsername
I0314 00:48:10.988125 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetSSHKeyPath
I0314 00:48:10.988248 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetSSHUsername
I0314 00:48:10.988252 58903 sshutil.go:53] new ssh client: &{IP:192.168.72.11 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18375-4912/.minikube/machines/old-k8s-version-004791/id_rsa Username:docker}
I0314 00:48:10.988378 58903 sshutil.go:53] new ssh client: &{IP:192.168.72.11 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18375-4912/.minikube/machines/old-k8s-version-004791/id_rsa Username:docker}
I0314 00:48:11.108074 58903 ssh_runner.go:195] Run: systemctl --version
I0314 00:48:11.114916 58903 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0314 00:48:11.280522 58903 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0314 00:48:11.288908 58903 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0314 00:48:11.288982 58903 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0314 00:48:11.308520 58903 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0314 00:48:11.308546 58903 start.go:494] detecting cgroup driver to use...
I0314 00:48:11.308617 58903 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0314 00:48:11.328170 58903 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0314 00:48:11.348058 58903 docker.go:217] disabling cri-docker service (if available) ...
I0314 00:48:11.348119 58903 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0314 00:48:11.366369 58903 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0314 00:48:11.385473 58903 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0314 00:48:11.556364 58903 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0314 00:48:11.743768 58903 docker.go:233] disabling docker service ...
I0314 00:48:11.743843 58903 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0314 00:48:11.763919 58903 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0314 00:48:11.779658 58903 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0314 00:48:11.937831 58903 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0314 00:48:12.094051 58903 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0314 00:48:12.112168 58903 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0314 00:48:12.133318 58903 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0314 00:48:12.133394 58903 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0314 00:48:12.147127 58903 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0314 00:48:12.147199 58903 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0314 00:48:12.159002 58903 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0314 00:48:12.171046 58903 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0314 00:48:12.185212 58903 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0314 00:48:12.203061 58903 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0314 00:48:12.215812 58903 crio.go:148] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0314 00:48:12.215875 58903 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0314 00:48:12.232646 58903 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0314 00:48:12.247253 58903 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0314 00:48:12.388337 58903 ssh_runner.go:195] Run: sudo systemctl restart crio
I0314 00:48:12.568622 58903 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0314 00:48:12.568692 58903 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0314 00:48:12.573724 58903 start.go:562] Will wait 60s for crictl version
I0314 00:48:12.573784 58903 ssh_runner.go:195] Run: which crictl
I0314 00:48:12.577920 58903 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0314 00:48:12.624906 58903 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0314 00:48:12.625015 58903 ssh_runner.go:195] Run: crio --version
I0314 00:48:12.660358 58903 ssh_runner.go:195] Run: crio --version
I0314 00:48:12.695552 58903 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0314 00:48:12.697144 58903 main.go:141] libmachine: (old-k8s-version-004791) Calling .GetIP
I0314 00:48:12.701107 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | domain old-k8s-version-004791 has defined MAC address 52:54:00:32:09:2e in network mk-old-k8s-version-004791
I0314 00:48:12.701702 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:32:09:2e", ip: ""} in network mk-old-k8s-version-004791: {Iface:virbr3 ExpiryTime:2024-03-14 01:48:01 +0000 UTC Type:0 Mac:52:54:00:32:09:2e Iaid: IPaddr:192.168.72.11 Prefix:24 Hostname:old-k8s-version-004791 Clientid:01:52:54:00:32:09:2e}
I0314 00:48:12.701733 58903 main.go:141] libmachine: (old-k8s-version-004791) DBG | domain old-k8s-version-004791 has defined IP address 192.168.72.11 and MAC address 52:54:00:32:09:2e in network mk-old-k8s-version-004791
I0314 00:48:12.702166 58903 ssh_runner.go:195] Run: grep 192.168.72.1 host.minikube.internal$ /etc/hosts
I0314 00:48:12.707544 58903 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.72.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0314 00:48:12.725133 58903 kubeadm.go:877] updating cluster {Name:old-k8s-version-004791 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18375/minikube-v1.32.1-1710348681-18375-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-004791 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.11 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mo
untPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0314 00:48:12.725282 58903 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0314 00:48:12.725329 58903 ssh_runner.go:195] Run: sudo crictl images --output json
I0314 00:48:12.767618 58903 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0314 00:48:12.767693 58903 ssh_runner.go:195] Run: which lz4
I0314 00:48:12.772189 58903 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0314 00:48:12.777046 58903 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0314 00:48:12.777081 58903 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18375-4912/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0314 00:48:14.810165 58903 crio.go:444] duration metric: took 2.038023402s to copy over tarball
I0314 00:48:14.810232 58903 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0314 00:48:17.880940 58903 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (3.070670486s)
I0314 00:48:17.880970 58903 crio.go:451] duration metric: took 3.070782902s to extract the tarball
I0314 00:48:17.880992 58903 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0314 00:48:17.927293 58903 ssh_runner.go:195] Run: sudo crictl images --output json
I0314 00:48:17.986913 58903 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0314 00:48:17.986936 58903 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0314 00:48:17.987004 58903 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0314 00:48:17.987224 58903 image.go:134] retrieving image: registry.k8s.io/pause:3.2
I0314 00:48:17.987242 58903 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0314 00:48:17.987337 58903 image.go:134] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0314 00:48:17.987444 58903 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0314 00:48:17.987455 58903 image.go:134] retrieving image: registry.k8s.io/coredns:1.7.0
I0314 00:48:17.987629 58903 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0314 00:48:17.987761 58903 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0314 00:48:17.988714 58903 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0314 00:48:17.989221 58903 image.go:177] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0314 00:48:17.989304 58903 image.go:177] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0314 00:48:17.989317 58903 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0314 00:48:17.989449 58903 image.go:177] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0314 00:48:17.989519 58903 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0314 00:48:17.989569 58903 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0314 00:48:17.989578 58903 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0314 00:48:18.166240 58903 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0314 00:48:18.168969 58903 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0314 00:48:18.192717 58903 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0314 00:48:18.214054 58903 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0314 00:48:18.216042 58903 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0314 00:48:18.233296 58903 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0314 00:48:18.266471 58903 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0314 00:48:18.280305 58903 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0314 00:48:18.280342 58903 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0314 00:48:18.280392 58903 ssh_runner.go:195] Run: which crictl
I0314 00:48:18.280439 58903 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0314 00:48:18.280482 58903 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0314 00:48:18.280552 58903 ssh_runner.go:195] Run: which crictl
I0314 00:48:18.384842 58903 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0314 00:48:18.384889 58903 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0314 00:48:18.384940 58903 ssh_runner.go:195] Run: which crictl
I0314 00:48:18.392150 58903 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0314 00:48:18.392191 58903 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0314 00:48:18.392200 58903 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0314 00:48:18.392222 58903 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0314 00:48:18.392247 58903 ssh_runner.go:195] Run: which crictl
I0314 00:48:18.392262 58903 ssh_runner.go:195] Run: which crictl
I0314 00:48:18.419402 58903 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0314 00:48:18.419453 58903 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0314 00:48:18.419500 58903 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0314 00:48:18.419532 58903 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0314 00:48:18.419555 58903 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0314 00:48:18.419572 58903 ssh_runner.go:195] Run: which crictl
I0314 00:48:18.419507 58903 ssh_runner.go:195] Run: which crictl
I0314 00:48:18.419658 58903 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0314 00:48:18.419707 58903 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0314 00:48:18.419768 58903 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0314 00:48:18.419768 58903 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0314 00:48:18.545587 58903 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0314 00:48:18.545700 58903 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0314 00:48:18.545779 58903 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18375-4912/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0314 00:48:18.547791 58903 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18375-4912/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0314 00:48:18.547854 58903 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18375-4912/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0314 00:48:18.547893 58903 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18375-4912/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0314 00:48:18.547918 58903 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18375-4912/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0314 00:48:18.601479 58903 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18375-4912/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0314 00:48:18.601637 58903 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18375-4912/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0314 00:48:18.931691 58903 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0314 00:48:19.092364 58903 cache_images.go:92] duration metric: took 1.105412983s to LoadCachedImages
W0314 00:48:19.092452 58903 out.go:239] X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/18375-4912/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0: no such file or directory
X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/18375-4912/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0: no such file or directory
I0314 00:48:19.092469 58903 kubeadm.go:928] updating node { 192.168.72.11 8443 v1.20.0 crio true true} ...
I0314 00:48:19.092628 58903 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-004791 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.72.11
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-004791 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0314 00:48:19.092752 58903 ssh_runner.go:195] Run: crio config
I0314 00:48:19.166895 58903 cni.go:84] Creating CNI manager for ""
I0314 00:48:19.166926 58903 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0314 00:48:19.166939 58903 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0314 00:48:19.166956 58903 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.72.11 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-004791 NodeName:old-k8s-version-004791 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.72.11"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.72.11 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt Stati
cPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0314 00:48:19.167136 58903 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.72.11
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-004791"
kubeletExtraArgs:
node-ip: 192.168.72.11
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.72.11"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0314 00:48:19.167208 58903 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0314 00:48:19.179389 58903 binaries.go:44] Found k8s binaries, skipping transfer
I0314 00:48:19.179447 58903 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0314 00:48:19.192583 58903 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (429 bytes)
I0314 00:48:19.213996 58903 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0314 00:48:19.232800 58903 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2120 bytes)
I0314 00:48:19.264213 58903 ssh_runner.go:195] Run: grep 192.168.72.11 control-plane.minikube.internal$ /etc/hosts
I0314 00:48:19.269809 58903 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.72.11 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0314 00:48:19.283677 58903 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0314 00:48:19.402694 58903 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0314 00:48:19.425562 58903 certs.go:68] Setting up /home/jenkins/minikube-integration/18375-4912/.minikube/profiles/old-k8s-version-004791 for IP: 192.168.72.11
I0314 00:48:19.425583 58903 certs.go:194] generating shared ca certs ...
I0314 00:48:19.425603 58903 certs.go:226] acquiring lock for ca certs: {Name:mkbdff29b987e0736a4e1c4659d995418ae18da7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0314 00:48:19.425791 58903 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/18375-4912/.minikube/ca.key
I0314 00:48:19.425863 58903 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/18375-4912/.minikube/proxy-client-ca.key
I0314 00:48:19.425879 58903 certs.go:256] generating profile certs ...
I0314 00:48:19.425946 58903 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/18375-4912/.minikube/profiles/old-k8s-version-004791/client.key
I0314 00:48:19.425965 58903 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18375-4912/.minikube/profiles/old-k8s-version-004791/client.crt with IP's: []
I0314 00:48:19.630228 58903 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18375-4912/.minikube/profiles/old-k8s-version-004791/client.crt ...
I0314 00:48:19.630260 58903 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18375-4912/.minikube/profiles/old-k8s-version-004791/client.crt: {Name:mk52acb8c963edd3d31176873e87722ef60e54b3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0314 00:48:19.630429 58903 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18375-4912/.minikube/profiles/old-k8s-version-004791/client.key ...
I0314 00:48:19.630444 58903 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18375-4912/.minikube/profiles/old-k8s-version-004791/client.key: {Name:mk9a17f9098d2f76eaeb2530534086a8ecd29047 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0314 00:48:19.630521 58903 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/18375-4912/.minikube/profiles/old-k8s-version-004791/apiserver.key.c57f8e0c
I0314 00:48:19.630533 58903 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18375-4912/.minikube/profiles/old-k8s-version-004791/apiserver.crt.c57f8e0c with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.72.11]
I0314 00:48:19.982015 58903 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18375-4912/.minikube/profiles/old-k8s-version-004791/apiserver.crt.c57f8e0c ...
I0314 00:48:19.982044 58903 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18375-4912/.minikube/profiles/old-k8s-version-004791/apiserver.crt.c57f8e0c: {Name:mka3897309a247fd9661b0ef01c849d4cb206294 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0314 00:48:19.982230 58903 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18375-4912/.minikube/profiles/old-k8s-version-004791/apiserver.key.c57f8e0c ...
I0314 00:48:19.982250 58903 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18375-4912/.minikube/profiles/old-k8s-version-004791/apiserver.key.c57f8e0c: {Name:mk454b1e87b55f0d58d5df445c6f3c4f3599efe0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0314 00:48:19.982345 58903 certs.go:381] copying /home/jenkins/minikube-integration/18375-4912/.minikube/profiles/old-k8s-version-004791/apiserver.crt.c57f8e0c -> /home/jenkins/minikube-integration/18375-4912/.minikube/profiles/old-k8s-version-004791/apiserver.crt
I0314 00:48:19.982442 58903 certs.go:385] copying /home/jenkins/minikube-integration/18375-4912/.minikube/profiles/old-k8s-version-004791/apiserver.key.c57f8e0c -> /home/jenkins/minikube-integration/18375-4912/.minikube/profiles/old-k8s-version-004791/apiserver.key
I0314 00:48:19.982525 58903 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/18375-4912/.minikube/profiles/old-k8s-version-004791/proxy-client.key
I0314 00:48:19.982547 58903 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18375-4912/.minikube/profiles/old-k8s-version-004791/proxy-client.crt with IP's: []
I0314 00:48:20.448530 58903 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18375-4912/.minikube/profiles/old-k8s-version-004791/proxy-client.crt ...
I0314 00:48:20.448572 58903 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18375-4912/.minikube/profiles/old-k8s-version-004791/proxy-client.crt: {Name:mk18d03296cd964c63e4c20935807f20b581916d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0314 00:48:20.448744 58903 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18375-4912/.minikube/profiles/old-k8s-version-004791/proxy-client.key ...
I0314 00:48:20.448759 58903 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18375-4912/.minikube/profiles/old-k8s-version-004791/proxy-client.key: {Name:mk109d6c011225ba90bb9a34e615c5339a9ab2b2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0314 00:48:20.448963 58903 certs.go:484] found cert: /home/jenkins/minikube-integration/18375-4912/.minikube/certs/12268.pem (1338 bytes)
W0314 00:48:20.449001 58903 certs.go:480] ignoring /home/jenkins/minikube-integration/18375-4912/.minikube/certs/12268_empty.pem, impossibly tiny 0 bytes
I0314 00:48:20.449009 58903 certs.go:484] found cert: /home/jenkins/minikube-integration/18375-4912/.minikube/certs/ca-key.pem (1679 bytes)
I0314 00:48:20.449033 58903 certs.go:484] found cert: /home/jenkins/minikube-integration/18375-4912/.minikube/certs/ca.pem (1078 bytes)
I0314 00:48:20.449056 58903 certs.go:484] found cert: /home/jenkins/minikube-integration/18375-4912/.minikube/certs/cert.pem (1123 bytes)
I0314 00:48:20.449078 58903 certs.go:484] found cert: /home/jenkins/minikube-integration/18375-4912/.minikube/certs/key.pem (1675 bytes)
I0314 00:48:20.449114 58903 certs.go:484] found cert: /home/jenkins/minikube-integration/18375-4912/.minikube/files/etc/ssl/certs/122682.pem (1708 bytes)
I0314 00:48:20.449782 58903 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18375-4912/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0314 00:48:20.498969 58903 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18375-4912/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0314 00:48:20.533781 58903 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18375-4912/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0314 00:48:20.565271 58903 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18375-4912/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0314 00:48:20.595448 58903 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18375-4912/.minikube/profiles/old-k8s-version-004791/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0314 00:48:20.626569 58903 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18375-4912/.minikube/profiles/old-k8s-version-004791/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0314 00:48:20.660387 58903 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18375-4912/.minikube/profiles/old-k8s-version-004791/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0314 00:48:20.698165 58903 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18375-4912/.minikube/profiles/old-k8s-version-004791/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0314 00:48:20.729299 58903 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18375-4912/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0314 00:48:20.757829 58903 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18375-4912/.minikube/certs/12268.pem --> /usr/share/ca-certificates/12268.pem (1338 bytes)
I0314 00:48:20.791793 58903 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18375-4912/.minikube/files/etc/ssl/certs/122682.pem --> /usr/share/ca-certificates/122682.pem (1708 bytes)
I0314 00:48:20.829383 58903 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0314 00:48:20.860777 58903 ssh_runner.go:195] Run: openssl version
I0314 00:48:20.875439 58903 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/122682.pem && ln -fs /usr/share/ca-certificates/122682.pem /etc/ssl/certs/122682.pem"
I0314 00:48:20.898981 58903 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/122682.pem
I0314 00:48:20.910504 58903 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Mar 13 23:36 /usr/share/ca-certificates/122682.pem
I0314 00:48:20.910591 58903 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/122682.pem
I0314 00:48:20.920225 58903 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/122682.pem /etc/ssl/certs/3ec20f2e.0"
I0314 00:48:20.937426 58903 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0314 00:48:20.953790 58903 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0314 00:48:20.961248 58903 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Mar 13 23:27 /usr/share/ca-certificates/minikubeCA.pem
I0314 00:48:20.961299 58903 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0314 00:48:20.968002 58903 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0314 00:48:20.987489 58903 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/12268.pem && ln -fs /usr/share/ca-certificates/12268.pem /etc/ssl/certs/12268.pem"
I0314 00:48:21.005278 58903 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/12268.pem
I0314 00:48:21.012198 58903 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Mar 13 23:36 /usr/share/ca-certificates/12268.pem
I0314 00:48:21.012267 58903 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/12268.pem
I0314 00:48:21.021036 58903 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/12268.pem /etc/ssl/certs/51391683.0"
I0314 00:48:21.038179 58903 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0314 00:48:21.044611 58903 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0314 00:48:21.044674 58903 kubeadm.go:391] StartCluster: {Name:old-k8s-version-004791 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18375/minikube-v1.32.1-1710348681-18375-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-004791 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.11 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0314 00:48:21.044767 58903 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0314 00:48:21.044820 58903 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0314 00:48:21.093693 58903 cri.go:89] found id: ""
I0314 00:48:21.093786 58903 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0314 00:48:21.109167 58903 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0314 00:48:21.124702 58903 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0314 00:48:21.139438 58903 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0314 00:48:21.139464 58903 kubeadm.go:156] found existing configuration files:
I0314 00:48:21.139521 58903 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0314 00:48:21.153943 58903 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0314 00:48:21.154006 58903 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0314 00:48:21.170024 58903 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0314 00:48:21.181625 58903 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0314 00:48:21.181682 58903 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0314 00:48:21.204107 58903 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0314 00:48:21.224490 58903 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0314 00:48:21.224566 58903 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0314 00:48:21.236483 58903 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0314 00:48:21.247814 58903 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0314 00:48:21.247871 58903 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0314 00:48:21.260760 58903 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0314 00:48:21.670922 58903 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0314 00:50:20.156835 58903 kubeadm.go:309] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0314 00:50:20.156938 58903 kubeadm.go:309] To see the stack trace of this error execute with --v=5 or higher
I0314 00:50:20.159217 58903 kubeadm.go:309] [init] Using Kubernetes version: v1.20.0
I0314 00:50:20.159417 58903 kubeadm.go:309] [preflight] Running pre-flight checks
I0314 00:50:20.159616 58903 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0314 00:50:20.159806 58903 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0314 00:50:20.159965 58903 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0314 00:50:20.160118 58903 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0314 00:50:20.162234 58903 out.go:204] - Generating certificates and keys ...
I0314 00:50:20.162328 58903 kubeadm.go:309] [certs] Using existing ca certificate authority
I0314 00:50:20.162410 58903 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0314 00:50:20.162508 58903 kubeadm.go:309] [certs] Generating "apiserver-kubelet-client" certificate and key
I0314 00:50:20.162585 58903 kubeadm.go:309] [certs] Generating "front-proxy-ca" certificate and key
I0314 00:50:20.162680 58903 kubeadm.go:309] [certs] Generating "front-proxy-client" certificate and key
I0314 00:50:20.162755 58903 kubeadm.go:309] [certs] Generating "etcd/ca" certificate and key
I0314 00:50:20.162840 58903 kubeadm.go:309] [certs] Generating "etcd/server" certificate and key
I0314 00:50:20.163031 58903 kubeadm.go:309] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-004791] and IPs [192.168.72.11 127.0.0.1 ::1]
I0314 00:50:20.163098 58903 kubeadm.go:309] [certs] Generating "etcd/peer" certificate and key
I0314 00:50:20.163207 58903 kubeadm.go:309] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-004791] and IPs [192.168.72.11 127.0.0.1 ::1]
I0314 00:50:20.163288 58903 kubeadm.go:309] [certs] Generating "etcd/healthcheck-client" certificate and key
I0314 00:50:20.163363 58903 kubeadm.go:309] [certs] Generating "apiserver-etcd-client" certificate and key
I0314 00:50:20.163421 58903 kubeadm.go:309] [certs] Generating "sa" key and public key
I0314 00:50:20.163497 58903 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0314 00:50:20.163568 58903 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0314 00:50:20.163636 58903 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0314 00:50:20.163693 58903 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0314 00:50:20.163742 58903 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0314 00:50:20.163827 58903 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0314 00:50:20.163911 58903 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0314 00:50:20.163946 58903 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0314 00:50:20.164044 58903 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0314 00:50:20.165776 58903 out.go:204] - Booting up control plane ...
I0314 00:50:20.165881 58903 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0314 00:50:20.165968 58903 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0314 00:50:20.166056 58903 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0314 00:50:20.166158 58903 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0314 00:50:20.166352 58903 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0314 00:50:20.166442 58903 kubeadm.go:309] [kubelet-check] Initial timeout of 40s passed.
I0314 00:50:20.166541 58903 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0314 00:50:20.166741 58903 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0314 00:50:20.166844 58903 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0314 00:50:20.167077 58903 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0314 00:50:20.167170 58903 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0314 00:50:20.167423 58903 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0314 00:50:20.167540 58903 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0314 00:50:20.167768 58903 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0314 00:50:20.167849 58903 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0314 00:50:20.168054 58903 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0314 00:50:20.168070 58903 kubeadm.go:309]
I0314 00:50:20.168117 58903 kubeadm.go:309] Unfortunately, an error has occurred:
I0314 00:50:20.168166 58903 kubeadm.go:309] timed out waiting for the condition
I0314 00:50:20.168177 58903 kubeadm.go:309]
I0314 00:50:20.168217 58903 kubeadm.go:309] This error is likely caused by:
I0314 00:50:20.168260 58903 kubeadm.go:309] - The kubelet is not running
I0314 00:50:20.168367 58903 kubeadm.go:309] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0314 00:50:20.168384 58903 kubeadm.go:309]
I0314 00:50:20.168495 58903 kubeadm.go:309] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0314 00:50:20.168537 58903 kubeadm.go:309] - 'systemctl status kubelet'
I0314 00:50:20.168575 58903 kubeadm.go:309] - 'journalctl -xeu kubelet'
I0314 00:50:20.168584 58903 kubeadm.go:309]
I0314 00:50:20.168723 58903 kubeadm.go:309] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0314 00:50:20.168821 58903 kubeadm.go:309] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0314 00:50:20.168833 58903 kubeadm.go:309]
I0314 00:50:20.168931 58903 kubeadm.go:309] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0314 00:50:20.169040 58903 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0314 00:50:20.169138 58903 kubeadm.go:309] Once you have found the failing container, you can inspect its logs with:
I0314 00:50:20.169204 58903 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
W0314 00:50:20.169315 58903 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-004791] and IPs [192.168.72.11 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-004791] and IPs [192.168.72.11 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-004791] and IPs [192.168.72.11 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-004791] and IPs [192.168.72.11 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0314 00:50:20.169357 58903 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0314 00:50:20.169575 58903 kubeadm.go:309]
I0314 00:50:21.808068 58903 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (1.638682517s)
I0314 00:50:21.808159 58903 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0314 00:50:21.824449 58903 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0314 00:50:21.836213 58903 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0314 00:50:21.836240 58903 kubeadm.go:156] found existing configuration files:
I0314 00:50:21.836290 58903 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0314 00:50:21.847447 58903 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0314 00:50:21.847512 58903 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0314 00:50:21.858431 58903 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0314 00:50:21.868947 58903 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0314 00:50:21.869015 58903 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0314 00:50:21.879926 58903 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0314 00:50:21.890379 58903 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0314 00:50:21.890446 58903 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0314 00:50:21.901038 58903 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0314 00:50:21.911200 58903 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0314 00:50:21.911270 58903 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0314 00:50:21.921758 58903 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0314 00:50:22.008632 58903 kubeadm.go:309] [init] Using Kubernetes version: v1.20.0
I0314 00:50:22.008684 58903 kubeadm.go:309] [preflight] Running pre-flight checks
I0314 00:50:22.172439 58903 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0314 00:50:22.172615 58903 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0314 00:50:22.172780 58903 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0314 00:50:22.401834 58903 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0314 00:50:22.404132 58903 out.go:204] - Generating certificates and keys ...
I0314 00:50:22.404235 58903 kubeadm.go:309] [certs] Using existing ca certificate authority
I0314 00:50:22.404310 58903 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0314 00:50:22.404440 58903 kubeadm.go:309] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0314 00:50:22.404561 58903 kubeadm.go:309] [certs] Using existing front-proxy-ca certificate authority
I0314 00:50:22.404673 58903 kubeadm.go:309] [certs] Using existing front-proxy-client certificate and key on disk
I0314 00:50:22.404768 58903 kubeadm.go:309] [certs] Using existing etcd/ca certificate authority
I0314 00:50:22.404859 58903 kubeadm.go:309] [certs] Using existing etcd/server certificate and key on disk
I0314 00:50:22.404971 58903 kubeadm.go:309] [certs] Using existing etcd/peer certificate and key on disk
I0314 00:50:22.405078 58903 kubeadm.go:309] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0314 00:50:22.405218 58903 kubeadm.go:309] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0314 00:50:22.405281 58903 kubeadm.go:309] [certs] Using the existing "sa" key
I0314 00:50:22.405355 58903 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0314 00:50:22.545948 58903 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0314 00:50:22.768404 58903 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0314 00:50:22.894564 58903 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0314 00:50:23.038348 58903 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0314 00:50:23.057107 58903 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0314 00:50:23.058810 58903 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0314 00:50:23.058875 58903 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0314 00:50:23.230940 58903 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0314 00:50:23.233768 58903 out.go:204] - Booting up control plane ...
I0314 00:50:23.233899 58903 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0314 00:50:23.241326 58903 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0314 00:50:23.244469 58903 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0314 00:50:23.251435 58903 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0314 00:50:23.258729 58903 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0314 00:51:03.260863 58903 kubeadm.go:309] [kubelet-check] Initial timeout of 40s passed.
I0314 00:51:03.261051 58903 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0314 00:51:03.261283 58903 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0314 00:51:08.261988 58903 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0314 00:51:08.262269 58903 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0314 00:51:18.263044 58903 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0314 00:51:18.263302 58903 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0314 00:51:38.264334 58903 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0314 00:51:38.264509 58903 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0314 00:52:18.264808 58903 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0314 00:52:18.265051 58903 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0314 00:52:18.265077 58903 kubeadm.go:309]
I0314 00:52:18.265126 58903 kubeadm.go:309] Unfortunately, an error has occurred:
I0314 00:52:18.265201 58903 kubeadm.go:309] timed out waiting for the condition
I0314 00:52:18.265227 58903 kubeadm.go:309]
I0314 00:52:18.265276 58903 kubeadm.go:309] This error is likely caused by:
I0314 00:52:18.265322 58903 kubeadm.go:309] - The kubelet is not running
I0314 00:52:18.265462 58903 kubeadm.go:309] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0314 00:52:18.265480 58903 kubeadm.go:309]
I0314 00:52:18.265642 58903 kubeadm.go:309] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0314 00:52:18.265689 58903 kubeadm.go:309] - 'systemctl status kubelet'
I0314 00:52:18.265745 58903 kubeadm.go:309] - 'journalctl -xeu kubelet'
I0314 00:52:18.265765 58903 kubeadm.go:309]
I0314 00:52:18.265860 58903 kubeadm.go:309] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0314 00:52:18.265929 58903 kubeadm.go:309] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0314 00:52:18.265935 58903 kubeadm.go:309]
I0314 00:52:18.266025 58903 kubeadm.go:309] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0314 00:52:18.266111 58903 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0314 00:52:18.266178 58903 kubeadm.go:309] Once you have found the failing container, you can inspect its logs with:
I0314 00:52:18.266241 58903 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0314 00:52:18.266250 58903 kubeadm.go:309]
I0314 00:52:18.267038 58903 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0314 00:52:18.267126 58903 kubeadm.go:309] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0314 00:52:18.267222 58903 kubeadm.go:309] To see the stack trace of this error execute with --v=5 or higher
I0314 00:52:18.267293 58903 kubeadm.go:393] duration metric: took 3m57.222624384s to StartCluster
I0314 00:52:18.267334 58903 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0314 00:52:18.267390 58903 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0314 00:52:18.315845 58903 cri.go:89] found id: ""
I0314 00:52:18.315869 58903 logs.go:276] 0 containers: []
W0314 00:52:18.315881 58903 logs.go:278] No container was found matching "kube-apiserver"
I0314 00:52:18.315889 58903 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0314 00:52:18.315951 58903 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0314 00:52:18.353777 58903 cri.go:89] found id: ""
I0314 00:52:18.353814 58903 logs.go:276] 0 containers: []
W0314 00:52:18.353825 58903 logs.go:278] No container was found matching "etcd"
I0314 00:52:18.353835 58903 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0314 00:52:18.353899 58903 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0314 00:52:18.392662 58903 cri.go:89] found id: ""
I0314 00:52:18.392690 58903 logs.go:276] 0 containers: []
W0314 00:52:18.392698 58903 logs.go:278] No container was found matching "coredns"
I0314 00:52:18.392703 58903 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0314 00:52:18.392776 58903 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0314 00:52:18.430051 58903 cri.go:89] found id: ""
I0314 00:52:18.430081 58903 logs.go:276] 0 containers: []
W0314 00:52:18.430090 58903 logs.go:278] No container was found matching "kube-scheduler"
I0314 00:52:18.430095 58903 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0314 00:52:18.430149 58903 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0314 00:52:18.465923 58903 cri.go:89] found id: ""
I0314 00:52:18.465955 58903 logs.go:276] 0 containers: []
W0314 00:52:18.465966 58903 logs.go:278] No container was found matching "kube-proxy"
I0314 00:52:18.465974 58903 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0314 00:52:18.466039 58903 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0314 00:52:18.512867 58903 cri.go:89] found id: ""
I0314 00:52:18.512899 58903 logs.go:276] 0 containers: []
W0314 00:52:18.512909 58903 logs.go:278] No container was found matching "kube-controller-manager"
I0314 00:52:18.512916 58903 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0314 00:52:18.512978 58903 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0314 00:52:18.550744 58903 cri.go:89] found id: ""
I0314 00:52:18.550777 58903 logs.go:276] 0 containers: []
W0314 00:52:18.550785 58903 logs.go:278] No container was found matching "kindnet"
I0314 00:52:18.550794 58903 logs.go:123] Gathering logs for kubelet ...
I0314 00:52:18.550805 58903 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0314 00:52:18.603130 58903 logs.go:123] Gathering logs for dmesg ...
I0314 00:52:18.603163 58903 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0314 00:52:18.617956 58903 logs.go:123] Gathering logs for describe nodes ...
I0314 00:52:18.617981 58903 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0314 00:52:18.725493 58903 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0314 00:52:18.725519 58903 logs.go:123] Gathering logs for CRI-O ...
I0314 00:52:18.725536 58903 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0314 00:52:18.823044 58903 logs.go:123] Gathering logs for container status ...
I0314 00:52:18.823082 58903 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0314 00:52:18.866256 58903 out.go:364] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0314 00:52:18.866302 58903 out.go:239] *
*
W0314 00:52:18.866366 58903 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0314 00:52:18.866393 58903 out.go:239] *
*
W0314 00:52:18.867229 58903 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0314 00:52:18.870192 58903 out.go:177]
W0314 00:52:18.871503 58903 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0314 00:52:18.871568 58903 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0314 00:52:18.871620 58903 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0314 00:52:18.873104 58903 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-004791 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-004791 -n old-k8s-version-004791
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-004791 -n old-k8s-version-004791: exit status 6 (233.665244ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0314 00:52:19.147746 65294 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-004791" does not appear in /home/jenkins/minikube-integration/18375-4912/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-004791" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (306.63s)