=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-648232 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-648232 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m51.206529188s)
-- stdout --
* [old-k8s-version-648232] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=18421
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/18421-5321/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/18421-5321/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-648232" primary control-plane node in "old-k8s-version-648232" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0318 21:47:42.391535 58466 out.go:291] Setting OutFile to fd 1 ...
I0318 21:47:42.391884 58466 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0318 21:47:42.391900 58466 out.go:304] Setting ErrFile to fd 2...
I0318 21:47:42.391918 58466 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0318 21:47:42.392239 58466 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18421-5321/.minikube/bin
I0318 21:47:42.393106 58466 out.go:298] Setting JSON to false
I0318 21:47:42.394565 58466 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-10","uptime":5406,"bootTime":1710793056,"procs":302,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1054-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0318 21:47:42.394651 58466 start.go:139] virtualization: kvm guest
I0318 21:47:42.397001 58466 out.go:177] * [old-k8s-version-648232] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
I0318 21:47:42.398830 58466 out.go:177] - MINIKUBE_LOCATION=18421
I0318 21:47:42.398833 58466 notify.go:220] Checking for updates...
I0318 21:47:42.400207 58466 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0318 21:47:42.401587 58466 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/18421-5321/kubeconfig
I0318 21:47:42.404090 58466 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/18421-5321/.minikube
I0318 21:47:42.405398 58466 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0318 21:47:42.406816 58466 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0318 21:47:42.408929 58466 config.go:182] Loaded profile config "bridge-389288": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0318 21:47:42.409146 58466 config.go:182] Loaded profile config "enable-default-cni-389288": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0318 21:47:42.409293 58466 config.go:182] Loaded profile config "flannel-389288": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0318 21:47:42.409445 58466 driver.go:392] Setting default libvirt URI to qemu:///system
I0318 21:47:42.462292 58466 out.go:177] * Using the kvm2 driver based on user configuration
I0318 21:47:42.463561 58466 start.go:297] selected driver: kvm2
I0318 21:47:42.463578 58466 start.go:901] validating driver "kvm2" against <nil>
I0318 21:47:42.463594 58466 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0318 21:47:42.464631 58466 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0318 21:47:42.464710 58466 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/18421-5321/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0318 21:47:42.488215 58466 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.32.0
I0318 21:47:42.488285 58466 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0318 21:47:42.488588 58466 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0318 21:47:42.488674 58466 cni.go:84] Creating CNI manager for ""
I0318 21:47:42.488696 58466 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0318 21:47:42.488712 58466 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0318 21:47:42.488795 58466 start.go:340] cluster config:
{Name:old-k8s-version-648232 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-648232 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0318 21:47:42.488956 58466 iso.go:125] acquiring lock: {Name:mkee7ff8b19df92fc222c1062e4ab65f944da05d Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0318 21:47:42.490656 58466 out.go:177] * Starting "old-k8s-version-648232" primary control-plane node in "old-k8s-version-648232" cluster
I0318 21:47:42.491796 58466 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0318 21:47:42.491836 58466 preload.go:147] Found local preload: /home/jenkins/minikube-integration/18421-5321/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0318 21:47:42.491845 58466 cache.go:56] Caching tarball of preloaded images
I0318 21:47:42.491924 58466 preload.go:173] Found /home/jenkins/minikube-integration/18421-5321/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0318 21:47:42.491938 58466 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0318 21:47:42.492065 58466 profile.go:142] Saving config to /home/jenkins/minikube-integration/18421-5321/.minikube/profiles/old-k8s-version-648232/config.json ...
I0318 21:47:42.492094 58466 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18421-5321/.minikube/profiles/old-k8s-version-648232/config.json: {Name:mka8575a7d907424014bf7651d4dc6b45967fdd2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0318 21:47:42.492269 58466 start.go:360] acquireMachinesLock for old-k8s-version-648232: {Name:mk09e3a69e52057e605334a45d2c691f6518c279 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0318 21:47:57.690580 58466 start.go:364] duration metric: took 15.198281662s to acquireMachinesLock for "old-k8s-version-648232"
I0318 21:47:57.690649 58466 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-648232 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18277/minikube-v1.32.1-1710573846-18277-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-648232 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0318 21:47:57.690727 58466 start.go:125] createHost starting for "" (driver="kvm2")
I0318 21:47:57.692226 58466 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0318 21:47:57.692424 58466 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0318 21:47:57.692484 58466 main.go:141] libmachine: Launching plugin server for driver kvm2
I0318 21:47:57.712128 58466 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40173
I0318 21:47:57.712607 58466 main.go:141] libmachine: () Calling .GetVersion
I0318 21:47:57.713226 58466 main.go:141] libmachine: Using API Version 1
I0318 21:47:57.713252 58466 main.go:141] libmachine: () Calling .SetConfigRaw
I0318 21:47:57.713612 58466 main.go:141] libmachine: () Calling .GetMachineName
I0318 21:47:57.713829 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetMachineName
I0318 21:47:57.714010 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .DriverName
I0318 21:47:57.714148 58466 start.go:159] libmachine.API.Create for "old-k8s-version-648232" (driver="kvm2")
I0318 21:47:57.714189 58466 client.go:168] LocalClient.Create starting
I0318 21:47:57.714223 58466 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18421-5321/.minikube/certs/ca.pem
I0318 21:47:57.714261 58466 main.go:141] libmachine: Decoding PEM data...
I0318 21:47:57.714289 58466 main.go:141] libmachine: Parsing certificate...
I0318 21:47:57.714364 58466 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18421-5321/.minikube/certs/cert.pem
I0318 21:47:57.714395 58466 main.go:141] libmachine: Decoding PEM data...
I0318 21:47:57.714412 58466 main.go:141] libmachine: Parsing certificate...
I0318 21:47:57.714441 58466 main.go:141] libmachine: Running pre-create checks...
I0318 21:47:57.714455 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .PreCreateCheck
I0318 21:47:57.714864 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetConfigRaw
I0318 21:47:57.715254 58466 main.go:141] libmachine: Creating machine...
I0318 21:47:57.715267 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .Create
I0318 21:47:57.715393 58466 main.go:141] libmachine: (old-k8s-version-648232) Creating KVM machine...
I0318 21:47:57.716742 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | found existing default KVM network
I0318 21:47:57.717945 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | I0318 21:47:57.717813 58598 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr3 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:12:a9:cb} reservation:<nil>}
I0318 21:47:57.719006 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | I0318 21:47:57.718897 58598 network.go:211] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:39:7a:5d} reservation:<nil>}
I0318 21:47:57.720044 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | I0318 21:47:57.719954 58598 network.go:206] using free private subnet 192.168.61.0/24: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000289340}
I0318 21:47:57.720074 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | created network xml:
I0318 21:47:57.720084 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | <network>
I0318 21:47:57.720095 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | <name>mk-old-k8s-version-648232</name>
I0318 21:47:57.720105 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | <dns enable='no'/>
I0318 21:47:57.720114 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG |
I0318 21:47:57.720124 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | <ip address='192.168.61.1' netmask='255.255.255.0'>
I0318 21:47:57.720133 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | <dhcp>
I0318 21:47:57.720143 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | <range start='192.168.61.2' end='192.168.61.253'/>
I0318 21:47:57.720151 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | </dhcp>
I0318 21:47:57.720159 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | </ip>
I0318 21:47:57.720167 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG |
I0318 21:47:57.720175 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | </network>
I0318 21:47:57.720184 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG |
I0318 21:47:57.725631 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | trying to create private KVM network mk-old-k8s-version-648232 192.168.61.0/24...
I0318 21:47:57.801610 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | private KVM network mk-old-k8s-version-648232 192.168.61.0/24 created
I0318 21:47:57.801632 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | I0318 21:47:57.801559 58598 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/18421-5321/.minikube
I0318 21:47:57.801658 58466 main.go:141] libmachine: (old-k8s-version-648232) Setting up store path in /home/jenkins/minikube-integration/18421-5321/.minikube/machines/old-k8s-version-648232 ...
I0318 21:47:57.801677 58466 main.go:141] libmachine: (old-k8s-version-648232) Building disk image from file:///home/jenkins/minikube-integration/18421-5321/.minikube/cache/iso/amd64/minikube-v1.32.1-1710573846-18277-amd64.iso
I0318 21:47:57.801690 58466 main.go:141] libmachine: (old-k8s-version-648232) Downloading /home/jenkins/minikube-integration/18421-5321/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/18421-5321/.minikube/cache/iso/amd64/minikube-v1.32.1-1710573846-18277-amd64.iso...
I0318 21:47:58.049275 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | I0318 21:47:58.049147 58598 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/18421-5321/.minikube/machines/old-k8s-version-648232/id_rsa...
I0318 21:47:58.183501 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | I0318 21:47:58.183299 58598 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/18421-5321/.minikube/machines/old-k8s-version-648232/old-k8s-version-648232.rawdisk...
I0318 21:47:58.183537 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | Writing magic tar header
I0318 21:47:58.183555 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | Writing SSH key tar header
I0318 21:47:58.183569 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | I0318 21:47:58.183436 58598 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/18421-5321/.minikube/machines/old-k8s-version-648232 ...
I0318 21:47:58.183588 58466 main.go:141] libmachine: (old-k8s-version-648232) Setting executable bit set on /home/jenkins/minikube-integration/18421-5321/.minikube/machines/old-k8s-version-648232 (perms=drwx------)
I0318 21:47:58.183608 58466 main.go:141] libmachine: (old-k8s-version-648232) Setting executable bit set on /home/jenkins/minikube-integration/18421-5321/.minikube/machines (perms=drwxr-xr-x)
I0318 21:47:58.183625 58466 main.go:141] libmachine: (old-k8s-version-648232) Setting executable bit set on /home/jenkins/minikube-integration/18421-5321/.minikube (perms=drwxr-xr-x)
I0318 21:47:58.183635 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18421-5321/.minikube/machines/old-k8s-version-648232
I0318 21:47:58.183650 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18421-5321/.minikube/machines
I0318 21:47:58.183661 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18421-5321/.minikube
I0318 21:47:58.183681 58466 main.go:141] libmachine: (old-k8s-version-648232) Setting executable bit set on /home/jenkins/minikube-integration/18421-5321 (perms=drwxrwxr-x)
I0318 21:47:58.183695 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18421-5321
I0318 21:47:58.183709 58466 main.go:141] libmachine: (old-k8s-version-648232) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0318 21:47:58.183724 58466 main.go:141] libmachine: (old-k8s-version-648232) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0318 21:47:58.183735 58466 main.go:141] libmachine: (old-k8s-version-648232) Creating domain...
I0318 21:47:58.183750 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0318 21:47:58.183763 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | Checking permissions on dir: /home/jenkins
I0318 21:47:58.183806 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | Checking permissions on dir: /home
I0318 21:47:58.183837 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | Skipping /home - not owner
I0318 21:47:58.185113 58466 main.go:141] libmachine: (old-k8s-version-648232) define libvirt domain using xml:
I0318 21:47:58.185146 58466 main.go:141] libmachine: (old-k8s-version-648232) <domain type='kvm'>
I0318 21:47:58.185158 58466 main.go:141] libmachine: (old-k8s-version-648232) <name>old-k8s-version-648232</name>
I0318 21:47:58.185167 58466 main.go:141] libmachine: (old-k8s-version-648232) <memory unit='MiB'>2200</memory>
I0318 21:47:58.185178 58466 main.go:141] libmachine: (old-k8s-version-648232) <vcpu>2</vcpu>
I0318 21:47:58.185188 58466 main.go:141] libmachine: (old-k8s-version-648232) <features>
I0318 21:47:58.185199 58466 main.go:141] libmachine: (old-k8s-version-648232) <acpi/>
I0318 21:47:58.185210 58466 main.go:141] libmachine: (old-k8s-version-648232) <apic/>
I0318 21:47:58.185249 58466 main.go:141] libmachine: (old-k8s-version-648232) <pae/>
I0318 21:47:58.185274 58466 main.go:141] libmachine: (old-k8s-version-648232)
I0318 21:47:58.185284 58466 main.go:141] libmachine: (old-k8s-version-648232) </features>
I0318 21:47:58.185293 58466 main.go:141] libmachine: (old-k8s-version-648232) <cpu mode='host-passthrough'>
I0318 21:47:58.185301 58466 main.go:141] libmachine: (old-k8s-version-648232)
I0318 21:47:58.185309 58466 main.go:141] libmachine: (old-k8s-version-648232) </cpu>
I0318 21:47:58.185318 58466 main.go:141] libmachine: (old-k8s-version-648232) <os>
I0318 21:47:58.185333 58466 main.go:141] libmachine: (old-k8s-version-648232) <type>hvm</type>
I0318 21:47:58.185346 58466 main.go:141] libmachine: (old-k8s-version-648232) <boot dev='cdrom'/>
I0318 21:47:58.185352 58466 main.go:141] libmachine: (old-k8s-version-648232) <boot dev='hd'/>
I0318 21:47:58.185374 58466 main.go:141] libmachine: (old-k8s-version-648232) <bootmenu enable='no'/>
I0318 21:47:58.185392 58466 main.go:141] libmachine: (old-k8s-version-648232) </os>
I0318 21:47:58.185401 58466 main.go:141] libmachine: (old-k8s-version-648232) <devices>
I0318 21:47:58.185417 58466 main.go:141] libmachine: (old-k8s-version-648232) <disk type='file' device='cdrom'>
I0318 21:47:58.185462 58466 main.go:141] libmachine: (old-k8s-version-648232) <source file='/home/jenkins/minikube-integration/18421-5321/.minikube/machines/old-k8s-version-648232/boot2docker.iso'/>
I0318 21:47:58.185488 58466 main.go:141] libmachine: (old-k8s-version-648232) <target dev='hdc' bus='scsi'/>
I0318 21:47:58.185503 58466 main.go:141] libmachine: (old-k8s-version-648232) <readonly/>
I0318 21:47:58.185514 58466 main.go:141] libmachine: (old-k8s-version-648232) </disk>
I0318 21:47:58.185526 58466 main.go:141] libmachine: (old-k8s-version-648232) <disk type='file' device='disk'>
I0318 21:47:58.185539 58466 main.go:141] libmachine: (old-k8s-version-648232) <driver name='qemu' type='raw' cache='default' io='threads' />
I0318 21:47:58.185554 58466 main.go:141] libmachine: (old-k8s-version-648232) <source file='/home/jenkins/minikube-integration/18421-5321/.minikube/machines/old-k8s-version-648232/old-k8s-version-648232.rawdisk'/>
I0318 21:47:58.185566 58466 main.go:141] libmachine: (old-k8s-version-648232) <target dev='hda' bus='virtio'/>
I0318 21:47:58.185575 58466 main.go:141] libmachine: (old-k8s-version-648232) </disk>
I0318 21:47:58.185590 58466 main.go:141] libmachine: (old-k8s-version-648232) <interface type='network'>
I0318 21:47:58.185600 58466 main.go:141] libmachine: (old-k8s-version-648232) <source network='mk-old-k8s-version-648232'/>
I0318 21:47:58.185626 58466 main.go:141] libmachine: (old-k8s-version-648232) <model type='virtio'/>
I0318 21:47:58.185639 58466 main.go:141] libmachine: (old-k8s-version-648232) </interface>
I0318 21:47:58.185650 58466 main.go:141] libmachine: (old-k8s-version-648232) <interface type='network'>
I0318 21:47:58.185674 58466 main.go:141] libmachine: (old-k8s-version-648232) <source network='default'/>
I0318 21:47:58.185696 58466 main.go:141] libmachine: (old-k8s-version-648232) <model type='virtio'/>
I0318 21:47:58.185708 58466 main.go:141] libmachine: (old-k8s-version-648232) </interface>
I0318 21:47:58.185727 58466 main.go:141] libmachine: (old-k8s-version-648232) <serial type='pty'>
I0318 21:47:58.185736 58466 main.go:141] libmachine: (old-k8s-version-648232) <target port='0'/>
I0318 21:47:58.185747 58466 main.go:141] libmachine: (old-k8s-version-648232) </serial>
I0318 21:47:58.185756 58466 main.go:141] libmachine: (old-k8s-version-648232) <console type='pty'>
I0318 21:47:58.185764 58466 main.go:141] libmachine: (old-k8s-version-648232) <target type='serial' port='0'/>
I0318 21:47:58.185794 58466 main.go:141] libmachine: (old-k8s-version-648232) </console>
I0318 21:47:58.185807 58466 main.go:141] libmachine: (old-k8s-version-648232) <rng model='virtio'>
I0318 21:47:58.185818 58466 main.go:141] libmachine: (old-k8s-version-648232) <backend model='random'>/dev/random</backend>
I0318 21:47:58.185829 58466 main.go:141] libmachine: (old-k8s-version-648232) </rng>
I0318 21:47:58.185837 58466 main.go:141] libmachine: (old-k8s-version-648232)
I0318 21:47:58.185846 58466 main.go:141] libmachine: (old-k8s-version-648232)
I0318 21:47:58.185855 58466 main.go:141] libmachine: (old-k8s-version-648232) </devices>
I0318 21:47:58.185876 58466 main.go:141] libmachine: (old-k8s-version-648232) </domain>
I0318 21:47:58.185890 58466 main.go:141] libmachine: (old-k8s-version-648232)
I0318 21:47:58.190395 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | domain old-k8s-version-648232 has defined MAC address 52:54:00:e4:38:c3 in network default
I0318 21:47:58.190944 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | domain old-k8s-version-648232 has defined MAC address 52:54:00:88:cb:42 in network mk-old-k8s-version-648232
I0318 21:47:58.190977 58466 main.go:141] libmachine: (old-k8s-version-648232) Ensuring networks are active...
I0318 21:47:58.191782 58466 main.go:141] libmachine: (old-k8s-version-648232) Ensuring network default is active
I0318 21:47:58.192116 58466 main.go:141] libmachine: (old-k8s-version-648232) Ensuring network mk-old-k8s-version-648232 is active
I0318 21:47:58.192715 58466 main.go:141] libmachine: (old-k8s-version-648232) Getting domain xml...
I0318 21:47:58.193497 58466 main.go:141] libmachine: (old-k8s-version-648232) Creating domain...
I0318 21:47:59.517820 58466 main.go:141] libmachine: (old-k8s-version-648232) Waiting to get IP...
I0318 21:47:59.518826 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | domain old-k8s-version-648232 has defined MAC address 52:54:00:88:cb:42 in network mk-old-k8s-version-648232
I0318 21:47:59.519347 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | unable to find current IP address of domain old-k8s-version-648232 in network mk-old-k8s-version-648232
I0318 21:47:59.519373 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | I0318 21:47:59.519316 58598 retry.go:31] will retry after 208.661299ms: waiting for machine to come up
I0318 21:47:59.729899 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | domain old-k8s-version-648232 has defined MAC address 52:54:00:88:cb:42 in network mk-old-k8s-version-648232
I0318 21:47:59.730505 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | unable to find current IP address of domain old-k8s-version-648232 in network mk-old-k8s-version-648232
I0318 21:47:59.730529 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | I0318 21:47:59.730470 58598 retry.go:31] will retry after 322.354078ms: waiting for machine to come up
I0318 21:48:00.054862 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | domain old-k8s-version-648232 has defined MAC address 52:54:00:88:cb:42 in network mk-old-k8s-version-648232
I0318 21:48:00.055493 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | unable to find current IP address of domain old-k8s-version-648232 in network mk-old-k8s-version-648232
I0318 21:48:00.055514 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | I0318 21:48:00.055443 58598 retry.go:31] will retry after 312.827609ms: waiting for machine to come up
I0318 21:48:00.370075 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | domain old-k8s-version-648232 has defined MAC address 52:54:00:88:cb:42 in network mk-old-k8s-version-648232
I0318 21:48:00.370614 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | unable to find current IP address of domain old-k8s-version-648232 in network mk-old-k8s-version-648232
I0318 21:48:00.370639 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | I0318 21:48:00.370572 58598 retry.go:31] will retry after 383.83221ms: waiting for machine to come up
I0318 21:48:00.756316 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | domain old-k8s-version-648232 has defined MAC address 52:54:00:88:cb:42 in network mk-old-k8s-version-648232
I0318 21:48:00.757036 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | unable to find current IP address of domain old-k8s-version-648232 in network mk-old-k8s-version-648232
I0318 21:48:00.757062 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | I0318 21:48:00.756957 58598 retry.go:31] will retry after 537.720269ms: waiting for machine to come up
I0318 21:48:01.296760 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | domain old-k8s-version-648232 has defined MAC address 52:54:00:88:cb:42 in network mk-old-k8s-version-648232
I0318 21:48:01.297310 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | unable to find current IP address of domain old-k8s-version-648232 in network mk-old-k8s-version-648232
I0318 21:48:01.297333 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | I0318 21:48:01.297267 58598 retry.go:31] will retry after 670.027493ms: waiting for machine to come up
I0318 21:48:01.969217 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | domain old-k8s-version-648232 has defined MAC address 52:54:00:88:cb:42 in network mk-old-k8s-version-648232
I0318 21:48:01.969755 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | unable to find current IP address of domain old-k8s-version-648232 in network mk-old-k8s-version-648232
I0318 21:48:01.969777 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | I0318 21:48:01.969709 58598 retry.go:31] will retry after 926.244615ms: waiting for machine to come up
I0318 21:48:02.897772 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | domain old-k8s-version-648232 has defined MAC address 52:54:00:88:cb:42 in network mk-old-k8s-version-648232
I0318 21:48:02.898326 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | unable to find current IP address of domain old-k8s-version-648232 in network mk-old-k8s-version-648232
I0318 21:48:02.898357 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | I0318 21:48:02.898283 58598 retry.go:31] will retry after 1.204065088s: waiting for machine to come up
I0318 21:48:04.103993 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | domain old-k8s-version-648232 has defined MAC address 52:54:00:88:cb:42 in network mk-old-k8s-version-648232
I0318 21:48:04.104396 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | unable to find current IP address of domain old-k8s-version-648232 in network mk-old-k8s-version-648232
I0318 21:48:04.104428 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | I0318 21:48:04.104357 58598 retry.go:31] will retry after 1.294093015s: waiting for machine to come up
I0318 21:48:05.400206 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | domain old-k8s-version-648232 has defined MAC address 52:54:00:88:cb:42 in network mk-old-k8s-version-648232
I0318 21:48:05.400733 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | unable to find current IP address of domain old-k8s-version-648232 in network mk-old-k8s-version-648232
I0318 21:48:05.400759 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | I0318 21:48:05.400684 58598 retry.go:31] will retry after 2.259103732s: waiting for machine to come up
I0318 21:48:07.662102 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | domain old-k8s-version-648232 has defined MAC address 52:54:00:88:cb:42 in network mk-old-k8s-version-648232
I0318 21:48:07.662600 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | unable to find current IP address of domain old-k8s-version-648232 in network mk-old-k8s-version-648232
I0318 21:48:07.662623 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | I0318 21:48:07.662561 58598 retry.go:31] will retry after 2.285357846s: waiting for machine to come up
I0318 21:48:09.950172 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | domain old-k8s-version-648232 has defined MAC address 52:54:00:88:cb:42 in network mk-old-k8s-version-648232
I0318 21:48:09.950917 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | unable to find current IP address of domain old-k8s-version-648232 in network mk-old-k8s-version-648232
I0318 21:48:09.950938 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | I0318 21:48:09.950838 58598 retry.go:31] will retry after 2.938451992s: waiting for machine to come up
I0318 21:48:12.890996 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | domain old-k8s-version-648232 has defined MAC address 52:54:00:88:cb:42 in network mk-old-k8s-version-648232
I0318 21:48:12.891545 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | unable to find current IP address of domain old-k8s-version-648232 in network mk-old-k8s-version-648232
I0318 21:48:12.891575 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | I0318 21:48:12.891503 58598 retry.go:31] will retry after 4.373814051s: waiting for machine to come up
I0318 21:48:17.270133 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | domain old-k8s-version-648232 has defined MAC address 52:54:00:88:cb:42 in network mk-old-k8s-version-648232
I0318 21:48:17.270729 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | unable to find current IP address of domain old-k8s-version-648232 in network mk-old-k8s-version-648232
I0318 21:48:17.270757 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | I0318 21:48:17.270652 58598 retry.go:31] will retry after 4.440706029s: waiting for machine to come up
I0318 21:48:21.713988 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | domain old-k8s-version-648232 has defined MAC address 52:54:00:88:cb:42 in network mk-old-k8s-version-648232
I0318 21:48:21.714550 58466 main.go:141] libmachine: (old-k8s-version-648232) Found IP for machine: 192.168.61.111
I0318 21:48:21.714577 58466 main.go:141] libmachine: (old-k8s-version-648232) Reserving static IP address...
I0318 21:48:21.714591 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | domain old-k8s-version-648232 has current primary IP address 192.168.61.111 and MAC address 52:54:00:88:cb:42 in network mk-old-k8s-version-648232
I0318 21:48:21.714952 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-648232", mac: "52:54:00:88:cb:42", ip: "192.168.61.111"} in network mk-old-k8s-version-648232
I0318 21:48:21.792542 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | Getting to WaitForSSH function...
I0318 21:48:21.792589 58466 main.go:141] libmachine: (old-k8s-version-648232) Reserved static IP address: 192.168.61.111
I0318 21:48:21.792599 58466 main.go:141] libmachine: (old-k8s-version-648232) Waiting for SSH to be available...
I0318 21:48:21.795318 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | domain old-k8s-version-648232 has defined MAC address 52:54:00:88:cb:42 in network mk-old-k8s-version-648232
I0318 21:48:21.795677 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:cb:42", ip: ""} in network mk-old-k8s-version-648232: {Iface:virbr2 ExpiryTime:2024-03-18 22:48:15 +0000 UTC Type:0 Mac:52:54:00:88:cb:42 Iaid: IPaddr:192.168.61.111 Prefix:24 Hostname:minikube Clientid:01:52:54:00:88:cb:42}
I0318 21:48:21.795708 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | domain old-k8s-version-648232 has defined IP address 192.168.61.111 and MAC address 52:54:00:88:cb:42 in network mk-old-k8s-version-648232
I0318 21:48:21.795959 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | Using SSH client type: external
I0318 21:48:21.795987 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | Using SSH private key: /home/jenkins/minikube-integration/18421-5321/.minikube/machines/old-k8s-version-648232/id_rsa (-rw-------)
I0318 21:48:21.796019 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.61.111 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/18421-5321/.minikube/machines/old-k8s-version-648232/id_rsa -p 22] /usr/bin/ssh <nil>}
I0318 21:48:21.796032 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | About to run SSH command:
I0318 21:48:21.796048 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | exit 0
I0318 21:48:21.925403 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | SSH cmd err, output: <nil>:
I0318 21:48:21.925675 58466 main.go:141] libmachine: (old-k8s-version-648232) KVM machine creation complete!
I0318 21:48:21.926046 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetConfigRaw
I0318 21:48:21.926596 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .DriverName
I0318 21:48:21.926798 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .DriverName
I0318 21:48:21.926982 58466 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0318 21:48:21.927004 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetState
I0318 21:48:21.928516 58466 main.go:141] libmachine: Detecting operating system of created instance...
I0318 21:48:21.928548 58466 main.go:141] libmachine: Waiting for SSH to be available...
I0318 21:48:21.928555 58466 main.go:141] libmachine: Getting to WaitForSSH function...
I0318 21:48:21.928564 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetSSHHostname
I0318 21:48:21.931041 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | domain old-k8s-version-648232 has defined MAC address 52:54:00:88:cb:42 in network mk-old-k8s-version-648232
I0318 21:48:21.931441 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:cb:42", ip: ""} in network mk-old-k8s-version-648232: {Iface:virbr2 ExpiryTime:2024-03-18 22:48:15 +0000 UTC Type:0 Mac:52:54:00:88:cb:42 Iaid: IPaddr:192.168.61.111 Prefix:24 Hostname:old-k8s-version-648232 Clientid:01:52:54:00:88:cb:42}
I0318 21:48:21.931466 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | domain old-k8s-version-648232 has defined IP address 192.168.61.111 and MAC address 52:54:00:88:cb:42 in network mk-old-k8s-version-648232
I0318 21:48:21.931655 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetSSHPort
I0318 21:48:21.931821 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetSSHKeyPath
I0318 21:48:21.932028 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetSSHKeyPath
I0318 21:48:21.932198 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetSSHUsername
I0318 21:48:21.932405 58466 main.go:141] libmachine: Using SSH client type: native
I0318 21:48:21.932693 58466 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4a0] 0x830200 <nil> [] 0s} 192.168.61.111 22 <nil> <nil>}
I0318 21:48:21.932711 58466 main.go:141] libmachine: About to run SSH command:
exit 0
I0318 21:48:22.036724 58466 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0318 21:48:22.036759 58466 main.go:141] libmachine: Detecting the provisioner...
I0318 21:48:22.036771 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetSSHHostname
I0318 21:48:22.039917 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | domain old-k8s-version-648232 has defined MAC address 52:54:00:88:cb:42 in network mk-old-k8s-version-648232
I0318 21:48:22.040234 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:cb:42", ip: ""} in network mk-old-k8s-version-648232: {Iface:virbr2 ExpiryTime:2024-03-18 22:48:15 +0000 UTC Type:0 Mac:52:54:00:88:cb:42 Iaid: IPaddr:192.168.61.111 Prefix:24 Hostname:old-k8s-version-648232 Clientid:01:52:54:00:88:cb:42}
I0318 21:48:22.040264 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | domain old-k8s-version-648232 has defined IP address 192.168.61.111 and MAC address 52:54:00:88:cb:42 in network mk-old-k8s-version-648232
I0318 21:48:22.040452 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetSSHPort
I0318 21:48:22.040646 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetSSHKeyPath
I0318 21:48:22.040898 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetSSHKeyPath
I0318 21:48:22.041098 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetSSHUsername
I0318 21:48:22.041271 58466 main.go:141] libmachine: Using SSH client type: native
I0318 21:48:22.041509 58466 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4a0] 0x830200 <nil> [] 0s} 192.168.61.111 22 <nil> <nil>}
I0318 21:48:22.041523 58466 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0318 21:48:22.154426 58466 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0318 21:48:22.154523 58466 main.go:141] libmachine: found compatible host: buildroot
I0318 21:48:22.154538 58466 main.go:141] libmachine: Provisioning with buildroot...
I0318 21:48:22.154550 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetMachineName
I0318 21:48:22.154811 58466 buildroot.go:166] provisioning hostname "old-k8s-version-648232"
I0318 21:48:22.154841 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetMachineName
I0318 21:48:22.155102 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetSSHHostname
I0318 21:48:22.157911 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | domain old-k8s-version-648232 has defined MAC address 52:54:00:88:cb:42 in network mk-old-k8s-version-648232
I0318 21:48:22.158338 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:cb:42", ip: ""} in network mk-old-k8s-version-648232: {Iface:virbr2 ExpiryTime:2024-03-18 22:48:15 +0000 UTC Type:0 Mac:52:54:00:88:cb:42 Iaid: IPaddr:192.168.61.111 Prefix:24 Hostname:old-k8s-version-648232 Clientid:01:52:54:00:88:cb:42}
I0318 21:48:22.158363 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | domain old-k8s-version-648232 has defined IP address 192.168.61.111 and MAC address 52:54:00:88:cb:42 in network mk-old-k8s-version-648232
I0318 21:48:22.158516 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetSSHPort
I0318 21:48:22.158697 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetSSHKeyPath
I0318 21:48:22.158878 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetSSHKeyPath
I0318 21:48:22.159055 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetSSHUsername
I0318 21:48:22.159225 58466 main.go:141] libmachine: Using SSH client type: native
I0318 21:48:22.159451 58466 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4a0] 0x830200 <nil> [] 0s} 192.168.61.111 22 <nil> <nil>}
I0318 21:48:22.159471 58466 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-648232 && echo "old-k8s-version-648232" | sudo tee /etc/hostname
I0318 21:48:22.286949 58466 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-648232
I0318 21:48:22.286988 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetSSHHostname
I0318 21:48:22.290449 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | domain old-k8s-version-648232 has defined MAC address 52:54:00:88:cb:42 in network mk-old-k8s-version-648232
I0318 21:48:22.290864 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:cb:42", ip: ""} in network mk-old-k8s-version-648232: {Iface:virbr2 ExpiryTime:2024-03-18 22:48:15 +0000 UTC Type:0 Mac:52:54:00:88:cb:42 Iaid: IPaddr:192.168.61.111 Prefix:24 Hostname:old-k8s-version-648232 Clientid:01:52:54:00:88:cb:42}
I0318 21:48:22.290892 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | domain old-k8s-version-648232 has defined IP address 192.168.61.111 and MAC address 52:54:00:88:cb:42 in network mk-old-k8s-version-648232
I0318 21:48:22.291146 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetSSHPort
I0318 21:48:22.291400 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetSSHKeyPath
I0318 21:48:22.291602 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetSSHKeyPath
I0318 21:48:22.291783 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetSSHUsername
I0318 21:48:22.291969 58466 main.go:141] libmachine: Using SSH client type: native
I0318 21:48:22.292182 58466 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4a0] 0x830200 <nil> [] 0s} 192.168.61.111 22 <nil> <nil>}
I0318 21:48:22.292210 58466 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-648232' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-648232/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-648232' | sudo tee -a /etc/hosts;
fi
fi
I0318 21:48:22.409868 58466 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0318 21:48:22.409900 58466 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/18421-5321/.minikube CaCertPath:/home/jenkins/minikube-integration/18421-5321/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18421-5321/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18421-5321/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18421-5321/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18421-5321/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18421-5321/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18421-5321/.minikube}
I0318 21:48:22.409956 58466 buildroot.go:174] setting up certificates
I0318 21:48:22.409970 58466 provision.go:84] configureAuth start
I0318 21:48:22.409986 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetMachineName
I0318 21:48:22.410263 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetIP
I0318 21:48:22.413136 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | domain old-k8s-version-648232 has defined MAC address 52:54:00:88:cb:42 in network mk-old-k8s-version-648232
I0318 21:48:22.413499 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:cb:42", ip: ""} in network mk-old-k8s-version-648232: {Iface:virbr2 ExpiryTime:2024-03-18 22:48:15 +0000 UTC Type:0 Mac:52:54:00:88:cb:42 Iaid: IPaddr:192.168.61.111 Prefix:24 Hostname:old-k8s-version-648232 Clientid:01:52:54:00:88:cb:42}
I0318 21:48:22.413521 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | domain old-k8s-version-648232 has defined IP address 192.168.61.111 and MAC address 52:54:00:88:cb:42 in network mk-old-k8s-version-648232
I0318 21:48:22.413626 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetSSHHostname
I0318 21:48:22.415949 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | domain old-k8s-version-648232 has defined MAC address 52:54:00:88:cb:42 in network mk-old-k8s-version-648232
I0318 21:48:22.416278 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:cb:42", ip: ""} in network mk-old-k8s-version-648232: {Iface:virbr2 ExpiryTime:2024-03-18 22:48:15 +0000 UTC Type:0 Mac:52:54:00:88:cb:42 Iaid: IPaddr:192.168.61.111 Prefix:24 Hostname:old-k8s-version-648232 Clientid:01:52:54:00:88:cb:42}
I0318 21:48:22.416298 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | domain old-k8s-version-648232 has defined IP address 192.168.61.111 and MAC address 52:54:00:88:cb:42 in network mk-old-k8s-version-648232
I0318 21:48:22.416473 58466 provision.go:143] copyHostCerts
I0318 21:48:22.416535 58466 exec_runner.go:144] found /home/jenkins/minikube-integration/18421-5321/.minikube/ca.pem, removing ...
I0318 21:48:22.416548 58466 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18421-5321/.minikube/ca.pem
I0318 21:48:22.416622 58466 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18421-5321/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18421-5321/.minikube/ca.pem (1078 bytes)
I0318 21:48:22.416750 58466 exec_runner.go:144] found /home/jenkins/minikube-integration/18421-5321/.minikube/cert.pem, removing ...
I0318 21:48:22.416760 58466 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18421-5321/.minikube/cert.pem
I0318 21:48:22.416789 58466 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18421-5321/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18421-5321/.minikube/cert.pem (1123 bytes)
I0318 21:48:22.416882 58466 exec_runner.go:144] found /home/jenkins/minikube-integration/18421-5321/.minikube/key.pem, removing ...
I0318 21:48:22.416893 58466 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18421-5321/.minikube/key.pem
I0318 21:48:22.416937 58466 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18421-5321/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18421-5321/.minikube/key.pem (1679 bytes)
I0318 21:48:22.417026 58466 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18421-5321/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18421-5321/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18421-5321/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-648232 san=[127.0.0.1 192.168.61.111 localhost minikube old-k8s-version-648232]
I0318 21:48:22.538427 58466 provision.go:177] copyRemoteCerts
I0318 21:48:22.538506 58466 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0318 21:48:22.538535 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetSSHHostname
I0318 21:48:22.541500 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | domain old-k8s-version-648232 has defined MAC address 52:54:00:88:cb:42 in network mk-old-k8s-version-648232
I0318 21:48:22.541846 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:cb:42", ip: ""} in network mk-old-k8s-version-648232: {Iface:virbr2 ExpiryTime:2024-03-18 22:48:15 +0000 UTC Type:0 Mac:52:54:00:88:cb:42 Iaid: IPaddr:192.168.61.111 Prefix:24 Hostname:old-k8s-version-648232 Clientid:01:52:54:00:88:cb:42}
I0318 21:48:22.541860 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | domain old-k8s-version-648232 has defined IP address 192.168.61.111 and MAC address 52:54:00:88:cb:42 in network mk-old-k8s-version-648232
I0318 21:48:22.542183 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetSSHPort
I0318 21:48:22.542393 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetSSHKeyPath
I0318 21:48:22.542535 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetSSHUsername
I0318 21:48:22.542688 58466 sshutil.go:53] new ssh client: &{IP:192.168.61.111 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18421-5321/.minikube/machines/old-k8s-version-648232/id_rsa Username:docker}
I0318 21:48:22.630278 58466 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18421-5321/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0318 21:48:22.656847 58466 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18421-5321/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0318 21:48:22.684196 58466 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18421-5321/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0318 21:48:22.710857 58466 provision.go:87] duration metric: took 300.873348ms to configureAuth
I0318 21:48:22.710889 58466 buildroot.go:189] setting minikube options for container-runtime
I0318 21:48:22.711107 58466 config.go:182] Loaded profile config "old-k8s-version-648232": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0318 21:48:22.711192 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetSSHHostname
I0318 21:48:22.714265 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | domain old-k8s-version-648232 has defined MAC address 52:54:00:88:cb:42 in network mk-old-k8s-version-648232
I0318 21:48:22.714710 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:cb:42", ip: ""} in network mk-old-k8s-version-648232: {Iface:virbr2 ExpiryTime:2024-03-18 22:48:15 +0000 UTC Type:0 Mac:52:54:00:88:cb:42 Iaid: IPaddr:192.168.61.111 Prefix:24 Hostname:old-k8s-version-648232 Clientid:01:52:54:00:88:cb:42}
I0318 21:48:22.714742 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | domain old-k8s-version-648232 has defined IP address 192.168.61.111 and MAC address 52:54:00:88:cb:42 in network mk-old-k8s-version-648232
I0318 21:48:22.714963 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetSSHPort
I0318 21:48:22.715164 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetSSHKeyPath
I0318 21:48:22.715340 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetSSHKeyPath
I0318 21:48:22.715481 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetSSHUsername
I0318 21:48:22.715650 58466 main.go:141] libmachine: Using SSH client type: native
I0318 21:48:22.715837 58466 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4a0] 0x830200 <nil> [] 0s} 192.168.61.111 22 <nil> <nil>}
I0318 21:48:22.715859 58466 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0318 21:48:23.017710 58466 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0318 21:48:23.017738 58466 main.go:141] libmachine: Checking connection to Docker...
I0318 21:48:23.017749 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetURL
I0318 21:48:23.019178 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | Using libvirt version 6000000
I0318 21:48:23.021773 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | domain old-k8s-version-648232 has defined MAC address 52:54:00:88:cb:42 in network mk-old-k8s-version-648232
I0318 21:48:23.022222 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:cb:42", ip: ""} in network mk-old-k8s-version-648232: {Iface:virbr2 ExpiryTime:2024-03-18 22:48:15 +0000 UTC Type:0 Mac:52:54:00:88:cb:42 Iaid: IPaddr:192.168.61.111 Prefix:24 Hostname:old-k8s-version-648232 Clientid:01:52:54:00:88:cb:42}
I0318 21:48:23.022251 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | domain old-k8s-version-648232 has defined IP address 192.168.61.111 and MAC address 52:54:00:88:cb:42 in network mk-old-k8s-version-648232
I0318 21:48:23.022510 58466 main.go:141] libmachine: Docker is up and running!
I0318 21:48:23.022527 58466 main.go:141] libmachine: Reticulating splines...
I0318 21:48:23.022535 58466 client.go:171] duration metric: took 25.308334056s to LocalClient.Create
I0318 21:48:23.022562 58466 start.go:167] duration metric: took 25.308423199s to libmachine.API.Create "old-k8s-version-648232"
I0318 21:48:23.022586 58466 start.go:293] postStartSetup for "old-k8s-version-648232" (driver="kvm2")
I0318 21:48:23.022599 58466 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0318 21:48:23.022617 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .DriverName
I0318 21:48:23.022820 58466 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0318 21:48:23.022842 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetSSHHostname
I0318 21:48:23.025236 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | domain old-k8s-version-648232 has defined MAC address 52:54:00:88:cb:42 in network mk-old-k8s-version-648232
I0318 21:48:23.025529 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:cb:42", ip: ""} in network mk-old-k8s-version-648232: {Iface:virbr2 ExpiryTime:2024-03-18 22:48:15 +0000 UTC Type:0 Mac:52:54:00:88:cb:42 Iaid: IPaddr:192.168.61.111 Prefix:24 Hostname:old-k8s-version-648232 Clientid:01:52:54:00:88:cb:42}
I0318 21:48:23.025552 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | domain old-k8s-version-648232 has defined IP address 192.168.61.111 and MAC address 52:54:00:88:cb:42 in network mk-old-k8s-version-648232
I0318 21:48:23.025741 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetSSHPort
I0318 21:48:23.025937 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetSSHKeyPath
I0318 21:48:23.026089 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetSSHUsername
I0318 21:48:23.026216 58466 sshutil.go:53] new ssh client: &{IP:192.168.61.111 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18421-5321/.minikube/machines/old-k8s-version-648232/id_rsa Username:docker}
I0318 21:48:23.116602 58466 ssh_runner.go:195] Run: cat /etc/os-release
I0318 21:48:23.121775 58466 info.go:137] Remote host: Buildroot 2023.02.9
I0318 21:48:23.121796 58466 filesync.go:126] Scanning /home/jenkins/minikube-integration/18421-5321/.minikube/addons for local assets ...
I0318 21:48:23.121859 58466 filesync.go:126] Scanning /home/jenkins/minikube-integration/18421-5321/.minikube/files for local assets ...
I0318 21:48:23.121969 58466 filesync.go:149] local asset: /home/jenkins/minikube-integration/18421-5321/.minikube/files/etc/ssl/certs/125682.pem -> 125682.pem in /etc/ssl/certs
I0318 21:48:23.122102 58466 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0318 21:48:23.133952 58466 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18421-5321/.minikube/files/etc/ssl/certs/125682.pem --> /etc/ssl/certs/125682.pem (1708 bytes)
I0318 21:48:23.163571 58466 start.go:296] duration metric: took 140.970793ms for postStartSetup
I0318 21:48:23.163616 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetConfigRaw
I0318 21:48:23.164257 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetIP
I0318 21:48:23.166905 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | domain old-k8s-version-648232 has defined MAC address 52:54:00:88:cb:42 in network mk-old-k8s-version-648232
I0318 21:48:23.167206 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:cb:42", ip: ""} in network mk-old-k8s-version-648232: {Iface:virbr2 ExpiryTime:2024-03-18 22:48:15 +0000 UTC Type:0 Mac:52:54:00:88:cb:42 Iaid: IPaddr:192.168.61.111 Prefix:24 Hostname:old-k8s-version-648232 Clientid:01:52:54:00:88:cb:42}
I0318 21:48:23.167230 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | domain old-k8s-version-648232 has defined IP address 192.168.61.111 and MAC address 52:54:00:88:cb:42 in network mk-old-k8s-version-648232
I0318 21:48:23.167492 58466 profile.go:142] Saving config to /home/jenkins/minikube-integration/18421-5321/.minikube/profiles/old-k8s-version-648232/config.json ...
I0318 21:48:23.167710 58466 start.go:128] duration metric: took 25.476972344s to createHost
I0318 21:48:23.167733 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetSSHHostname
I0318 21:48:23.170065 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | domain old-k8s-version-648232 has defined MAC address 52:54:00:88:cb:42 in network mk-old-k8s-version-648232
I0318 21:48:23.170462 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:cb:42", ip: ""} in network mk-old-k8s-version-648232: {Iface:virbr2 ExpiryTime:2024-03-18 22:48:15 +0000 UTC Type:0 Mac:52:54:00:88:cb:42 Iaid: IPaddr:192.168.61.111 Prefix:24 Hostname:old-k8s-version-648232 Clientid:01:52:54:00:88:cb:42}
I0318 21:48:23.170493 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | domain old-k8s-version-648232 has defined IP address 192.168.61.111 and MAC address 52:54:00:88:cb:42 in network mk-old-k8s-version-648232
I0318 21:48:23.170600 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetSSHPort
I0318 21:48:23.170813 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetSSHKeyPath
I0318 21:48:23.170966 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetSSHKeyPath
I0318 21:48:23.171106 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetSSHUsername
I0318 21:48:23.171264 58466 main.go:141] libmachine: Using SSH client type: native
I0318 21:48:23.171437 58466 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4a0] 0x830200 <nil> [] 0s} 192.168.61.111 22 <nil> <nil>}
I0318 21:48:23.171453 58466 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0318 21:48:23.278476 58466 main.go:141] libmachine: SSH cmd err, output: <nil>: 1710798503.253768046
I0318 21:48:23.278501 58466 fix.go:216] guest clock: 1710798503.253768046
I0318 21:48:23.278511 58466 fix.go:229] Guest: 2024-03-18 21:48:23.253768046 +0000 UTC Remote: 2024-03-18 21:48:23.167722741 +0000 UTC m=+40.833788395 (delta=86.045305ms)
I0318 21:48:23.278536 58466 fix.go:200] guest clock delta is within tolerance: 86.045305ms
I0318 21:48:23.278543 58466 start.go:83] releasing machines lock for "old-k8s-version-648232", held for 25.587924369s
I0318 21:48:23.278569 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .DriverName
I0318 21:48:23.278834 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetIP
I0318 21:48:23.281524 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | domain old-k8s-version-648232 has defined MAC address 52:54:00:88:cb:42 in network mk-old-k8s-version-648232
I0318 21:48:23.281898 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:cb:42", ip: ""} in network mk-old-k8s-version-648232: {Iface:virbr2 ExpiryTime:2024-03-18 22:48:15 +0000 UTC Type:0 Mac:52:54:00:88:cb:42 Iaid: IPaddr:192.168.61.111 Prefix:24 Hostname:old-k8s-version-648232 Clientid:01:52:54:00:88:cb:42}
I0318 21:48:23.281930 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | domain old-k8s-version-648232 has defined IP address 192.168.61.111 and MAC address 52:54:00:88:cb:42 in network mk-old-k8s-version-648232
I0318 21:48:23.282105 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .DriverName
I0318 21:48:23.282644 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .DriverName
I0318 21:48:23.282854 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .DriverName
I0318 21:48:23.282959 58466 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0318 21:48:23.283003 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetSSHHostname
I0318 21:48:23.283067 58466 ssh_runner.go:195] Run: cat /version.json
I0318 21:48:23.283103 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetSSHHostname
I0318 21:48:23.285753 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | domain old-k8s-version-648232 has defined MAC address 52:54:00:88:cb:42 in network mk-old-k8s-version-648232
I0318 21:48:23.286098 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:cb:42", ip: ""} in network mk-old-k8s-version-648232: {Iface:virbr2 ExpiryTime:2024-03-18 22:48:15 +0000 UTC Type:0 Mac:52:54:00:88:cb:42 Iaid: IPaddr:192.168.61.111 Prefix:24 Hostname:old-k8s-version-648232 Clientid:01:52:54:00:88:cb:42}
I0318 21:48:23.286127 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | domain old-k8s-version-648232 has defined IP address 192.168.61.111 and MAC address 52:54:00:88:cb:42 in network mk-old-k8s-version-648232
I0318 21:48:23.286151 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | domain old-k8s-version-648232 has defined MAC address 52:54:00:88:cb:42 in network mk-old-k8s-version-648232
I0318 21:48:23.286253 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetSSHPort
I0318 21:48:23.286448 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetSSHKeyPath
I0318 21:48:23.286580 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:cb:42", ip: ""} in network mk-old-k8s-version-648232: {Iface:virbr2 ExpiryTime:2024-03-18 22:48:15 +0000 UTC Type:0 Mac:52:54:00:88:cb:42 Iaid: IPaddr:192.168.61.111 Prefix:24 Hostname:old-k8s-version-648232 Clientid:01:52:54:00:88:cb:42}
I0318 21:48:23.286599 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetSSHUsername
I0318 21:48:23.286615 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | domain old-k8s-version-648232 has defined IP address 192.168.61.111 and MAC address 52:54:00:88:cb:42 in network mk-old-k8s-version-648232
I0318 21:48:23.286751 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetSSHPort
I0318 21:48:23.286795 58466 sshutil.go:53] new ssh client: &{IP:192.168.61.111 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18421-5321/.minikube/machines/old-k8s-version-648232/id_rsa Username:docker}
I0318 21:48:23.286909 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetSSHKeyPath
I0318 21:48:23.287073 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetSSHUsername
I0318 21:48:23.287219 58466 sshutil.go:53] new ssh client: &{IP:192.168.61.111 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18421-5321/.minikube/machines/old-k8s-version-648232/id_rsa Username:docker}
I0318 21:48:23.366730 58466 ssh_runner.go:195] Run: systemctl --version
I0318 21:48:23.391256 58466 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0318 21:48:23.563842 58466 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0318 21:48:23.571600 58466 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0318 21:48:23.571693 58466 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0318 21:48:23.594568 58466 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0318 21:48:23.594595 58466 start.go:494] detecting cgroup driver to use...
I0318 21:48:23.594653 58466 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0318 21:48:23.615753 58466 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0318 21:48:23.633407 58466 docker.go:217] disabling cri-docker service (if available) ...
I0318 21:48:23.633498 58466 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0318 21:48:23.654509 58466 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0318 21:48:23.672161 58466 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0318 21:48:23.799243 58466 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0318 21:48:23.962640 58466 docker.go:233] disabling docker service ...
I0318 21:48:23.962704 58466 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0318 21:48:23.979967 58466 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0318 21:48:23.994899 58466 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0318 21:48:24.157842 58466 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0318 21:48:24.301103 58466 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0318 21:48:24.318049 58466 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0318 21:48:24.342329 58466 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0318 21:48:24.342386 58466 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0318 21:48:24.356720 58466 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0318 21:48:24.356812 58466 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0318 21:48:24.371308 58466 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0318 21:48:24.384494 58466 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0318 21:48:24.397951 58466 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0318 21:48:24.412154 58466 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0318 21:48:24.423912 58466 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0318 21:48:24.423964 58466 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0318 21:48:24.441907 58466 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0318 21:48:24.455914 58466 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0318 21:48:24.592148 58466 ssh_runner.go:195] Run: sudo systemctl restart crio
I0318 21:48:24.766694 58466 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0318 21:48:24.766772 58466 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0318 21:48:24.772682 58466 start.go:562] Will wait 60s for crictl version
I0318 21:48:24.772755 58466 ssh_runner.go:195] Run: which crictl
I0318 21:48:24.777073 58466 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0318 21:48:24.826021 58466 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0318 21:48:24.826104 58466 ssh_runner.go:195] Run: crio --version
I0318 21:48:24.859558 58466 ssh_runner.go:195] Run: crio --version
I0318 21:48:24.893240 58466 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0318 21:48:24.894312 58466 main.go:141] libmachine: (old-k8s-version-648232) Calling .GetIP
I0318 21:48:24.897178 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | domain old-k8s-version-648232 has defined MAC address 52:54:00:88:cb:42 in network mk-old-k8s-version-648232
I0318 21:48:24.897516 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:cb:42", ip: ""} in network mk-old-k8s-version-648232: {Iface:virbr2 ExpiryTime:2024-03-18 22:48:15 +0000 UTC Type:0 Mac:52:54:00:88:cb:42 Iaid: IPaddr:192.168.61.111 Prefix:24 Hostname:old-k8s-version-648232 Clientid:01:52:54:00:88:cb:42}
I0318 21:48:24.897542 58466 main.go:141] libmachine: (old-k8s-version-648232) DBG | domain old-k8s-version-648232 has defined IP address 192.168.61.111 and MAC address 52:54:00:88:cb:42 in network mk-old-k8s-version-648232
I0318 21:48:24.897802 58466 ssh_runner.go:195] Run: grep 192.168.61.1 host.minikube.internal$ /etc/hosts
I0318 21:48:24.902481 58466 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.61.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0318 21:48:24.916269 58466 kubeadm.go:877] updating cluster {Name:old-k8s-version-648232 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18277/minikube-v1.32.1-1710573846-18277-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-648232 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.111 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] M
ountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0318 21:48:24.916398 58466 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0318 21:48:24.916477 58466 ssh_runner.go:195] Run: sudo crictl images --output json
I0318 21:48:24.954097 58466 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0318 21:48:24.954169 58466 ssh_runner.go:195] Run: which lz4
I0318 21:48:24.958912 58466 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0318 21:48:24.964035 58466 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0318 21:48:24.964066 58466 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18421-5321/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0318 21:48:27.031683 58466 crio.go:462] duration metric: took 2.072799124s to copy over tarball
I0318 21:48:27.031745 58466 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0318 21:48:30.435542 58466 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (3.403755814s)
I0318 21:48:30.435575 58466 crio.go:469] duration metric: took 3.403867703s to extract the tarball
I0318 21:48:30.435585 58466 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0318 21:48:30.489126 58466 ssh_runner.go:195] Run: sudo crictl images --output json
I0318 21:48:30.605889 58466 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0318 21:48:30.605918 58466 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0318 21:48:30.605990 58466 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0318 21:48:30.606242 58466 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0318 21:48:30.606280 58466 image.go:134] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0318 21:48:30.606326 58466 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0318 21:48:30.606351 58466 image.go:134] retrieving image: registry.k8s.io/coredns:1.7.0
I0318 21:48:30.606499 58466 image.go:134] retrieving image: registry.k8s.io/pause:3.2
I0318 21:48:30.606530 58466 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0318 21:48:30.606504 58466 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0318 21:48:30.607765 58466 image.go:177] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0318 21:48:30.607764 58466 image.go:177] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0318 21:48:30.607798 58466 image.go:177] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0318 21:48:30.607886 58466 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0318 21:48:30.607891 58466 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0318 21:48:30.607904 58466 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0318 21:48:30.607938 58466 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0318 21:48:30.608236 58466 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0318 21:48:30.764581 58466 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0318 21:48:30.764892 58466 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0318 21:48:30.772817 58466 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0318 21:48:30.774691 58466 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0318 21:48:30.775566 58466 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0318 21:48:30.785278 58466 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0318 21:48:30.809057 58466 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0318 21:48:30.990063 58466 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0318 21:48:30.990119 58466 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0318 21:48:30.990129 58466 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0318 21:48:30.990077 58466 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0318 21:48:30.990164 58466 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0318 21:48:30.990179 58466 ssh_runner.go:195] Run: which crictl
I0318 21:48:30.990205 58466 ssh_runner.go:195] Run: which crictl
I0318 21:48:30.990181 58466 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0318 21:48:30.990256 58466 ssh_runner.go:195] Run: which crictl
I0318 21:48:31.011716 58466 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0318 21:48:31.011751 58466 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0318 21:48:31.011781 58466 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0318 21:48:31.011808 58466 ssh_runner.go:195] Run: which crictl
I0318 21:48:31.011821 58466 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0318 21:48:31.011828 58466 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0318 21:48:31.011865 58466 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0318 21:48:31.011878 58466 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0318 21:48:31.011890 58466 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0318 21:48:31.011916 58466 ssh_runner.go:195] Run: which crictl
I0318 21:48:31.011926 58466 ssh_runner.go:195] Run: which crictl
I0318 21:48:31.011868 58466 ssh_runner.go:195] Run: which crictl
I0318 21:48:31.011974 58466 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0318 21:48:31.011945 58466 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0318 21:48:31.012014 58466 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0318 21:48:31.039081 58466 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0318 21:48:31.086452 58466 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18421-5321/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0318 21:48:31.110460 58466 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18421-5321/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0318 21:48:31.110544 58466 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0318 21:48:31.110548 58466 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0318 21:48:31.110657 58466 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0318 21:48:31.110676 58466 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18421-5321/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0318 21:48:31.175683 58466 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18421-5321/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0318 21:48:31.228976 58466 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18421-5321/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0318 21:48:31.229014 58466 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18421-5321/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0318 21:48:31.229052 58466 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18421-5321/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0318 21:48:31.577349 58466 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0318 21:48:31.748945 58466 cache_images.go:92] duration metric: took 1.143007085s to LoadCachedImages
W0318 21:48:31.749037 58466 out.go:239] X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/18421-5321/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0: no such file or directory
X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/18421-5321/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0: no such file or directory
I0318 21:48:31.749053 58466 kubeadm.go:928] updating node { 192.168.61.111 8443 v1.20.0 crio true true} ...
I0318 21:48:31.749184 58466 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-648232 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.61.111
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-648232 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0318 21:48:31.749255 58466 ssh_runner.go:195] Run: crio config
I0318 21:48:31.842702 58466 cni.go:84] Creating CNI manager for ""
I0318 21:48:31.842725 58466 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0318 21:48:31.842737 58466 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0318 21:48:31.842763 58466 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.61.111 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-648232 NodeName:old-k8s-version-648232 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.61.111"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.61.111 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0318 21:48:31.842971 58466 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.61.111
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-648232"
kubeletExtraArgs:
node-ip: 192.168.61.111
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.61.111"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0318 21:48:31.843041 58466 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0318 21:48:31.861472 58466 binaries.go:44] Found k8s binaries, skipping transfer
I0318 21:48:31.861544 58466 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0318 21:48:31.876597 58466 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0318 21:48:31.906796 58466 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0318 21:48:31.932196 58466 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2123 bytes)
I0318 21:48:31.961165 58466 ssh_runner.go:195] Run: grep 192.168.61.111 control-plane.minikube.internal$ /etc/hosts
I0318 21:48:31.966002 58466 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.61.111 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0318 21:48:31.993476 58466 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0318 21:48:32.234838 58466 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0318 21:48:32.263741 58466 certs.go:68] Setting up /home/jenkins/minikube-integration/18421-5321/.minikube/profiles/old-k8s-version-648232 for IP: 192.168.61.111
I0318 21:48:32.263765 58466 certs.go:194] generating shared ca certs ...
I0318 21:48:32.263785 58466 certs.go:226] acquiring lock for ca certs: {Name:mk9ff12f9299606f9768ecbdfa24f15ecf095a72 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0318 21:48:32.263931 58466 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/18421-5321/.minikube/ca.key
I0318 21:48:32.263981 58466 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/18421-5321/.minikube/proxy-client-ca.key
I0318 21:48:32.263997 58466 certs.go:256] generating profile certs ...
I0318 21:48:32.264059 58466 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/18421-5321/.minikube/profiles/old-k8s-version-648232/client.key
I0318 21:48:32.264087 58466 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18421-5321/.minikube/profiles/old-k8s-version-648232/client.crt with IP's: []
I0318 21:48:32.330626 58466 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18421-5321/.minikube/profiles/old-k8s-version-648232/client.crt ...
I0318 21:48:32.330658 58466 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18421-5321/.minikube/profiles/old-k8s-version-648232/client.crt: {Name:mk864c029de97c78c2e38ad05cf233d0738bc0f3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0318 21:48:32.330867 58466 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18421-5321/.minikube/profiles/old-k8s-version-648232/client.key ...
I0318 21:48:32.330892 58466 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18421-5321/.minikube/profiles/old-k8s-version-648232/client.key: {Name:mk5e6c2014944df0133b07219a13ee241677e31e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0318 21:48:32.331024 58466 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/18421-5321/.minikube/profiles/old-k8s-version-648232/apiserver.key.a3f2b5e4
I0318 21:48:32.331054 58466 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18421-5321/.minikube/profiles/old-k8s-version-648232/apiserver.crt.a3f2b5e4 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.61.111]
I0318 21:48:32.529521 58466 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18421-5321/.minikube/profiles/old-k8s-version-648232/apiserver.crt.a3f2b5e4 ...
I0318 21:48:32.529551 58466 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18421-5321/.minikube/profiles/old-k8s-version-648232/apiserver.crt.a3f2b5e4: {Name:mk56e9721d0c1e9ac3aae3ed093bf1c7767fbfaf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0318 21:48:32.529774 58466 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18421-5321/.minikube/profiles/old-k8s-version-648232/apiserver.key.a3f2b5e4 ...
I0318 21:48:32.529793 58466 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18421-5321/.minikube/profiles/old-k8s-version-648232/apiserver.key.a3f2b5e4: {Name:mk621c7929fdda5c3da0533c579f7190f1bbd654 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0318 21:48:32.529935 58466 certs.go:381] copying /home/jenkins/minikube-integration/18421-5321/.minikube/profiles/old-k8s-version-648232/apiserver.crt.a3f2b5e4 -> /home/jenkins/minikube-integration/18421-5321/.minikube/profiles/old-k8s-version-648232/apiserver.crt
I0318 21:48:32.530030 58466 certs.go:385] copying /home/jenkins/minikube-integration/18421-5321/.minikube/profiles/old-k8s-version-648232/apiserver.key.a3f2b5e4 -> /home/jenkins/minikube-integration/18421-5321/.minikube/profiles/old-k8s-version-648232/apiserver.key
I0318 21:48:32.530105 58466 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/18421-5321/.minikube/profiles/old-k8s-version-648232/proxy-client.key
I0318 21:48:32.530122 58466 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18421-5321/.minikube/profiles/old-k8s-version-648232/proxy-client.crt with IP's: []
I0318 21:48:32.648139 58466 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18421-5321/.minikube/profiles/old-k8s-version-648232/proxy-client.crt ...
I0318 21:48:32.648175 58466 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18421-5321/.minikube/profiles/old-k8s-version-648232/proxy-client.crt: {Name:mka52ef5f1d6e438b0cf23b52552df2982d4eed7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0318 21:48:32.648367 58466 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18421-5321/.minikube/profiles/old-k8s-version-648232/proxy-client.key ...
I0318 21:48:32.648384 58466 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18421-5321/.minikube/profiles/old-k8s-version-648232/proxy-client.key: {Name:mk33b04a91125e6ddf78b1c579de2d00b6541a8b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0318 21:48:32.648652 58466 certs.go:484] found cert: /home/jenkins/minikube-integration/18421-5321/.minikube/certs/12568.pem (1338 bytes)
W0318 21:48:32.648700 58466 certs.go:480] ignoring /home/jenkins/minikube-integration/18421-5321/.minikube/certs/12568_empty.pem, impossibly tiny 0 bytes
I0318 21:48:32.648710 58466 certs.go:484] found cert: /home/jenkins/minikube-integration/18421-5321/.minikube/certs/ca-key.pem (1675 bytes)
I0318 21:48:32.648744 58466 certs.go:484] found cert: /home/jenkins/minikube-integration/18421-5321/.minikube/certs/ca.pem (1078 bytes)
I0318 21:48:32.648830 58466 certs.go:484] found cert: /home/jenkins/minikube-integration/18421-5321/.minikube/certs/cert.pem (1123 bytes)
I0318 21:48:32.648859 58466 certs.go:484] found cert: /home/jenkins/minikube-integration/18421-5321/.minikube/certs/key.pem (1679 bytes)
I0318 21:48:32.648957 58466 certs.go:484] found cert: /home/jenkins/minikube-integration/18421-5321/.minikube/files/etc/ssl/certs/125682.pem (1708 bytes)
I0318 21:48:32.649798 58466 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18421-5321/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0318 21:48:32.706688 58466 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18421-5321/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0318 21:48:32.789561 58466 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18421-5321/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0318 21:48:32.847261 58466 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18421-5321/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0318 21:48:32.881462 58466 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18421-5321/.minikube/profiles/old-k8s-version-648232/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0318 21:48:32.924542 58466 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18421-5321/.minikube/profiles/old-k8s-version-648232/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0318 21:48:32.959330 58466 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18421-5321/.minikube/profiles/old-k8s-version-648232/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0318 21:48:32.989335 58466 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18421-5321/.minikube/profiles/old-k8s-version-648232/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0318 21:48:33.033168 58466 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18421-5321/.minikube/certs/12568.pem --> /usr/share/ca-certificates/12568.pem (1338 bytes)
I0318 21:48:33.076933 58466 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18421-5321/.minikube/files/etc/ssl/certs/125682.pem --> /usr/share/ca-certificates/125682.pem (1708 bytes)
I0318 21:48:33.119387 58466 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18421-5321/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0318 21:48:33.162336 58466 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0318 21:48:33.197557 58466 ssh_runner.go:195] Run: openssl version
I0318 21:48:33.207217 58466 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/12568.pem && ln -fs /usr/share/ca-certificates/12568.pem /etc/ssl/certs/12568.pem"
I0318 21:48:33.229887 58466 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/12568.pem
I0318 21:48:33.243197 58466 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Mar 18 20:42 /usr/share/ca-certificates/12568.pem
I0318 21:48:33.243260 58466 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/12568.pem
I0318 21:48:33.252325 58466 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/12568.pem /etc/ssl/certs/51391683.0"
I0318 21:48:33.270859 58466 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/125682.pem && ln -fs /usr/share/ca-certificates/125682.pem /etc/ssl/certs/125682.pem"
I0318 21:48:33.289370 58466 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/125682.pem
I0318 21:48:33.297145 58466 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Mar 18 20:42 /usr/share/ca-certificates/125682.pem
I0318 21:48:33.297209 58466 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/125682.pem
I0318 21:48:33.306367 58466 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/125682.pem /etc/ssl/certs/3ec20f2e.0"
I0318 21:48:33.325535 58466 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0318 21:48:33.356245 58466 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0318 21:48:33.364694 58466 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Mar 18 20:32 /usr/share/ca-certificates/minikubeCA.pem
I0318 21:48:33.364768 58466 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0318 21:48:33.373973 58466 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0318 21:48:33.399011 58466 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0318 21:48:33.407904 58466 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0318 21:48:33.407950 58466 kubeadm.go:391] StartCluster: {Name:old-k8s-version-648232 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18277/minikube-v1.32.1-1710573846-18277-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-648232 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.111 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Moun
tPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0318 21:48:33.408013 58466 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0318 21:48:33.408054 58466 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0318 21:48:33.469135 58466 cri.go:89] found id: ""
I0318 21:48:33.469199 58466 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0318 21:48:33.491083 58466 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0318 21:48:33.509197 58466 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0318 21:48:33.528515 58466 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0318 21:48:33.528532 58466 kubeadm.go:156] found existing configuration files:
I0318 21:48:33.528592 58466 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0318 21:48:33.540801 58466 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0318 21:48:33.540868 58466 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0318 21:48:33.552870 58466 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0318 21:48:33.568212 58466 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0318 21:48:33.568276 58466 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0318 21:48:33.585308 58466 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0318 21:48:33.601535 58466 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0318 21:48:33.601599 58466 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0318 21:48:33.619732 58466 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0318 21:48:33.636520 58466 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0318 21:48:33.636581 58466 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0318 21:48:33.657467 58466 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0318 21:48:33.902225 58466 kubeadm.go:309] [init] Using Kubernetes version: v1.20.0
I0318 21:48:33.902461 58466 kubeadm.go:309] [preflight] Running pre-flight checks
I0318 21:48:34.172775 58466 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0318 21:48:34.172942 58466 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0318 21:48:34.173061 58466 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0318 21:48:34.507775 58466 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0318 21:48:34.509613 58466 out.go:204] - Generating certificates and keys ...
I0318 21:48:34.509706 58466 kubeadm.go:309] [certs] Using existing ca certificate authority
I0318 21:48:34.509788 58466 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0318 21:48:34.791559 58466 kubeadm.go:309] [certs] Generating "apiserver-kubelet-client" certificate and key
I0318 21:48:34.946406 58466 kubeadm.go:309] [certs] Generating "front-proxy-ca" certificate and key
I0318 21:48:35.445388 58466 kubeadm.go:309] [certs] Generating "front-proxy-client" certificate and key
I0318 21:48:35.638179 58466 kubeadm.go:309] [certs] Generating "etcd/ca" certificate and key
I0318 21:48:35.857315 58466 kubeadm.go:309] [certs] Generating "etcd/server" certificate and key
I0318 21:48:35.857632 58466 kubeadm.go:309] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-648232] and IPs [192.168.61.111 127.0.0.1 ::1]
I0318 21:48:36.105935 58466 kubeadm.go:309] [certs] Generating "etcd/peer" certificate and key
I0318 21:48:36.106336 58466 kubeadm.go:309] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-648232] and IPs [192.168.61.111 127.0.0.1 ::1]
I0318 21:48:36.244234 58466 kubeadm.go:309] [certs] Generating "etcd/healthcheck-client" certificate and key
I0318 21:48:36.484041 58466 kubeadm.go:309] [certs] Generating "apiserver-etcd-client" certificate and key
I0318 21:48:36.848839 58466 kubeadm.go:309] [certs] Generating "sa" key and public key
I0318 21:48:36.849295 58466 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0318 21:48:37.174767 58466 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0318 21:48:37.417225 58466 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0318 21:48:37.578055 58466 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0318 21:48:37.872893 58466 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0318 21:48:37.896975 58466 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0318 21:48:37.897710 58466 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0318 21:48:37.897862 58466 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0318 21:48:38.031932 58466 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0318 21:48:38.033508 58466 out.go:204] - Booting up control plane ...
I0318 21:48:38.033656 58466 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0318 21:48:38.038136 58466 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0318 21:48:38.039818 58466 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0318 21:48:38.040623 58466 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0318 21:48:38.044581 58466 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0318 21:49:18.041908 58466 kubeadm.go:309] [kubelet-check] Initial timeout of 40s passed.
I0318 21:49:18.044126 58466 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0318 21:49:18.044623 58466 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0318 21:49:23.045643 58466 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0318 21:49:23.045887 58466 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0318 21:49:33.046559 58466 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0318 21:49:33.046748 58466 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0318 21:49:53.048021 58466 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0318 21:49:53.048305 58466 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0318 21:50:33.047860 58466 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0318 21:50:33.048120 58466 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0318 21:50:33.048147 58466 kubeadm.go:309]
I0318 21:50:33.048200 58466 kubeadm.go:309] Unfortunately, an error has occurred:
I0318 21:50:33.048258 58466 kubeadm.go:309] timed out waiting for the condition
I0318 21:50:33.048283 58466 kubeadm.go:309]
I0318 21:50:33.048333 58466 kubeadm.go:309] This error is likely caused by:
I0318 21:50:33.048396 58466 kubeadm.go:309] - The kubelet is not running
I0318 21:50:33.048547 58466 kubeadm.go:309] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0318 21:50:33.048559 58466 kubeadm.go:309]
I0318 21:50:33.048637 58466 kubeadm.go:309] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0318 21:50:33.048673 58466 kubeadm.go:309] - 'systemctl status kubelet'
I0318 21:50:33.048703 58466 kubeadm.go:309] - 'journalctl -xeu kubelet'
I0318 21:50:33.048709 58466 kubeadm.go:309]
I0318 21:50:33.048796 58466 kubeadm.go:309] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0318 21:50:33.048935 58466 kubeadm.go:309] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0318 21:50:33.048955 58466 kubeadm.go:309]
I0318 21:50:33.049109 58466 kubeadm.go:309] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0318 21:50:33.049190 58466 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0318 21:50:33.049263 58466 kubeadm.go:309] Once you have found the failing container, you can inspect its logs with:
I0318 21:50:33.049337 58466 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0318 21:50:33.049345 58466 kubeadm.go:309]
I0318 21:50:33.050406 58466 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0318 21:50:33.050477 58466 kubeadm.go:309] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0318 21:50:33.050573 58466 kubeadm.go:309] To see the stack trace of this error execute with --v=5 or higher
W0318 21:50:33.050780 58466 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-648232] and IPs [192.168.61.111 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-648232] and IPs [192.168.61.111 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-648232] and IPs [192.168.61.111 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-648232] and IPs [192.168.61.111 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0318 21:50:33.050849 58466 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0318 21:50:36.047140 58466 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (2.996260999s)
I0318 21:50:36.047257 58466 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0318 21:50:36.066262 58466 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0318 21:50:36.078389 58466 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0318 21:50:36.078409 58466 kubeadm.go:156] found existing configuration files:
I0318 21:50:36.078456 58466 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0318 21:50:36.089777 58466 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0318 21:50:36.089829 58466 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0318 21:50:36.101378 58466 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0318 21:50:36.112566 58466 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0318 21:50:36.112626 58466 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0318 21:50:36.123358 58466 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0318 21:50:36.134043 58466 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0318 21:50:36.134102 58466 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0318 21:50:36.145145 58466 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0318 21:50:36.155559 58466 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0318 21:50:36.155620 58466 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0318 21:50:36.166968 58466 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0318 21:50:36.246787 58466 kubeadm.go:309] [init] Using Kubernetes version: v1.20.0
I0318 21:50:36.246864 58466 kubeadm.go:309] [preflight] Running pre-flight checks
I0318 21:50:36.404969 58466 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0318 21:50:36.405124 58466 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0318 21:50:36.405249 58466 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0318 21:50:36.631949 58466 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0318 21:50:36.634171 58466 out.go:204] - Generating certificates and keys ...
I0318 21:50:36.634281 58466 kubeadm.go:309] [certs] Using existing ca certificate authority
I0318 21:50:36.634364 58466 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0318 21:50:36.634482 58466 kubeadm.go:309] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0318 21:50:36.634570 58466 kubeadm.go:309] [certs] Using existing front-proxy-ca certificate authority
I0318 21:50:36.634659 58466 kubeadm.go:309] [certs] Using existing front-proxy-client certificate and key on disk
I0318 21:50:36.634765 58466 kubeadm.go:309] [certs] Using existing etcd/ca certificate authority
I0318 21:50:36.634855 58466 kubeadm.go:309] [certs] Using existing etcd/server certificate and key on disk
I0318 21:50:36.635267 58466 kubeadm.go:309] [certs] Using existing etcd/peer certificate and key on disk
I0318 21:50:36.635670 58466 kubeadm.go:309] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0318 21:50:36.636003 58466 kubeadm.go:309] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0318 21:50:36.636175 58466 kubeadm.go:309] [certs] Using the existing "sa" key
I0318 21:50:36.636278 58466 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0318 21:50:36.898554 58466 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0318 21:50:37.267462 58466 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0318 21:50:37.611755 58466 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0318 21:50:37.708788 58466 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0318 21:50:37.725807 58466 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0318 21:50:37.727268 58466 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0318 21:50:37.727312 58466 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0318 21:50:37.881732 58466 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0318 21:50:37.883657 58466 out.go:204] - Booting up control plane ...
I0318 21:50:37.883770 58466 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0318 21:50:37.891459 58466 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0318 21:50:37.892380 58466 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0318 21:50:37.893307 58466 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0318 21:50:37.895463 58466 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0318 21:51:17.897693 58466 kubeadm.go:309] [kubelet-check] Initial timeout of 40s passed.
I0318 21:51:17.897786 58466 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0318 21:51:17.897982 58466 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0318 21:51:22.898448 58466 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0318 21:51:22.898653 58466 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0318 21:51:32.899365 58466 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0318 21:51:32.899567 58466 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0318 21:51:52.900699 58466 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0318 21:51:52.900995 58466 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0318 21:52:32.900515 58466 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0318 21:52:32.900770 58466 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0318 21:52:32.900792 58466 kubeadm.go:309]
I0318 21:52:32.900854 58466 kubeadm.go:309] Unfortunately, an error has occurred:
I0318 21:52:32.900930 58466 kubeadm.go:309] timed out waiting for the condition
I0318 21:52:32.900941 58466 kubeadm.go:309]
I0318 21:52:32.900998 58466 kubeadm.go:309] This error is likely caused by:
I0318 21:52:32.901051 58466 kubeadm.go:309] - The kubelet is not running
I0318 21:52:32.901213 58466 kubeadm.go:309] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0318 21:52:32.901239 58466 kubeadm.go:309]
I0318 21:52:32.901363 58466 kubeadm.go:309] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0318 21:52:32.901414 58466 kubeadm.go:309] - 'systemctl status kubelet'
I0318 21:52:32.901453 58466 kubeadm.go:309] - 'journalctl -xeu kubelet'
I0318 21:52:32.901460 58466 kubeadm.go:309]
I0318 21:52:32.901545 58466 kubeadm.go:309] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0318 21:52:32.901614 58466 kubeadm.go:309] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0318 21:52:32.901622 58466 kubeadm.go:309]
I0318 21:52:32.901716 58466 kubeadm.go:309] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0318 21:52:32.901831 58466 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0318 21:52:32.901928 58466 kubeadm.go:309] Once you have found the failing container, you can inspect its logs with:
I0318 21:52:32.902030 58466 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0318 21:52:32.902044 58466 kubeadm.go:309]
I0318 21:52:32.902959 58466 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0318 21:52:32.903074 58466 kubeadm.go:309] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0318 21:52:32.903154 58466 kubeadm.go:309] To see the stack trace of this error execute with --v=5 or higher
I0318 21:52:32.903232 58466 kubeadm.go:393] duration metric: took 3m59.495283933s to StartCluster
I0318 21:52:32.903281 58466 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0318 21:52:32.903340 58466 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0318 21:52:32.952461 58466 cri.go:89] found id: ""
I0318 21:52:32.952485 58466 logs.go:276] 0 containers: []
W0318 21:52:32.952493 58466 logs.go:278] No container was found matching "kube-apiserver"
I0318 21:52:32.952504 58466 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0318 21:52:32.952556 58466 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0318 21:52:32.990960 58466 cri.go:89] found id: ""
I0318 21:52:32.990983 58466 logs.go:276] 0 containers: []
W0318 21:52:32.990992 58466 logs.go:278] No container was found matching "etcd"
I0318 21:52:32.990998 58466 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0318 21:52:32.991048 58466 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0318 21:52:33.031616 58466 cri.go:89] found id: ""
I0318 21:52:33.031643 58466 logs.go:276] 0 containers: []
W0318 21:52:33.031651 58466 logs.go:278] No container was found matching "coredns"
I0318 21:52:33.031656 58466 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0318 21:52:33.031704 58466 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0318 21:52:33.068913 58466 cri.go:89] found id: ""
I0318 21:52:33.068932 58466 logs.go:276] 0 containers: []
W0318 21:52:33.068940 58466 logs.go:278] No container was found matching "kube-scheduler"
I0318 21:52:33.068945 58466 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0318 21:52:33.068989 58466 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0318 21:52:33.103460 58466 cri.go:89] found id: ""
I0318 21:52:33.103484 58466 logs.go:276] 0 containers: []
W0318 21:52:33.103491 58466 logs.go:278] No container was found matching "kube-proxy"
I0318 21:52:33.103497 58466 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0318 21:52:33.103540 58466 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0318 21:52:33.139549 58466 cri.go:89] found id: ""
I0318 21:52:33.139580 58466 logs.go:276] 0 containers: []
W0318 21:52:33.139591 58466 logs.go:278] No container was found matching "kube-controller-manager"
I0318 21:52:33.139599 58466 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0318 21:52:33.139655 58466 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0318 21:52:33.180437 58466 cri.go:89] found id: ""
I0318 21:52:33.180466 58466 logs.go:276] 0 containers: []
W0318 21:52:33.180476 58466 logs.go:278] No container was found matching "kindnet"
I0318 21:52:33.180486 58466 logs.go:123] Gathering logs for container status ...
I0318 21:52:33.180498 58466 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0318 21:52:33.232995 58466 logs.go:123] Gathering logs for kubelet ...
I0318 21:52:33.233031 58466 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0318 21:52:33.286878 58466 logs.go:123] Gathering logs for dmesg ...
I0318 21:52:33.286912 58466 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0318 21:52:33.301491 58466 logs.go:123] Gathering logs for describe nodes ...
I0318 21:52:33.301517 58466 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0318 21:52:33.426544 58466 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0318 21:52:33.426565 58466 logs.go:123] Gathering logs for CRI-O ...
I0318 21:52:33.426578 58466 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
W0318 21:52:33.526085 58466 out.go:364] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0318 21:52:33.526131 58466 out.go:239] *
*
W0318 21:52:33.526190 58466 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0318 21:52:33.526224 58466 out.go:239] *
*
W0318 21:52:33.527054 58466 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0318 21:52:33.529829 58466 out.go:177]
W0318 21:52:33.530938 58466 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0318 21:52:33.530981 58466 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0318 21:52:33.530997 58466 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0318 21:52:33.532169 58466 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-648232 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-648232 -n old-k8s-version-648232
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-648232 -n old-k8s-version-648232: exit status 6 (239.30988ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0318 21:52:33.807525 64670 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-648232" does not appear in /home/jenkins/minikube-integration/18421-5321/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-648232" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (291.50s)