=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-384148 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-384148 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m35.067102255s)
-- stdout --
* [old-k8s-version-384148] minikube v1.33.0-beta.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=18588
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/18588-368424/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/18588-368424/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-384148" primary control-plane node in "old-k8s-version-384148" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0408 12:36:40.868785 427857 out.go:291] Setting OutFile to fd 1 ...
I0408 12:36:40.868968 427857 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0408 12:36:40.868980 427857 out.go:304] Setting ErrFile to fd 2...
I0408 12:36:40.868987 427857 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0408 12:36:40.869785 427857 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18588-368424/.minikube/bin
I0408 12:36:40.870963 427857 out.go:298] Setting JSON to false
I0408 12:36:40.872831 427857 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-6","uptime":8344,"bootTime":1712571457,"procs":295,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1055-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0408 12:36:40.872943 427857 start.go:139] virtualization: kvm guest
I0408 12:36:40.875595 427857 out.go:177] * [old-k8s-version-384148] minikube v1.33.0-beta.0 on Ubuntu 20.04 (kvm/amd64)
I0408 12:36:40.878285 427857 out.go:177] - MINIKUBE_LOCATION=18588
I0408 12:36:40.878201 427857 notify.go:220] Checking for updates...
I0408 12:36:40.880282 427857 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0408 12:36:40.882189 427857 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/18588-368424/kubeconfig
I0408 12:36:40.884124 427857 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/18588-368424/.minikube
I0408 12:36:40.885791 427857 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0408 12:36:40.887623 427857 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0408 12:36:40.890109 427857 config.go:182] Loaded profile config "cert-expiration-283523": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.29.3
I0408 12:36:40.890257 427857 config.go:182] Loaded profile config "enable-default-cni-583253": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.29.3
I0408 12:36:40.890379 427857 config.go:182] Loaded profile config "flannel-583253": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.29.3
I0408 12:36:40.890555 427857 driver.go:392] Setting default libvirt URI to qemu:///system
I0408 12:36:40.932704 427857 out.go:177] * Using the kvm2 driver based on user configuration
I0408 12:36:40.934489 427857 start.go:297] selected driver: kvm2
I0408 12:36:40.934512 427857 start.go:901] validating driver "kvm2" against <nil>
I0408 12:36:40.934547 427857 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0408 12:36:40.935368 427857 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0408 12:36:40.935476 427857 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/18588-368424/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0408 12:36:40.952974 427857 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.0-beta.0
I0408 12:36:40.953041 427857 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0408 12:36:40.953262 427857 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0408 12:36:40.953334 427857 cni.go:84] Creating CNI manager for ""
I0408 12:36:40.953355 427857 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0408 12:36:40.953362 427857 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0408 12:36:40.953410 427857 start.go:340] cluster config:
{Name:old-k8s-version-384148 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1712138838-18566@sha256:a1b6bbc384c0914baa698cc91ccedcb662b3c0986082ff16cc623c5d83216034 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-384148 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0408 12:36:40.953515 427857 iso.go:125] acquiring lock: {Name:mk905101cd088ffce857d9d63a12e311f1c90fe6 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0408 12:36:40.956029 427857 out.go:177] * Starting "old-k8s-version-384148" primary control-plane node in "old-k8s-version-384148" cluster
I0408 12:36:40.957885 427857 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0408 12:36:40.957969 427857 preload.go:147] Found local preload: /home/jenkins/minikube-integration/18588-368424/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0408 12:36:40.957980 427857 cache.go:56] Caching tarball of preloaded images
I0408 12:36:40.958123 427857 preload.go:173] Found /home/jenkins/minikube-integration/18588-368424/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0408 12:36:40.958141 427857 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0408 12:36:40.958298 427857 profile.go:143] Saving config to /home/jenkins/minikube-integration/18588-368424/.minikube/profiles/old-k8s-version-384148/config.json ...
I0408 12:36:40.958330 427857 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18588-368424/.minikube/profiles/old-k8s-version-384148/config.json: {Name:mk19cded6c80769b6f537493d0df29d1fecf8eab Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0408 12:36:40.958533 427857 start.go:360] acquireMachinesLock for old-k8s-version-384148: {Name:mk652c18a262a3ba7b953c47749e248ec98d2e54 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0408 12:36:40.958582 427857 start.go:364] duration metric: took 21.202µs to acquireMachinesLock for "old-k8s-version-384148"
I0408 12:36:40.958603 427857 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-384148 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18566/minikube-v1.33.0-1712138767-18566-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1712138838-18566@sha256:a1b6bbc384c0914baa698cc91ccedcb662b3c0986082ff16cc623c5d83216034 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-384148 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0408 12:36:40.958713 427857 start.go:125] createHost starting for "" (driver="kvm2")
I0408 12:36:40.962071 427857 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0408 12:36:40.962298 427857 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0408 12:36:40.962358 427857 main.go:141] libmachine: Launching plugin server for driver kvm2
I0408 12:36:40.978405 427857 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43379
I0408 12:36:40.979030 427857 main.go:141] libmachine: () Calling .GetVersion
I0408 12:36:40.979854 427857 main.go:141] libmachine: Using API Version 1
I0408 12:36:40.979890 427857 main.go:141] libmachine: () Calling .SetConfigRaw
I0408 12:36:40.980373 427857 main.go:141] libmachine: () Calling .GetMachineName
I0408 12:36:40.980684 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetMachineName
I0408 12:36:40.980898 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .DriverName
I0408 12:36:40.981189 427857 start.go:159] libmachine.API.Create for "old-k8s-version-384148" (driver="kvm2")
I0408 12:36:40.981237 427857 client.go:168] LocalClient.Create starting
I0408 12:36:40.981285 427857 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18588-368424/.minikube/certs/ca.pem
I0408 12:36:40.981338 427857 main.go:141] libmachine: Decoding PEM data...
I0408 12:36:40.981361 427857 main.go:141] libmachine: Parsing certificate...
I0408 12:36:40.981469 427857 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18588-368424/.minikube/certs/cert.pem
I0408 12:36:40.981506 427857 main.go:141] libmachine: Decoding PEM data...
I0408 12:36:40.981524 427857 main.go:141] libmachine: Parsing certificate...
I0408 12:36:40.981551 427857 main.go:141] libmachine: Running pre-create checks...
I0408 12:36:40.981567 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .PreCreateCheck
I0408 12:36:40.981993 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetConfigRaw
I0408 12:36:40.982484 427857 main.go:141] libmachine: Creating machine...
I0408 12:36:40.982499 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .Create
I0408 12:36:40.982687 427857 main.go:141] libmachine: (old-k8s-version-384148) Creating KVM machine...
I0408 12:36:40.984323 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | found existing default KVM network
I0408 12:36:40.986053 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | I0408 12:36:40.985867 427880 network.go:206] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc00010f7f0}
I0408 12:36:40.986103 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | created network xml:
I0408 12:36:40.986120 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | <network>
I0408 12:36:40.986139 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | <name>mk-old-k8s-version-384148</name>
I0408 12:36:40.986151 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | <dns enable='no'/>
I0408 12:36:40.986163 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG |
I0408 12:36:40.986177 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | <ip address='192.168.39.1' netmask='255.255.255.0'>
I0408 12:36:40.986209 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | <dhcp>
I0408 12:36:40.986225 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | <range start='192.168.39.2' end='192.168.39.253'/>
I0408 12:36:40.986234 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | </dhcp>
I0408 12:36:40.986247 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | </ip>
I0408 12:36:40.986260 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG |
I0408 12:36:40.986274 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | </network>
I0408 12:36:40.986285 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG |
I0408 12:36:40.992225 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | trying to create private KVM network mk-old-k8s-version-384148 192.168.39.0/24...
I0408 12:36:41.076439 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | private KVM network mk-old-k8s-version-384148 192.168.39.0/24 created
I0408 12:36:41.076487 427857 main.go:141] libmachine: (old-k8s-version-384148) Setting up store path in /home/jenkins/minikube-integration/18588-368424/.minikube/machines/old-k8s-version-384148 ...
I0408 12:36:41.076544 427857 main.go:141] libmachine: (old-k8s-version-384148) Building disk image from file:///home/jenkins/minikube-integration/18588-368424/.minikube/cache/iso/amd64/minikube-v1.33.0-1712138767-18566-amd64.iso
I0408 12:36:41.076567 427857 main.go:141] libmachine: (old-k8s-version-384148) Downloading /home/jenkins/minikube-integration/18588-368424/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/18588-368424/.minikube/cache/iso/amd64/minikube-v1.33.0-1712138767-18566-amd64.iso...
I0408 12:36:41.076583 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | I0408 12:36:41.076399 427880 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/18588-368424/.minikube
I0408 12:36:41.371718 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | I0408 12:36:41.371505 427880 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/18588-368424/.minikube/machines/old-k8s-version-384148/id_rsa...
I0408 12:36:41.640077 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | I0408 12:36:41.639947 427880 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/18588-368424/.minikube/machines/old-k8s-version-384148/old-k8s-version-384148.rawdisk...
I0408 12:36:41.640114 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | Writing magic tar header
I0408 12:36:41.640131 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | Writing SSH key tar header
I0408 12:36:41.640144 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | I0408 12:36:41.640103 427880 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/18588-368424/.minikube/machines/old-k8s-version-384148 ...
I0408 12:36:41.640253 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18588-368424/.minikube/machines/old-k8s-version-384148
I0408 12:36:41.640310 427857 main.go:141] libmachine: (old-k8s-version-384148) Setting executable bit set on /home/jenkins/minikube-integration/18588-368424/.minikube/machines/old-k8s-version-384148 (perms=drwx------)
I0408 12:36:41.640336 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18588-368424/.minikube/machines
I0408 12:36:41.640352 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18588-368424/.minikube
I0408 12:36:41.640360 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18588-368424
I0408 12:36:41.640371 427857 main.go:141] libmachine: (old-k8s-version-384148) Setting executable bit set on /home/jenkins/minikube-integration/18588-368424/.minikube/machines (perms=drwxr-xr-x)
I0408 12:36:41.640381 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0408 12:36:41.640391 427857 main.go:141] libmachine: (old-k8s-version-384148) Setting executable bit set on /home/jenkins/minikube-integration/18588-368424/.minikube (perms=drwxr-xr-x)
I0408 12:36:41.640404 427857 main.go:141] libmachine: (old-k8s-version-384148) Setting executable bit set on /home/jenkins/minikube-integration/18588-368424 (perms=drwxrwxr-x)
I0408 12:36:41.640421 427857 main.go:141] libmachine: (old-k8s-version-384148) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0408 12:36:41.640432 427857 main.go:141] libmachine: (old-k8s-version-384148) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0408 12:36:41.640438 427857 main.go:141] libmachine: (old-k8s-version-384148) Creating domain...
I0408 12:36:41.640449 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | Checking permissions on dir: /home/jenkins
I0408 12:36:41.640457 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | Checking permissions on dir: /home
I0408 12:36:41.640488 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | Skipping /home - not owner
I0408 12:36:41.641814 427857 main.go:141] libmachine: (old-k8s-version-384148) define libvirt domain using xml:
I0408 12:36:41.641838 427857 main.go:141] libmachine: (old-k8s-version-384148) <domain type='kvm'>
I0408 12:36:41.641848 427857 main.go:141] libmachine: (old-k8s-version-384148) <name>old-k8s-version-384148</name>
I0408 12:36:41.641861 427857 main.go:141] libmachine: (old-k8s-version-384148) <memory unit='MiB'>2200</memory>
I0408 12:36:41.641870 427857 main.go:141] libmachine: (old-k8s-version-384148) <vcpu>2</vcpu>
I0408 12:36:41.641882 427857 main.go:141] libmachine: (old-k8s-version-384148) <features>
I0408 12:36:41.641905 427857 main.go:141] libmachine: (old-k8s-version-384148) <acpi/>
I0408 12:36:41.641926 427857 main.go:141] libmachine: (old-k8s-version-384148) <apic/>
I0408 12:36:41.641945 427857 main.go:141] libmachine: (old-k8s-version-384148) <pae/>
I0408 12:36:41.641963 427857 main.go:141] libmachine: (old-k8s-version-384148)
I0408 12:36:41.641972 427857 main.go:141] libmachine: (old-k8s-version-384148) </features>
I0408 12:36:41.641980 427857 main.go:141] libmachine: (old-k8s-version-384148) <cpu mode='host-passthrough'>
I0408 12:36:41.641989 427857 main.go:141] libmachine: (old-k8s-version-384148)
I0408 12:36:41.641995 427857 main.go:141] libmachine: (old-k8s-version-384148) </cpu>
I0408 12:36:41.642004 427857 main.go:141] libmachine: (old-k8s-version-384148) <os>
I0408 12:36:41.642016 427857 main.go:141] libmachine: (old-k8s-version-384148) <type>hvm</type>
I0408 12:36:41.642048 427857 main.go:141] libmachine: (old-k8s-version-384148) <boot dev='cdrom'/>
I0408 12:36:41.642077 427857 main.go:141] libmachine: (old-k8s-version-384148) <boot dev='hd'/>
I0408 12:36:41.642102 427857 main.go:141] libmachine: (old-k8s-version-384148) <bootmenu enable='no'/>
I0408 12:36:41.642123 427857 main.go:141] libmachine: (old-k8s-version-384148) </os>
I0408 12:36:41.642139 427857 main.go:141] libmachine: (old-k8s-version-384148) <devices>
I0408 12:36:41.642155 427857 main.go:141] libmachine: (old-k8s-version-384148) <disk type='file' device='cdrom'>
I0408 12:36:41.642173 427857 main.go:141] libmachine: (old-k8s-version-384148) <source file='/home/jenkins/minikube-integration/18588-368424/.minikube/machines/old-k8s-version-384148/boot2docker.iso'/>
I0408 12:36:41.642185 427857 main.go:141] libmachine: (old-k8s-version-384148) <target dev='hdc' bus='scsi'/>
I0408 12:36:41.642214 427857 main.go:141] libmachine: (old-k8s-version-384148) <readonly/>
I0408 12:36:41.642236 427857 main.go:141] libmachine: (old-k8s-version-384148) </disk>
I0408 12:36:41.642246 427857 main.go:141] libmachine: (old-k8s-version-384148) <disk type='file' device='disk'>
I0408 12:36:41.642256 427857 main.go:141] libmachine: (old-k8s-version-384148) <driver name='qemu' type='raw' cache='default' io='threads' />
I0408 12:36:41.642275 427857 main.go:141] libmachine: (old-k8s-version-384148) <source file='/home/jenkins/minikube-integration/18588-368424/.minikube/machines/old-k8s-version-384148/old-k8s-version-384148.rawdisk'/>
I0408 12:36:41.642293 427857 main.go:141] libmachine: (old-k8s-version-384148) <target dev='hda' bus='virtio'/>
I0408 12:36:41.642318 427857 main.go:141] libmachine: (old-k8s-version-384148) </disk>
I0408 12:36:41.642347 427857 main.go:141] libmachine: (old-k8s-version-384148) <interface type='network'>
I0408 12:36:41.642358 427857 main.go:141] libmachine: (old-k8s-version-384148) <source network='mk-old-k8s-version-384148'/>
I0408 12:36:41.642370 427857 main.go:141] libmachine: (old-k8s-version-384148) <model type='virtio'/>
I0408 12:36:41.642378 427857 main.go:141] libmachine: (old-k8s-version-384148) </interface>
I0408 12:36:41.642389 427857 main.go:141] libmachine: (old-k8s-version-384148) <interface type='network'>
I0408 12:36:41.642401 427857 main.go:141] libmachine: (old-k8s-version-384148) <source network='default'/>
I0408 12:36:41.642412 427857 main.go:141] libmachine: (old-k8s-version-384148) <model type='virtio'/>
I0408 12:36:41.642423 427857 main.go:141] libmachine: (old-k8s-version-384148) </interface>
I0408 12:36:41.642431 427857 main.go:141] libmachine: (old-k8s-version-384148) <serial type='pty'>
I0408 12:36:41.642442 427857 main.go:141] libmachine: (old-k8s-version-384148) <target port='0'/>
I0408 12:36:41.642453 427857 main.go:141] libmachine: (old-k8s-version-384148) </serial>
I0408 12:36:41.642471 427857 main.go:141] libmachine: (old-k8s-version-384148) <console type='pty'>
I0408 12:36:41.642483 427857 main.go:141] libmachine: (old-k8s-version-384148) <target type='serial' port='0'/>
I0408 12:36:41.642492 427857 main.go:141] libmachine: (old-k8s-version-384148) </console>
I0408 12:36:41.642502 427857 main.go:141] libmachine: (old-k8s-version-384148) <rng model='virtio'>
I0408 12:36:41.642516 427857 main.go:141] libmachine: (old-k8s-version-384148) <backend model='random'>/dev/random</backend>
I0408 12:36:41.642526 427857 main.go:141] libmachine: (old-k8s-version-384148) </rng>
I0408 12:36:41.642534 427857 main.go:141] libmachine: (old-k8s-version-384148)
I0408 12:36:41.642544 427857 main.go:141] libmachine: (old-k8s-version-384148)
I0408 12:36:41.642552 427857 main.go:141] libmachine: (old-k8s-version-384148) </devices>
I0408 12:36:41.642561 427857 main.go:141] libmachine: (old-k8s-version-384148) </domain>
I0408 12:36:41.642572 427857 main.go:141] libmachine: (old-k8s-version-384148)
I0408 12:36:41.647236 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | domain old-k8s-version-384148 has defined MAC address 52:54:00:02:8e:a4 in network default
I0408 12:36:41.647870 427857 main.go:141] libmachine: (old-k8s-version-384148) Ensuring networks are active...
I0408 12:36:41.647903 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | domain old-k8s-version-384148 has defined MAC address 52:54:00:06:da:95 in network mk-old-k8s-version-384148
I0408 12:36:41.648594 427857 main.go:141] libmachine: (old-k8s-version-384148) Ensuring network default is active
I0408 12:36:41.649014 427857 main.go:141] libmachine: (old-k8s-version-384148) Ensuring network mk-old-k8s-version-384148 is active
I0408 12:36:41.649674 427857 main.go:141] libmachine: (old-k8s-version-384148) Getting domain xml...
I0408 12:36:41.650890 427857 main.go:141] libmachine: (old-k8s-version-384148) Creating domain...
I0408 12:36:43.078358 427857 main.go:141] libmachine: (old-k8s-version-384148) Waiting to get IP...
I0408 12:36:43.079477 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | domain old-k8s-version-384148 has defined MAC address 52:54:00:06:da:95 in network mk-old-k8s-version-384148
I0408 12:36:43.080104 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | unable to find current IP address of domain old-k8s-version-384148 in network mk-old-k8s-version-384148
I0408 12:36:43.080132 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | I0408 12:36:43.080059 427880 retry.go:31] will retry after 213.349334ms: waiting for machine to come up
I0408 12:36:43.295813 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | domain old-k8s-version-384148 has defined MAC address 52:54:00:06:da:95 in network mk-old-k8s-version-384148
I0408 12:36:43.296478 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | unable to find current IP address of domain old-k8s-version-384148 in network mk-old-k8s-version-384148
I0408 12:36:43.296508 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | I0408 12:36:43.296416 427880 retry.go:31] will retry after 268.560644ms: waiting for machine to come up
I0408 12:36:43.567297 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | domain old-k8s-version-384148 has defined MAC address 52:54:00:06:da:95 in network mk-old-k8s-version-384148
I0408 12:36:43.568014 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | unable to find current IP address of domain old-k8s-version-384148 in network mk-old-k8s-version-384148
I0408 12:36:43.568038 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | I0408 12:36:43.567970 427880 retry.go:31] will retry after 370.668467ms: waiting for machine to come up
I0408 12:36:43.940742 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | domain old-k8s-version-384148 has defined MAC address 52:54:00:06:da:95 in network mk-old-k8s-version-384148
I0408 12:36:43.941462 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | unable to find current IP address of domain old-k8s-version-384148 in network mk-old-k8s-version-384148
I0408 12:36:43.941497 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | I0408 12:36:43.941403 427880 retry.go:31] will retry after 566.797332ms: waiting for machine to come up
I0408 12:36:44.510068 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | domain old-k8s-version-384148 has defined MAC address 52:54:00:06:da:95 in network mk-old-k8s-version-384148
I0408 12:36:44.510696 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | unable to find current IP address of domain old-k8s-version-384148 in network mk-old-k8s-version-384148
I0408 12:36:44.510730 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | I0408 12:36:44.510614 427880 retry.go:31] will retry after 732.470397ms: waiting for machine to come up
I0408 12:36:45.245329 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | domain old-k8s-version-384148 has defined MAC address 52:54:00:06:da:95 in network mk-old-k8s-version-384148
I0408 12:36:45.246106 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | unable to find current IP address of domain old-k8s-version-384148 in network mk-old-k8s-version-384148
I0408 12:36:45.246134 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | I0408 12:36:45.245998 427880 retry.go:31] will retry after 811.885095ms: waiting for machine to come up
I0408 12:36:46.059585 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | domain old-k8s-version-384148 has defined MAC address 52:54:00:06:da:95 in network mk-old-k8s-version-384148
I0408 12:36:46.060413 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | unable to find current IP address of domain old-k8s-version-384148 in network mk-old-k8s-version-384148
I0408 12:36:46.060464 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | I0408 12:36:46.060361 427880 retry.go:31] will retry after 940.045894ms: waiting for machine to come up
I0408 12:36:47.001698 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | domain old-k8s-version-384148 has defined MAC address 52:54:00:06:da:95 in network mk-old-k8s-version-384148
I0408 12:36:47.002308 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | unable to find current IP address of domain old-k8s-version-384148 in network mk-old-k8s-version-384148
I0408 12:36:47.002339 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | I0408 12:36:47.002241 427880 retry.go:31] will retry after 1.410862329s: waiting for machine to come up
I0408 12:36:48.414505 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | domain old-k8s-version-384148 has defined MAC address 52:54:00:06:da:95 in network mk-old-k8s-version-384148
I0408 12:36:48.415114 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | unable to find current IP address of domain old-k8s-version-384148 in network mk-old-k8s-version-384148
I0408 12:36:48.415147 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | I0408 12:36:48.415055 427880 retry.go:31] will retry after 1.750440519s: waiting for machine to come up
I0408 12:36:50.167101 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | domain old-k8s-version-384148 has defined MAC address 52:54:00:06:da:95 in network mk-old-k8s-version-384148
I0408 12:36:50.167701 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | unable to find current IP address of domain old-k8s-version-384148 in network mk-old-k8s-version-384148
I0408 12:36:50.167729 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | I0408 12:36:50.167633 427880 retry.go:31] will retry after 1.574388234s: waiting for machine to come up
I0408 12:36:51.743563 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | domain old-k8s-version-384148 has defined MAC address 52:54:00:06:da:95 in network mk-old-k8s-version-384148
I0408 12:36:51.744185 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | unable to find current IP address of domain old-k8s-version-384148 in network mk-old-k8s-version-384148
I0408 12:36:51.744218 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | I0408 12:36:51.744093 427880 retry.go:31] will retry after 2.066042502s: waiting for machine to come up
I0408 12:36:53.811994 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | domain old-k8s-version-384148 has defined MAC address 52:54:00:06:da:95 in network mk-old-k8s-version-384148
I0408 12:36:53.812698 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | unable to find current IP address of domain old-k8s-version-384148 in network mk-old-k8s-version-384148
I0408 12:36:53.812729 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | I0408 12:36:53.812612 427880 retry.go:31] will retry after 3.610461988s: waiting for machine to come up
I0408 12:36:57.424954 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | domain old-k8s-version-384148 has defined MAC address 52:54:00:06:da:95 in network mk-old-k8s-version-384148
I0408 12:36:57.425551 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | unable to find current IP address of domain old-k8s-version-384148 in network mk-old-k8s-version-384148
I0408 12:36:57.425579 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | I0408 12:36:57.425494 427880 retry.go:31] will retry after 3.073515603s: waiting for machine to come up
I0408 12:37:00.501090 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | domain old-k8s-version-384148 has defined MAC address 52:54:00:06:da:95 in network mk-old-k8s-version-384148
I0408 12:37:00.501698 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | unable to find current IP address of domain old-k8s-version-384148 in network mk-old-k8s-version-384148
I0408 12:37:00.501748 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | I0408 12:37:00.501641 427880 retry.go:31] will retry after 5.461813527s: waiting for machine to come up
I0408 12:37:05.968982 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | domain old-k8s-version-384148 has defined MAC address 52:54:00:06:da:95 in network mk-old-k8s-version-384148
I0408 12:37:05.969672 427857 main.go:141] libmachine: (old-k8s-version-384148) Found IP for machine: 192.168.39.245
I0408 12:37:05.969697 427857 main.go:141] libmachine: (old-k8s-version-384148) Reserving static IP address...
I0408 12:37:05.969707 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | domain old-k8s-version-384148 has current primary IP address 192.168.39.245 and MAC address 52:54:00:06:da:95 in network mk-old-k8s-version-384148
I0408 12:37:05.970090 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-384148", mac: "52:54:00:06:da:95", ip: "192.168.39.245"} in network mk-old-k8s-version-384148
I0408 12:37:06.050095 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | Getting to WaitForSSH function...
I0408 12:37:06.050135 427857 main.go:141] libmachine: (old-k8s-version-384148) Reserved static IP address: 192.168.39.245
I0408 12:37:06.050151 427857 main.go:141] libmachine: (old-k8s-version-384148) Waiting for SSH to be available...
I0408 12:37:06.052797 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | domain old-k8s-version-384148 has defined MAC address 52:54:00:06:da:95 in network mk-old-k8s-version-384148
I0408 12:37:06.053179 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:06:da:95", ip: ""} in network mk-old-k8s-version-384148: {Iface:virbr4 ExpiryTime:2024-04-08 13:36:57 +0000 UTC Type:0 Mac:52:54:00:06:da:95 Iaid: IPaddr:192.168.39.245 Prefix:24 Hostname:minikube Clientid:01:52:54:00:06:da:95}
I0408 12:37:06.053210 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | domain old-k8s-version-384148 has defined IP address 192.168.39.245 and MAC address 52:54:00:06:da:95 in network mk-old-k8s-version-384148
I0408 12:37:06.053363 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | Using SSH client type: external
I0408 12:37:06.053396 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | Using SSH private key: /home/jenkins/minikube-integration/18588-368424/.minikube/machines/old-k8s-version-384148/id_rsa (-rw-------)
I0408 12:37:06.053448 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.245 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/18588-368424/.minikube/machines/old-k8s-version-384148/id_rsa -p 22] /usr/bin/ssh <nil>}
I0408 12:37:06.053474 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | About to run SSH command:
I0408 12:37:06.053492 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | exit 0
I0408 12:37:06.184419 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | SSH cmd err, output: <nil>:
I0408 12:37:06.184744 427857 main.go:141] libmachine: (old-k8s-version-384148) KVM machine creation complete!
I0408 12:37:06.185053 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetConfigRaw
I0408 12:37:06.185727 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .DriverName
I0408 12:37:06.185981 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .DriverName
I0408 12:37:06.186271 427857 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0408 12:37:06.186291 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetState
I0408 12:37:06.187955 427857 main.go:141] libmachine: Detecting operating system of created instance...
I0408 12:37:06.187970 427857 main.go:141] libmachine: Waiting for SSH to be available...
I0408 12:37:06.187976 427857 main.go:141] libmachine: Getting to WaitForSSH function...
I0408 12:37:06.187984 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetSSHHostname
I0408 12:37:06.191839 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | domain old-k8s-version-384148 has defined MAC address 52:54:00:06:da:95 in network mk-old-k8s-version-384148
I0408 12:37:06.192236 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:06:da:95", ip: ""} in network mk-old-k8s-version-384148: {Iface:virbr4 ExpiryTime:2024-04-08 13:36:57 +0000 UTC Type:0 Mac:52:54:00:06:da:95 Iaid: IPaddr:192.168.39.245 Prefix:24 Hostname:old-k8s-version-384148 Clientid:01:52:54:00:06:da:95}
I0408 12:37:06.192284 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | domain old-k8s-version-384148 has defined IP address 192.168.39.245 and MAC address 52:54:00:06:da:95 in network mk-old-k8s-version-384148
I0408 12:37:06.192445 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetSSHPort
I0408 12:37:06.192665 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetSSHKeyPath
I0408 12:37:06.192826 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetSSHKeyPath
I0408 12:37:06.193069 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetSSHUsername
I0408 12:37:06.193314 427857 main.go:141] libmachine: Using SSH client type: native
I0408 12:37:06.193608 427857 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil> [] 0s} 192.168.39.245 22 <nil> <nil>}
I0408 12:37:06.193624 427857 main.go:141] libmachine: About to run SSH command:
exit 0
I0408 12:37:06.291256 427857 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0408 12:37:06.291303 427857 main.go:141] libmachine: Detecting the provisioner...
I0408 12:37:06.291314 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetSSHHostname
I0408 12:37:06.294244 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | domain old-k8s-version-384148 has defined MAC address 52:54:00:06:da:95 in network mk-old-k8s-version-384148
I0408 12:37:06.294634 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:06:da:95", ip: ""} in network mk-old-k8s-version-384148: {Iface:virbr4 ExpiryTime:2024-04-08 13:36:57 +0000 UTC Type:0 Mac:52:54:00:06:da:95 Iaid: IPaddr:192.168.39.245 Prefix:24 Hostname:old-k8s-version-384148 Clientid:01:52:54:00:06:da:95}
I0408 12:37:06.294668 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | domain old-k8s-version-384148 has defined IP address 192.168.39.245 and MAC address 52:54:00:06:da:95 in network mk-old-k8s-version-384148
I0408 12:37:06.294853 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetSSHPort
I0408 12:37:06.295053 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetSSHKeyPath
I0408 12:37:06.295280 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetSSHKeyPath
I0408 12:37:06.295456 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetSSHUsername
I0408 12:37:06.295740 427857 main.go:141] libmachine: Using SSH client type: native
I0408 12:37:06.296005 427857 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil> [] 0s} 192.168.39.245 22 <nil> <nil>}
I0408 12:37:06.296022 427857 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0408 12:37:06.400836 427857 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0408 12:37:06.400921 427857 main.go:141] libmachine: found compatible host: buildroot
I0408 12:37:06.400931 427857 main.go:141] libmachine: Provisioning with buildroot...
I0408 12:37:06.400941 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetMachineName
I0408 12:37:06.401255 427857 buildroot.go:166] provisioning hostname "old-k8s-version-384148"
I0408 12:37:06.401286 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetMachineName
I0408 12:37:06.401477 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetSSHHostname
I0408 12:37:06.404242 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | domain old-k8s-version-384148 has defined MAC address 52:54:00:06:da:95 in network mk-old-k8s-version-384148
I0408 12:37:06.404589 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:06:da:95", ip: ""} in network mk-old-k8s-version-384148: {Iface:virbr4 ExpiryTime:2024-04-08 13:36:57 +0000 UTC Type:0 Mac:52:54:00:06:da:95 Iaid: IPaddr:192.168.39.245 Prefix:24 Hostname:old-k8s-version-384148 Clientid:01:52:54:00:06:da:95}
I0408 12:37:06.404611 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | domain old-k8s-version-384148 has defined IP address 192.168.39.245 and MAC address 52:54:00:06:da:95 in network mk-old-k8s-version-384148
I0408 12:37:06.404780 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetSSHPort
I0408 12:37:06.404992 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetSSHKeyPath
I0408 12:37:06.405169 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetSSHKeyPath
I0408 12:37:06.405308 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetSSHUsername
I0408 12:37:06.405501 427857 main.go:141] libmachine: Using SSH client type: native
I0408 12:37:06.405728 427857 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil> [] 0s} 192.168.39.245 22 <nil> <nil>}
I0408 12:37:06.405746 427857 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-384148 && echo "old-k8s-version-384148" | sudo tee /etc/hostname
I0408 12:37:06.519168 427857 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-384148
I0408 12:37:06.519209 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetSSHHostname
I0408 12:37:06.522455 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | domain old-k8s-version-384148 has defined MAC address 52:54:00:06:da:95 in network mk-old-k8s-version-384148
I0408 12:37:06.523009 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:06:da:95", ip: ""} in network mk-old-k8s-version-384148: {Iface:virbr4 ExpiryTime:2024-04-08 13:36:57 +0000 UTC Type:0 Mac:52:54:00:06:da:95 Iaid: IPaddr:192.168.39.245 Prefix:24 Hostname:old-k8s-version-384148 Clientid:01:52:54:00:06:da:95}
I0408 12:37:06.523043 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | domain old-k8s-version-384148 has defined IP address 192.168.39.245 and MAC address 52:54:00:06:da:95 in network mk-old-k8s-version-384148
I0408 12:37:06.523273 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetSSHPort
I0408 12:37:06.523453 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetSSHKeyPath
I0408 12:37:06.523649 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetSSHKeyPath
I0408 12:37:06.523839 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetSSHUsername
I0408 12:37:06.524051 427857 main.go:141] libmachine: Using SSH client type: native
I0408 12:37:06.524307 427857 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil> [] 0s} 192.168.39.245 22 <nil> <nil>}
I0408 12:37:06.524334 427857 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-384148' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-384148/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-384148' | sudo tee -a /etc/hosts;
fi
fi
I0408 12:37:06.634132 427857 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0408 12:37:06.634175 427857 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/18588-368424/.minikube CaCertPath:/home/jenkins/minikube-integration/18588-368424/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18588-368424/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18588-368424/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18588-368424/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18588-368424/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18588-368424/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18588-368424/.minikube}
I0408 12:37:06.634204 427857 buildroot.go:174] setting up certificates
I0408 12:37:06.634223 427857 provision.go:84] configureAuth start
I0408 12:37:06.634243 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetMachineName
I0408 12:37:06.634579 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetIP
I0408 12:37:06.637781 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | domain old-k8s-version-384148 has defined MAC address 52:54:00:06:da:95 in network mk-old-k8s-version-384148
I0408 12:37:06.638174 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:06:da:95", ip: ""} in network mk-old-k8s-version-384148: {Iface:virbr4 ExpiryTime:2024-04-08 13:36:57 +0000 UTC Type:0 Mac:52:54:00:06:da:95 Iaid: IPaddr:192.168.39.245 Prefix:24 Hostname:old-k8s-version-384148 Clientid:01:52:54:00:06:da:95}
I0408 12:37:06.638214 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | domain old-k8s-version-384148 has defined IP address 192.168.39.245 and MAC address 52:54:00:06:da:95 in network mk-old-k8s-version-384148
I0408 12:37:06.638343 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetSSHHostname
I0408 12:37:06.640612 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | domain old-k8s-version-384148 has defined MAC address 52:54:00:06:da:95 in network mk-old-k8s-version-384148
I0408 12:37:06.641037 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:06:da:95", ip: ""} in network mk-old-k8s-version-384148: {Iface:virbr4 ExpiryTime:2024-04-08 13:36:57 +0000 UTC Type:0 Mac:52:54:00:06:da:95 Iaid: IPaddr:192.168.39.245 Prefix:24 Hostname:old-k8s-version-384148 Clientid:01:52:54:00:06:da:95}
I0408 12:37:06.641075 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | domain old-k8s-version-384148 has defined IP address 192.168.39.245 and MAC address 52:54:00:06:da:95 in network mk-old-k8s-version-384148
I0408 12:37:06.641262 427857 provision.go:143] copyHostCerts
I0408 12:37:06.641344 427857 exec_runner.go:144] found /home/jenkins/minikube-integration/18588-368424/.minikube/ca.pem, removing ...
I0408 12:37:06.641380 427857 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18588-368424/.minikube/ca.pem
I0408 12:37:06.641467 427857 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18588-368424/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18588-368424/.minikube/ca.pem (1082 bytes)
I0408 12:37:06.641595 427857 exec_runner.go:144] found /home/jenkins/minikube-integration/18588-368424/.minikube/cert.pem, removing ...
I0408 12:37:06.641608 427857 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18588-368424/.minikube/cert.pem
I0408 12:37:06.641644 427857 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18588-368424/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18588-368424/.minikube/cert.pem (1123 bytes)
I0408 12:37:06.641838 427857 exec_runner.go:144] found /home/jenkins/minikube-integration/18588-368424/.minikube/key.pem, removing ...
I0408 12:37:06.641864 427857 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18588-368424/.minikube/key.pem
I0408 12:37:06.641931 427857 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18588-368424/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18588-368424/.minikube/key.pem (1675 bytes)
I0408 12:37:06.642027 427857 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18588-368424/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18588-368424/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18588-368424/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-384148 san=[127.0.0.1 192.168.39.245 localhost minikube old-k8s-version-384148]
I0408 12:37:06.962159 427857 provision.go:177] copyRemoteCerts
I0408 12:37:06.962227 427857 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0408 12:37:06.962282 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetSSHHostname
I0408 12:37:06.965196 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | domain old-k8s-version-384148 has defined MAC address 52:54:00:06:da:95 in network mk-old-k8s-version-384148
I0408 12:37:06.965499 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:06:da:95", ip: ""} in network mk-old-k8s-version-384148: {Iface:virbr4 ExpiryTime:2024-04-08 13:36:57 +0000 UTC Type:0 Mac:52:54:00:06:da:95 Iaid: IPaddr:192.168.39.245 Prefix:24 Hostname:old-k8s-version-384148 Clientid:01:52:54:00:06:da:95}
I0408 12:37:06.965526 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | domain old-k8s-version-384148 has defined IP address 192.168.39.245 and MAC address 52:54:00:06:da:95 in network mk-old-k8s-version-384148
I0408 12:37:06.965701 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetSSHPort
I0408 12:37:06.965985 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetSSHKeyPath
I0408 12:37:06.966142 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetSSHUsername
I0408 12:37:06.966275 427857 sshutil.go:53] new ssh client: &{IP:192.168.39.245 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18588-368424/.minikube/machines/old-k8s-version-384148/id_rsa Username:docker}
I0408 12:37:07.046605 427857 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18588-368424/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0408 12:37:07.073461 427857 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18588-368424/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0408 12:37:07.102841 427857 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18588-368424/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0408 12:37:07.130954 427857 provision.go:87] duration metric: took 496.70594ms to configureAuth
I0408 12:37:07.130994 427857 buildroot.go:189] setting minikube options for container-runtime
I0408 12:37:07.131176 427857 config.go:182] Loaded profile config "old-k8s-version-384148": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0408 12:37:07.131260 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetSSHHostname
I0408 12:37:07.134020 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | domain old-k8s-version-384148 has defined MAC address 52:54:00:06:da:95 in network mk-old-k8s-version-384148
I0408 12:37:07.134341 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:06:da:95", ip: ""} in network mk-old-k8s-version-384148: {Iface:virbr4 ExpiryTime:2024-04-08 13:36:57 +0000 UTC Type:0 Mac:52:54:00:06:da:95 Iaid: IPaddr:192.168.39.245 Prefix:24 Hostname:old-k8s-version-384148 Clientid:01:52:54:00:06:da:95}
I0408 12:37:07.134383 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | domain old-k8s-version-384148 has defined IP address 192.168.39.245 and MAC address 52:54:00:06:da:95 in network mk-old-k8s-version-384148
I0408 12:37:07.134579 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetSSHPort
I0408 12:37:07.134816 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetSSHKeyPath
I0408 12:37:07.134986 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetSSHKeyPath
I0408 12:37:07.135158 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetSSHUsername
I0408 12:37:07.135308 427857 main.go:141] libmachine: Using SSH client type: native
I0408 12:37:07.135521 427857 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil> [] 0s} 192.168.39.245 22 <nil> <nil>}
I0408 12:37:07.135549 427857 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0408 12:37:07.425784 427857 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0408 12:37:07.425819 427857 main.go:141] libmachine: Checking connection to Docker...
I0408 12:37:07.425830 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetURL
I0408 12:37:07.427206 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | Using libvirt version 6000000
I0408 12:37:07.429616 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | domain old-k8s-version-384148 has defined MAC address 52:54:00:06:da:95 in network mk-old-k8s-version-384148
I0408 12:37:07.429966 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:06:da:95", ip: ""} in network mk-old-k8s-version-384148: {Iface:virbr4 ExpiryTime:2024-04-08 13:36:57 +0000 UTC Type:0 Mac:52:54:00:06:da:95 Iaid: IPaddr:192.168.39.245 Prefix:24 Hostname:old-k8s-version-384148 Clientid:01:52:54:00:06:da:95}
I0408 12:37:07.429995 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | domain old-k8s-version-384148 has defined IP address 192.168.39.245 and MAC address 52:54:00:06:da:95 in network mk-old-k8s-version-384148
I0408 12:37:07.430223 427857 main.go:141] libmachine: Docker is up and running!
I0408 12:37:07.430237 427857 main.go:141] libmachine: Reticulating splines...
I0408 12:37:07.430245 427857 client.go:171] duration metric: took 26.448996743s to LocalClient.Create
I0408 12:37:07.430272 427857 start.go:167] duration metric: took 26.449083043s to libmachine.API.Create "old-k8s-version-384148"
I0408 12:37:07.430285 427857 start.go:293] postStartSetup for "old-k8s-version-384148" (driver="kvm2")
I0408 12:37:07.430313 427857 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0408 12:37:07.430333 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .DriverName
I0408 12:37:07.430649 427857 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0408 12:37:07.430679 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetSSHHostname
I0408 12:37:07.433586 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | domain old-k8s-version-384148 has defined MAC address 52:54:00:06:da:95 in network mk-old-k8s-version-384148
I0408 12:37:07.434016 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:06:da:95", ip: ""} in network mk-old-k8s-version-384148: {Iface:virbr4 ExpiryTime:2024-04-08 13:36:57 +0000 UTC Type:0 Mac:52:54:00:06:da:95 Iaid: IPaddr:192.168.39.245 Prefix:24 Hostname:old-k8s-version-384148 Clientid:01:52:54:00:06:da:95}
I0408 12:37:07.434048 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | domain old-k8s-version-384148 has defined IP address 192.168.39.245 and MAC address 52:54:00:06:da:95 in network mk-old-k8s-version-384148
I0408 12:37:07.434221 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetSSHPort
I0408 12:37:07.434453 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetSSHKeyPath
I0408 12:37:07.434646 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetSSHUsername
I0408 12:37:07.434760 427857 sshutil.go:53] new ssh client: &{IP:192.168.39.245 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18588-368424/.minikube/machines/old-k8s-version-384148/id_rsa Username:docker}
I0408 12:37:07.522920 427857 ssh_runner.go:195] Run: cat /etc/os-release
I0408 12:37:07.527774 427857 info.go:137] Remote host: Buildroot 2023.02.9
I0408 12:37:07.527803 427857 filesync.go:126] Scanning /home/jenkins/minikube-integration/18588-368424/.minikube/addons for local assets ...
I0408 12:37:07.527859 427857 filesync.go:126] Scanning /home/jenkins/minikube-integration/18588-368424/.minikube/files for local assets ...
I0408 12:37:07.527943 427857 filesync.go:149] local asset: /home/jenkins/minikube-integration/18588-368424/.minikube/files/etc/ssl/certs/3758172.pem -> 3758172.pem in /etc/ssl/certs
I0408 12:37:07.528047 427857 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0408 12:37:07.538199 427857 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18588-368424/.minikube/files/etc/ssl/certs/3758172.pem --> /etc/ssl/certs/3758172.pem (1708 bytes)
I0408 12:37:07.564982 427857 start.go:296] duration metric: took 134.67889ms for postStartSetup
I0408 12:37:07.565051 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetConfigRaw
I0408 12:37:07.565757 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetIP
I0408 12:37:07.568926 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | domain old-k8s-version-384148 has defined MAC address 52:54:00:06:da:95 in network mk-old-k8s-version-384148
I0408 12:37:07.569330 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:06:da:95", ip: ""} in network mk-old-k8s-version-384148: {Iface:virbr4 ExpiryTime:2024-04-08 13:36:57 +0000 UTC Type:0 Mac:52:54:00:06:da:95 Iaid: IPaddr:192.168.39.245 Prefix:24 Hostname:old-k8s-version-384148 Clientid:01:52:54:00:06:da:95}
I0408 12:37:07.569359 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | domain old-k8s-version-384148 has defined IP address 192.168.39.245 and MAC address 52:54:00:06:da:95 in network mk-old-k8s-version-384148
I0408 12:37:07.569643 427857 profile.go:143] Saving config to /home/jenkins/minikube-integration/18588-368424/.minikube/profiles/old-k8s-version-384148/config.json ...
I0408 12:37:07.569909 427857 start.go:128] duration metric: took 26.611180267s to createHost
I0408 12:37:07.569955 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetSSHHostname
I0408 12:37:07.572306 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | domain old-k8s-version-384148 has defined MAC address 52:54:00:06:da:95 in network mk-old-k8s-version-384148
I0408 12:37:07.572644 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:06:da:95", ip: ""} in network mk-old-k8s-version-384148: {Iface:virbr4 ExpiryTime:2024-04-08 13:36:57 +0000 UTC Type:0 Mac:52:54:00:06:da:95 Iaid: IPaddr:192.168.39.245 Prefix:24 Hostname:old-k8s-version-384148 Clientid:01:52:54:00:06:da:95}
I0408 12:37:07.572666 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | domain old-k8s-version-384148 has defined IP address 192.168.39.245 and MAC address 52:54:00:06:da:95 in network mk-old-k8s-version-384148
I0408 12:37:07.572853 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetSSHPort
I0408 12:37:07.573072 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetSSHKeyPath
I0408 12:37:07.573290 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetSSHKeyPath
I0408 12:37:07.573433 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetSSHUsername
I0408 12:37:07.573558 427857 main.go:141] libmachine: Using SSH client type: native
I0408 12:37:07.573729 427857 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil> [] 0s} 192.168.39.245 22 <nil> <nil>}
I0408 12:37:07.573753 427857 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0408 12:37:07.676909 427857 main.go:141] libmachine: SSH cmd err, output: <nil>: 1712579827.661479819
I0408 12:37:07.676938 427857 fix.go:216] guest clock: 1712579827.661479819
I0408 12:37:07.676948 427857 fix.go:229] Guest: 2024-04-08 12:37:07.661479819 +0000 UTC Remote: 2024-04-08 12:37:07.569936836 +0000 UTC m=+26.756682625 (delta=91.542983ms)
I0408 12:37:07.676991 427857 fix.go:200] guest clock delta is within tolerance: 91.542983ms
I0408 12:37:07.676999 427857 start.go:83] releasing machines lock for "old-k8s-version-384148", held for 26.71840661s
I0408 12:37:07.677034 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .DriverName
I0408 12:37:07.677359 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetIP
I0408 12:37:07.680284 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | domain old-k8s-version-384148 has defined MAC address 52:54:00:06:da:95 in network mk-old-k8s-version-384148
I0408 12:37:07.680565 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:06:da:95", ip: ""} in network mk-old-k8s-version-384148: {Iface:virbr4 ExpiryTime:2024-04-08 13:36:57 +0000 UTC Type:0 Mac:52:54:00:06:da:95 Iaid: IPaddr:192.168.39.245 Prefix:24 Hostname:old-k8s-version-384148 Clientid:01:52:54:00:06:da:95}
I0408 12:37:07.680596 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | domain old-k8s-version-384148 has defined IP address 192.168.39.245 and MAC address 52:54:00:06:da:95 in network mk-old-k8s-version-384148
I0408 12:37:07.680818 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .DriverName
I0408 12:37:07.684125 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .DriverName
I0408 12:37:07.684351 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .DriverName
I0408 12:37:07.684442 427857 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0408 12:37:07.684515 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetSSHHostname
I0408 12:37:07.684591 427857 ssh_runner.go:195] Run: cat /version.json
I0408 12:37:07.684617 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetSSHHostname
I0408 12:37:07.687215 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | domain old-k8s-version-384148 has defined MAC address 52:54:00:06:da:95 in network mk-old-k8s-version-384148
I0408 12:37:07.687279 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | domain old-k8s-version-384148 has defined MAC address 52:54:00:06:da:95 in network mk-old-k8s-version-384148
I0408 12:37:07.687643 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:06:da:95", ip: ""} in network mk-old-k8s-version-384148: {Iface:virbr4 ExpiryTime:2024-04-08 13:36:57 +0000 UTC Type:0 Mac:52:54:00:06:da:95 Iaid: IPaddr:192.168.39.245 Prefix:24 Hostname:old-k8s-version-384148 Clientid:01:52:54:00:06:da:95}
I0408 12:37:07.687674 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | domain old-k8s-version-384148 has defined IP address 192.168.39.245 and MAC address 52:54:00:06:da:95 in network mk-old-k8s-version-384148
I0408 12:37:07.687721 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:06:da:95", ip: ""} in network mk-old-k8s-version-384148: {Iface:virbr4 ExpiryTime:2024-04-08 13:36:57 +0000 UTC Type:0 Mac:52:54:00:06:da:95 Iaid: IPaddr:192.168.39.245 Prefix:24 Hostname:old-k8s-version-384148 Clientid:01:52:54:00:06:da:95}
I0408 12:37:07.687764 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | domain old-k8s-version-384148 has defined IP address 192.168.39.245 and MAC address 52:54:00:06:da:95 in network mk-old-k8s-version-384148
I0408 12:37:07.687871 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetSSHPort
I0408 12:37:07.688070 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetSSHKeyPath
I0408 12:37:07.688106 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetSSHPort
I0408 12:37:07.688284 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetSSHKeyPath
I0408 12:37:07.688292 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetSSHUsername
I0408 12:37:07.688486 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetSSHUsername
I0408 12:37:07.688482 427857 sshutil.go:53] new ssh client: &{IP:192.168.39.245 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18588-368424/.minikube/machines/old-k8s-version-384148/id_rsa Username:docker}
I0408 12:37:07.688627 427857 sshutil.go:53] new ssh client: &{IP:192.168.39.245 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18588-368424/.minikube/machines/old-k8s-version-384148/id_rsa Username:docker}
I0408 12:37:07.806264 427857 ssh_runner.go:195] Run: systemctl --version
I0408 12:37:07.815797 427857 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0408 12:37:07.985625 427857 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0408 12:37:07.992407 427857 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0408 12:37:07.992475 427857 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0408 12:37:08.019674 427857 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0408 12:37:08.019715 427857 start.go:494] detecting cgroup driver to use...
I0408 12:37:08.019808 427857 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0408 12:37:08.047212 427857 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0408 12:37:08.065153 427857 docker.go:217] disabling cri-docker service (if available) ...
I0408 12:37:08.065230 427857 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0408 12:37:08.084092 427857 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0408 12:37:08.101065 427857 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0408 12:37:08.242982 427857 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0408 12:37:08.396323 427857 docker.go:233] disabling docker service ...
I0408 12:37:08.396386 427857 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0408 12:37:08.417263 427857 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0408 12:37:08.432215 427857 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0408 12:37:08.583200 427857 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0408 12:37:08.753546 427857 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0408 12:37:08.770006 427857 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0408 12:37:08.793679 427857 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0408 12:37:08.793755 427857 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0408 12:37:08.806953 427857 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0408 12:37:08.807047 427857 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0408 12:37:08.821115 427857 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0408 12:37:08.837375 427857 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0408 12:37:08.853929 427857 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0408 12:37:08.869693 427857 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0408 12:37:08.883029 427857 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0408 12:37:08.883109 427857 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0408 12:37:08.904682 427857 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0408 12:37:08.916518 427857 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0408 12:37:09.075999 427857 ssh_runner.go:195] Run: sudo systemctl restart crio
I0408 12:37:09.257481 427857 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0408 12:37:09.257563 427857 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0408 12:37:09.264128 427857 start.go:562] Will wait 60s for crictl version
I0408 12:37:09.264205 427857 ssh_runner.go:195] Run: which crictl
I0408 12:37:09.270084 427857 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0408 12:37:09.314688 427857 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0408 12:37:09.314784 427857 ssh_runner.go:195] Run: crio --version
I0408 12:37:09.348727 427857 ssh_runner.go:195] Run: crio --version
I0408 12:37:09.389330 427857 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0408 12:37:09.390734 427857 main.go:141] libmachine: (old-k8s-version-384148) Calling .GetIP
I0408 12:37:09.394401 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | domain old-k8s-version-384148 has defined MAC address 52:54:00:06:da:95 in network mk-old-k8s-version-384148
I0408 12:37:09.394941 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:06:da:95", ip: ""} in network mk-old-k8s-version-384148: {Iface:virbr4 ExpiryTime:2024-04-08 13:36:57 +0000 UTC Type:0 Mac:52:54:00:06:da:95 Iaid: IPaddr:192.168.39.245 Prefix:24 Hostname:old-k8s-version-384148 Clientid:01:52:54:00:06:da:95}
I0408 12:37:09.394998 427857 main.go:141] libmachine: (old-k8s-version-384148) DBG | domain old-k8s-version-384148 has defined IP address 192.168.39.245 and MAC address 52:54:00:06:da:95 in network mk-old-k8s-version-384148
I0408 12:37:09.395239 427857 ssh_runner.go:195] Run: grep 192.168.39.1 host.minikube.internal$ /etc/hosts
I0408 12:37:09.400150 427857 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0408 12:37:09.416497 427857 kubeadm.go:877] updating cluster {Name:old-k8s-version-384148 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18566/minikube-v1.33.0-1712138767-18566-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1712138838-18566@sha256:a1b6bbc384c0914baa698cc91ccedcb662b3c0986082ff16cc623c5d83216034 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-384148 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.245 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] M
ountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0408 12:37:09.416644 427857 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0408 12:37:09.416717 427857 ssh_runner.go:195] Run: sudo crictl images --output json
I0408 12:37:09.464939 427857 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0408 12:37:09.465025 427857 ssh_runner.go:195] Run: which lz4
I0408 12:37:09.470089 427857 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0408 12:37:09.477942 427857 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0408 12:37:09.478003 427857 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18588-368424/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0408 12:37:11.475839 427857 crio.go:462] duration metric: took 2.005762609s to copy over tarball
I0408 12:37:11.475972 427857 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0408 12:37:14.514832 427857 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (3.038822794s)
I0408 12:37:14.514873 427857 crio.go:469] duration metric: took 3.03899703s to extract the tarball
I0408 12:37:14.514886 427857 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0408 12:37:14.562209 427857 ssh_runner.go:195] Run: sudo crictl images --output json
I0408 12:37:14.620287 427857 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0408 12:37:14.620315 427857 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0408 12:37:14.620404 427857 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0408 12:37:14.620423 427857 image.go:134] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0408 12:37:14.620436 427857 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0408 12:37:14.620474 427857 image.go:134] retrieving image: registry.k8s.io/pause:3.2
I0408 12:37:14.620544 427857 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0408 12:37:14.620482 427857 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0408 12:37:14.620438 427857 image.go:134] retrieving image: registry.k8s.io/coredns:1.7.0
I0408 12:37:14.620933 427857 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0408 12:37:14.621890 427857 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0408 12:37:14.621920 427857 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0408 12:37:14.622197 427857 image.go:177] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0408 12:37:14.622198 427857 image.go:177] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0408 12:37:14.622207 427857 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0408 12:37:14.622279 427857 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0408 12:37:14.622384 427857 image.go:177] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0408 12:37:14.622477 427857 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0408 12:37:14.845508 427857 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0408 12:37:14.855989 427857 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0408 12:37:14.857338 427857 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0408 12:37:14.862269 427857 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0408 12:37:14.863958 427857 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0408 12:37:14.873446 427857 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0408 12:37:14.879222 427857 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0408 12:37:14.961775 427857 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0408 12:37:14.961842 427857 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0408 12:37:14.961903 427857 ssh_runner.go:195] Run: which crictl
I0408 12:37:14.963572 427857 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0408 12:37:14.963622 427857 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0408 12:37:14.963670 427857 ssh_runner.go:195] Run: which crictl
I0408 12:37:15.040035 427857 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0408 12:37:15.040086 427857 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0408 12:37:15.040131 427857 ssh_runner.go:195] Run: which crictl
I0408 12:37:15.056709 427857 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0408 12:37:15.056769 427857 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0408 12:37:15.056832 427857 ssh_runner.go:195] Run: which crictl
I0408 12:37:15.076748 427857 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0408 12:37:15.076797 427857 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0408 12:37:15.076802 427857 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0408 12:37:15.076834 427857 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0408 12:37:15.076848 427857 ssh_runner.go:195] Run: which crictl
I0408 12:37:15.076857 427857 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0408 12:37:15.076834 427857 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0408 12:37:15.076899 427857 ssh_runner.go:195] Run: which crictl
I0408 12:37:15.076910 427857 ssh_runner.go:195] Run: which crictl
I0408 12:37:15.076911 427857 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0408 12:37:15.076940 427857 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0408 12:37:15.076982 427857 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0408 12:37:15.077007 427857 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0408 12:37:15.081528 427857 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0408 12:37:15.164784 427857 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18588-368424/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0408 12:37:15.164859 427857 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0408 12:37:15.209138 427857 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0408 12:37:15.209193 427857 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18588-368424/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0408 12:37:15.209219 427857 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18588-368424/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0408 12:37:15.209293 427857 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18588-368424/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0408 12:37:15.209295 427857 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18588-368424/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0408 12:37:15.230321 427857 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18588-368424/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0408 12:37:15.255579 427857 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18588-368424/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0408 12:37:15.504235 427857 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0408 12:37:15.654550 427857 cache_images.go:92] duration metric: took 1.034214764s to LoadCachedImages
W0408 12:37:15.654659 427857 out.go:239] X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/18588-368424/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0: no such file or directory
X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/18588-368424/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0: no such file or directory
I0408 12:37:15.654680 427857 kubeadm.go:928] updating node { 192.168.39.245 8443 v1.20.0 crio true true} ...
I0408 12:37:15.654840 427857 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-384148 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.39.245
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-384148 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0408 12:37:15.654953 427857 ssh_runner.go:195] Run: crio config
I0408 12:37:15.710377 427857 cni.go:84] Creating CNI manager for ""
I0408 12:37:15.710406 427857 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0408 12:37:15.710421 427857 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0408 12:37:15.710440 427857 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.245 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-384148 NodeName:old-k8s-version-384148 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.245"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.245 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0408 12:37:15.710597 427857 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.39.245
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-384148"
kubeletExtraArgs:
node-ip: 192.168.39.245
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.39.245"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0408 12:37:15.710700 427857 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0408 12:37:15.722565 427857 binaries.go:44] Found k8s binaries, skipping transfer
I0408 12:37:15.722654 427857 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0408 12:37:15.734077 427857 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0408 12:37:15.753816 427857 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0408 12:37:15.776837 427857 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2123 bytes)
I0408 12:37:15.796664 427857 ssh_runner.go:195] Run: grep 192.168.39.245 control-plane.minikube.internal$ /etc/hosts
I0408 12:37:15.801300 427857 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.245 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0408 12:37:15.815331 427857 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0408 12:37:15.959779 427857 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0408 12:37:16.047536 427857 certs.go:68] Setting up /home/jenkins/minikube-integration/18588-368424/.minikube/profiles/old-k8s-version-384148 for IP: 192.168.39.245
I0408 12:37:16.047567 427857 certs.go:194] generating shared ca certs ...
I0408 12:37:16.047589 427857 certs.go:226] acquiring lock for ca certs: {Name:mk437f743d6bdec5f37197e2e8bf0fd46f91f62e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0408 12:37:16.047893 427857 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/18588-368424/.minikube/ca.key
I0408 12:37:16.047989 427857 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/18588-368424/.minikube/proxy-client-ca.key
I0408 12:37:16.048007 427857 certs.go:256] generating profile certs ...
I0408 12:37:16.048100 427857 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/18588-368424/.minikube/profiles/old-k8s-version-384148/client.key
I0408 12:37:16.048129 427857 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18588-368424/.minikube/profiles/old-k8s-version-384148/client.crt with IP's: []
I0408 12:37:16.597439 427857 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18588-368424/.minikube/profiles/old-k8s-version-384148/client.crt ...
I0408 12:37:16.597479 427857 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18588-368424/.minikube/profiles/old-k8s-version-384148/client.crt: {Name:mkbd9ea82a6cd666f29931f10aa38dd0f6cd46ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0408 12:37:16.597675 427857 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18588-368424/.minikube/profiles/old-k8s-version-384148/client.key ...
I0408 12:37:16.597694 427857 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18588-368424/.minikube/profiles/old-k8s-version-384148/client.key: {Name:mkbf40c6f4a2d1dd392be5aacb14f587861a0057 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0408 12:37:16.597801 427857 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/18588-368424/.minikube/profiles/old-k8s-version-384148/apiserver.key.b153d6a1
I0408 12:37:16.597824 427857 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18588-368424/.minikube/profiles/old-k8s-version-384148/apiserver.crt.b153d6a1 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.245]
I0408 12:37:16.732869 427857 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18588-368424/.minikube/profiles/old-k8s-version-384148/apiserver.crt.b153d6a1 ...
I0408 12:37:16.732900 427857 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18588-368424/.minikube/profiles/old-k8s-version-384148/apiserver.crt.b153d6a1: {Name:mk0cc72a128492f6574332a7f9b12c9d2fd13036 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0408 12:37:16.733087 427857 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18588-368424/.minikube/profiles/old-k8s-version-384148/apiserver.key.b153d6a1 ...
I0408 12:37:16.733105 427857 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18588-368424/.minikube/profiles/old-k8s-version-384148/apiserver.key.b153d6a1: {Name:mk3352b132cc32fb8914e346a0480aac8fea5099 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0408 12:37:16.733207 427857 certs.go:381] copying /home/jenkins/minikube-integration/18588-368424/.minikube/profiles/old-k8s-version-384148/apiserver.crt.b153d6a1 -> /home/jenkins/minikube-integration/18588-368424/.minikube/profiles/old-k8s-version-384148/apiserver.crt
I0408 12:37:16.733331 427857 certs.go:385] copying /home/jenkins/minikube-integration/18588-368424/.minikube/profiles/old-k8s-version-384148/apiserver.key.b153d6a1 -> /home/jenkins/minikube-integration/18588-368424/.minikube/profiles/old-k8s-version-384148/apiserver.key
I0408 12:37:16.733417 427857 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/18588-368424/.minikube/profiles/old-k8s-version-384148/proxy-client.key
I0408 12:37:16.733440 427857 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18588-368424/.minikube/profiles/old-k8s-version-384148/proxy-client.crt with IP's: []
I0408 12:37:16.855983 427857 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18588-368424/.minikube/profiles/old-k8s-version-384148/proxy-client.crt ...
I0408 12:37:16.856023 427857 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18588-368424/.minikube/profiles/old-k8s-version-384148/proxy-client.crt: {Name:mk6f9a4afa9e885b2e6ada5e55785cba45ffa0ee Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0408 12:37:16.856214 427857 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18588-368424/.minikube/profiles/old-k8s-version-384148/proxy-client.key ...
I0408 12:37:16.856232 427857 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18588-368424/.minikube/profiles/old-k8s-version-384148/proxy-client.key: {Name:mk11808c2213b7d7d1bf671e4654182ee87a2d55 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0408 12:37:16.856455 427857 certs.go:484] found cert: /home/jenkins/minikube-integration/18588-368424/.minikube/certs/375817.pem (1338 bytes)
W0408 12:37:16.856512 427857 certs.go:480] ignoring /home/jenkins/minikube-integration/18588-368424/.minikube/certs/375817_empty.pem, impossibly tiny 0 bytes
I0408 12:37:16.856533 427857 certs.go:484] found cert: /home/jenkins/minikube-integration/18588-368424/.minikube/certs/ca-key.pem (1679 bytes)
I0408 12:37:16.856568 427857 certs.go:484] found cert: /home/jenkins/minikube-integration/18588-368424/.minikube/certs/ca.pem (1082 bytes)
I0408 12:37:16.856602 427857 certs.go:484] found cert: /home/jenkins/minikube-integration/18588-368424/.minikube/certs/cert.pem (1123 bytes)
I0408 12:37:16.856635 427857 certs.go:484] found cert: /home/jenkins/minikube-integration/18588-368424/.minikube/certs/key.pem (1675 bytes)
I0408 12:37:16.856698 427857 certs.go:484] found cert: /home/jenkins/minikube-integration/18588-368424/.minikube/files/etc/ssl/certs/3758172.pem (1708 bytes)
I0408 12:37:16.857345 427857 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18588-368424/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0408 12:37:16.892207 427857 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18588-368424/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0408 12:37:16.928004 427857 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18588-368424/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0408 12:37:16.964797 427857 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18588-368424/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0408 12:37:17.004861 427857 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18588-368424/.minikube/profiles/old-k8s-version-384148/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0408 12:37:17.036124 427857 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18588-368424/.minikube/profiles/old-k8s-version-384148/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0408 12:37:17.063228 427857 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18588-368424/.minikube/profiles/old-k8s-version-384148/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0408 12:37:17.098776 427857 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18588-368424/.minikube/profiles/old-k8s-version-384148/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0408 12:37:17.133349 427857 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18588-368424/.minikube/certs/375817.pem --> /usr/share/ca-certificates/375817.pem (1338 bytes)
I0408 12:37:17.167704 427857 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18588-368424/.minikube/files/etc/ssl/certs/3758172.pem --> /usr/share/ca-certificates/3758172.pem (1708 bytes)
I0408 12:37:17.202324 427857 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18588-368424/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0408 12:37:17.234653 427857 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (752 bytes)
I0408 12:37:17.258813 427857 ssh_runner.go:195] Run: openssl version
I0408 12:37:17.266813 427857 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0408 12:37:17.281123 427857 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0408 12:37:17.286503 427857 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Apr 8 11:21 /usr/share/ca-certificates/minikubeCA.pem
I0408 12:37:17.286598 427857 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0408 12:37:17.293160 427857 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0408 12:37:17.309484 427857 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/375817.pem && ln -fs /usr/share/ca-certificates/375817.pem /etc/ssl/certs/375817.pem"
I0408 12:37:17.324827 427857 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/375817.pem
I0408 12:37:17.332278 427857 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Apr 8 11:30 /usr/share/ca-certificates/375817.pem
I0408 12:37:17.332353 427857 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/375817.pem
I0408 12:37:17.340768 427857 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/375817.pem /etc/ssl/certs/51391683.0"
I0408 12:37:17.357450 427857 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/3758172.pem && ln -fs /usr/share/ca-certificates/3758172.pem /etc/ssl/certs/3758172.pem"
I0408 12:37:17.373556 427857 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/3758172.pem
I0408 12:37:17.380620 427857 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Apr 8 11:30 /usr/share/ca-certificates/3758172.pem
I0408 12:37:17.380701 427857 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/3758172.pem
I0408 12:37:17.388916 427857 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/3758172.pem /etc/ssl/certs/3ec20f2e.0"
I0408 12:37:17.403901 427857 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0408 12:37:17.409743 427857 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0408 12:37:17.409806 427857 kubeadm.go:391] StartCluster: {Name:old-k8s-version-384148 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18566/minikube-v1.33.0-1712138767-18566-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1712138838-18566@sha256:a1b6bbc384c0914baa698cc91ccedcb662b3c0986082ff16cc623c5d83216034 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-384148 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.245 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Moun
tPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0408 12:37:17.409923 427857 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0408 12:37:17.410090 427857 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0408 12:37:17.455602 427857 cri.go:89] found id: ""
I0408 12:37:17.455721 427857 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0408 12:37:17.469952 427857 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0408 12:37:17.484433 427857 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0408 12:37:17.495741 427857 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0408 12:37:17.495770 427857 kubeadm.go:156] found existing configuration files:
I0408 12:37:17.495830 427857 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0408 12:37:17.508488 427857 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0408 12:37:17.508586 427857 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0408 12:37:17.519716 427857 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0408 12:37:17.529471 427857 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0408 12:37:17.529556 427857 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0408 12:37:17.539716 427857 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0408 12:37:17.549755 427857 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0408 12:37:17.549836 427857 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0408 12:37:17.563404 427857 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0408 12:37:17.574746 427857 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0408 12:37:17.574822 427857 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0408 12:37:17.586301 427857 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0408 12:37:17.789342 427857 kubeadm.go:309] [init] Using Kubernetes version: v1.20.0
I0408 12:37:17.789428 427857 kubeadm.go:309] [preflight] Running pre-flight checks
I0408 12:37:17.974672 427857 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0408 12:37:17.974825 427857 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0408 12:37:17.974988 427857 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0408 12:37:18.199712 427857 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0408 12:37:18.201803 427857 out.go:204] - Generating certificates and keys ...
I0408 12:37:18.201922 427857 kubeadm.go:309] [certs] Using existing ca certificate authority
I0408 12:37:18.202007 427857 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0408 12:37:18.741593 427857 kubeadm.go:309] [certs] Generating "apiserver-kubelet-client" certificate and key
I0408 12:37:18.915142 427857 kubeadm.go:309] [certs] Generating "front-proxy-ca" certificate and key
I0408 12:37:18.981888 427857 kubeadm.go:309] [certs] Generating "front-proxy-client" certificate and key
I0408 12:37:19.092993 427857 kubeadm.go:309] [certs] Generating "etcd/ca" certificate and key
I0408 12:37:19.393290 427857 kubeadm.go:309] [certs] Generating "etcd/server" certificate and key
I0408 12:37:19.398333 427857 kubeadm.go:309] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-384148] and IPs [192.168.39.245 127.0.0.1 ::1]
I0408 12:37:19.518743 427857 kubeadm.go:309] [certs] Generating "etcd/peer" certificate and key
I0408 12:37:19.519273 427857 kubeadm.go:309] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-384148] and IPs [192.168.39.245 127.0.0.1 ::1]
I0408 12:37:19.731332 427857 kubeadm.go:309] [certs] Generating "etcd/healthcheck-client" certificate and key
I0408 12:37:19.828468 427857 kubeadm.go:309] [certs] Generating "apiserver-etcd-client" certificate and key
I0408 12:37:19.918967 427857 kubeadm.go:309] [certs] Generating "sa" key and public key
I0408 12:37:19.919182 427857 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0408 12:37:20.050224 427857 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0408 12:37:20.304337 427857 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0408 12:37:20.536350 427857 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0408 12:37:20.648576 427857 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0408 12:37:20.673858 427857 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0408 12:37:20.675143 427857 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0408 12:37:20.675214 427857 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0408 12:37:20.889069 427857 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0408 12:37:20.890979 427857 out.go:204] - Booting up control plane ...
I0408 12:37:20.891130 427857 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0408 12:37:20.912279 427857 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0408 12:37:20.914422 427857 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0408 12:37:20.916017 427857 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0408 12:37:20.924317 427857 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0408 12:38:00.922955 427857 kubeadm.go:309] [kubelet-check] Initial timeout of 40s passed.
I0408 12:38:00.923096 427857 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0408 12:38:00.923360 427857 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0408 12:38:05.923958 427857 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0408 12:38:05.924135 427857 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0408 12:38:15.925162 427857 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0408 12:38:15.925365 427857 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0408 12:38:35.926748 427857 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0408 12:38:35.927017 427857 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0408 12:39:15.926789 427857 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0408 12:39:15.927097 427857 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0408 12:39:15.927141 427857 kubeadm.go:309]
I0408 12:39:15.927218 427857 kubeadm.go:309] Unfortunately, an error has occurred:
I0408 12:39:15.927290 427857 kubeadm.go:309] timed out waiting for the condition
I0408 12:39:15.927309 427857 kubeadm.go:309]
I0408 12:39:15.927344 427857 kubeadm.go:309] This error is likely caused by:
I0408 12:39:15.927388 427857 kubeadm.go:309] - The kubelet is not running
I0408 12:39:15.927535 427857 kubeadm.go:309] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0408 12:39:15.927548 427857 kubeadm.go:309]
I0408 12:39:15.927786 427857 kubeadm.go:309] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0408 12:39:15.927847 427857 kubeadm.go:309] - 'systemctl status kubelet'
I0408 12:39:15.927905 427857 kubeadm.go:309] - 'journalctl -xeu kubelet'
I0408 12:39:15.927922 427857 kubeadm.go:309]
I0408 12:39:15.928083 427857 kubeadm.go:309] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0408 12:39:15.928229 427857 kubeadm.go:309] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0408 12:39:15.928243 427857 kubeadm.go:309]
I0408 12:39:15.928389 427857 kubeadm.go:309] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0408 12:39:15.928522 427857 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0408 12:39:15.928638 427857 kubeadm.go:309] Once you have found the failing container, you can inspect its logs with:
I0408 12:39:15.928753 427857 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0408 12:39:15.928777 427857 kubeadm.go:309]
I0408 12:39:15.929636 427857 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0408 12:39:15.929763 427857 kubeadm.go:309] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0408 12:39:15.929927 427857 kubeadm.go:309] To see the stack trace of this error execute with --v=5 or higher
W0408 12:39:15.930054 427857 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-384148] and IPs [192.168.39.245 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-384148] and IPs [192.168.39.245 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-384148] and IPs [192.168.39.245 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-384148] and IPs [192.168.39.245 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0408 12:39:15.930119 427857 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0408 12:39:18.565693 427857 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (2.635530602s)
I0408 12:39:18.565777 427857 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0408 12:39:18.584365 427857 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0408 12:39:18.595805 427857 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0408 12:39:18.595828 427857 kubeadm.go:156] found existing configuration files:
I0408 12:39:18.595898 427857 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0408 12:39:18.606868 427857 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0408 12:39:18.606948 427857 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0408 12:39:18.619153 427857 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0408 12:39:18.630563 427857 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0408 12:39:18.630642 427857 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0408 12:39:18.642131 427857 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0408 12:39:18.654092 427857 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0408 12:39:18.654175 427857 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0408 12:39:18.666958 427857 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0408 12:39:18.678002 427857 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0408 12:39:18.678062 427857 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0408 12:39:18.689377 427857 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0408 12:39:18.947515 427857 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0408 12:41:15.244643 427857 kubeadm.go:309] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0408 12:41:15.244753 427857 kubeadm.go:309] To see the stack trace of this error execute with --v=5 or higher
I0408 12:41:15.246505 427857 kubeadm.go:309] [init] Using Kubernetes version: v1.20.0
I0408 12:41:15.246564 427857 kubeadm.go:309] [preflight] Running pre-flight checks
I0408 12:41:15.246660 427857 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0408 12:41:15.246779 427857 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0408 12:41:15.247005 427857 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0408 12:41:15.247075 427857 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0408 12:41:15.248982 427857 out.go:204] - Generating certificates and keys ...
I0408 12:41:15.249063 427857 kubeadm.go:309] [certs] Using existing ca certificate authority
I0408 12:41:15.249154 427857 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0408 12:41:15.249252 427857 kubeadm.go:309] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0408 12:41:15.249336 427857 kubeadm.go:309] [certs] Using existing front-proxy-ca certificate authority
I0408 12:41:15.249426 427857 kubeadm.go:309] [certs] Using existing front-proxy-client certificate and key on disk
I0408 12:41:15.249510 427857 kubeadm.go:309] [certs] Using existing etcd/ca certificate authority
I0408 12:41:15.249578 427857 kubeadm.go:309] [certs] Using existing etcd/server certificate and key on disk
I0408 12:41:15.249638 427857 kubeadm.go:309] [certs] Using existing etcd/peer certificate and key on disk
I0408 12:41:15.249709 427857 kubeadm.go:309] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0408 12:41:15.249809 427857 kubeadm.go:309] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0408 12:41:15.249856 427857 kubeadm.go:309] [certs] Using the existing "sa" key
I0408 12:41:15.249908 427857 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0408 12:41:15.249973 427857 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0408 12:41:15.250030 427857 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0408 12:41:15.250083 427857 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0408 12:41:15.250153 427857 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0408 12:41:15.250258 427857 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0408 12:41:15.250348 427857 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0408 12:41:15.250414 427857 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0408 12:41:15.250515 427857 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0408 12:41:15.251950 427857 out.go:204] - Booting up control plane ...
I0408 12:41:15.252074 427857 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0408 12:41:15.252161 427857 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0408 12:41:15.252217 427857 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0408 12:41:15.252288 427857 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0408 12:41:15.252454 427857 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0408 12:41:15.252555 427857 kubeadm.go:309] [kubelet-check] Initial timeout of 40s passed.
I0408 12:41:15.252648 427857 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0408 12:41:15.252870 427857 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0408 12:41:15.252965 427857 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0408 12:41:15.253206 427857 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0408 12:41:15.253296 427857 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0408 12:41:15.253499 427857 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0408 12:41:15.253591 427857 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0408 12:41:15.253788 427857 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0408 12:41:15.253898 427857 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0408 12:41:15.254052 427857 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0408 12:41:15.254061 427857 kubeadm.go:309]
I0408 12:41:15.254107 427857 kubeadm.go:309] Unfortunately, an error has occurred:
I0408 12:41:15.254142 427857 kubeadm.go:309] timed out waiting for the condition
I0408 12:41:15.254153 427857 kubeadm.go:309]
I0408 12:41:15.254188 427857 kubeadm.go:309] This error is likely caused by:
I0408 12:41:15.254218 427857 kubeadm.go:309] - The kubelet is not running
I0408 12:41:15.254345 427857 kubeadm.go:309] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0408 12:41:15.254354 427857 kubeadm.go:309]
I0408 12:41:15.254443 427857 kubeadm.go:309] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0408 12:41:15.254473 427857 kubeadm.go:309] - 'systemctl status kubelet'
I0408 12:41:15.254503 427857 kubeadm.go:309] - 'journalctl -xeu kubelet'
I0408 12:41:15.254509 427857 kubeadm.go:309]
I0408 12:41:15.254622 427857 kubeadm.go:309] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0408 12:41:15.254759 427857 kubeadm.go:309] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0408 12:41:15.254776 427857 kubeadm.go:309]
I0408 12:41:15.254907 427857 kubeadm.go:309] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0408 12:41:15.254988 427857 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0408 12:41:15.255068 427857 kubeadm.go:309] Once you have found the failing container, you can inspect its logs with:
I0408 12:41:15.255167 427857 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0408 12:41:15.255207 427857 kubeadm.go:309]
I0408 12:41:15.255292 427857 kubeadm.go:393] duration metric: took 3m57.845493267s to StartCluster
I0408 12:41:15.255383 427857 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0408 12:41:15.255466 427857 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0408 12:41:15.303417 427857 cri.go:89] found id: ""
I0408 12:41:15.303460 427857 logs.go:276] 0 containers: []
W0408 12:41:15.303471 427857 logs.go:278] No container was found matching "kube-apiserver"
I0408 12:41:15.303480 427857 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0408 12:41:15.303549 427857 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0408 12:41:15.342101 427857 cri.go:89] found id: ""
I0408 12:41:15.342136 427857 logs.go:276] 0 containers: []
W0408 12:41:15.342147 427857 logs.go:278] No container was found matching "etcd"
I0408 12:41:15.342156 427857 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0408 12:41:15.342230 427857 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0408 12:41:15.381005 427857 cri.go:89] found id: ""
I0408 12:41:15.381037 427857 logs.go:276] 0 containers: []
W0408 12:41:15.381046 427857 logs.go:278] No container was found matching "coredns"
I0408 12:41:15.381053 427857 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0408 12:41:15.381132 427857 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0408 12:41:15.422117 427857 cri.go:89] found id: ""
I0408 12:41:15.422145 427857 logs.go:276] 0 containers: []
W0408 12:41:15.422154 427857 logs.go:278] No container was found matching "kube-scheduler"
I0408 12:41:15.422160 427857 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0408 12:41:15.422221 427857 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0408 12:41:15.460054 427857 cri.go:89] found id: ""
I0408 12:41:15.460092 427857 logs.go:276] 0 containers: []
W0408 12:41:15.460104 427857 logs.go:278] No container was found matching "kube-proxy"
I0408 12:41:15.460112 427857 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0408 12:41:15.460181 427857 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0408 12:41:15.497884 427857 cri.go:89] found id: ""
I0408 12:41:15.497911 427857 logs.go:276] 0 containers: []
W0408 12:41:15.497920 427857 logs.go:278] No container was found matching "kube-controller-manager"
I0408 12:41:15.497927 427857 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0408 12:41:15.498016 427857 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0408 12:41:15.536837 427857 cri.go:89] found id: ""
I0408 12:41:15.536880 427857 logs.go:276] 0 containers: []
W0408 12:41:15.536901 427857 logs.go:278] No container was found matching "kindnet"
I0408 12:41:15.536914 427857 logs.go:123] Gathering logs for dmesg ...
I0408 12:41:15.536933 427857 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0408 12:41:15.550650 427857 logs.go:123] Gathering logs for describe nodes ...
I0408 12:41:15.550688 427857 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0408 12:41:15.669989 427857 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0408 12:41:15.670019 427857 logs.go:123] Gathering logs for CRI-O ...
I0408 12:41:15.670037 427857 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0408 12:41:15.763806 427857 logs.go:123] Gathering logs for container status ...
I0408 12:41:15.763849 427857 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0408 12:41:15.807522 427857 logs.go:123] Gathering logs for kubelet ...
I0408 12:41:15.807562 427857 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0408 12:41:15.859436 427857 out.go:364] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0408 12:41:15.859491 427857 out.go:239] *
*
W0408 12:41:15.859556 427857 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0408 12:41:15.859579 427857 out.go:239] *
*
W0408 12:41:15.860331 427857 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0408 12:41:15.864274 427857 out.go:177]
W0408 12:41:15.865660 427857 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0408 12:41:15.865709 427857 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0408 12:41:15.865736 427857 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0408 12:41:15.867283 427857 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-384148 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-384148 -n old-k8s-version-384148
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-384148 -n old-k8s-version-384148: exit status 6 (252.725787ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0408 12:41:16.166953 432945 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-384148" does not appear in /home/jenkins/minikube-integration/18588-368424/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-384148" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (275.38s)