=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-276459 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-276459 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m32.64373404s)
-- stdout --
* [old-k8s-version-276459] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=19349
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19349-8084/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19349-8084/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-276459" primary control-plane node in "old-k8s-version-276459" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0731 17:57:39.117433 67995 out.go:291] Setting OutFile to fd 1 ...
I0731 17:57:39.117525 67995 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0731 17:57:39.117533 67995 out.go:304] Setting ErrFile to fd 2...
I0731 17:57:39.117537 67995 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0731 17:57:39.117711 67995 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19349-8084/.minikube/bin
I0731 17:57:39.118277 67995 out.go:298] Setting JSON to false
I0731 17:57:39.119514 67995 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-8","uptime":6003,"bootTime":1722442656,"procs":315,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1065-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0731 17:57:39.119576 67995 start.go:139] virtualization: kvm guest
I0731 17:57:39.121850 67995 out.go:177] * [old-k8s-version-276459] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
I0731 17:57:39.123125 67995 out.go:177] - MINIKUBE_LOCATION=19349
I0731 17:57:39.123178 67995 notify.go:220] Checking for updates...
I0731 17:57:39.125621 67995 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0731 17:57:39.126856 67995 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19349-8084/kubeconfig
I0731 17:57:39.128060 67995 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19349-8084/.minikube
I0731 17:57:39.129307 67995 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0731 17:57:39.130625 67995 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0731 17:57:39.132272 67995 config.go:182] Loaded profile config "enable-default-cni-985288": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3
I0731 17:57:39.132391 67995 config.go:182] Loaded profile config "flannel-985288": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3
I0731 17:57:39.132494 67995 config.go:182] Loaded profile config "kubernetes-upgrade-410576": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.0-beta.0
I0731 17:57:39.132620 67995 driver.go:392] Setting default libvirt URI to qemu:///system
I0731 17:57:39.169119 67995 out.go:177] * Using the kvm2 driver based on user configuration
I0731 17:57:39.170527 67995 start.go:297] selected driver: kvm2
I0731 17:57:39.170542 67995 start.go:901] validating driver "kvm2" against <nil>
I0731 17:57:39.170558 67995 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0731 17:57:39.171300 67995 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0731 17:57:39.171386 67995 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19349-8084/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0731 17:57:39.186105 67995 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.1
I0731 17:57:39.186165 67995 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0731 17:57:39.186441 67995 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0731 17:57:39.186507 67995 cni.go:84] Creating CNI manager for ""
I0731 17:57:39.186522 67995 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0731 17:57:39.186536 67995 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0731 17:57:39.186601 67995 start.go:340] cluster config:
{Name:old-k8s-version-276459 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-276459 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0731 17:57:39.186720 67995 iso.go:125] acquiring lock: {Name:mk4494bb5a63902bf12a909c3109db85229bc516 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0731 17:57:39.188567 67995 out.go:177] * Starting "old-k8s-version-276459" primary control-plane node in "old-k8s-version-276459" cluster
I0731 17:57:39.189908 67995 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0731 17:57:39.189950 67995 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19349-8084/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0731 17:57:39.189959 67995 cache.go:56] Caching tarball of preloaded images
I0731 17:57:39.190050 67995 preload.go:172] Found /home/jenkins/minikube-integration/19349-8084/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0731 17:57:39.190062 67995 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0731 17:57:39.190187 67995 profile.go:143] Saving config to /home/jenkins/minikube-integration/19349-8084/.minikube/profiles/old-k8s-version-276459/config.json ...
I0731 17:57:39.190211 67995 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19349-8084/.minikube/profiles/old-k8s-version-276459/config.json: {Name:mk7d50135ed2c60e0545008accf64d73827c287c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0731 17:57:39.190384 67995 start.go:360] acquireMachinesLock for old-k8s-version-276459: {Name:mkd78eacfab7d6c3058c6674434b3d889ec957e0 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0731 17:57:39.190428 67995 start.go:364] duration metric: took 23.264µs to acquireMachinesLock for "old-k8s-version-276459"
I0731 17:57:39.190453 67995 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-276459 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19339/minikube-v1.33.1-1722248113-19339-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-276459 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0731 17:57:39.190531 67995 start.go:125] createHost starting for "" (driver="kvm2")
I0731 17:57:39.192130 67995 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0731 17:57:39.192285 67995 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0731 17:57:39.192338 67995 main.go:141] libmachine: Launching plugin server for driver kvm2
I0731 17:57:39.207371 67995 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38035
I0731 17:57:39.207857 67995 main.go:141] libmachine: () Calling .GetVersion
I0731 17:57:39.208398 67995 main.go:141] libmachine: Using API Version 1
I0731 17:57:39.208419 67995 main.go:141] libmachine: () Calling .SetConfigRaw
I0731 17:57:39.208831 67995 main.go:141] libmachine: () Calling .GetMachineName
I0731 17:57:39.209071 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetMachineName
I0731 17:57:39.209265 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .DriverName
I0731 17:57:39.209468 67995 start.go:159] libmachine.API.Create for "old-k8s-version-276459" (driver="kvm2")
I0731 17:57:39.209498 67995 client.go:168] LocalClient.Create starting
I0731 17:57:39.209536 67995 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19349-8084/.minikube/certs/ca.pem
I0731 17:57:39.209581 67995 main.go:141] libmachine: Decoding PEM data...
I0731 17:57:39.209601 67995 main.go:141] libmachine: Parsing certificate...
I0731 17:57:39.209678 67995 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19349-8084/.minikube/certs/cert.pem
I0731 17:57:39.209706 67995 main.go:141] libmachine: Decoding PEM data...
I0731 17:57:39.209729 67995 main.go:141] libmachine: Parsing certificate...
I0731 17:57:39.209754 67995 main.go:141] libmachine: Running pre-create checks...
I0731 17:57:39.209775 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .PreCreateCheck
I0731 17:57:39.210233 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetConfigRaw
I0731 17:57:39.210764 67995 main.go:141] libmachine: Creating machine...
I0731 17:57:39.210779 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .Create
I0731 17:57:39.210966 67995 main.go:141] libmachine: (old-k8s-version-276459) Creating KVM machine...
I0731 17:57:39.212423 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | found existing default KVM network
I0731 17:57:39.213833 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | I0731 17:57:39.213686 68018 network.go:206] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000112c10}
I0731 17:57:39.213853 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | created network xml:
I0731 17:57:39.213862 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | <network>
I0731 17:57:39.213868 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | <name>mk-old-k8s-version-276459</name>
I0731 17:57:39.213875 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | <dns enable='no'/>
I0731 17:57:39.213880 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG |
I0731 17:57:39.213886 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | <ip address='192.168.39.1' netmask='255.255.255.0'>
I0731 17:57:39.213905 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | <dhcp>
I0731 17:57:39.213919 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | <range start='192.168.39.2' end='192.168.39.253'/>
I0731 17:57:39.213928 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | </dhcp>
I0731 17:57:39.214021 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | </ip>
I0731 17:57:39.214085 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG |
I0731 17:57:39.214101 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | </network>
I0731 17:57:39.214119 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG |
I0731 17:57:39.219563 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | trying to create private KVM network mk-old-k8s-version-276459 192.168.39.0/24...
I0731 17:57:39.310430 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | private KVM network mk-old-k8s-version-276459 192.168.39.0/24 created
I0731 17:57:39.310478 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | I0731 17:57:39.310310 68018 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19349-8084/.minikube
I0731 17:57:39.310493 67995 main.go:141] libmachine: (old-k8s-version-276459) Setting up store path in /home/jenkins/minikube-integration/19349-8084/.minikube/machines/old-k8s-version-276459 ...
I0731 17:57:39.310522 67995 main.go:141] libmachine: (old-k8s-version-276459) Building disk image from file:///home/jenkins/minikube-integration/19349-8084/.minikube/cache/iso/amd64/minikube-v1.33.1-1722248113-19339-amd64.iso
I0731 17:57:39.310574 67995 main.go:141] libmachine: (old-k8s-version-276459) Downloading /home/jenkins/minikube-integration/19349-8084/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19349-8084/.minikube/cache/iso/amd64/minikube-v1.33.1-1722248113-19339-amd64.iso...
I0731 17:57:39.576495 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | I0731 17:57:39.576315 68018 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19349-8084/.minikube/machines/old-k8s-version-276459/id_rsa...
I0731 17:57:39.680936 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | I0731 17:57:39.680813 68018 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19349-8084/.minikube/machines/old-k8s-version-276459/old-k8s-version-276459.rawdisk...
I0731 17:57:39.680965 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | Writing magic tar header
I0731 17:57:39.680982 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | Writing SSH key tar header
I0731 17:57:39.681031 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | I0731 17:57:39.680975 68018 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19349-8084/.minikube/machines/old-k8s-version-276459 ...
I0731 17:57:39.681109 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19349-8084/.minikube/machines/old-k8s-version-276459
I0731 17:57:39.681131 67995 main.go:141] libmachine: (old-k8s-version-276459) Setting executable bit set on /home/jenkins/minikube-integration/19349-8084/.minikube/machines/old-k8s-version-276459 (perms=drwx------)
I0731 17:57:39.681144 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19349-8084/.minikube/machines
I0731 17:57:39.681160 67995 main.go:141] libmachine: (old-k8s-version-276459) Setting executable bit set on /home/jenkins/minikube-integration/19349-8084/.minikube/machines (perms=drwxr-xr-x)
I0731 17:57:39.681181 67995 main.go:141] libmachine: (old-k8s-version-276459) Setting executable bit set on /home/jenkins/minikube-integration/19349-8084/.minikube (perms=drwxr-xr-x)
I0731 17:57:39.681196 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19349-8084/.minikube
I0731 17:57:39.681211 67995 main.go:141] libmachine: (old-k8s-version-276459) Setting executable bit set on /home/jenkins/minikube-integration/19349-8084 (perms=drwxrwxr-x)
I0731 17:57:39.681229 67995 main.go:141] libmachine: (old-k8s-version-276459) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0731 17:57:39.681243 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19349-8084
I0731 17:57:39.681261 67995 main.go:141] libmachine: (old-k8s-version-276459) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0731 17:57:39.681274 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0731 17:57:39.681291 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | Checking permissions on dir: /home/jenkins
I0731 17:57:39.681300 67995 main.go:141] libmachine: (old-k8s-version-276459) Creating domain...
I0731 17:57:39.681307 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | Checking permissions on dir: /home
I0731 17:57:39.681317 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | Skipping /home - not owner
I0731 17:57:39.682579 67995 main.go:141] libmachine: (old-k8s-version-276459) define libvirt domain using xml:
I0731 17:57:39.682601 67995 main.go:141] libmachine: (old-k8s-version-276459) <domain type='kvm'>
I0731 17:57:39.682612 67995 main.go:141] libmachine: (old-k8s-version-276459) <name>old-k8s-version-276459</name>
I0731 17:57:39.682630 67995 main.go:141] libmachine: (old-k8s-version-276459) <memory unit='MiB'>2200</memory>
I0731 17:57:39.682656 67995 main.go:141] libmachine: (old-k8s-version-276459) <vcpu>2</vcpu>
I0731 17:57:39.682679 67995 main.go:141] libmachine: (old-k8s-version-276459) <features>
I0731 17:57:39.682691 67995 main.go:141] libmachine: (old-k8s-version-276459) <acpi/>
I0731 17:57:39.682706 67995 main.go:141] libmachine: (old-k8s-version-276459) <apic/>
I0731 17:57:39.682716 67995 main.go:141] libmachine: (old-k8s-version-276459) <pae/>
I0731 17:57:39.682738 67995 main.go:141] libmachine: (old-k8s-version-276459)
I0731 17:57:39.682749 67995 main.go:141] libmachine: (old-k8s-version-276459) </features>
I0731 17:57:39.682761 67995 main.go:141] libmachine: (old-k8s-version-276459) <cpu mode='host-passthrough'>
I0731 17:57:39.682772 67995 main.go:141] libmachine: (old-k8s-version-276459)
I0731 17:57:39.682782 67995 main.go:141] libmachine: (old-k8s-version-276459) </cpu>
I0731 17:57:39.682793 67995 main.go:141] libmachine: (old-k8s-version-276459) <os>
I0731 17:57:39.682804 67995 main.go:141] libmachine: (old-k8s-version-276459) <type>hvm</type>
I0731 17:57:39.682812 67995 main.go:141] libmachine: (old-k8s-version-276459) <boot dev='cdrom'/>
I0731 17:57:39.682826 67995 main.go:141] libmachine: (old-k8s-version-276459) <boot dev='hd'/>
I0731 17:57:39.682837 67995 main.go:141] libmachine: (old-k8s-version-276459) <bootmenu enable='no'/>
I0731 17:57:39.682850 67995 main.go:141] libmachine: (old-k8s-version-276459) </os>
I0731 17:57:39.682871 67995 main.go:141] libmachine: (old-k8s-version-276459) <devices>
I0731 17:57:39.682885 67995 main.go:141] libmachine: (old-k8s-version-276459) <disk type='file' device='cdrom'>
I0731 17:57:39.682902 67995 main.go:141] libmachine: (old-k8s-version-276459) <source file='/home/jenkins/minikube-integration/19349-8084/.minikube/machines/old-k8s-version-276459/boot2docker.iso'/>
I0731 17:57:39.682913 67995 main.go:141] libmachine: (old-k8s-version-276459) <target dev='hdc' bus='scsi'/>
I0731 17:57:39.682922 67995 main.go:141] libmachine: (old-k8s-version-276459) <readonly/>
I0731 17:57:39.682931 67995 main.go:141] libmachine: (old-k8s-version-276459) </disk>
I0731 17:57:39.682941 67995 main.go:141] libmachine: (old-k8s-version-276459) <disk type='file' device='disk'>
I0731 17:57:39.682952 67995 main.go:141] libmachine: (old-k8s-version-276459) <driver name='qemu' type='raw' cache='default' io='threads' />
I0731 17:57:39.682969 67995 main.go:141] libmachine: (old-k8s-version-276459) <source file='/home/jenkins/minikube-integration/19349-8084/.minikube/machines/old-k8s-version-276459/old-k8s-version-276459.rawdisk'/>
I0731 17:57:39.682979 67995 main.go:141] libmachine: (old-k8s-version-276459) <target dev='hda' bus='virtio'/>
I0731 17:57:39.682986 67995 main.go:141] libmachine: (old-k8s-version-276459) </disk>
I0731 17:57:39.682998 67995 main.go:141] libmachine: (old-k8s-version-276459) <interface type='network'>
I0731 17:57:39.683010 67995 main.go:141] libmachine: (old-k8s-version-276459) <source network='mk-old-k8s-version-276459'/>
I0731 17:57:39.683021 67995 main.go:141] libmachine: (old-k8s-version-276459) <model type='virtio'/>
I0731 17:57:39.683036 67995 main.go:141] libmachine: (old-k8s-version-276459) </interface>
I0731 17:57:39.683048 67995 main.go:141] libmachine: (old-k8s-version-276459) <interface type='network'>
I0731 17:57:39.683060 67995 main.go:141] libmachine: (old-k8s-version-276459) <source network='default'/>
I0731 17:57:39.683072 67995 main.go:141] libmachine: (old-k8s-version-276459) <model type='virtio'/>
I0731 17:57:39.683081 67995 main.go:141] libmachine: (old-k8s-version-276459) </interface>
I0731 17:57:39.683089 67995 main.go:141] libmachine: (old-k8s-version-276459) <serial type='pty'>
I0731 17:57:39.683098 67995 main.go:141] libmachine: (old-k8s-version-276459) <target port='0'/>
I0731 17:57:39.683138 67995 main.go:141] libmachine: (old-k8s-version-276459) </serial>
I0731 17:57:39.683161 67995 main.go:141] libmachine: (old-k8s-version-276459) <console type='pty'>
I0731 17:57:39.683176 67995 main.go:141] libmachine: (old-k8s-version-276459) <target type='serial' port='0'/>
I0731 17:57:39.683188 67995 main.go:141] libmachine: (old-k8s-version-276459) </console>
I0731 17:57:39.683201 67995 main.go:141] libmachine: (old-k8s-version-276459) <rng model='virtio'>
I0731 17:57:39.683223 67995 main.go:141] libmachine: (old-k8s-version-276459) <backend model='random'>/dev/random</backend>
I0731 17:57:39.683247 67995 main.go:141] libmachine: (old-k8s-version-276459) </rng>
I0731 17:57:39.683266 67995 main.go:141] libmachine: (old-k8s-version-276459)
I0731 17:57:39.683282 67995 main.go:141] libmachine: (old-k8s-version-276459)
I0731 17:57:39.683292 67995 main.go:141] libmachine: (old-k8s-version-276459) </devices>
I0731 17:57:39.683298 67995 main.go:141] libmachine: (old-k8s-version-276459) </domain>
I0731 17:57:39.683310 67995 main.go:141] libmachine: (old-k8s-version-276459)
I0731 17:57:39.688638 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | domain old-k8s-version-276459 has defined MAC address 52:54:00:89:39:4e in network default
I0731 17:57:39.689230 67995 main.go:141] libmachine: (old-k8s-version-276459) Ensuring networks are active...
I0731 17:57:39.689252 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | domain old-k8s-version-276459 has defined MAC address 52:54:00:79:9d:96 in network mk-old-k8s-version-276459
I0731 17:57:39.689888 67995 main.go:141] libmachine: (old-k8s-version-276459) Ensuring network default is active
I0731 17:57:39.690220 67995 main.go:141] libmachine: (old-k8s-version-276459) Ensuring network mk-old-k8s-version-276459 is active
I0731 17:57:39.690746 67995 main.go:141] libmachine: (old-k8s-version-276459) Getting domain xml...
I0731 17:57:39.691416 67995 main.go:141] libmachine: (old-k8s-version-276459) Creating domain...
I0731 17:57:41.026258 67995 main.go:141] libmachine: (old-k8s-version-276459) Waiting to get IP...
I0731 17:57:41.027135 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | domain old-k8s-version-276459 has defined MAC address 52:54:00:79:9d:96 in network mk-old-k8s-version-276459
I0731 17:57:41.027688 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | unable to find current IP address of domain old-k8s-version-276459 in network mk-old-k8s-version-276459
I0731 17:57:41.027755 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | I0731 17:57:41.027658 68018 retry.go:31] will retry after 299.311272ms: waiting for machine to come up
I0731 17:57:41.327950 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | domain old-k8s-version-276459 has defined MAC address 52:54:00:79:9d:96 in network mk-old-k8s-version-276459
I0731 17:57:41.328415 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | unable to find current IP address of domain old-k8s-version-276459 in network mk-old-k8s-version-276459
I0731 17:57:41.328439 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | I0731 17:57:41.328372 68018 retry.go:31] will retry after 362.13362ms: waiting for machine to come up
I0731 17:57:41.691998 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | domain old-k8s-version-276459 has defined MAC address 52:54:00:79:9d:96 in network mk-old-k8s-version-276459
I0731 17:57:41.692503 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | unable to find current IP address of domain old-k8s-version-276459 in network mk-old-k8s-version-276459
I0731 17:57:41.692536 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | I0731 17:57:41.692464 68018 retry.go:31] will retry after 432.407689ms: waiting for machine to come up
I0731 17:57:42.126805 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | domain old-k8s-version-276459 has defined MAC address 52:54:00:79:9d:96 in network mk-old-k8s-version-276459
I0731 17:57:42.127489 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | unable to find current IP address of domain old-k8s-version-276459 in network mk-old-k8s-version-276459
I0731 17:57:42.127515 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | I0731 17:57:42.127444 68018 retry.go:31] will retry after 413.716495ms: waiting for machine to come up
I0731 17:57:42.543029 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | domain old-k8s-version-276459 has defined MAC address 52:54:00:79:9d:96 in network mk-old-k8s-version-276459
I0731 17:57:42.543593 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | unable to find current IP address of domain old-k8s-version-276459 in network mk-old-k8s-version-276459
I0731 17:57:42.543623 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | I0731 17:57:42.543539 68018 retry.go:31] will retry after 485.377079ms: waiting for machine to come up
I0731 17:57:43.030441 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | domain old-k8s-version-276459 has defined MAC address 52:54:00:79:9d:96 in network mk-old-k8s-version-276459
I0731 17:57:43.031267 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | unable to find current IP address of domain old-k8s-version-276459 in network mk-old-k8s-version-276459
I0731 17:57:43.031290 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | I0731 17:57:43.031219 68018 retry.go:31] will retry after 923.154755ms: waiting for machine to come up
I0731 17:57:43.956323 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | domain old-k8s-version-276459 has defined MAC address 52:54:00:79:9d:96 in network mk-old-k8s-version-276459
I0731 17:57:43.956817 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | unable to find current IP address of domain old-k8s-version-276459 in network mk-old-k8s-version-276459
I0731 17:57:43.956862 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | I0731 17:57:43.956771 68018 retry.go:31] will retry after 962.456791ms: waiting for machine to come up
I0731 17:57:44.920531 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | domain old-k8s-version-276459 has defined MAC address 52:54:00:79:9d:96 in network mk-old-k8s-version-276459
I0731 17:57:44.921182 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | unable to find current IP address of domain old-k8s-version-276459 in network mk-old-k8s-version-276459
I0731 17:57:44.921204 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | I0731 17:57:44.921097 68018 retry.go:31] will retry after 1.107879536s: waiting for machine to come up
I0731 17:57:46.030530 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | domain old-k8s-version-276459 has defined MAC address 52:54:00:79:9d:96 in network mk-old-k8s-version-276459
I0731 17:57:46.031222 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | unable to find current IP address of domain old-k8s-version-276459 in network mk-old-k8s-version-276459
I0731 17:57:46.031247 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | I0731 17:57:46.031142 68018 retry.go:31] will retry after 1.67805442s: waiting for machine to come up
I0731 17:57:47.710539 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | domain old-k8s-version-276459 has defined MAC address 52:54:00:79:9d:96 in network mk-old-k8s-version-276459
I0731 17:57:47.711335 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | unable to find current IP address of domain old-k8s-version-276459 in network mk-old-k8s-version-276459
I0731 17:57:47.711367 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | I0731 17:57:47.711269 68018 retry.go:31] will retry after 1.585652652s: waiting for machine to come up
I0731 17:57:49.298743 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | domain old-k8s-version-276459 has defined MAC address 52:54:00:79:9d:96 in network mk-old-k8s-version-276459
I0731 17:57:49.299368 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | unable to find current IP address of domain old-k8s-version-276459 in network mk-old-k8s-version-276459
I0731 17:57:49.299393 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | I0731 17:57:49.299317 68018 retry.go:31] will retry after 2.429908417s: waiting for machine to come up
I0731 17:57:51.731416 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | domain old-k8s-version-276459 has defined MAC address 52:54:00:79:9d:96 in network mk-old-k8s-version-276459
I0731 17:57:51.731885 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | unable to find current IP address of domain old-k8s-version-276459 in network mk-old-k8s-version-276459
I0731 17:57:51.731909 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | I0731 17:57:51.731839 68018 retry.go:31] will retry after 2.296376405s: waiting for machine to come up
I0731 17:57:54.030279 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | domain old-k8s-version-276459 has defined MAC address 52:54:00:79:9d:96 in network mk-old-k8s-version-276459
I0731 17:57:54.030794 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | unable to find current IP address of domain old-k8s-version-276459 in network mk-old-k8s-version-276459
I0731 17:57:54.030839 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | I0731 17:57:54.030748 68018 retry.go:31] will retry after 2.914320434s: waiting for machine to come up
I0731 17:57:56.948124 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | domain old-k8s-version-276459 has defined MAC address 52:54:00:79:9d:96 in network mk-old-k8s-version-276459
I0731 17:57:56.948641 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | unable to find current IP address of domain old-k8s-version-276459 in network mk-old-k8s-version-276459
I0731 17:57:56.948668 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | I0731 17:57:56.948597 68018 retry.go:31] will retry after 3.886986085s: waiting for machine to come up
I0731 17:58:00.837371 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | domain old-k8s-version-276459 has defined MAC address 52:54:00:79:9d:96 in network mk-old-k8s-version-276459
I0731 17:58:00.837940 67995 main.go:141] libmachine: (old-k8s-version-276459) Found IP for machine: 192.168.39.26
I0731 17:58:00.837986 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | domain old-k8s-version-276459 has current primary IP address 192.168.39.26 and MAC address 52:54:00:79:9d:96 in network mk-old-k8s-version-276459
I0731 17:58:00.837996 67995 main.go:141] libmachine: (old-k8s-version-276459) Reserving static IP address...
I0731 17:58:00.838391 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-276459", mac: "52:54:00:79:9d:96", ip: "192.168.39.26"} in network mk-old-k8s-version-276459
I0731 17:58:00.912934 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | Getting to WaitForSSH function...
I0731 17:58:00.912968 67995 main.go:141] libmachine: (old-k8s-version-276459) Reserved static IP address: 192.168.39.26
I0731 17:58:00.912981 67995 main.go:141] libmachine: (old-k8s-version-276459) Waiting for SSH to be available...
I0731 17:58:00.915542 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | domain old-k8s-version-276459 has defined MAC address 52:54:00:79:9d:96 in network mk-old-k8s-version-276459
I0731 17:58:00.915878 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | unable to find host DHCP lease matching {name: "", mac: "52:54:00:79:9d:96", ip: ""} in network mk-old-k8s-version-276459
I0731 17:58:00.915904 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | unable to find defined IP address of network mk-old-k8s-version-276459 interface with MAC address 52:54:00:79:9d:96
I0731 17:58:00.916108 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | Using SSH client type: external
I0731 17:58:00.916133 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | Using SSH private key: /home/jenkins/minikube-integration/19349-8084/.minikube/machines/old-k8s-version-276459/id_rsa (-rw-------)
I0731 17:58:00.916163 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@ -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19349-8084/.minikube/machines/old-k8s-version-276459/id_rsa -p 22] /usr/bin/ssh <nil>}
I0731 17:58:00.916189 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | About to run SSH command:
I0731 17:58:00.916204 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | exit 0
I0731 17:58:00.919684 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | SSH cmd err, output: exit status 255:
I0731 17:58:00.919706 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | Error getting ssh command 'exit 0' : ssh command error:
I0731 17:58:00.919715 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | command : exit 0
I0731 17:58:00.919723 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | err : exit status 255
I0731 17:58:00.919731 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | output :
I0731 17:58:03.920241 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | Getting to WaitForSSH function...
I0731 17:58:03.923291 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | domain old-k8s-version-276459 has defined MAC address 52:54:00:79:9d:96 in network mk-old-k8s-version-276459
I0731 17:58:03.923884 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:79:9d:96", ip: ""} in network mk-old-k8s-version-276459: {Iface:virbr3 ExpiryTime:2024-07-31 18:57:55 +0000 UTC Type:0 Mac:52:54:00:79:9d:96 Iaid: IPaddr:192.168.39.26 Prefix:24 Hostname:old-k8s-version-276459 Clientid:01:52:54:00:79:9d:96}
I0731 17:58:03.923923 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | domain old-k8s-version-276459 has defined IP address 192.168.39.26 and MAC address 52:54:00:79:9d:96 in network mk-old-k8s-version-276459
I0731 17:58:03.924092 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | Using SSH client type: external
I0731 17:58:03.924121 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | Using SSH private key: /home/jenkins/minikube-integration/19349-8084/.minikube/machines/old-k8s-version-276459/id_rsa (-rw-------)
I0731 17:58:03.924170 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.26 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19349-8084/.minikube/machines/old-k8s-version-276459/id_rsa -p 22] /usr/bin/ssh <nil>}
I0731 17:58:03.924183 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | About to run SSH command:
I0731 17:58:03.924223 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | exit 0
I0731 17:58:04.055523 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | SSH cmd err, output: <nil>:
I0731 17:58:04.055797 67995 main.go:141] libmachine: (old-k8s-version-276459) KVM machine creation complete!
I0731 17:58:04.056177 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetConfigRaw
I0731 17:58:04.056816 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .DriverName
I0731 17:58:04.057030 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .DriverName
I0731 17:58:04.057247 67995 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0731 17:58:04.057274 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetState
I0731 17:58:04.058921 67995 main.go:141] libmachine: Detecting operating system of created instance...
I0731 17:58:04.058934 67995 main.go:141] libmachine: Waiting for SSH to be available...
I0731 17:58:04.058939 67995 main.go:141] libmachine: Getting to WaitForSSH function...
I0731 17:58:04.058946 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetSSHHostname
I0731 17:58:04.061789 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | domain old-k8s-version-276459 has defined MAC address 52:54:00:79:9d:96 in network mk-old-k8s-version-276459
I0731 17:58:04.062098 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:79:9d:96", ip: ""} in network mk-old-k8s-version-276459: {Iface:virbr3 ExpiryTime:2024-07-31 18:57:55 +0000 UTC Type:0 Mac:52:54:00:79:9d:96 Iaid: IPaddr:192.168.39.26 Prefix:24 Hostname:old-k8s-version-276459 Clientid:01:52:54:00:79:9d:96}
I0731 17:58:04.062116 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | domain old-k8s-version-276459 has defined IP address 192.168.39.26 and MAC address 52:54:00:79:9d:96 in network mk-old-k8s-version-276459
I0731 17:58:04.062320 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetSSHPort
I0731 17:58:04.062506 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetSSHKeyPath
I0731 17:58:04.062649 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetSSHKeyPath
I0731 17:58:04.062770 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetSSHUsername
I0731 17:58:04.062972 67995 main.go:141] libmachine: Using SSH client type: native
I0731 17:58:04.063226 67995 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.39.26 22 <nil> <nil>}
I0731 17:58:04.063243 67995 main.go:141] libmachine: About to run SSH command:
exit 0
I0731 17:58:04.179036 67995 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0731 17:58:04.179060 67995 main.go:141] libmachine: Detecting the provisioner...
I0731 17:58:04.179071 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetSSHHostname
I0731 17:58:04.182228 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | domain old-k8s-version-276459 has defined MAC address 52:54:00:79:9d:96 in network mk-old-k8s-version-276459
I0731 17:58:04.182627 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:79:9d:96", ip: ""} in network mk-old-k8s-version-276459: {Iface:virbr3 ExpiryTime:2024-07-31 18:57:55 +0000 UTC Type:0 Mac:52:54:00:79:9d:96 Iaid: IPaddr:192.168.39.26 Prefix:24 Hostname:old-k8s-version-276459 Clientid:01:52:54:00:79:9d:96}
I0731 17:58:04.182665 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | domain old-k8s-version-276459 has defined IP address 192.168.39.26 and MAC address 52:54:00:79:9d:96 in network mk-old-k8s-version-276459
I0731 17:58:04.182767 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetSSHPort
I0731 17:58:04.182944 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetSSHKeyPath
I0731 17:58:04.183094 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetSSHKeyPath
I0731 17:58:04.183256 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetSSHUsername
I0731 17:58:04.183416 67995 main.go:141] libmachine: Using SSH client type: native
I0731 17:58:04.183589 67995 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.39.26 22 <nil> <nil>}
I0731 17:58:04.183604 67995 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0731 17:58:04.303826 67995 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0731 17:58:04.303907 67995 main.go:141] libmachine: found compatible host: buildroot
I0731 17:58:04.303922 67995 main.go:141] libmachine: Provisioning with buildroot...
I0731 17:58:04.303939 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetMachineName
I0731 17:58:04.304211 67995 buildroot.go:166] provisioning hostname "old-k8s-version-276459"
I0731 17:58:04.304235 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetMachineName
I0731 17:58:04.304403 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetSSHHostname
I0731 17:58:04.306991 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | domain old-k8s-version-276459 has defined MAC address 52:54:00:79:9d:96 in network mk-old-k8s-version-276459
I0731 17:58:04.307364 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:79:9d:96", ip: ""} in network mk-old-k8s-version-276459: {Iface:virbr3 ExpiryTime:2024-07-31 18:57:55 +0000 UTC Type:0 Mac:52:54:00:79:9d:96 Iaid: IPaddr:192.168.39.26 Prefix:24 Hostname:old-k8s-version-276459 Clientid:01:52:54:00:79:9d:96}
I0731 17:58:04.307396 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | domain old-k8s-version-276459 has defined IP address 192.168.39.26 and MAC address 52:54:00:79:9d:96 in network mk-old-k8s-version-276459
I0731 17:58:04.307552 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetSSHPort
I0731 17:58:04.307729 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetSSHKeyPath
I0731 17:58:04.307908 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetSSHKeyPath
I0731 17:58:04.308055 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetSSHUsername
I0731 17:58:04.308221 67995 main.go:141] libmachine: Using SSH client type: native
I0731 17:58:04.308400 67995 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.39.26 22 <nil> <nil>}
I0731 17:58:04.308411 67995 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-276459 && echo "old-k8s-version-276459" | sudo tee /etc/hostname
I0731 17:58:04.440653 67995 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-276459
I0731 17:58:04.440682 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetSSHHostname
I0731 17:58:04.443793 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | domain old-k8s-version-276459 has defined MAC address 52:54:00:79:9d:96 in network mk-old-k8s-version-276459
I0731 17:58:04.444149 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:79:9d:96", ip: ""} in network mk-old-k8s-version-276459: {Iface:virbr3 ExpiryTime:2024-07-31 18:57:55 +0000 UTC Type:0 Mac:52:54:00:79:9d:96 Iaid: IPaddr:192.168.39.26 Prefix:24 Hostname:old-k8s-version-276459 Clientid:01:52:54:00:79:9d:96}
I0731 17:58:04.444178 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | domain old-k8s-version-276459 has defined IP address 192.168.39.26 and MAC address 52:54:00:79:9d:96 in network mk-old-k8s-version-276459
I0731 17:58:04.444406 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetSSHPort
I0731 17:58:04.444602 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetSSHKeyPath
I0731 17:58:04.444823 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetSSHKeyPath
I0731 17:58:04.444971 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetSSHUsername
I0731 17:58:04.445134 67995 main.go:141] libmachine: Using SSH client type: native
I0731 17:58:04.445340 67995 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.39.26 22 <nil> <nil>}
I0731 17:58:04.445364 67995 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-276459' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-276459/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-276459' | sudo tee -a /etc/hosts;
fi
fi
I0731 17:58:04.568874 67995 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0731 17:58:04.568910 67995 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19349-8084/.minikube CaCertPath:/home/jenkins/minikube-integration/19349-8084/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19349-8084/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19349-8084/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19349-8084/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19349-8084/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19349-8084/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19349-8084/.minikube}
I0731 17:58:04.568935 67995 buildroot.go:174] setting up certificates
I0731 17:58:04.568955 67995 provision.go:84] configureAuth start
I0731 17:58:04.568972 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetMachineName
I0731 17:58:04.569226 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetIP
I0731 17:58:04.571687 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | domain old-k8s-version-276459 has defined MAC address 52:54:00:79:9d:96 in network mk-old-k8s-version-276459
I0731 17:58:04.572047 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:79:9d:96", ip: ""} in network mk-old-k8s-version-276459: {Iface:virbr3 ExpiryTime:2024-07-31 18:57:55 +0000 UTC Type:0 Mac:52:54:00:79:9d:96 Iaid: IPaddr:192.168.39.26 Prefix:24 Hostname:old-k8s-version-276459 Clientid:01:52:54:00:79:9d:96}
I0731 17:58:04.572073 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | domain old-k8s-version-276459 has defined IP address 192.168.39.26 and MAC address 52:54:00:79:9d:96 in network mk-old-k8s-version-276459
I0731 17:58:04.572216 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetSSHHostname
I0731 17:58:04.574518 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | domain old-k8s-version-276459 has defined MAC address 52:54:00:79:9d:96 in network mk-old-k8s-version-276459
I0731 17:58:04.574822 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:79:9d:96", ip: ""} in network mk-old-k8s-version-276459: {Iface:virbr3 ExpiryTime:2024-07-31 18:57:55 +0000 UTC Type:0 Mac:52:54:00:79:9d:96 Iaid: IPaddr:192.168.39.26 Prefix:24 Hostname:old-k8s-version-276459 Clientid:01:52:54:00:79:9d:96}
I0731 17:58:04.574863 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | domain old-k8s-version-276459 has defined IP address 192.168.39.26 and MAC address 52:54:00:79:9d:96 in network mk-old-k8s-version-276459
I0731 17:58:04.574978 67995 provision.go:143] copyHostCerts
I0731 17:58:04.575027 67995 exec_runner.go:144] found /home/jenkins/minikube-integration/19349-8084/.minikube/ca.pem, removing ...
I0731 17:58:04.575036 67995 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19349-8084/.minikube/ca.pem
I0731 17:58:04.575096 67995 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19349-8084/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19349-8084/.minikube/ca.pem (1082 bytes)
I0731 17:58:04.575244 67995 exec_runner.go:144] found /home/jenkins/minikube-integration/19349-8084/.minikube/cert.pem, removing ...
I0731 17:58:04.575254 67995 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19349-8084/.minikube/cert.pem
I0731 17:58:04.575282 67995 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19349-8084/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19349-8084/.minikube/cert.pem (1123 bytes)
I0731 17:58:04.575352 67995 exec_runner.go:144] found /home/jenkins/minikube-integration/19349-8084/.minikube/key.pem, removing ...
I0731 17:58:04.575359 67995 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19349-8084/.minikube/key.pem
I0731 17:58:04.575381 67995 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19349-8084/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19349-8084/.minikube/key.pem (1675 bytes)
I0731 17:58:04.575459 67995 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19349-8084/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19349-8084/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19349-8084/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-276459 san=[127.0.0.1 192.168.39.26 localhost minikube old-k8s-version-276459]
I0731 17:58:04.733167 67995 provision.go:177] copyRemoteCerts
I0731 17:58:04.733212 67995 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0731 17:58:04.733245 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetSSHHostname
I0731 17:58:04.736023 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | domain old-k8s-version-276459 has defined MAC address 52:54:00:79:9d:96 in network mk-old-k8s-version-276459
I0731 17:58:04.736439 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:79:9d:96", ip: ""} in network mk-old-k8s-version-276459: {Iface:virbr3 ExpiryTime:2024-07-31 18:57:55 +0000 UTC Type:0 Mac:52:54:00:79:9d:96 Iaid: IPaddr:192.168.39.26 Prefix:24 Hostname:old-k8s-version-276459 Clientid:01:52:54:00:79:9d:96}
I0731 17:58:04.736475 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | domain old-k8s-version-276459 has defined IP address 192.168.39.26 and MAC address 52:54:00:79:9d:96 in network mk-old-k8s-version-276459
I0731 17:58:04.736652 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetSSHPort
I0731 17:58:04.736819 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetSSHKeyPath
I0731 17:58:04.736952 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetSSHUsername
I0731 17:58:04.737044 67995 sshutil.go:53] new ssh client: &{IP:192.168.39.26 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19349-8084/.minikube/machines/old-k8s-version-276459/id_rsa Username:docker}
I0731 17:58:04.825053 67995 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19349-8084/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0731 17:58:04.848356 67995 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19349-8084/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0731 17:58:04.873600 67995 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19349-8084/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0731 17:58:04.898773 67995 provision.go:87] duration metric: took 329.804543ms to configureAuth
I0731 17:58:04.898799 67995 buildroot.go:189] setting minikube options for container-runtime
I0731 17:58:04.898978 67995 config.go:182] Loaded profile config "old-k8s-version-276459": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0731 17:58:04.899060 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetSSHHostname
I0731 17:58:04.902014 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | domain old-k8s-version-276459 has defined MAC address 52:54:00:79:9d:96 in network mk-old-k8s-version-276459
I0731 17:58:04.902448 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:79:9d:96", ip: ""} in network mk-old-k8s-version-276459: {Iface:virbr3 ExpiryTime:2024-07-31 18:57:55 +0000 UTC Type:0 Mac:52:54:00:79:9d:96 Iaid: IPaddr:192.168.39.26 Prefix:24 Hostname:old-k8s-version-276459 Clientid:01:52:54:00:79:9d:96}
I0731 17:58:04.902475 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | domain old-k8s-version-276459 has defined IP address 192.168.39.26 and MAC address 52:54:00:79:9d:96 in network mk-old-k8s-version-276459
I0731 17:58:04.902648 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetSSHPort
I0731 17:58:04.902865 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetSSHKeyPath
I0731 17:58:04.903076 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetSSHKeyPath
I0731 17:58:04.903269 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetSSHUsername
I0731 17:58:04.903453 67995 main.go:141] libmachine: Using SSH client type: native
I0731 17:58:04.903657 67995 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.39.26 22 <nil> <nil>}
I0731 17:58:04.903673 67995 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0731 17:58:05.201873 67995 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0731 17:58:05.201898 67995 main.go:141] libmachine: Checking connection to Docker...
I0731 17:58:05.201910 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetURL
I0731 17:58:05.203512 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | Using libvirt version 6000000
I0731 17:58:05.206035 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | domain old-k8s-version-276459 has defined MAC address 52:54:00:79:9d:96 in network mk-old-k8s-version-276459
I0731 17:58:05.206506 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:79:9d:96", ip: ""} in network mk-old-k8s-version-276459: {Iface:virbr3 ExpiryTime:2024-07-31 18:57:55 +0000 UTC Type:0 Mac:52:54:00:79:9d:96 Iaid: IPaddr:192.168.39.26 Prefix:24 Hostname:old-k8s-version-276459 Clientid:01:52:54:00:79:9d:96}
I0731 17:58:05.206536 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | domain old-k8s-version-276459 has defined IP address 192.168.39.26 and MAC address 52:54:00:79:9d:96 in network mk-old-k8s-version-276459
I0731 17:58:05.206681 67995 main.go:141] libmachine: Docker is up and running!
I0731 17:58:05.206698 67995 main.go:141] libmachine: Reticulating splines...
I0731 17:58:05.206706 67995 client.go:171] duration metric: took 25.997201308s to LocalClient.Create
I0731 17:58:05.206730 67995 start.go:167] duration metric: took 25.997263222s to libmachine.API.Create "old-k8s-version-276459"
I0731 17:58:05.206743 67995 start.go:293] postStartSetup for "old-k8s-version-276459" (driver="kvm2")
I0731 17:58:05.206754 67995 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0731 17:58:05.206777 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .DriverName
I0731 17:58:05.207071 67995 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0731 17:58:05.207096 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetSSHHostname
I0731 17:58:05.209592 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | domain old-k8s-version-276459 has defined MAC address 52:54:00:79:9d:96 in network mk-old-k8s-version-276459
I0731 17:58:05.209960 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:79:9d:96", ip: ""} in network mk-old-k8s-version-276459: {Iface:virbr3 ExpiryTime:2024-07-31 18:57:55 +0000 UTC Type:0 Mac:52:54:00:79:9d:96 Iaid: IPaddr:192.168.39.26 Prefix:24 Hostname:old-k8s-version-276459 Clientid:01:52:54:00:79:9d:96}
I0731 17:58:05.209987 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | domain old-k8s-version-276459 has defined IP address 192.168.39.26 and MAC address 52:54:00:79:9d:96 in network mk-old-k8s-version-276459
I0731 17:58:05.210203 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetSSHPort
I0731 17:58:05.210401 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetSSHKeyPath
I0731 17:58:05.210574 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetSSHUsername
I0731 17:58:05.210729 67995 sshutil.go:53] new ssh client: &{IP:192.168.39.26 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19349-8084/.minikube/machines/old-k8s-version-276459/id_rsa Username:docker}
I0731 17:58:05.302690 67995 ssh_runner.go:195] Run: cat /etc/os-release
I0731 17:58:05.306881 67995 info.go:137] Remote host: Buildroot 2023.02.9
I0731 17:58:05.306906 67995 filesync.go:126] Scanning /home/jenkins/minikube-integration/19349-8084/.minikube/addons for local assets ...
I0731 17:58:05.306964 67995 filesync.go:126] Scanning /home/jenkins/minikube-integration/19349-8084/.minikube/files for local assets ...
I0731 17:58:05.307061 67995 filesync.go:149] local asset: /home/jenkins/minikube-integration/19349-8084/.minikube/files/etc/ssl/certs/152592.pem -> 152592.pem in /etc/ssl/certs
I0731 17:58:05.307201 67995 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0731 17:58:05.316574 67995 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19349-8084/.minikube/files/etc/ssl/certs/152592.pem --> /etc/ssl/certs/152592.pem (1708 bytes)
I0731 17:58:05.340706 67995 start.go:296] duration metric: took 133.953084ms for postStartSetup
I0731 17:58:05.340748 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetConfigRaw
I0731 17:58:05.341418 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetIP
I0731 17:58:05.343860 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | domain old-k8s-version-276459 has defined MAC address 52:54:00:79:9d:96 in network mk-old-k8s-version-276459
I0731 17:58:05.344184 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:79:9d:96", ip: ""} in network mk-old-k8s-version-276459: {Iface:virbr3 ExpiryTime:2024-07-31 18:57:55 +0000 UTC Type:0 Mac:52:54:00:79:9d:96 Iaid: IPaddr:192.168.39.26 Prefix:24 Hostname:old-k8s-version-276459 Clientid:01:52:54:00:79:9d:96}
I0731 17:58:05.344215 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | domain old-k8s-version-276459 has defined IP address 192.168.39.26 and MAC address 52:54:00:79:9d:96 in network mk-old-k8s-version-276459
I0731 17:58:05.344380 67995 profile.go:143] Saving config to /home/jenkins/minikube-integration/19349-8084/.minikube/profiles/old-k8s-version-276459/config.json ...
I0731 17:58:05.344562 67995 start.go:128] duration metric: took 26.154018034s to createHost
I0731 17:58:05.344581 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetSSHHostname
I0731 17:58:05.346631 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | domain old-k8s-version-276459 has defined MAC address 52:54:00:79:9d:96 in network mk-old-k8s-version-276459
I0731 17:58:05.346921 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:79:9d:96", ip: ""} in network mk-old-k8s-version-276459: {Iface:virbr3 ExpiryTime:2024-07-31 18:57:55 +0000 UTC Type:0 Mac:52:54:00:79:9d:96 Iaid: IPaddr:192.168.39.26 Prefix:24 Hostname:old-k8s-version-276459 Clientid:01:52:54:00:79:9d:96}
I0731 17:58:05.346948 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | domain old-k8s-version-276459 has defined IP address 192.168.39.26 and MAC address 52:54:00:79:9d:96 in network mk-old-k8s-version-276459
I0731 17:58:05.347059 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetSSHPort
I0731 17:58:05.347235 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetSSHKeyPath
I0731 17:58:05.347402 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetSSHKeyPath
I0731 17:58:05.347548 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetSSHUsername
I0731 17:58:05.347701 67995 main.go:141] libmachine: Using SSH client type: native
I0731 17:58:05.347895 67995 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.39.26 22 <nil> <nil>}
I0731 17:58:05.347907 67995 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0731 17:58:05.460751 67995 main.go:141] libmachine: SSH cmd err, output: <nil>: 1722448685.436586704
I0731 17:58:05.460780 67995 fix.go:216] guest clock: 1722448685.436586704
I0731 17:58:05.460791 67995 fix.go:229] Guest: 2024-07-31 17:58:05.436586704 +0000 UTC Remote: 2024-07-31 17:58:05.344571634 +0000 UTC m=+26.267860021 (delta=92.01507ms)
I0731 17:58:05.460815 67995 fix.go:200] guest clock delta is within tolerance: 92.01507ms
I0731 17:58:05.460823 67995 start.go:83] releasing machines lock for "old-k8s-version-276459", held for 26.270384134s
I0731 17:58:05.460854 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .DriverName
I0731 17:58:05.461115 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetIP
I0731 17:58:05.464094 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | domain old-k8s-version-276459 has defined MAC address 52:54:00:79:9d:96 in network mk-old-k8s-version-276459
I0731 17:58:05.464511 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:79:9d:96", ip: ""} in network mk-old-k8s-version-276459: {Iface:virbr3 ExpiryTime:2024-07-31 18:57:55 +0000 UTC Type:0 Mac:52:54:00:79:9d:96 Iaid: IPaddr:192.168.39.26 Prefix:24 Hostname:old-k8s-version-276459 Clientid:01:52:54:00:79:9d:96}
I0731 17:58:05.464560 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | domain old-k8s-version-276459 has defined IP address 192.168.39.26 and MAC address 52:54:00:79:9d:96 in network mk-old-k8s-version-276459
I0731 17:58:05.464767 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .DriverName
I0731 17:58:05.465324 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .DriverName
I0731 17:58:05.465795 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .DriverName
I0731 17:58:05.465896 67995 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0731 17:58:05.465940 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetSSHHostname
I0731 17:58:05.466025 67995 ssh_runner.go:195] Run: cat /version.json
I0731 17:58:05.466051 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetSSHHostname
I0731 17:58:05.469082 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | domain old-k8s-version-276459 has defined MAC address 52:54:00:79:9d:96 in network mk-old-k8s-version-276459
I0731 17:58:05.469374 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | domain old-k8s-version-276459 has defined MAC address 52:54:00:79:9d:96 in network mk-old-k8s-version-276459
I0731 17:58:05.469503 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:79:9d:96", ip: ""} in network mk-old-k8s-version-276459: {Iface:virbr3 ExpiryTime:2024-07-31 18:57:55 +0000 UTC Type:0 Mac:52:54:00:79:9d:96 Iaid: IPaddr:192.168.39.26 Prefix:24 Hostname:old-k8s-version-276459 Clientid:01:52:54:00:79:9d:96}
I0731 17:58:05.469531 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | domain old-k8s-version-276459 has defined IP address 192.168.39.26 and MAC address 52:54:00:79:9d:96 in network mk-old-k8s-version-276459
I0731 17:58:05.469657 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetSSHPort
I0731 17:58:05.469809 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:79:9d:96", ip: ""} in network mk-old-k8s-version-276459: {Iface:virbr3 ExpiryTime:2024-07-31 18:57:55 +0000 UTC Type:0 Mac:52:54:00:79:9d:96 Iaid: IPaddr:192.168.39.26 Prefix:24 Hostname:old-k8s-version-276459 Clientid:01:52:54:00:79:9d:96}
I0731 17:58:05.469830 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | domain old-k8s-version-276459 has defined IP address 192.168.39.26 and MAC address 52:54:00:79:9d:96 in network mk-old-k8s-version-276459
I0731 17:58:05.469860 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetSSHKeyPath
I0731 17:58:05.469997 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetSSHUsername
I0731 17:58:05.470017 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetSSHPort
I0731 17:58:05.470160 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetSSHKeyPath
I0731 17:58:05.470154 67995 sshutil.go:53] new ssh client: &{IP:192.168.39.26 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19349-8084/.minikube/machines/old-k8s-version-276459/id_rsa Username:docker}
I0731 17:58:05.470317 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetSSHUsername
I0731 17:58:05.470446 67995 sshutil.go:53] new ssh client: &{IP:192.168.39.26 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19349-8084/.minikube/machines/old-k8s-version-276459/id_rsa Username:docker}
I0731 17:58:05.595846 67995 ssh_runner.go:195] Run: systemctl --version
I0731 17:58:05.603187 67995 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0731 17:58:05.763357 67995 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0731 17:58:05.769601 67995 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0731 17:58:05.769677 67995 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0731 17:58:05.786689 67995 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0731 17:58:05.786709 67995 start.go:495] detecting cgroup driver to use...
I0731 17:58:05.786761 67995 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0731 17:58:05.808633 67995 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0731 17:58:05.824857 67995 docker.go:217] disabling cri-docker service (if available) ...
I0731 17:58:05.824929 67995 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0731 17:58:05.838902 67995 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0731 17:58:05.854831 67995 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0731 17:58:05.989233 67995 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0731 17:58:06.154472 67995 docker.go:233] disabling docker service ...
I0731 17:58:06.154555 67995 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0731 17:58:06.170168 67995 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0731 17:58:06.185206 67995 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0731 17:58:06.346174 67995 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0731 17:58:06.480008 67995 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0731 17:58:06.493937 67995 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0731 17:58:06.512195 67995 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0731 17:58:06.512246 67995 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0731 17:58:06.524490 67995 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0731 17:58:06.524575 67995 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0731 17:58:06.537686 67995 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0731 17:58:06.547877 67995 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0731 17:58:06.559959 67995 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0731 17:58:06.573367 67995 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0731 17:58:06.583080 67995 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0731 17:58:06.583160 67995 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0731 17:58:06.599516 67995 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0731 17:58:06.609470 67995 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0731 17:58:06.744474 67995 ssh_runner.go:195] Run: sudo systemctl restart crio
I0731 17:58:06.924488 67995 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0731 17:58:06.924582 67995 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0731 17:58:06.929250 67995 start.go:563] Will wait 60s for crictl version
I0731 17:58:06.929306 67995 ssh_runner.go:195] Run: which crictl
I0731 17:58:06.932813 67995 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0731 17:58:06.972195 67995 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0731 17:58:06.972273 67995 ssh_runner.go:195] Run: crio --version
I0731 17:58:07.004263 67995 ssh_runner.go:195] Run: crio --version
I0731 17:58:07.042486 67995 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0731 17:58:07.043911 67995 main.go:141] libmachine: (old-k8s-version-276459) Calling .GetIP
I0731 17:58:07.047132 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | domain old-k8s-version-276459 has defined MAC address 52:54:00:79:9d:96 in network mk-old-k8s-version-276459
I0731 17:58:07.047688 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:79:9d:96", ip: ""} in network mk-old-k8s-version-276459: {Iface:virbr3 ExpiryTime:2024-07-31 18:57:55 +0000 UTC Type:0 Mac:52:54:00:79:9d:96 Iaid: IPaddr:192.168.39.26 Prefix:24 Hostname:old-k8s-version-276459 Clientid:01:52:54:00:79:9d:96}
I0731 17:58:07.047720 67995 main.go:141] libmachine: (old-k8s-version-276459) DBG | domain old-k8s-version-276459 has defined IP address 192.168.39.26 and MAC address 52:54:00:79:9d:96 in network mk-old-k8s-version-276459
I0731 17:58:07.047966 67995 ssh_runner.go:195] Run: grep 192.168.39.1 host.minikube.internal$ /etc/hosts
I0731 17:58:07.052389 67995 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0731 17:58:07.066189 67995 kubeadm.go:883] updating cluster {Name:old-k8s-version-276459 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19339/minikube-v1.33.1-1722248113-19339-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-276459 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.26 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mo
untPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0731 17:58:07.066315 67995 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0731 17:58:07.066365 67995 ssh_runner.go:195] Run: sudo crictl images --output json
I0731 17:58:07.101795 67995 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0731 17:58:07.101865 67995 ssh_runner.go:195] Run: which lz4
I0731 17:58:07.106007 67995 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0731 17:58:07.114368 67995 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0731 17:58:07.114400 67995 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19349-8084/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0731 17:58:08.713134 67995 crio.go:462] duration metric: took 1.607150286s to copy over tarball
I0731 17:58:08.713209 67995 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0731 17:58:11.620940 67995 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.907693181s)
I0731 17:58:11.620972 67995 crio.go:469] duration metric: took 2.907807763s to extract the tarball
I0731 17:58:11.620981 67995 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0731 17:58:11.665324 67995 ssh_runner.go:195] Run: sudo crictl images --output json
I0731 17:58:11.716977 67995 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0731 17:58:11.717006 67995 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0731 17:58:11.717080 67995 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0731 17:58:11.717392 67995 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0731 17:58:11.717411 67995 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0731 17:58:11.717422 67995 image.go:134] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0731 17:58:11.717589 67995 image.go:134] retrieving image: registry.k8s.io/coredns:1.7.0
I0731 17:58:11.717617 67995 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0731 17:58:11.717625 67995 image.go:134] retrieving image: registry.k8s.io/pause:3.2
I0731 17:58:11.717302 67995 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0731 17:58:11.718840 67995 image.go:177] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0731 17:58:11.718848 67995 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0731 17:58:11.718875 67995 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0731 17:58:11.718950 67995 image.go:177] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0731 17:58:11.718956 67995 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0731 17:58:11.719228 67995 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0731 17:58:11.719267 67995 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0731 17:58:11.719542 67995 image.go:177] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0731 17:58:11.968891 67995 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0731 17:58:11.971597 67995 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0731 17:58:11.975177 67995 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0731 17:58:11.975409 67995 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0731 17:58:11.984322 67995 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0731 17:58:11.991915 67995 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0731 17:58:12.061059 67995 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0731 17:58:12.061105 67995 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0731 17:58:12.061149 67995 ssh_runner.go:195] Run: which crictl
I0731 17:58:12.125910 67995 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0731 17:58:12.125955 67995 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0731 17:58:12.126000 67995 ssh_runner.go:195] Run: which crictl
I0731 17:58:12.135373 67995 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0731 17:58:12.135414 67995 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0731 17:58:12.135429 67995 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0731 17:58:12.135446 67995 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0731 17:58:12.135483 67995 ssh_runner.go:195] Run: which crictl
I0731 17:58:12.135489 67995 ssh_runner.go:195] Run: which crictl
I0731 17:58:12.135534 67995 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0731 17:58:12.135552 67995 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0731 17:58:12.135579 67995 ssh_runner.go:195] Run: which crictl
I0731 17:58:12.148884 67995 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0731 17:58:12.148923 67995 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0731 17:58:12.148970 67995 ssh_runner.go:195] Run: which crictl
I0731 17:58:12.148995 67995 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0731 17:58:12.149058 67995 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0731 17:58:12.150366 67995 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0731 17:58:12.150401 67995 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0731 17:58:12.155415 67995 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0731 17:58:12.160264 67995 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0731 17:58:12.249447 67995 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19349-8084/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0731 17:58:12.249548 67995 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19349-8084/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0731 17:58:12.279159 67995 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19349-8084/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0731 17:58:12.280321 67995 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19349-8084/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0731 17:58:12.280335 67995 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19349-8084/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0731 17:58:12.280399 67995 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19349-8084/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0731 17:58:12.288072 67995 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0731 17:58:12.330492 67995 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0731 17:58:12.330534 67995 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0731 17:58:12.330583 67995 ssh_runner.go:195] Run: which crictl
I0731 17:58:12.335475 67995 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0731 17:58:12.371431 67995 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19349-8084/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0731 17:58:12.584137 67995 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0731 17:58:12.735370 67995 cache_images.go:92] duration metric: took 1.018348553s to LoadCachedImages
W0731 17:58:12.735444 67995 out.go:239] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19349-8084/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19349-8084/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0: no such file or directory
I0731 17:58:12.735458 67995 kubeadm.go:934] updating node { 192.168.39.26 8443 v1.20.0 crio true true} ...
I0731 17:58:12.735596 67995 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-276459 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.39.26
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-276459 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0731 17:58:12.735681 67995 ssh_runner.go:195] Run: crio config
I0731 17:58:12.781021 67995 cni.go:84] Creating CNI manager for ""
I0731 17:58:12.781042 67995 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0731 17:58:12.781051 67995 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0731 17:58:12.781067 67995 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.26 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-276459 NodeName:old-k8s-version-276459 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.26"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.26 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt Stati
cPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0731 17:58:12.781227 67995 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.39.26
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-276459"
kubeletExtraArgs:
node-ip: 192.168.39.26
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.39.26"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0731 17:58:12.781301 67995 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0731 17:58:12.792170 67995 binaries.go:44] Found k8s binaries, skipping transfer
I0731 17:58:12.792246 67995 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0731 17:58:12.801785 67995 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (429 bytes)
I0731 17:58:12.817793 67995 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0731 17:58:12.834303 67995 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2120 bytes)
I0731 17:58:12.851098 67995 ssh_runner.go:195] Run: grep 192.168.39.26 control-plane.minikube.internal$ /etc/hosts
I0731 17:58:12.855226 67995 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.26 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0731 17:58:12.866904 67995 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0731 17:58:13.013776 67995 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0731 17:58:13.037494 67995 certs.go:68] Setting up /home/jenkins/minikube-integration/19349-8084/.minikube/profiles/old-k8s-version-276459 for IP: 192.168.39.26
I0731 17:58:13.037519 67995 certs.go:194] generating shared ca certs ...
I0731 17:58:13.037534 67995 certs.go:226] acquiring lock for ca certs: {Name:mk49eed439085f9c30746706460ce213570d1997 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0731 17:58:13.037755 67995 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19349-8084/.minikube/ca.key
I0731 17:58:13.037824 67995 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19349-8084/.minikube/proxy-client-ca.key
I0731 17:58:13.037841 67995 certs.go:256] generating profile certs ...
I0731 17:58:13.037915 67995 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19349-8084/.minikube/profiles/old-k8s-version-276459/client.key
I0731 17:58:13.037937 67995 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19349-8084/.minikube/profiles/old-k8s-version-276459/client.crt with IP's: []
I0731 17:58:13.240802 67995 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19349-8084/.minikube/profiles/old-k8s-version-276459/client.crt ...
I0731 17:58:13.240835 67995 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19349-8084/.minikube/profiles/old-k8s-version-276459/client.crt: {Name:mk87dcfcabfd5e9b0b22ccf8b01d833e6856862c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0731 17:58:13.241032 67995 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19349-8084/.minikube/profiles/old-k8s-version-276459/client.key ...
I0731 17:58:13.241053 67995 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19349-8084/.minikube/profiles/old-k8s-version-276459/client.key: {Name:mk0b993f99482a1ab4aace1b405b47451a37545e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0731 17:58:13.241169 67995 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19349-8084/.minikube/profiles/old-k8s-version-276459/apiserver.key.7c620cac
I0731 17:58:13.241188 67995 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19349-8084/.minikube/profiles/old-k8s-version-276459/apiserver.crt.7c620cac with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.26]
I0731 17:58:13.456843 67995 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19349-8084/.minikube/profiles/old-k8s-version-276459/apiserver.crt.7c620cac ...
I0731 17:58:13.456879 67995 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19349-8084/.minikube/profiles/old-k8s-version-276459/apiserver.crt.7c620cac: {Name:mk27907551fc7a941834b628d48348a9b93118f9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0731 17:58:13.457097 67995 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19349-8084/.minikube/profiles/old-k8s-version-276459/apiserver.key.7c620cac ...
I0731 17:58:13.457121 67995 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19349-8084/.minikube/profiles/old-k8s-version-276459/apiserver.key.7c620cac: {Name:mk55bf645aa942510332fbb3e38c723520d91bb5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0731 17:58:13.457224 67995 certs.go:381] copying /home/jenkins/minikube-integration/19349-8084/.minikube/profiles/old-k8s-version-276459/apiserver.crt.7c620cac -> /home/jenkins/minikube-integration/19349-8084/.minikube/profiles/old-k8s-version-276459/apiserver.crt
I0731 17:58:13.457330 67995 certs.go:385] copying /home/jenkins/minikube-integration/19349-8084/.minikube/profiles/old-k8s-version-276459/apiserver.key.7c620cac -> /home/jenkins/minikube-integration/19349-8084/.minikube/profiles/old-k8s-version-276459/apiserver.key
I0731 17:58:13.457404 67995 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19349-8084/.minikube/profiles/old-k8s-version-276459/proxy-client.key
I0731 17:58:13.457422 67995 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19349-8084/.minikube/profiles/old-k8s-version-276459/proxy-client.crt with IP's: []
I0731 17:58:13.620720 67995 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19349-8084/.minikube/profiles/old-k8s-version-276459/proxy-client.crt ...
I0731 17:58:13.620750 67995 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19349-8084/.minikube/profiles/old-k8s-version-276459/proxy-client.crt: {Name:mkc88f4cf331f48f9df3c79c804f8ff148998c77 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0731 17:58:13.620938 67995 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19349-8084/.minikube/profiles/old-k8s-version-276459/proxy-client.key ...
I0731 17:58:13.620954 67995 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19349-8084/.minikube/profiles/old-k8s-version-276459/proxy-client.key: {Name:mk173f15970a2ac972c6480e0481b0bd7521484d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0731 17:58:13.621142 67995 certs.go:484] found cert: /home/jenkins/minikube-integration/19349-8084/.minikube/certs/15259.pem (1338 bytes)
W0731 17:58:13.621188 67995 certs.go:480] ignoring /home/jenkins/minikube-integration/19349-8084/.minikube/certs/15259_empty.pem, impossibly tiny 0 bytes
I0731 17:58:13.621200 67995 certs.go:484] found cert: /home/jenkins/minikube-integration/19349-8084/.minikube/certs/ca-key.pem (1675 bytes)
I0731 17:58:13.621222 67995 certs.go:484] found cert: /home/jenkins/minikube-integration/19349-8084/.minikube/certs/ca.pem (1082 bytes)
I0731 17:58:13.621245 67995 certs.go:484] found cert: /home/jenkins/minikube-integration/19349-8084/.minikube/certs/cert.pem (1123 bytes)
I0731 17:58:13.621265 67995 certs.go:484] found cert: /home/jenkins/minikube-integration/19349-8084/.minikube/certs/key.pem (1675 bytes)
I0731 17:58:13.621300 67995 certs.go:484] found cert: /home/jenkins/minikube-integration/19349-8084/.minikube/files/etc/ssl/certs/152592.pem (1708 bytes)
I0731 17:58:13.622159 67995 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19349-8084/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0731 17:58:13.648863 67995 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19349-8084/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0731 17:58:13.672630 67995 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19349-8084/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0731 17:58:13.698879 67995 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19349-8084/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0731 17:58:13.727525 67995 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19349-8084/.minikube/profiles/old-k8s-version-276459/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0731 17:58:13.755989 67995 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19349-8084/.minikube/profiles/old-k8s-version-276459/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0731 17:58:13.783577 67995 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19349-8084/.minikube/profiles/old-k8s-version-276459/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0731 17:58:13.812561 67995 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19349-8084/.minikube/profiles/old-k8s-version-276459/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0731 17:58:13.838172 67995 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19349-8084/.minikube/files/etc/ssl/certs/152592.pem --> /usr/share/ca-certificates/152592.pem (1708 bytes)
I0731 17:58:13.861827 67995 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19349-8084/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0731 17:58:13.890382 67995 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19349-8084/.minikube/certs/15259.pem --> /usr/share/ca-certificates/15259.pem (1338 bytes)
I0731 17:58:13.919046 67995 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0731 17:58:13.937008 67995 ssh_runner.go:195] Run: openssl version
I0731 17:58:13.947269 67995 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/152592.pem && ln -fs /usr/share/ca-certificates/152592.pem /etc/ssl/certs/152592.pem"
I0731 17:58:13.968796 67995 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/152592.pem
I0731 17:58:13.977075 67995 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jul 31 16:54 /usr/share/ca-certificates/152592.pem
I0731 17:58:13.977137 67995 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/152592.pem
I0731 17:58:13.989508 67995 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/152592.pem /etc/ssl/certs/3ec20f2e.0"
I0731 17:58:14.007323 67995 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0731 17:58:14.027919 67995 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0731 17:58:14.034891 67995 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jul 31 16:42 /usr/share/ca-certificates/minikubeCA.pem
I0731 17:58:14.034967 67995 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0731 17:58:14.040368 67995 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0731 17:58:14.050578 67995 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/15259.pem && ln -fs /usr/share/ca-certificates/15259.pem /etc/ssl/certs/15259.pem"
I0731 17:58:14.061202 67995 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/15259.pem
I0731 17:58:14.065519 67995 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jul 31 16:54 /usr/share/ca-certificates/15259.pem
I0731 17:58:14.065578 67995 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/15259.pem
I0731 17:58:14.071230 67995 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/15259.pem /etc/ssl/certs/51391683.0"
I0731 17:58:14.081356 67995 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0731 17:58:14.085290 67995 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0731 17:58:14.085353 67995 kubeadm.go:392] StartCluster: {Name:old-k8s-version-276459 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19339/minikube-v1.33.1-1722248113-19339-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-276459 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.26 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0731 17:58:14.085443 67995 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0731 17:58:14.085519 67995 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0731 17:58:14.126449 67995 cri.go:89] found id: ""
I0731 17:58:14.126519 67995 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0731 17:58:14.138484 67995 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0731 17:58:14.149445 67995 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0731 17:58:14.161279 67995 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0731 17:58:14.161300 67995 kubeadm.go:157] found existing configuration files:
I0731 17:58:14.161349 67995 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0731 17:58:14.173634 67995 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0731 17:58:14.173696 67995 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0731 17:58:14.186438 67995 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0731 17:58:14.198397 67995 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0731 17:58:14.198445 67995 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0731 17:58:14.211748 67995 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0731 17:58:14.224200 67995 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0731 17:58:14.224260 67995 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0731 17:58:14.235540 67995 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0731 17:58:14.247138 67995 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0731 17:58:14.247201 67995 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0731 17:58:14.259374 67995 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0731 17:58:14.536613 67995 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0731 18:00:12.868746 67995 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0731 18:00:12.868881 67995 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0731 18:00:12.870244 67995 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0731 18:00:12.870302 67995 kubeadm.go:310] [preflight] Running pre-flight checks
I0731 18:00:12.870386 67995 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0731 18:00:12.870548 67995 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0731 18:00:12.870708 67995 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0731 18:00:12.870803 67995 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0731 18:00:12.872641 67995 out.go:204] - Generating certificates and keys ...
I0731 18:00:12.872754 67995 kubeadm.go:310] [certs] Using existing ca certificate authority
I0731 18:00:12.872850 67995 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0731 18:00:12.872958 67995 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0731 18:00:12.873042 67995 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0731 18:00:12.873123 67995 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0731 18:00:12.873192 67995 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0731 18:00:12.873263 67995 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0731 18:00:12.873415 67995 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-276459] and IPs [192.168.39.26 127.0.0.1 ::1]
I0731 18:00:12.873481 67995 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0731 18:00:12.873645 67995 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-276459] and IPs [192.168.39.26 127.0.0.1 ::1]
I0731 18:00:12.873727 67995 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0731 18:00:12.873805 67995 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0731 18:00:12.873861 67995 kubeadm.go:310] [certs] Generating "sa" key and public key
I0731 18:00:12.873928 67995 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0731 18:00:12.873992 67995 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0731 18:00:12.874056 67995 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0731 18:00:12.874135 67995 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0731 18:00:12.874204 67995 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0731 18:00:12.874331 67995 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0731 18:00:12.874434 67995 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0731 18:00:12.874497 67995 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0731 18:00:12.874583 67995 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0731 18:00:12.875974 67995 out.go:204] - Booting up control plane ...
I0731 18:00:12.876062 67995 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0731 18:00:12.876124 67995 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0731 18:00:12.876182 67995 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0731 18:00:12.876260 67995 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0731 18:00:12.876432 67995 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0731 18:00:12.876499 67995 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0731 18:00:12.876592 67995 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0731 18:00:12.876835 67995 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0731 18:00:12.876928 67995 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0731 18:00:12.877114 67995 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0731 18:00:12.877189 67995 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0731 18:00:12.877347 67995 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0731 18:00:12.877404 67995 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0731 18:00:12.877567 67995 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0731 18:00:12.877653 67995 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0731 18:00:12.877890 67995 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0731 18:00:12.877898 67995 kubeadm.go:310]
I0731 18:00:12.877945 67995 kubeadm.go:310] Unfortunately, an error has occurred:
I0731 18:00:12.877978 67995 kubeadm.go:310] timed out waiting for the condition
I0731 18:00:12.877984 67995 kubeadm.go:310]
I0731 18:00:12.878024 67995 kubeadm.go:310] This error is likely caused by:
I0731 18:00:12.878075 67995 kubeadm.go:310] - The kubelet is not running
I0731 18:00:12.878235 67995 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0731 18:00:12.878250 67995 kubeadm.go:310]
I0731 18:00:12.878392 67995 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0731 18:00:12.878431 67995 kubeadm.go:310] - 'systemctl status kubelet'
I0731 18:00:12.878458 67995 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0731 18:00:12.878464 67995 kubeadm.go:310]
I0731 18:00:12.878578 67995 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0731 18:00:12.878693 67995 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0731 18:00:12.878701 67995 kubeadm.go:310]
I0731 18:00:12.878777 67995 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0731 18:00:12.878856 67995 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0731 18:00:12.878926 67995 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0731 18:00:12.879011 67995 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0731 18:00:12.879078 67995 kubeadm.go:310]
W0731 18:00:12.879132 67995 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-276459] and IPs [192.168.39.26 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-276459] and IPs [192.168.39.26 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-276459] and IPs [192.168.39.26 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-276459] and IPs [192.168.39.26 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0731 18:00:12.879178 67995 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0731 18:00:14.332977 67995 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (1.453772943s)
I0731 18:00:14.333079 67995 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0731 18:00:14.351717 67995 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0731 18:00:14.365192 67995 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0731 18:00:14.365216 67995 kubeadm.go:157] found existing configuration files:
I0731 18:00:14.365263 67995 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0731 18:00:14.377655 67995 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0731 18:00:14.377705 67995 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0731 18:00:14.390126 67995 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0731 18:00:14.402381 67995 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0731 18:00:14.402455 67995 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0731 18:00:14.415181 67995 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0731 18:00:14.425058 67995 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0731 18:00:14.425120 67995 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0731 18:00:14.435203 67995 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0731 18:00:14.444471 67995 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0731 18:00:14.444533 67995 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0731 18:00:14.455834 67995 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0731 18:00:14.526627 67995 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0731 18:00:14.526691 67995 kubeadm.go:310] [preflight] Running pre-flight checks
I0731 18:00:14.666243 67995 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0731 18:00:14.666406 67995 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0731 18:00:14.666596 67995 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0731 18:00:14.856924 67995 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0731 18:00:14.859354 67995 out.go:204] - Generating certificates and keys ...
I0731 18:00:14.859466 67995 kubeadm.go:310] [certs] Using existing ca certificate authority
I0731 18:00:14.859556 67995 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0731 18:00:14.859673 67995 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0731 18:00:14.859763 67995 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0731 18:00:14.859871 67995 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0731 18:00:14.859961 67995 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0731 18:00:14.860060 67995 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0731 18:00:14.860147 67995 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0731 18:00:14.861437 67995 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0731 18:00:14.861575 67995 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0731 18:00:14.861645 67995 kubeadm.go:310] [certs] Using the existing "sa" key
I0731 18:00:14.861726 67995 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0731 18:00:14.981277 67995 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0731 18:00:15.476263 67995 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0731 18:00:15.843641 67995 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0731 18:00:15.942973 67995 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0731 18:00:15.960713 67995 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0731 18:00:15.962181 67995 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0731 18:00:15.962279 67995 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0731 18:00:16.116470 67995 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0731 18:00:16.118327 67995 out.go:204] - Booting up control plane ...
I0731 18:00:16.118457 67995 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0731 18:00:16.126555 67995 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0731 18:00:16.129957 67995 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0731 18:00:16.130090 67995 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0731 18:00:16.134664 67995 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0731 18:00:56.137383 67995 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0731 18:00:56.137885 67995 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0731 18:00:56.138057 67995 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0731 18:01:01.138845 67995 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0731 18:01:01.139223 67995 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0731 18:01:11.139342 67995 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0731 18:01:11.139567 67995 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0731 18:01:31.138399 67995 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0731 18:01:31.138593 67995 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0731 18:02:11.138009 67995 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0731 18:02:11.138254 67995 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0731 18:02:11.138279 67995 kubeadm.go:310]
I0731 18:02:11.138350 67995 kubeadm.go:310] Unfortunately, an error has occurred:
I0731 18:02:11.138405 67995 kubeadm.go:310] timed out waiting for the condition
I0731 18:02:11.138420 67995 kubeadm.go:310]
I0731 18:02:11.138474 67995 kubeadm.go:310] This error is likely caused by:
I0731 18:02:11.138516 67995 kubeadm.go:310] - The kubelet is not running
I0731 18:02:11.138617 67995 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0731 18:02:11.138624 67995 kubeadm.go:310]
I0731 18:02:11.138707 67995 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0731 18:02:11.138737 67995 kubeadm.go:310] - 'systemctl status kubelet'
I0731 18:02:11.138765 67995 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0731 18:02:11.138770 67995 kubeadm.go:310]
I0731 18:02:11.138858 67995 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0731 18:02:11.138936 67995 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0731 18:02:11.138942 67995 kubeadm.go:310]
I0731 18:02:11.139031 67995 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0731 18:02:11.139142 67995 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0731 18:02:11.139242 67995 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0731 18:02:11.139308 67995 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0731 18:02:11.139317 67995 kubeadm.go:310]
I0731 18:02:11.140288 67995 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0731 18:02:11.140374 67995 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0731 18:02:11.140435 67995 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0731 18:02:11.140493 67995 kubeadm.go:394] duration metric: took 3m57.05515081s to StartCluster
I0731 18:02:11.140532 67995 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0731 18:02:11.140579 67995 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0731 18:02:11.182354 67995 cri.go:89] found id: ""
I0731 18:02:11.182380 67995 logs.go:276] 0 containers: []
W0731 18:02:11.182388 67995 logs.go:278] No container was found matching "kube-apiserver"
I0731 18:02:11.182394 67995 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0731 18:02:11.182439 67995 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0731 18:02:11.214130 67995 cri.go:89] found id: ""
I0731 18:02:11.214153 67995 logs.go:276] 0 containers: []
W0731 18:02:11.214160 67995 logs.go:278] No container was found matching "etcd"
I0731 18:02:11.214166 67995 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0731 18:02:11.214209 67995 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0731 18:02:11.244156 67995 cri.go:89] found id: ""
I0731 18:02:11.244189 67995 logs.go:276] 0 containers: []
W0731 18:02:11.244200 67995 logs.go:278] No container was found matching "coredns"
I0731 18:02:11.244207 67995 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0731 18:02:11.244267 67995 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0731 18:02:11.274175 67995 cri.go:89] found id: ""
I0731 18:02:11.274210 67995 logs.go:276] 0 containers: []
W0731 18:02:11.274220 67995 logs.go:278] No container was found matching "kube-scheduler"
I0731 18:02:11.274228 67995 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0731 18:02:11.274290 67995 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0731 18:02:11.308135 67995 cri.go:89] found id: ""
I0731 18:02:11.308167 67995 logs.go:276] 0 containers: []
W0731 18:02:11.308176 67995 logs.go:278] No container was found matching "kube-proxy"
I0731 18:02:11.308182 67995 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0731 18:02:11.308244 67995 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0731 18:02:11.338714 67995 cri.go:89] found id: ""
I0731 18:02:11.338742 67995 logs.go:276] 0 containers: []
W0731 18:02:11.338752 67995 logs.go:278] No container was found matching "kube-controller-manager"
I0731 18:02:11.338759 67995 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0731 18:02:11.338817 67995 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0731 18:02:11.369211 67995 cri.go:89] found id: ""
I0731 18:02:11.369247 67995 logs.go:276] 0 containers: []
W0731 18:02:11.369259 67995 logs.go:278] No container was found matching "kindnet"
I0731 18:02:11.369272 67995 logs.go:123] Gathering logs for dmesg ...
I0731 18:02:11.369288 67995 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0731 18:02:11.381547 67995 logs.go:123] Gathering logs for describe nodes ...
I0731 18:02:11.381575 67995 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0731 18:02:11.530092 67995 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0731 18:02:11.530113 67995 logs.go:123] Gathering logs for CRI-O ...
I0731 18:02:11.530126 67995 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0731 18:02:11.619769 67995 logs.go:123] Gathering logs for container status ...
I0731 18:02:11.619804 67995 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0731 18:02:11.654780 67995 logs.go:123] Gathering logs for kubelet ...
I0731 18:02:11.654811 67995 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0731 18:02:11.705960 67995 out.go:364] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0731 18:02:11.706004 67995 out.go:239] *
*
W0731 18:02:11.706058 67995 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0731 18:02:11.706078 67995 out.go:239] *
*
W0731 18:02:11.706835 67995 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0731 18:02:11.709551 67995 out.go:177]
W0731 18:02:11.710642 67995 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0731 18:02:11.710700 67995 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0731 18:02:11.710726 67995 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0731 18:02:11.712127 67995 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-276459 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-276459 -n old-k8s-version-276459
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-276459 -n old-k8s-version-276459: exit status 6 (217.52363ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0731 18:02:11.972784 73162 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-276459" does not appear in /home/jenkins/minikube-integration/19349-8084/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-276459" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (272.91s)